Article View: bit.software.international
Article #516Re: Byte-stream encoding of Unicode
From: Glenn Adams
Date: Fri, 18 Jun 1993 15:23
Date: Fri, 18 Jun 1993 15:23
31 lines
2151 bytes
2151 bytes
> Date: Tue, 15 Jun 93 18:39:06 +0200 > From: avr@mtfmi.att.com > > Glenn Adams writes: >> The most pernicious of the problems, #1 above, can now be solve fairly well >> thanks to the new ISO/IEC 10646-1:1993 Universal Character Set standard (and >> Unicode, the more fully specified 2-byte form of this new standard). >> However, problems remain in the actual use of Unicode; e.g., the possibility >> of having a NUL octet embedded in a 2-byte character encoding. [In Unicode, >> a coded character must be interpreted as a full 16-bit wide character, >> and not as a string of octets such as are found in multi-byte encodings >> like JIS.] > > Rob Pike and Ken Thompson have proposed a very elegant solution > to the "Unicode problem" in their recent "Hello World or..." > paper... I discussed this solution later in my article, under the heading of UTF-2: The problems with interchanging and processing 16-bit and 32-bit encoding forms may be alleviated through the use of a transformation format. Two formats have been defined (one in 10646), UTF-1, and another by JTC1/SC22/WG15, UTF-2. The latter is currently used by the AT&T Plan 9 operating system ... Perhaps you didn't recognize the name UTF-2. It is also called FSS-UTF, for File System Safe UTF, although this only applies to ASCII file systems, and not, for example, an EBCDIC based file system. Glenn Adams
Technical Details
Message-ID:
<1993Jun18.152346.13187@cis.vutbr.cz>Path:
arc1-ca.pugleaf.net!gmd.de!xlink.net!howland.reston.ans.net!noc.near.net!uunet!news.univie.ac.at!alijku11!aci.cvut.cs!cis.vutbr.cz!insoft-l@cis.vutbr.czShow Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit X-Google-Thread: 110cdc,19f020648e77bd98 X-Google-Attributes: gid110cdc,public X-Google-ArrivalTime: 1993-06-18 21:16:21 PST Newsgroups: bit.software.international Path: arc1-ca.pugleaf.net!gmd.de!xlink.net!howland.reston.ans.net!noc.near.net!uunet!news.univie.ac.at!alijku11!aci.cvut.cs!cis.vutbr.cz!insoft-l@cis.vutbr.cz From: Glenn Adams <glenn@metis.com> Subject: Re: Byte-stream encoding of Unicode Date: Fri, 18 Jun 1993 15:23:46 GMT Message-ID: <1993Jun18.152346.13187@cis.vutbr.cz> Approved: insoft-l-moderator@cis.vutbr.cz Sender: insoft-l@cis.vutbr.cz Reply-To: <insoft-l@cis.vutbr.cz> Originator: insoft-l@cis.vutbr.cz Organization: Technical University of Brno, Czech Republic Lines: 33