🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: comp.std.internat
Article #458

Re: 8-bit representation, plus an X problem

#458
From: Andrew Hume
Date: Thu, 17 Dec 1992 16:01
34 lines
2300 bytes
In article <1gpruaINNhfm@frigate.doc.ic.ac.uk>, rap@news (Ross Paterson) writes:
> It's hard to imagine that FSS-UTF will be popular with users of those
> alphabets (all originating in Asia, BTW) whose letters are going to
> take up 3 bytes, while they take up 2 in UTF-1 and 7 bits or so in
> existing standards.


	i wish folks would just come out and say the character sets they mean.
if you mean kanji (shift-jis), or chinese (GB2312-80 or Big 5), or korean,
then the existing practice is two bytes per character.

	UTF-1 does #00-#9f in one byte, #a0-#4015 in two bytes, and #4106-#ffff
in three bytes. FSS-UTF does #00-#7f in one byte, #80-#7ff in two bytes and
#800-#ffff in three bytes. given the unified han characters now start at #4e00,
i'd say FSS-UTF and UTF-1 had pretty much the same performance here.

	certainly, the characters between #800 and #4015 will take 50% more
space in FSS-UTF than UTF-1. from our file command (which guesses at languages),
this would seem to include Devanagari, Bengali, Gurmukhi, Gujarati, Oriya,
Tamil, Telugu, Kannada, Malayalam, Thai, Lao, Tibetan, Georgian,
Japanese (hiragana etc), chinese (some) and korean. (with the exceptions
of the CJK scripts and perhaps georgian, there is no measureable email
traffic in these scripts.)

 	and even for these scripts, i would guess connectivity (in the sense
of being able to send/receive messages at all) matters more to those folks
than the increase in space (how much of your disk is mail?) or decrease in
bandwidth (in most messages i see, headers are 30-50% of the message).

	in any case, i agree there is a space overhead. its up to users
to figure out if its worth it; i just wanted to clear up factual errors.


			andrew
Technical Details
Message-ID: <24433@alice.att.com>
Path: arc1-ca.pugleaf.net!sparky!uunet!spool.mu.edu!uwm.edu!zaphod.mps.ohio-state.edu!pacific.mps.ohio-state.edu!linac!att!att!allegra!alice!andrew
References: <24426@alice.att.com| <1gpruaINNhfm@frigate.doc.ic.ac.uk>

Show Full Headers
Complete Article Headers
Path: arc1-ca.pugleaf.net!sparky!uunet!spool.mu.edu!uwm.edu!zaphod.mps.ohio-state.edu!pacific.mps.ohio-state.edu!linac!att!att!allegra!alice!andrew
From: andrew@alice.att.com (Andrew Hume)
Newsgroups: comp.std.internat,news.admin.misc
Subject: Re: 8-bit representation, plus an X problem
Summary: lets not get carried away here
Message-ID: <24433@alice.att.com>
Date: 17 Dec 92 16:01:33 GMT
Article-I.D.: alice.24433
References: <24426@alice.att.com| <1gpruaINNhfm@frigate.doc.ic.ac.uk>
Organization: AT&T Bell Laboratories, Murray Hill NJ
Lines: 34