🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: bit.software.international
Article #356

Unicode<-->SJIS: maybe there really IS data-loss??

#356
From: Steve R Billings
Date: Fri, 15 Oct 1993 18:53
24 lines
1753 bytes
I know we covered this before and I was assured that each SJIS character
has a Unicode equivalent, but here's a wrinkle:

Hitachi tells me that on their workstation (which supports SJIS and J/EUC)
there is a one-byte '1' and a two-byte '1' (as just one example). I'm
not sure if this is standard SJIS or not, but I believe it comes from
the one-byte ASCII '1' added to the two-byte JIS '1'.

Anyway, since our application will receive identifiers such as filenames
from other applications, and these may contain one-byte '1's and/or
two-byte '1's, we MUST pass them back as we received them.  Converting
them into an internal Unicode character set and then back actually
will result in data-loss.

Am I correct that this is a true gotcha, or does Unicode provide
some solution for this?

[Another wrinkle is an area set-aside in SJIS for user-defined
characters, such as company logos.  We must store and return
these characters as well.  Does this map into Unicode?]

Thanks,
Steve Billings
srb@world.std.com
Technical Details
Message-ID: <29mrk6$19b@rhino.cis.vutbr.cz>
Path: arc1-ca.pugleaf.net!gmd.de!newsserver.jvnc.net!howland.reston.ans.net!paladin.american.edu!news.univie.ac.at!aci.cvut.cz!rhino.cis.vutbr.cz!gateway

Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: 110cdc,3021eb4c9225e18d,start
X-Google-Attributes: gid110cdc,public
X-Google-ArrivalTime: 1993-10-15 22:27:16 PST
Path: arc1-ca.pugleaf.net!gmd.de!newsserver.jvnc.net!howland.reston.ans.net!paladin.american.edu!news.univie.ac.at!aci.cvut.cz!rhino.cis.vutbr.cz!gateway
From: srb@world.std.com (Steve R Billings)
Newsgroups: bit.software.international
Subject: Unicode<-->SJIS: maybe there really IS data-loss??
Date: 15 Oct 1993 19:53:58 +0100
Organization: Technical University of Brno, Czech Republic
Lines: 27
Sender: daemon@rhino.cis.vutbr.cz
Approved: insoft-l-moderator@cis.vutbr.cz
Message-ID: <29mrk6$19b@rhino.cis.vutbr.cz>
Reply-To: <insoft-l@cis.vutbr.cz>