Thread View: net.internat
2 messages
2 total messages
Started by Stavros Macrakis
Wed, 20 Nov 1985 20:30
Texts in other languages
Author: Stavros Macrakis
Date: Wed, 20 Nov 1985 20:30
Date: Wed, 20 Nov 1985 20:30
18 lines
1408 bytes
1408 bytes
For an experiment in text compression, I would find it useful to have
a collection of texts in a variety of languages. Ideally, I would
like a half-dozen distinct texts, each 2000-15000 words long, in each
language. The texts should be in a consistent (documented)
transcription, preferably without formatting commands. The texts need
not be selected to be `representative' of the language. For instance,
technical papers are fine. The languages in which I am interested are
French, Italian, German, (Modern) Greek, Arabic, and Turkish. If you
have texts in other languages, please let me know.
If you could send me mail describing the texts you might be able to
provide, we can find some way of transferring them later.
Thanks
-s
Macrakis@Harvard.{Harvard.EDU,ARPA,uucp,csnet}
@Harvunxh.bitnet
Re: Texts in other languages
Author: Gary Benson
Date: Mon, 02 Dec 1985 18:45
Date: Mon, 02 Dec 1985 18:45
34 lines
2405 bytes
2405 bytes
> For an experiment in text compression, I would find it useful to have
> a collection of texts in a variety of languages. Ideally, I would
> like a half-dozen distinct texts, each 2000-15000 words long, in each
> language. The texts should be in a consistent (documented)
> transcription, preferably without formatting commands. The texts need
> not be selected to be `representative' of the language. For instance,
> technical papers are fine. The languages in which I am interested are
> French, Italian, German, (Modern) Greek, Arabic, and Turkish. If you
> have texts in other languages, please let me know.
>
> If you could send me mail describing the texts you might be able to
> provide, we can find some way of transferring them later.
>
> Thanks
> -s
>
> Macrakis@Harvard.{Harvard.EDU,ARPA,uucp,csnet}
> @Harvunxh.bitnet
When Xerox bought Diablo and got into the high-speed character printer
business, they used a computer to generate a paragraph of "standard
English text". It was nonsense to read of course, but contained
the proper distribution of letters, word lengths, and sentence lengths.
They used the text to time their printers. Why not use a "standard
text" from each of the languages you are interested in? It seems to me
that way you would get a clearer picture of the perfomance of a compression
algorithm *on text in the language of interest* than you will with a
transcription, which to my mind at least is really just a term meaning
a translation.
--
Gary Benson * John Fluke Mfg. Co. * PO Box C9090 * Everett WA * 98206
MS/232-E = = {allegra} {uw-beaver} !fluke!inc = = (206)356-5367
_-_-_-_-_-_-_-_-ascii is our god and unix is his profit-_-_-_-_-_-_-_-_-_-_-_
Thread Navigation
This is a paginated view of messages in the thread with full content displayed inline.
Messages are displayed in chronological order, with the original post highlighted in green.
Use pagination controls to navigate through all messages in large threads.
Back to All Threads