🚀 go-pugleaf

Timothy> Chaitin/Kolmogorov Algorithmic Information Theory does set an
Timothy> absolute limit to the degree to which any given data can be
Timothy> compressed: the string s cannot be compressed beyond its
Timothy> entropy (or informational content) H(s).

there's no limit to how well any one particular or small group of
possible inputs can be compressed.  consider a code that compresses
input A (say this netnews post) to "0", and any other input B to "1B".
clearly, that one bit is less than H(A), but averaged over all inputs,
satisfies the theory.  the magic of (lossless) compressing is deciding
what inputs you want to compress and "concentrating" the code to make
that portion of the possible input space take very little space, at
the expense of other stuff taking lots of space.

-- 
				orgasm
Scott Draves			nitrous
spot@cs.cmu.edu			death