🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: sci.physics
Article #4800

Re: Can Information Have Physical Units?

#4800
From: John C. Baez
Date: Tue, 06 Oct 1992 17:05
27 lines
1848 bytes
In article <12950089@hpspdla.spd.HP.COM> ric@hpspdla.spd.HP.COM (Ric Peregrino) writes:
>
>Shooting from the hip I'd say information has the same units as entropy,
>which I thought was unitless. But what about Gibbs free energy:
>
>dG = dH + TdS
>
>S then has units of energy/temperture? Maybe I'm just being dense?

You'll have to check your specific gravity yourself.  The usual
definition of entropy a la stat mech is S = k ln Omega, where Omega is
the number of microstates in the given macrostate, a dimensionless
quantity.  I believe this formula appears on Boltzmann's grave, by the
way.  k here is his constant, which appears in the formula for the
probability that a state of energy E will be occupied at temperature T, 

exp(-E/kT)

(suitably normalized).  So since things in exponentials have to be
dimensionless, k has units of energy/temperature, so yes, you're right,
S has units of energy/temperature.  Information however is dimensionless
(as are "bits"); in Boltzmann's formula the information required to say
which microstate the macrostate is really in is ln Omega.  (If we use
base 2 log here the way computer scientists do, we get the number of
"bits".  If we use natural log, as Boltzmann did, this number is the
number of "nits".  Wasting energy arguing over small pieces of
information is therefore known as "nitpicking."
Technical Details
Message-ID: <1992Oct6.170513.25273@galois.mit.edu>
Path: arc1-ca.pugleaf.net!sparky!uunet!snorkelwacker.mit.edu!galois!riesz!jbaez
References: <1992Oct5.153852.12046@asl.dl.nec.com> <12950089@hpspdla.spd.HP.COM>

Show Full Headers
Complete Article Headers
Newsgroups: sci.physics
Path: arc1-ca.pugleaf.net!sparky!uunet!snorkelwacker.mit.edu!galois!riesz!jbaez
From: jbaez@riesz.mit.edu (John C. Baez)
Subject: Re: Can Information Have Physical Units?
Message-ID: <1992Oct6.170513.25273@galois.mit.edu>
Sender: news@galois.mit.edu
Nntp-Posting-Host: riesz
Organization: MIT Department of Mathematics, Cambridge, MA
References: <1992Oct5.153852.12046@asl.dl.nec.com> <12950089@hpspdla.spd.HP.COM>
Date: Tue, 6 Oct 92 17:05:13 GMT
Lines: 28