🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: sci.math.stat
Article #642

Re: Gibbs sampling and annealing (was: Help! Book recommendations?)

#642
From: Radford Neal
Date: Tue, 06 Oct 1992 15:59
25 lines
1805 bytes
In article <1992Oct5.225003.11916@news2.cis.umn.edu> charlie@umnstat.stat.umn.edu (Charles Geyer) writes:

>[Annealing] doesn't help much.  All it attempts to do is produce one
>realization that is "almost" from the stationary distribution to
>use as the start of the run.
>
>But if the chain mixes very slowly, the average will be near the starting
>point, but not near the expectation one wants to calculate.
>
>On the other hand, if the chain mixes rapidly, the "annealing" isn't
>needed.

Not necessarily. It could be that the chain mixes rapidly once it has
reached the right general region, but that without annealing it takes
a long time to reach that region from whereever it was started.

Anyway, in some problems, notably many in statistical physics,
obtaining a _single_ point form the correct distribution is enough to
solve the problem. An example would be finding the volume of a given
mass of a substance at given temperature and pressure. This quantity
fluctuates, but with a large number of molecules, these fluctuations
are negligible.  A single point from the distribution will almost
certainly give you a good estimate.

    Radford Neal
Technical Details
Message-ID: <92Oct6.115856edt.512@neuron.ai.toronto.edu>
Path: arc1-ca.pugleaf.net!sparky!uunet!utcsri!relay.cs.toronto.edu!neuron.ai.toronto.edu!ai.toronto.edu!radford
References: <92Oct4.130952edt.243@neuron.ai.toronto.edu> <1992Oct4.192217.27919@news2.cis.umn.edu> <92Oct5.123636edt.472@neuron.ai.toronto.edu> <1992Oct5.225003.11916@news2.cis.umn.edu>

Show Full Headers
Complete Article Headers
Path: arc1-ca.pugleaf.net!sparky!uunet!utcsri!relay.cs.toronto.edu!neuron.ai.toronto.edu!ai.toronto.edu!radford
Newsgroups: sci.math.stat,sci.math.num-analysis
From: radford@cs.toronto.edu (Radford Neal)
Subject: Re: Gibbs sampling and annealing (was: Help!  Book recommendations?)
Message-ID: <92Oct6.115856edt.512@neuron.ai.toronto.edu>
Organization: Department of Computer Science, University of Toronto
References: <92Oct4.130952edt.243@neuron.ai.toronto.edu> <1992Oct4.192217.27919@news2.cis.umn.edu> <92Oct5.123636edt.472@neuron.ai.toronto.edu> <1992Oct5.225003.11916@news2.cis.umn.edu>
Date: 6 Oct 92 15:59:13 GMT
Lines: 25