Article View: sci.math.stat
Article #642Re: Gibbs sampling and annealing (was: Help! Book recommendations?)
From: Radford Neal
Date: Tue, 06 Oct 1992 15:59
Date: Tue, 06 Oct 1992 15:59
25 lines
1805 bytes
1805 bytes
In article <1992Oct5.225003.11916@news2.cis.umn.edu> charlie@umnstat.stat.umn.edu (Charles Geyer) writes:
>[Annealing] doesn't help much. All it attempts to do is produce one
>realization that is "almost" from the stationary distribution to
>use as the start of the run.
>
>But if the chain mixes very slowly, the average will be near the starting
>point, but not near the expectation one wants to calculate.
>
>On the other hand, if the chain mixes rapidly, the "annealing" isn't
>needed.
Not necessarily. It could be that the chain mixes rapidly once it has
reached the right general region, but that without annealing it takes
a long time to reach that region from whereever it was started.
Anyway, in some problems, notably many in statistical physics,
obtaining a _single_ point form the correct distribution is enough to
solve the problem. An example would be finding the volume of a given
mass of a substance at given temperature and pressure. This quantity
fluctuates, but with a large number of molecules, these fluctuations
are negligible. A single point from the distribution will almost
certainly give you a good estimate.
Radford Neal
Technical Details
Message-ID:
<92Oct6.115856edt.512@neuron.ai.toronto.edu>Path:
arc1-ca.pugleaf.net!sparky!uunet!utcsri!relay.cs.toronto.edu!neuron.ai.toronto.edu!ai.toronto.edu!radfordReferences:
<92Oct4.130952edt.243@neuron.ai.toronto.edu> <1992Oct4.192217.27919@news2.cis.umn.edu> <92Oct5.123636edt.472@neuron.ai.toronto.edu> <1992Oct5.225003.11916@news2.cis.umn.edu>Show Full Headers
Complete Article Headers
Path: arc1-ca.pugleaf.net!sparky!uunet!utcsri!relay.cs.toronto.edu!neuron.ai.toronto.edu!ai.toronto.edu!radford Newsgroups: sci.math.stat,sci.math.num-analysis From: radford@cs.toronto.edu (Radford Neal) Subject: Re: Gibbs sampling and annealing (was: Help! Book recommendations?) Message-ID: <92Oct6.115856edt.512@neuron.ai.toronto.edu> Organization: Department of Computer Science, University of Toronto References: <92Oct4.130952edt.243@neuron.ai.toronto.edu> <1992Oct4.192217.27919@news2.cis.umn.edu> <92Oct5.123636edt.472@neuron.ai.toronto.edu> <1992Oct5.225003.11916@news2.cis.umn.edu> Date: 6 Oct 92 15:59:13 GMT Lines: 25