Article View: sci.math.stat
Article #636Re: Gibbs sampling and annealing (was: Help! Book recommendations?)
From: Radford Neal
Date: Sun, 04 Oct 1992 17:10
Date: Sun, 04 Oct 1992 17:10
22 lines
1618 bytes
1618 bytes
In article <1992Oct3.210337.21498@news2.cis.umn.edu> charlie@umnstat.stat.umn.edu (Charles Geyer) writes:
> It makes no sense to compare Gibbs sampling versus simulated annealing,
> for example.
Correct, but not for the reasons you perhaps mean. Simulated annealing
is a technique that can be used in conjunction with Gibbs sampling
(or other Markov chain methods, such as the Metropolis algorithm)
in order to reach the final equilibrium distribution more quickly.
Most of the annealing literature is devoted to the case of annealing down
to a "temperature" of zero, where the distribution being sampled from
is concentrated at the points where the global minimum is realized, but
the technique is equally applicable when the goal is to sample from the
distribution at some non-zero temperature.
Gibbs sampling and simulated annealing have been used in this fashion with
the "Boltzmann machine" neural network of Ackley, Hinton, and Sejnowski
(Ccognitive Science, vol. 9, pp. 147-169, 1985), and for many simulations
of physical systems.
Radford Neal
Technical Details
Message-ID:
<92Oct4.130952edt.243@neuron.ai.toronto.edu>Path:
arc1-ca.pugleaf.net!sparky!uunet!utcsri!relay.cs.toronto.edu!neuron.ai.toronto.edu!ai.toronto.edu!radfordReferences:
<1992Oct2.095522.9172@vax.oxford.ac.uk> <1992Oct3.210337.21498@news2.cis.umn.edu>Show Full Headers
Complete Article Headers
Path: arc1-ca.pugleaf.net!sparky!uunet!utcsri!relay.cs.toronto.edu!neuron.ai.toronto.edu!ai.toronto.edu!radford Newsgroups: sci.math.stat,sci.math.num-analysis From: radford@cs.toronto.edu (Radford Neal) Subject: Re: Gibbs sampling and annealing (was: Help! Book recommendations?) Message-ID: <92Oct4.130952edt.243@neuron.ai.toronto.edu> Organization: Department of Computer Science, University of Toronto References: <1992Oct2.095522.9172@vax.oxford.ac.uk> <1992Oct3.210337.21498@news2.cis.umn.edu> Date: 4 Oct 92 17:10:10 GMT Lines: 22