🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: sci.math.stat
Article #636

Re: Gibbs sampling and annealing (was: Help! Book recommendations?)

#636
From: Radford Neal
Date: Sun, 04 Oct 1992 17:10
22 lines
1618 bytes
In article <1992Oct3.210337.21498@news2.cis.umn.edu> charlie@umnstat.stat.umn.edu (Charles Geyer) writes:

> It makes no sense to compare Gibbs sampling versus simulated annealing, 
> for example.

Correct, but not for the reasons you perhaps mean. Simulated annealing
is a technique that can be used in conjunction with Gibbs sampling 
(or other Markov chain methods, such as the Metropolis algorithm) 
in order to reach the final equilibrium distribution more quickly.

Most of the annealing literature is devoted to the case of annealing down
to a "temperature" of zero, where the distribution being sampled from
is concentrated at the points where the global minimum is realized, but
the technique is equally applicable when the goal is to sample from the
distribution at some non-zero temperature. 

Gibbs sampling and simulated annealing have been used in this fashion with
the "Boltzmann machine" neural network of Ackley, Hinton, and Sejnowski
(Ccognitive Science, vol. 9, pp. 147-169, 1985), and for many simulations 
of physical systems.

    Radford Neal
Technical Details
Message-ID: <92Oct4.130952edt.243@neuron.ai.toronto.edu>
Path: arc1-ca.pugleaf.net!sparky!uunet!utcsri!relay.cs.toronto.edu!neuron.ai.toronto.edu!ai.toronto.edu!radford
References: <1992Oct2.095522.9172@vax.oxford.ac.uk> <1992Oct3.210337.21498@news2.cis.umn.edu>

Show Full Headers
Complete Article Headers
Path: arc1-ca.pugleaf.net!sparky!uunet!utcsri!relay.cs.toronto.edu!neuron.ai.toronto.edu!ai.toronto.edu!radford
Newsgroups: sci.math.stat,sci.math.num-analysis
From: radford@cs.toronto.edu (Radford Neal)
Subject: Re: Gibbs sampling and annealing (was: Help!  Book recommendations?)
Message-ID: <92Oct4.130952edt.243@neuron.ai.toronto.edu>
Organization: Department of Computer Science, University of Toronto
References: <1992Oct2.095522.9172@vax.oxford.ac.uk> <1992Oct3.210337.21498@news2.cis.umn.edu>
Date: 4 Oct 92 17:10:10 GMT
Lines: 22