🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: sci.math.stat
Article #463

Re: Gibbs sampling and annealing (was: Help! Book recommendations?)

#463
From: frederic montoya
Date: Fri, 09 Oct 1992 11:50
33 lines
1956 bytes
In article <1992Oct4.192217.27919@news2.cis.umn.edu>,
charlie@umnstat.stat.umn.edu (Charles Geyer) writes:
> In article <1992Oct3.210337.21498@news2.cis.umn.edu> I wrote:
> 
>    It makes no sense to compare Gibbs sampling versus simulated annealing, 
>    for example.
> 
> In article <92Oct4.130952edt.243@neuron.ai.toronto.edu>
radford@cs.toronto.edu
> (Radford Neal) replies:
> 
> > Correct, but not for the reasons you perhaps mean. Simulated annealing
> > is a technique that can be used in conjunction with Gibbs sampling 
> > (or other Markov chain methods, such as the Metropolis algorithm) 
> > in order to reach the final equilibrium distribution more quickly.
> 
> Depends on how you think about Markov chain Monte Carlo.  The
> Metropolis-Hastings algorithm produces a Markov chain with a known
> stationary distribution.  This "annealing trick" doesn't.  So far
> from mixing MCMC and simulated annealing, it is not MCMC at all.
> 
> Are there any practically useful convergence results for such schemes
> once Markov chain theory is thrown out the window?
> 

This especially true whenever you want to sample thermodynamic
quantities. Averages must then be well controlled in order
to get significant results.

-----
Frederic Montoya
LSG2M - Ecole des Mines
fmontoya@circe.fr
Technical Details
Message-ID: <1992Oct09.115016.187288@circe.fr>
Path: arc1-ca.pugleaf.net!sparky!uunet!mcsun!corton!frors65!frors65.circe.fr!fmontoya
References: <1992Oct4.192217.27919@news2.cis.umn.edu> <1992Oct2.095522.9172@vax.oxford.ac.uk> <1992Oct3.210337.21498@news2.cis.umn.edu> <92Oct4.130952edt.243@neuron.ai.toronto.edu>

Show Full Headers
Complete Article Headers
Path: arc1-ca.pugleaf.net!sparky!uunet!mcsun!corton!frors65!frors65.circe.fr!fmontoya
From: fmontoya@frors65.circe.fr (frederic montoya)
Newsgroups: sci.math.stat,sci.math.num-analysis
Subject: Re: Gibbs sampling and annealing (was: Help!  Book recommendations?)
Message-ID: <1992Oct09.115016.187288@circe.fr>
Date: 9 Oct 92 11:50:16 GMT
References: <1992Oct4.192217.27919@news2.cis.umn.edu> <1992Oct2.095522.9172@vax.oxford.ac.uk> <1992Oct3.210337.21498@news2.cis.umn.edu> <92Oct4.130952edt.243@neuron.ai.toronto.edu>
Sender: news@circe.fr (login news)
Reply-To: fmontoya@frors65.circe.fr (frederic montoya)
Organization: circe
Lines: 33