🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: comp.ai.genetic
Article #54

Re: GA versus Simulated Annealing

#54
From: Liang-Wen Chang
Date: Wed, 27 Jan 1993 08:27
46 lines
3085 bytes
In article <2360@blue.cis.pitt.edu> genetic+@pitt.edu (Dr. Dave) writes:
>
>I say "should" above because, as far as I know, nobody has done a systematic
>study on this.  However, it seems to be not uncommon, at least when looking at
>combinatorial problems, to see cases where SA is faster, and running a lot of
>different SA runs will find you solutions just as good as the best GA runs, 
>but the *average* value of the GA solutions is better than the average value
>of the SA solutions, and the quality of the GA is less sensitive to parameter
>settings (pop size, mutation rate, encoding and operators, etc.) than the SA
>is to its parameters (cooling schedule, settle time at a given temp., etc.).
>
>I'd be happy to be corrected about any of the above, if anyone out there has
>different experience/intuition...
>
>Dave Tate

The GA is insensitive to encoding due to the way of crossover operation.
However, we also can say it IS sensitive to encoding once the encoding
method is chosen.  Because any encoding of numbers will have some
bits is significant than other bits, because such inhomogeneous of
bit encoding, the crossover will produce offsprings in the 'neighborhood'
of the parents.  The radius of the neighborhood is random and variable
depending on where the crossover points are cut.  I haven't figured
out the statistic nature of such variable radius w.r.t. particular
encoding.  The recent 'uniform crossover' method is more of multi-bit
mutation than crossover.  

Another thought is that GA is not quite working if the error surface
contains long nerrow stiff valleys.  Usually, GA will stuck, not
matter how you tune the parameters(those rates and pop size).  Once,
it stucks(converges prematurely), it can never get out by itself because
of the similarity among pops.

SA also has the problem of stucking in some local extremes.  However,
the process is dynamic due to the temperature, if let it run long enough,
it 'might' be able to jump out from the stagnation point.  The difficult
of SA is to determine the schedule and corresponding initial temperature
for a particular problem.  The error surface with long nerrow stiff valleys
, SA can perform  better than GA.  This is equivallent to say that 
mutation with certain distribution is preferable than crossover with
random cut to such error surfaces.  However, if the area of extremes
is not narrow but stiff, GA may work better than SA.

Any comments?  I would appreciate if any.

Boris
Technical Details
Message-ID: <1993Jan27.082732.15090@udel.edu>
Path: arc1-ca.pugleaf.net!sparky!uunet!munnari.oz.au!sgiblab!spool.mu.edu!howland.reston.ans.net!bogus.sura.net!udel!louie!pecan.cns.udel.edu!chang
References: <1993Jan19.155159.16736@thunder.mcrcim.mcgill.edu> <2360@blue.cis.pitt.edu>

Show Full Headers
Complete Article Headers
Newsgroups: comp.ai.genetic
Path: arc1-ca.pugleaf.net!sparky!uunet!munnari.oz.au!sgiblab!spool.mu.edu!howland.reston.ans.net!bogus.sura.net!udel!louie!pecan.cns.udel.edu!chang
From: chang@pecan.cns.udel.edu (Liang-Wen Chang)
Subject: Re: GA versus Simulated Annealing
Message-ID: <1993Jan27.082732.15090@udel.edu>
Sender: usenet@udel.edu (USENET News Service)
Nntp-Posting-Host: pecan.cns.udel.edu
Organization: University of Delaware, Newark
References: <1993Jan19.155159.16736@thunder.mcrcim.mcgill.edu> <2360@blue.cis.pitt.edu>
Date: Wed, 27 Jan 1993 08:27:32 GMT
Lines: 46