Article View: comp.ai
Article #9326Re: Announcement: The Temporal Neuron Revolution.... some thoughts
From: the_walrus
Date: Wed, 15 Oct 1997 00:00
Date: Wed, 15 Oct 1997 00:00
143 lines
6997 bytes
6997 bytes
Steven Packham wrote: > > Erik Vick wrote: > > > > Louis Savain wrote: > > > > > > In article <343AAFF1.6D35@dial.pipex.com>, Howard Snart > > > <aac88@dial.pipex.com> wrote: > > > > > > >[...] > > > >This approach stems from several misgivings I have over the existing > > > >methods of teaching neural nets... most significantly > > > >backtracking.(which I see as un-scalable, and fundementally wrong... you > > > >force the outputs to conform, whereas the problem may lie far from the > > > >outputs) > > > > > > I agree. Traditional neural nets are not biologically plausible, > > > nor do they do the kind of learning that is needed to gain common > > > sense. > > > > > I disagree. I feel that the formation of a topographical map > of the environment is obvious starting in Striata cortex area 17 (field > of vision division, > edge detection), 18 and 19 (starting three dimensional mappings with > stereoscopic > details. Where the corpus colosum begins to wire both hemisphere > together). > > All of this structure and organization within the brain can be > explained > with mechanism which the neuron does posses. The mechanism seem to > contain some > very simple functionality which parallels the learning process that > back-prop > engages. This is only one very insignificant aspect of computing ability > which neurons do posses. In fact Back-Prop can be broken down > into a very basic model that neuron could employ quite easily. But backprop is NP-Complete! Read the book by Stephen Judd. Ask a mathemetician about NP-Completeness. It isn't get-roundable. > We are not ignoring this are we? > > The drift of gaze through the center mass of a pattern, > this with the method area 17 and 18 divide the visual pattern can > minimize the non linearity of the sensed 2-D space information, by the > way. This sentence makes no sense. > Which can also introduce size invariance and the sense of rotational > invariance of patterns to the degree which the brain does hold. Just > modeling > concepts. Many of these concepts which arise in the brain can be > attribute to > these simple computing ideas as the numerous neural networking papers > have > suggested. Are you talking about Zipser now? His results are just human-eye comparisons of the shape of some 3d plots ... not exactly scientifically significant. In fact, ALL the papers I've seen trying to model visual processing with backprop have had to fix, or at least fudge the results in some way to make it look realistic. > Actually the Back Prop model is a very simplified model of a neuron. > Yet it can mirror a portion of the computing ability the neuron > contains. One > that does not require the back prop algorithm to exist as a subroutine. > It has the possibility to be mirrored because of the nature of patterns > themselves. Wrong. The neuron is FAR more complicated than the simple computational model offered by an artificial neuron, which is of similar computational significance to a synapse. Nature doesn't tend to generously overendow. > When adding up all the other variables which the various real neuron > structures present throughout the brain they can really add up. I am > actually > very surprised how obvious the computational mechanism of the brain are. This, again, makes little sense. > The > problem I see is there vast variations. The many different structures > are > enough to take quite a while to familiarize ones self with. This is true ... different areas of the brain do appear to perform computation very differently. However, no-one is saying here that we are close to being able to reproduce a brain. If we could reproduce EVEN A SMALL PART of the brains functionality (for instance a plausible learning algorithm for any part of it), then that would knock me backwards off my seat in surprise. > Opinion, "obviously common sense lies in > the brains ability to model and communicate internally in > some modeling mode. Pardon? > Failure in most systems to communicate with us as we do with each other > seem to lie in their inability to track time, and model space. Yes ... and temporal functionality is PRECISELY what is missing from backprop, and what Louis is trying to suggest as useful, although it appears to me that he is encountering the classic resistance of a threatened paradigm. Backprop is dead already ... it died six years ago, but has forgotten to stop breathing. walrus. -- Crap to get around Nutscrape error: lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r` lr;iwquhium]98=9 pooiq rp9ii0]09`1 49 i#ir#oi #008fg]`248r`
Technical Details
Message-ID:
<34448D43.763B@bigfoot.com>Path:
arc1-ca.pugleaf.net!unknown!not-for-mailReferences:
<342b36de.10039603@news.earthlink.net> <342fb9ae.4111800@news.earthlink.net> <343AAFF1.6D35@dial.pipex.com> <343efdd4.28374986@news.earthlink.net> <34437E3B.400F@concentric.net> <34446D77.F829445C@qi3.com>Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit X-Google-Thread: 10d5b4,10bd0b81cba64349 X-Google-Attributes: gid10d5b4,public X-Google-Thread: 10ca9b,10bd0b81cba64349 X-Google-Attributes: gid10ca9b,public X-Google-Thread: 10461e,10bd0b81cba64349 X-Google-Attributes: gid10461e,public X-Google-Thread: 10d04f,10bd0b81cba64349 X-Google-Attributes: gid10d04f,public X-Google-Thread: f6b1a,10bd0b81cba64349 X-Google-Attributes: gidf6b1a,public X-Google-Thread: 101fc6,10bd0b81cba64349 X-Google-Attributes: gid101fc6,public From: "the_walrus@bigfoot.com" <the_walrus@bigfoot.com> Subject: Re: Announcement: The Temporal Neuron Revolution.... some thoughts Date: 1997/10/15 Message-ID: <34448D43.763B@bigfoot.com> X-Deja-AN: 281851604 Distribution: inet References: <342b36de.10039603@news.earthlink.net> <342fb9ae.4111800@news.earthlink.net> <343AAFF1.6D35@dial.pipex.com> <343efdd4.28374986@news.earthlink.net> <34437E3B.400F@concentric.net> <34446D77.F829445C@qi3.com> Organization: 'Dis Organisation Newsgroups: comp.ai,comp.ai.philosophy,comp.theory.self-org-sys,comp.theory.dynamic-sys,comp.ai.neural-nets,fr.comp.ia