🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: comp.ai
Article #9325

Re: Announcement: The Temporal Neuron Revolution.... some thoughts

#9325
From: Louis Savain
Date: Wed, 15 Oct 1997 00:00
77 lines
4159 bytes
[Please note follow-ups]

In article <34446D77.F829445C@qi3.com>, Steven Packham
<packhste@qi3.com> wrote:

>Erik Vick wrote:
>> 
>> Louis Savain wrote:
>> >
>> > In article <343AAFF1.6D35@dial.pipex.com>, Howard Snart
>> > <aac88@dial.pipex.com> wrote:
>> >
>> > >[...]
>> > >This approach stems from several misgivings I have over the existing
>> > >methods of teaching neural nets... most significantly
>> > >backtracking.(which I see as un-scalable, and fundementally wrong... you
>> > >force the outputs to conform, whereas the problem may lie far from the
>> > >outputs)
>> >
>> >   I agree.  Traditional neural nets are not biologically plausible,
>> > nor do they do the kind of learning that is needed to gain common
>> > sense.
>> >
>
>	I disagree. I feel that the formation of a topographical map
>of the environment is obvious starting in Striata cortex area 17 (field
>of vision division, edge detection), 18 and 19 (starting three
>dimensional mappings with stereoscopic details. Where the corpus
>colosum begins to wire both hemisphere together).
>
>	All of this structure and organization within the brain can be
>explained with mechanism which the neuron does posses. The mechanism
>seem to contain some very simple functionality which parallels the
>learning process that back-prop engages. This is only one very
>insignificant aspect of computing ability which neurons do posses. In
>fact Back-Prop can be broken down into a very basic model that neuron
>could employ quite easily.

>We are not ignoring this are we?

  Well, there is no evidence, AFAIK, that biological neural nets use
back propagation.  The only thing that could come remotely close to
back propagation is what is called "antidromic or retrograde spikes".
These are known to affect computation in a neuron's dendrite and, as
suggested by the context of this thread, they are observed to greatly
modify synaptic efficacy depending on the temporal order between
pre-synaptic and post synaptic potentials (Henry Markram, 1-10-97,
Science).  I personally feel that back-propagation is the least
biologically plausible aspect of conventional NNs.  Indeed, I see
back-prop as a dead end.  Just one man's opinion.

>[...]
>Actually the Back Prop model is a very simplified model of a neuron.

  I don't see how the back-prop model can be a model of a neuron in
the light of what I just wrote.

>[...]
>I am actually very surprised how obvious the computational mechanism
>of the brain are.

  There are many, including yours truly, who will disagree with this.
  
>The problem I see is there vast variations. The many different
>structures are enough to take quite a while to familiarize ones self
>with.

 I disagree with the above although there are many who will agree with
you.  I see little variation in fundamental operating principles from
one neuron to the next.

Regards,

Louis Savain

President, Marengo Media, Inc.
Technical Details
Message-ID: <3444f2ee.2636978@news.earthlink.net>
Path: arc1-ca.pugleaf.net!unknown!not-for-mail
References: <342b36de.10039603@news.earthlink.net> <342fb9ae.4111800@news.earthlink.net> <343AAFF1.6D35@dial.pipex.com> <343efdd4.28374986@news.earthlink.net> <34437E3B.400F@concentric.net> <34446D77.F829445C@qi3.com>

Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: 10d5b4,10bd0b81cba64349
X-Google-Attributes: gid10d5b4,public
X-Google-Thread: 101fc6,10bd0b81cba64349
X-Google-Attributes: gid101fc6,public
X-Google-Thread: f6b1a,10bd0b81cba64349
X-Google-Attributes: gidf6b1a,public
X-Google-Thread: 10ca9b,10bd0b81cba64349
X-Google-Attributes: gid10ca9b,public
X-Google-Thread: 10461e,10bd0b81cba64349
X-Google-Attributes: gid10461e,public
X-Google-Thread: 10d04f,10bd0b81cba64349
X-Google-Attributes: gid10d04f,public
From: savainl@earthlink.net (Louis Savain)
Subject: Re: Announcement: The Temporal Neuron Revolution.... some thoughts
Date: 1997/10/15
Message-ID: <3444f2ee.2636978@news.earthlink.net>
X-Deja-AN: 280764220
References: <342b36de.10039603@news.earthlink.net> <342fb9ae.4111800@news.earthlink.net> <343AAFF1.6D35@dial.pipex.com> <343efdd4.28374986@news.earthlink.net> <34437E3B.400F@concentric.net> <34446D77.F829445C@qi3.com>
Followup-To: comp.ai,comp.ai.philosophy
Distribution: inet
Organization: Marengo Media, Inc.
Newsgroups: comp.ai,comp.ai.philosophy,comp.theory.self-org-sys,comp.theory.dynamic-sys,comp.ai.neural-nets,fr.comp.ia