🚀 go-pugleaf

     Recognize that the transfer function in a neural network threshold unit
doesn't really have to be a sigmoid function.  It just has to look roughly
like one.  The behavior of the net is not all that sensitive to the 
exact form of that function.  It has to be continuous and monotonic, 
reasonably smooth, and rise rapidly in the middle of the working range.
The trigonometric form of the transfer function is really just a notational
convenience.

     It would be a worthwhile exercise to come up with some other forms
of transfer function with roughly the same graph, but better matched to
hardware implementation.  How do real neurons do it?

					John Nagle