What is "THE STANDARD UNIVERSAL APPROXIMATOR NEURAL NETWORK "

Question

Greg Heath 2018-8-18

回答： Greg Heath 2018-8-25

The "STANDARD" UNIVERSAL APPROXIMATOR NEURAL NETWORK is a hidden layer regression net with

A SINGLE hidden layer 
A SINGLE bounded nonlinear hidden layer transfer function
A LINEAR output layer transfer function

I'm stating this because it is obvious that some believe that, for a universal approximator:

    1. There has to be more than one hidden layer
 and/or
    2. The output layer transfer funtion has to be nonlinear.

Of course there are additional conditions on function finiteness, etc which I have omitted, but I think I have made my point.

Hope this Helps,

Greg

Answer 1

Greg Heath 2018-8-25

The question is the answer