Why 'net.IW{1,1}' will return negative value and smaller value like -0.0090, 0.2447, and so on.

Question

mun1013 2015-6-22

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/224825-why-net-iw-1-1-will-return-negative-value-and-smaller-value-like-0-0090-0-2447-and-so-on

评论： Greg Heath 2019-12-9

I was doing multilayer neural network using newff function. size of input = 3 x 150 (3 input data, 150 samples) size of target = 1 x 150 net = newff([minmax(Inputs)],[10,1],{'logsig' 'logsig'}); 10 neurons in hidden layer and 1 neuron in output layer so the size of input weight in hidden layer = 3 x 10, a = weight; (the value of weight is 50 and above) a = net.IW{1,1};

Why a = net.IW{1,1}; will return negative value and the value is very small?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Greg Heath 2015-6-23

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/224825-why-net-iw-1-1-will-return-negative-value-and-smaller-value-like-0-0090-0-2447-and-so-on#answer_183661

在 MATLAB Online 中打开

[ 10 3 ] = size(IW)

Do not worry about the size or sign of a single weight in a single design. Typically, it is almost impossible to understand the purpose of each single weight.

The best approach for designing a real-world net is to make multiple designs to

 1. Mitigate the uncertainty of using random initial weights
 2. Reduce the time and effort needed to find a sufficiently low local minima in a mountainous weight space.

Using too many weights is called overfitting. If these are trained too long (overtraining), the training error can be driven very low. However, very often those designs do not work well on nontraining data.

I try to minimize the number of weights by minimizing the number of hidden nodes subject to the constraint that the variance of the error (= output-target) is less than the average variance of the target components by a factor of ~100 to 200.

Hope this helps.

Thank you for formally accepting my answer

Greg