I have a mse mistake in Neural Network
1 次查看(过去 30 天)
显示 更早的评论
Hello I have a question I need to know how to avoid local minima in Neural Networks, or I don't know why after I train the model and test it once, I have a mse 0.015, and once again and test I got 0.012, each time I train once I got other mse value. Thank you so much for your help
0 个评论
采纳的回答
Greg Heath
2016-10-1
You are confused. The task is to find a local minimum that is sufficiently low. I use the goal
mse(target-output) <= 0.01*mean(var(target',1)).
This yields an Rsquare >= 0.99 % Look up Rsquare in wikipedia
Furthermore, because of the output's invariance to the shuffling of hidden node order and weight signs there are 2^H * H! equivalent nets with the same number of hidden nodes and weight absolute values. For the default value H = 10, 2^H *H! = 3.7159e+09
Furthermore there are often more than one set of orders and absolute values that will cause an acceptable Rsquare.
The differences you see can be caused by different initial random weight values.
Hope this helps.
Thank you for formally accepting my answer
Greg
3 个评论
Greg Heath
2016-10-2
I haven't read any recent NN books.
Try taking a look at some of my tutorial type posts in both NEWSGROUP and ANSWERS
greg tutorial neural
更多回答(0 个)
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Sequence and Numeric Feature Data Workflows 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!