Is there any automatic code/way to choose/optimize the neural networks parameters on MATLAB?
15 次查看(过去 30 天)
显示 更早的评论
Dear experts,
I am an undergraduate student and i am doing my bachelor thesis in classification using neural networks.
I am struggling in optimizing neural networks hyper parameters (example: learning rate, regularization parameter, number of hidden neurons, mini-batch sizes, which training algorithm, weights/biases, mu(for Jacobin methods)....etc.). I read different books, where they provide some rules of thumb to choose the parameters.
However, my supervisor mentioned that there is an automatic way/code to choose the hyper parameters on matlab and then matlab runs with the parameters which fits the most and then it trains the data.
Is there any possibility to mention where can i find such an automated way or mention it in the answer? (i have looked everywhere in the Q&A asked about neural networks, and the documentation it is really hard to find such method so i decided to ask the experts themselves) Thanks in advance
0 个评论
回答(3 个)
David Ding
2017-5-26
Hi Yehia,
Perhaps the following on model building and assessment might be of use to you:
Thanks,
David
Greg Heath
2017-11-8
Search the NEWSGROUP and ANSWERS with
greg patternnet
Most of my designs accept all defaults except
1. No of hidden nodes
2. Initial random weights
and use a double for loop to obtain tens of candidate designs that yield
mse(target-output) <= 0.01*mean(var(target,1))
The resulting classification error rates are usually very acceptable. In rare cases, I have to reduce 0.01 to 0.005 or lower.
Hope this helps.
Thank you for formally accepting my answer
Greg
0 个评论
Alan Weiss
2017-11-8
In addition to Greg's comment (and he is the source of most wisdom on this matter), perhaps this example will show you the technique your advisor is referring to (requires Statistics and Machine Learning Toolbox).
Alan Weiss
MATLAB mathematical toolbox documentation
0 个评论
另请参阅
产品
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!