Question of Hyperparameter tuning of shallow neural network
5 次查看(过去 30 天)
显示 更早的评论
Hi all,
I only tuning the number of nuerons in one hidden layer and accept all default parameters.
here is comments from referee:
The machine learning models have numerous hyper-parameters, but the authors only optimise one, and did not even report the values of the others. It is not clear why they chosen only one, or why they chose the ones they did, but this is unacceptable. All independent hyper-parameters need to be optimised simultaneously.
how to answer this comment?
Thank you.
0 个评论
采纳的回答
Shashank Gupta
2021-2-5
Hi Qiang,
The points raised by the reviewers are valid, you can't just optimize one variable and leave the rest as it is. even if you are intent to optimize some of the variable, you must explain why it is done and must provide the values used for rest of the parameters. All the hyper parameters used in ML model have some significance and not conveying why it is not being optimized or even not been give the value is certainly no one will accept. My suggestion would be, if you not intent to optimize all parameter then you must convey the reason and give them the default set of values used for those parameters. You need to show clearity on the purpose.
I hope this helps.
Cheers.
3 个评论
Shashank Gupta
2021-2-5
Yes, its resonable to optimize, actually it is very important to optimize all of them. There are many ways to do it, MATLAB has a bayesian approach too. Check this out. It might help you.
更多回答(0 个)
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Deep Learning Toolbox 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!