Question of Hyperparameter tuning of shallow neural network

4 次查看(过去 30 天)
Hi all,
I trained a shallow neuron network and tuning parameters following this post from @Greg Heath.
I only tuning the number of nuerons in one hidden layer and accept all default parameters.
here is comments from referee:
The machine learning models have numerous hyper-parameters, but the authors only optimise one, and did not even report the values of the others. It is not clear why they chosen only one, or why they chose the ones they did, but this is unacceptable. All independent hyper-parameters need to be optimised simultaneously.
how to answer this comment?
Thank you.

采纳的回答

Shashank Gupta
Shashank Gupta 2021-2-5
Hi Qiang,
The points raised by the reviewers are valid, you can't just optimize one variable and leave the rest as it is. even if you are intent to optimize some of the variable, you must explain why it is done and must provide the values used for rest of the parameters. All the hyper parameters used in ML model have some significance and not conveying why it is not being optimized or even not been give the value is certainly no one will accept. My suggestion would be, if you not intent to optimize all parameter then you must convey the reason and give them the default set of values used for those parameters. You need to show clearity on the purpose.
I hope this helps.
Cheers.
  3 个评论
Shashank Gupta
Shashank Gupta 2021-2-5
Yes, its resonable to optimize, actually it is very important to optimize all of them. There are many ways to do it, MATLAB has a bayesian approach too. Check this out. It might help you.

请先登录,再进行评论。

更多回答(0 个)

类别

Help CenterFile Exchange 中查找有关 Sequence and Numeric Feature Data Workflows 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by