Improvements of Random Search for Hyperparameter Optimization

Question

Moritz Bleibtreu 2016-5-19

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/285030-improvements-of-random-search-for-hyperparameter-optimization

回答： Don Mathis 2017-1-8

Hello

Random search is one possibility for hyperparameter optimization in machine learning. I have applied random search to search for the best hyperparameters of a SVM classifier with a RBF kernel. Additional to the continuous Cost and gamma parameter, I have one discrete parameter and also an equality constraint over some parameters.

Now, I would like to develop random search further, e.g. through adaptive random search. That means for example adaptation of the search direction or of the search range.

Does somebody have an idea how this can be done or could reference to some existing work on this? Other ideas for improving random search are also welcome.