Adaboost Learning Rate in Matlab Documentation
2 次查看(过去 30 天)
显示 更早的评论
Hey,
the description of Adaboost allows to set a learn rate.
However, the learn rate typically refers to Gradient Boosting. Could anyone explain to me what Matlab is doing when AdaboostM1 is applied.
Thanks for your help!
0 个评论
采纳的回答
Raunak Gupta
2020-8-15
Hi,
The LearnRate option in AdaBoostM1 tells about the learning rate of shrinkage which is essentially the shrink in contribution of each new base-model learned in the ensemble. This parameter controls how much the new model contributes to existing one. Normally if the LearnRate is too small it will require more iterations to get trained and will be more accurate. AdaBoostM1 is used for binary classification problem only.
3 个评论
Raunak Gupta
2020-8-21
编辑:Raunak Gupta
2020-8-21
Hi Dario,
The LearnRate parameter is included while calculate the weights of the weak hypothesis in the ensemble that is () in the Algorithm mentioned here. It is not explained in the original AdaBoost algorithm but is used widely in almost all of the application of AdaBoost because it provides a way to tinker the actual contribution of subsequent weak learners. So when any is calculated for a learner it is multiplied with LearnRate to diminish or enhance its contribution (based on value being < 1 or > 1).
更多回答(0 个)
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Classification Ensembles 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!