Adaboost Learning Rate in Matlab Documentation

Question

Dario Walter 2020-8-13

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/579069-adaboost-learning-rate-in-matlab-documentation

评论： Dario Walter 2020-8-23

采纳的回答： Raunak Gupta

Hey,

the description of Adaboost allows to set a learn rate.

https://de.mathworks.com/help/stats/fitcensemble.html

However, the learn rate typically refers to Gradient Boosting. Could anyone explain to me what Matlab is doing when AdaboostM1 is applied.

Thanks for your help!

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Raunak Gupta 2020-8-15

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/579069-adaboost-learning-rate-in-matlab-documentation#answer_480369

Hi,

The LearnRate option in AdaBoostM1 tells about the learning rate of shrinkage which is essentially the shrink in contribution of each new base-model learned in the ensemble. This parameter controls how much the new model contributes to existing one. Normally if the LearnRate is too small it will require more iterations to get trained and will be more accurate. AdaBoostM1 is used for binary classification problem only.

3 个评论
显示 1更早的评论隐藏 1更早的评论

Raunak Gupta 2020-8-21

编辑：Raunak Gupta 2020-8-21

Hi Dario,

The LearnRate parameter is included while calculate the weights of the weak hypothesis in the ensemble that is (

) in the Algorithm mentioned here. It is not explained in the original AdaBoost algorithm but is used widely in almost all of the application of AdaBoost because it provides a way to tinker the actual contribution of subsequent weak learners. So when any

is calculated for a learner it is multiplied with LearnRate to diminish or enhance its contribution (based on value being < 1 or > 1).

You can see in this example, the influence of different LearnRate.

Dario Walter 2020-8-23