How to determine feature importance using gradient boosting?

Question

hanspeter 2024-6-24

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2131501-how-to-determine-feature-importance-using-gradient-boosting

评论： the cyclist 2024-6-24

When using XGBoost in Python you can train a model and then use the embedded feature importance of XGBoost to determine which features are the most important.

In Matlab there is no implementation of XGBoost, but there is fitrensemble which is similar (afaik). Is there a way to use it for detemination of feature importance? Or is there maybe another way to do feature importance the way XGBoost does it?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

the cyclist 2024-6-24

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2131501-how-to-determine-feature-importance-using-gradient-boosting#answer_1476401

The model that is output from fitrensemble has a predictorImportance method for global predictor importance.

You can also use shapley for local feature importance.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

the cyclist 2024-6-24

Also, note that XGBoost is not an algorithm. It's just an efficient implementation of gradient boosting. You might find this question/answer from the MathWorks support team to be interesting.

请先登录，再进行评论。