Predictor Importance feature for Tree Ensemble (Random Forest) method
25 次查看(过去 30 天)
显示 更早的评论
Hello, It seems that MATLAB package has two approaches for calculating variable importance:
The first is "predictorImportance": http://www.mathworks.com/help/stats/compactregressionensemble.predictorimportance.html
The second is permutation method: http://www.mathworks.com/help/stats/treebagger.oobpermutedvardeltaerror.html
I'm wondering what are the difference between the two approaches, and which is preferred?
Thanks!
0 个评论
回答(1 个)
Prashanth Ravindran
2016-2-8
This query was asked back in 2013. I will try to answer for those people who might be looking for the answer.
predictorImportance. This function has input as the ensemble created by the fitensembe function. And this function can be used to create many different kinds of ensembles such as boosting trees, bagging trees, etc..
treebagger.oobpermutedvardeltaerror: Yes this is an output from the Treebagger function in matlab which implements random forests. This can also be used to implement baggin trees by setting the 'NumPredictorsToSample' to 'all'.
You see the basic algorithms are different for the two functions and hence the outputs may be different.
4 个评论
Zainab Al-RubayezayMATH
2018-11-4
Hi
I got a negative result of feature importance as well when I used Treebagger. However, I got a positive result when I try to know what are the most important features of the same dataset by applying predictorImportance for the model result from ensemble.
Does anyone know the reasons?
Thanks Zainab
Shanning Bao
2019-4-10
For why the feature importance may be negative:
Seems useful
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Regression Tree Ensembles 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!