Feature Importance value for SVM, KNN, and Discriminant type classifier?
8 次查看(过去 30 天)
显示 更早的评论
I am using MATLAB classification learner app for my classification task. I am interested to know feature importance value for each kind of machine learning model. I know feature importance for tree and ensemble type models can be find out by 'predictorimportance' function. Is there any way that can be used to determine feature importance value in case of SVM,KNN Discriminant type classifier?
0 个评论
回答(1 个)
Ayush Aniket
2024-8-29
In MATLAB, there is no direct method to find out feature importance for models like SVM, KNN, and discriminant analysis.
However, for determining feature importance for these models you can use Recursive Feature Elimination (RFE) technique that recursively removes the least important features based on the model's performance and can be adapted to any of the above-mentioned models.
You can use the sequentialfs function in MATLAB to implement it. The function uses a custom criterion function to select the features and these can be the models SVM, KNN etc. Refer to the following documentation to read about the process of using a custom criterion function:
The importance of the feature can be implied from the order in they are removed.
0 个评论
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Statistics and Machine Learning Toolbox 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!