Does the type of classifier make that much difference in feature selection in sequentialfs function?

Question

Sara Salimi 2019-1-2

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/437898-does-the-type-of-classifier-make-that-much-difference-in-feature-selection-in-sequentialfs-function

评论： Don Mathis 2019-1-10

Hi,

I am wondering if does it make significant difference in feature selcetion if we are using difference classifiers during feature selection?

For example, I am using the following naive bayes classifier:

fun = @(Xtrain,Ytrain,Xtest,Ytest)...
sum(Ytest~=predict(fitcnb(Xtrain,Ytrain,'Distribution','kernel'),Xtest));
[inmodel,history] = sequentialfs(fun,myData,classes,'cv',c2,'options',opts,'nfeatures',60);

or if I use fitsvm, instead of fitcnb, will make that much difference on the selceted features?

Thanks

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Don Mathis 2019-1-4

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/437898-does-the-type-of-classifier-make-that-much-difference-in-feature-selection-in-sequentialfs-function#answer_354990

I think in general it will make a difference which classifier you use, because different classifiers deterct different kinds of patterns. An SVM could discover that a pair of uncorrelated predictors are both relevant because it can learn nonlinear I/O relationships, while a linear classifier might not be able to detect that nonlinear structure, and then "decide" that both predictors are irrelevant.

2 个评论
显示无隐藏无

Sara Salimi 2019-1-10

Thank you very much for your help,

So, can I come to this conclusion that for finding the relevant features, it would be better to use SVM?

Don Mathis 2019-1-10

I don't think there's any right answer here. You could even try both and take the union of the features. The features you get will also depend on the hyperparameters you choose for your SVM or NB models.

请先登录，再进行评论。

Does the type of classifier make that much difference in feature selection in sequentialfs function?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

回答（1 个）

2 个评论
显示无隐藏无

另请参阅

类别

标签

Community Treasure Hunt

Does the type of classifier make that much difference in feature selection in sequentialfs function?

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

回答（1 个）

2 个评论 显示 无隐藏 无

另请参阅

类别

标签

Community Treasure Hunt

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

2 个评论
显示无隐藏无