not getting same accuracy as classifier app

Question

Ashwin Kannan 2018-5-7

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/399578-not-getting-same-accuracy-as-classifier-app

评论： Bernhard Suhm 2018-6-12

I train a classifier, say SVM, with data standardization & 50 fold cross validation in Classifier App GUI. I get an accuracy of 90%. Now I export the model, and run prediction on the same features that was used to train the model. The result is that I get very low accuracy (~40-50%). Shouldn't I be getting high accuracy since I'm testing my train set? Is it got something to do with standardizing the test data? or does 'm.predictFcn()' take care of standardizing test data?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Bernhard Suhm 2018-6-12

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/399578-not-getting-same-accuracy-as-classifier-app#answer_324262

The model trained inside the Learner app doesn't exactly match the exported model because the latter will be trained on the complete data set, with no evaluation data held out. But that should rather increase than decrease accuracy. You do need to ensure you have applied the same "standardization" (I assume you mean something like subtracting the mean and dividing by the standard deviation) that was applied to the "training" data, the predict function doesn't "automagically" perform such normalization, and a mismatch in that would explain the low accuracy.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Bernhard Suhm 2018-6-12

I obtained some additional clarification: you must have checked "Standardize data" among the Advanced options in the Classification Learner. That does perform the standard normalization I referred to above. And the exported model does carry the mean and standardization (in m.ClassificationSVM.Mu and *.Sigma), and the predictFcn will apply that normalization to whatever table you pass into it. I just verified that yields an accuracy slightly higher than the one reported in the app on the training set, just like I expected. So you must have got something else messed up.

请先登录，再进行评论。