Confusion Matrix of cross validation of an ECOC SVM classifier

3 次查看（过去 30 天）
Mehrdad Heydarzadeh
评论： Pallavi 2018-8-10
Hi, I am using MATLAB 2015 and statistics and machine learning toolbox. I want to do a 10-fold cross validation for an ECOC svm classifier with 19 classes. I want to report test result by obtaining confusion matrix. I used following piece of code:
template = templateSVM('KernelFunction', 'rbf', 'KernelScale', 'auto', 'BoxConstraint', 1, 'Standardize', 1);
trainedClassifier = fitcecoc(Features, Labels, 'Learners', template, 'Coding', 'onevsone');
partModel = crossval(trainedClassifier, 'KFold', 10);
Accuracy = 1 - kfoldLoss(partModel, 'LossFun', 'ClassifError');
[validationPredictions, validationScores] = kfoldPredict(partModel);
confmat=confusionmat(Features(:,1),validationPredictions);
Is the confmat, the average confusion matrix of 10 folds which are taken out during cross validation? I mean, should I use this confusion matrix as test performance of classifier? If it is not, what should I do for doing a test on the performance of classifier? Thanks in advance Mehrdad
  3 个评论
显示 1更早的评论
Angga Lisdiyanto
Angga Lisdiyanto 2016-5-12
I need the answer too.
Please comment into Tom 's Answer, not to your Question.

请先登录，再进行评论。

请先登录，再回答此问题。

回答（2 个）

Daniel
Daniel 2016-6-23
编辑：Daniel 2016-6-23
Yes. If you examine the crossval object you will see an attribute called Trained. It contains k classifiers where k is the number of folds you specified. Each classifier trains on its respective partition which is specified by the Partition attribute of the crossval object. The kFoldPredict function returns the aggregate predictions of all k folds into the validationPredictions variable so your confusion matrix shows the classification results of all of your data.
For nice plots, use plotconfusion function. If your labels are non-numeric I have had good luck with the heatmap plotting toolbox which can be found in FileExchange
Tom Lane
Tom Lane 2015-7-5
The confusion matrix is one measure of classifier accuracy. You should supply the confmat function with the known labels and the predicted values. It appears you want to supply Labels in place of Features(:,1). Your other argument looks okay; the predicted value for row J is computed using the classifier for which row J is part of the 10% held out, and the training is done on the other 90%.
  1 个评论
Angga Lisdiyanto
Angga Lisdiyanto 2016-5-14
编辑：Angga Lisdiyanto 2016-5-14
Hi Tom, how to add x & y labels on confusionmat function? And my class value type is string, i cannot use confusionmat function.

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Classification Learner App 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by