Plotting ROC for fitcecoc svm classifier

Question

Roohollah Milimonfared 2017-10-14

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/361369-plotting-roc-for-fitcecoc-svm-classifier

评论： SI LIU 2021-4-27

Hi I have created a 4 level SVM classifier by fitcecoc. I need to generate ROC curve for each class. This is the code: template = templateSVM('KernelFunction', 'gaussian', 'PolynomialOrder', [], ... 'KernelScale', 1, 'BoxConstraint', 1, 'Standardize', true);

[classificationSVM,HyperparameterOptimizationResults] = fitcecoc(predictors... , response, 'Learners', template, 'Coding', 'onevsone', 'OptimizeHyperparameters',... {'BoxConstraint','KernelScale'},'HyperparameterOptimizationOptions',... struct('AcquisitionFunctionName', 'expected-improvement-plus',... 'Repartition',true,'MaxObjectiveEvaluations',10,'kfold',5),'Verbose',0,... 'FitPosterior',1);

[label,NegLoss,PBScore,Posterior] = resubPredict(classificationSVM);

Apparently, I need to use perfcurve function to get the ROC. Yet, the help instructions are for fitcsvm that does not work for fitcecoc. I am trying to use the following code for class 1: [Xsvm,Ysvm,Tsvm,AUCsvm] = perfcurve(response,Posterior(:,1),'true'); Yet, I receive the below error message: Error using perfcurve>membership (line 693) Positive class is not found in the input data.

Error in perfcurve (line 437) [W,subYnames] = membership(cls(sorted),weights(sorted),... I was wondering how I can proceed from here.

Thanks, Roohollah

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

SI LIU 2021-4-27

Undefined function 'Posterior' for input arguments of type 'ClassificationECOC'.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Prashant Arora 2017-10-18

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/361369-plotting-roc-for-fitcecoc-svm-classifier#answer_286432

Hi Roohollah,

The reason you are getting this error because you defined the positive class to be "true" in the perfcurve function. This only work if the labels are logical values, i.e. can be defined as "true" or "False". If your labels are not logical values, you must define the Positive class as one of the member of the labels. You can find more information about this at the following link:

https://www.mathworks.com/help/stats/perfcurve.html?s_tid=srchtitle#inputarg_posclass

Hope this helps!

Prashant

2 个评论
显示无隐藏无

Roohollah Milimonfared 2017-10-23

Thanks Prashant. I was wondering if there is any standard procedure to generate ROC plots for multi-level classifiers. I am using one-vs-one coding design for the binary learners. Does that mean I have to use purcurve function for each binary learner separately? Thanks.

satinder nagra 2020-2-11