app roc curve different to perfcurve

2 次查看（过去 30 天）
Esmeralda Ruiz Pujadas
评论： Esmeralda Ruiz Pujadas 2022-1-3
Dear all,
I have a question, I want to overlay two roc curves, but my surprise is that when I use perfcurve the AUC is much higher that the one otained in the app. I think the one of the app (machine learning toolbox makes more sense) according to the accuracy.
How is possible to get a 5% of difference in AUC of the same classifier with the same data between the machine toolbox and the perfcurve.What is the difference between both implementations?
[~,score_svm] = resubPredict(classificationSVM);
[Xsvm,Ysvm,Tsvm,AUCsvm] = perfcurve(trainingData.Eval,score_svm(:,1),1);
Thank you
  2 个评论
Ive J
Ive J 2021-12-18
Classification learner app calculates the AUC using the validation set, not the whole sample (perfcurve). If you set validation to Resubstitution validation in the learner app, the AUC from learner app and perfcurve should be same (this is only for comparison, and in this way your model is not proteceted against overfitting)

请先登录，再进行评论。

请先登录，再回答此问题。

回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 ROC - AUC 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by