Calculate Sensitivity and Specificity from Code generated from Classification Learner

Question

Sarah Ayyad 2021-9-27

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1461839-calculate-sensitivity-and-specificity-from-code-generated-from-classification-learner

评论： Shen Jia Wei 2022-4-7

I have trained my dataset in the classification learner app and tried to calculate classification performance using leave-one-out cross-validation. Since classification learner doesn't support this configuration of K-fold, I used the way of generating the code for training the currently selected model.

I have tried to compute the sensitivity and specificity but all the ways I found depend on predicted class labels and I can't get the resulted class labels since it is not a new dataset. I just want to evaluate the trained model.

Is any way to evaluate the sensitivity and specifity or the confusion matrix from Classification Learner App Code generated?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Sarah Ayyad 2021-9-28

3
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1461839-calculate-sensitivity-and-specificity-from-code-generated-from-classification-learner#answer_796924

编辑：Sarah Ayyad 2021-9-28

在 MATLAB Online 中打开

I computed all performance metrics by the following way

[validationPredictions, validationScores] = kfoldPredict(partitionedModel);
confmat = confusionmat(response,validationPredictions) % where response is the last column in the dataset representing a class
TP = confmat(2, 2);
TN = confmat(1, 1);
FP = confmat(1, 2);
FN = confmat(2, 1);
Accuracy = (TP + TN) / (TP + TN + FP + FN);
Sensitivity = TP / (FN + TP);
specificity = TN / (TN + FP);
z = FP / (FP+TN);
X = [0;Sensitivity;1];
Y = [0;z;1];
AUC = trapz(Y,X);  % This way is used for only binary classification