What parameters to use to show performance of a classifer

5 次查看（过去 30 天）
farheen asdf
farheen asdf 2016-1-3
编辑： MHN 2016-1-21
Hi. I want to know what are the parameters which best show the performance of a classifier? My data is divided into 3 classes and I have used KNN and ANN to classify it. Now I want to compare the two classifiers and wanted to know which parameters I could use. I calculated Sensitivity, Specificity, accuracy and precision for KNN but when I was searching for calculation of these parameters for ANN I found that they are best suited for binary (2-class) classification. So, what parameters can show the performance in case of 3 class classifier? And if the above mentioned parameters are only for binary classification then what are the values that classperf gives for KNN? And lastly if Sensitivity, Specificity, accuracy and precision can be used to show the performance of 3 class classifier then how do I calculate them for ANN? Thank you.
  1 个评论
Greg Heath
Greg Heath 2016-1-5
编辑：Greg Heath 2016-1-5
4x4 count and percent confusion matrices containing row and column sums are good summaries of performance.
Not sure what else is available given those summaries. Summarizing the results in terms of 3 binary classifiers doesn't light my fire.
Greg

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

MHN
MHN 2016-1-21
编辑：MHN 2016-1-21
There is not any "best" performance evaluation, specifically for N-class classifier (N>2) . It depends on your problem in hand. Usually some of the parameters are more important than the others based on your problem. For example, you can see the following paper for some performance evaluation parameters when N=3 : Patel, Amit C., and Mia K. Markey. "Comparison of three-class classification performance metrics: a case study in breast cancer CAD." Medical imaging. International Society for Optics and Photonics, 2005.
If you would like to find the confusion matrix and then calculate the parameters, this is an example :
load ionosphere
tc = fitctree(X,Y);
Y_hat = predict(tc,X);
[C,order] = confusionmat(Y, Y_hat);

类别

在 Help Center 和 File Exchange 中查找有关 Nearest Neighbors 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by