ROC curve - how automatically find the most suitable threshold?

19 次查看(过去 30 天)
I have a ROC curve for my data. I would like to find the most suitable threshold for data classification. The threshold should be located in place where False Positive Rate and True Positive Rate are balanced each other. From the interpretation of the ROC curve I know that should choice some threshold which is close to the left upper corner. Is there a way to find this threshold automatically?

回答(4 个)

Luke Hubbard
Luke Hubbard 2021-4-27
编辑:Luke Hubbard 2021-4-27
Follow the example for plotting the ROC curve.
[X,Y,T,AUC,OPTROCPT] = perfcurve(labels,scores,posclass);
ThresholdForOptROCpt = T((X==OPTROCPT(1))&(Y==OPTROCPT(2)))

the cyclist
the cyclist 2015-12-19
To find the best threshold, you first need to define what you mean by "best". Specifically, you need a function that determines the cost of each type of error. In some applications, a false positive is much more costly than a false negative. In other applications, the opposite is true.
After you figure that "cost function" out, then you minimize the cost along your ROC curve.
  1 个评论
Karolina
Karolina 2015-12-19
In the word balanced I meant the place where true negative rate is crossing true positive rate. Like here link please see figure "Sensitivity and specificity versus criterion value"

请先登录,再进行评论。


the cyclist
the cyclist 2015-12-19
When you say you have the curve, I assume you have the (X,Y) coordinates of the curve, for example as output by the perfcurve function.
X = false positive rate, and 1-Y = false negative rate.
So, you can do
[minErrDiff,minIdx] = min(X,1-Y)
to find which value is closest to being balanced.

Dario Walter
Dario Walter 2020-6-16
There is an output available in the perfcurve functions that returns the value you are looking for:
[X,Y,T,~,OPTROCPT,suby,subnames] = perfcurve(...)
OPTROCPT provides the required value.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by