How to get probabilities of each class which is classified with RUSBoost for an imbalanced data set

Question

Dilshan Subasinghe 2020-4-24

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/520385-how-to-get-probabilities-of-each-class-which-is-classified-with-rusboost-for-an-imbalanced-data-set

评论： Louis 2023-11-6

I have a dataset with 7 classes and 3 features. The data set is hugely imbalanced. So, I referred https://www.mathworks.com/help/stats/classification-with-imbalanced-data.html to classfy the data. I get a prediction accuracy of 94%. But I need the probability of getting each class for a feature or set of features. How to get probability of each class to a given feature?

[Nt Mt] = size(y); % Number of observations in the training sample

t = templateTree('MaxNumSplits',Nt);

rusTree = fitcensemble(X,y,'Method','RUSBoost', 'NumLearningCycles',1000,'Learners',t,'LearnRate',0.1,'nprint',100);

[~,scores] = predict(rusTree,[1 16 3 5])

I get following scores for above code, 0.7345, 3.5105, 1.1893, 0, 0, 0, 0.0082

But above scores are not probablities, how to get values between 0-1 where sum of proabilities in all classes is equal to 1?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Raunak Gupta 2020-4-29

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/520385-how-to-get-probabilities-of-each-class-which-is-classified-with-rusboost-for-an-imbalanced-data-set#answer_429173

编辑：Raunak Gupta 2020-4-29

Hi,

The reason behind predict not returning scores as probability estimates is because the ‘RUSBoost’ algorithm used in the model does not treat scores as probabilistic estimates. Instead, the score represents the confidence of a classification into a class, higher, being more confidence as it is explained in the documentation link of fitcensemble .

If you would like to get probabilistic estimate for scores you can set the 'ScoreTransform' to 'logit' in 'fitcensemble'. This name-value pair transforms the score to probabilistic estimates. This is explained here. Then using predict on the model returns scores as probability values for each class.

2 个评论
显示无隐藏无

Siddharth Arora 2022-2-27

Hi Raunak,

I have treid the suggested approaches: (1) using Score Transform to logit in fitcenesmble (for a binary classification problem and the scores are still not probabilistic estimates. I have tried specifing 'ScoreTransform' to 'logit' in 'fitcensemble', and also tried Mdl.ScoreTransform = 'logit' before using the 'predict' function, and the scores (any given row) do not add to 1. I have tried 'doublelogit' for Adaboost and that works fine. But not RUSboost. Please let me know how else I could convert scores from RUSboost to probabilistic estimates? Is it right to use scores from RUSboost as inputs for perfcurve to get AUC values, or should the scores be transformed first? Thank you

Louis 2023-11-6

I am experiencing the exactly same issue as Siddharth Arora as above. Setting "ScoreTransform' to 'logit' ensures that the score outputs are below 1, but score outputs do not sum to 1.

请先登录，再进行评论。