Create k-fold Cross Validation with Undersampling for highly imbalanced Dataset

6 次查看（过去 30 天）
Dario Walter
Dario Walter 2020-8-4
回答： Anshika Chaurasia 2020-8-14
Dear Community,
I am not sure how to implement the following requirement. When I use undersampling for my supervised Machine Learning Algorithm, how can I assure that the k-fold corresponds to the distribution of the original dataset. The performace metric (e.g. PR AUC) shall refer to the original distribution and not to the distribution of the undersampled set.
It does not make sense to solely perform k-fold cross validation on the entire undersampled dataset.
Your help is highly appreciated!

请先登录，再回答此问题。

回答（1 个）

Anshika Chaurasia
Anshika Chaurasia 2020-8-14
Hi Dario,
It is my understanding that you want k-folds (cross-validation) to preserve the imbalanced distribution of original dataset. The solution is stratified k-fold cross-validation.
  • Use cvpartition function and refer to cvpartition documentation for more information.
c = cvpartition(group,'KFold',k,'Stratify',stratifyOption)
  • You can also try following file exchange documents as a drop-in replacement to cvpartition:
  1. Distribution-balanced stratified cross-validation
  2. Stratified cross-validation for multi-label datasets

类别

在 Help Center 和 File Exchange 中查找有关 Classification 的更多信息

标签

产品


版本

R2020a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by