How can I compute statistical significance with cross-validation?

3 次查看（过去 30 天）

Sepp 2016-6-11

1
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/289421-how-can-i-compute-statistical-significance-with-cross-validation

编辑： Esmeralda Ruiz Pujadas 2022-8-11

Hello

I've done nested cross-validation with 10 outer runs and 10 inner runs to evaluate different classifiers. In the end I average the accuracies of the 10 outer cross-validation runs to get a final accuracy for one classifier.

Now, I would like to do some statistical test among the classifiers to see if one classifier performs better than another.

How can this be done in Matlab (or in general) based on the cross-validation accuracies?

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Esmeralda Ruiz Pujadas 2022-8-11

编辑：Esmeralda Ruiz Pujadas 2022-8-11

Hello, I am having the same issue. It seems no solution. According to a paper, the problem of nested cross-validation, you cannot apply statistical measurements afterwards because you have different parameters in each iteration. Were you able to implement an alternative?.

请先登录，再进行评论。

请先登录，再回答此问题。