multcompare and ttest2

10 次查看（过去 30 天）

karlo gonzales 2016-3-2

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/271019-multcompare-and-ttest2

评论： Felix-Antoine Savoie 2019-1-21

Dear Friends,

I have a simple and very basic question regarding the P-value of multcompare and ttest2 function. As i understand, after anova we use PostHoc analysis to p-value between all pairs. I expected to have the same p-value using ttest2. BUT, their p-value is very different! would you please to help me to figure out the problem? thanks Karlo

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

the cyclist 2016-3-2

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/271019-multcompare-and-ttest2#answer_212000

编辑：the cyclist 2016-3-2

When you make pairwise comparisons among several groups (not just two), you are more likely to find a difference between a given pair, just by random chance.

The P-values you get from multcompare take into account. The P-values you get from running all the t-tests independently does not (because it doesn't "know" that you have run multiple comparisons.)

Relevant: XKCD comic on multiple comparisons

5 个评论
显示 3更早的评论隐藏 3更早的评论

the cyclist 2016-3-3

在 MATLAB Online 中打开

There are many possible solutions to the multiple comparisons problem. I don't know the algorithm that multcompare uses, and can't dig into it right now. There are references in the documentation. You could also type

edit multcompare

to see what the code does.

Felix-Antoine Savoie 2019-1-21

Dear the cyclist,

You are correct that uncorrected multiple comparisons may lead to false positives (by chance). However, when using "multcompare" with the 'lsd' correction i(e, non-corrected ttest), I still get p-values that differ from those obtained from a standard ttest (not very different, but still). Do you have any idea as to why this happens?

Felix

请先登录，再进行评论。

请先登录，再回答此问题。