Automated unpaired 2 sample statsitical test
1. The Mann-Whitney U test (which is often used as a non-parametric alternative to independent sample t-test) ha a high false positive rate when the two samples have unequal higher order moments (e.g. unequal variance) [1]. Fligner and Pollicello's robust rank order test corrects this short-coming [2].
2. However, when the sample distributions cannot be assumed to be normal, they are often fallaciously assumed to be at least symmetric which is rarely the case. In fact in such cases, the absolute performance of both the above non-parametric tests is poor. Additionally, the convergence of the test statistic to standard normal distribution is often slow (as the sample sizes increase) [2,3].
3. Hence, this function adopts a boot-strapped Monte-Carlo method to dynamically approximate the critical values for the test statistic of the non-parametric tests. This technique has the advantage of making no assumptions about data distributions and therefore significantly reduce the bias in these tests [3].
4. This function requires Statistics and Machine Learning Toolbox
5. Written and tested in MATLAB R2020a
LIMITATIONS : 1. This function is only valid for continuous data.
REFERENCES:
1.Fligner, M.A. and Pollicello, G.E. III. (1981). “Robust Rank Procedures for the Behrens-Fisher Problem.” Journal of the American Statistical Association. 76, 162–168.
2. Feltovich, N. Nonparametric Tests of Differences in Medians: Comparison of the Wilcoxon–Mann–Whitney and Robust Rank-Order Tests. Experimental Economics 6, 273–297 (2003). https://doi.org/10.1023/A:1026273319211
3. Boos, D.D. and Brownie, C. (1988). “Bootstrap p-Values for Tests of Nonparametric Hypotheses.” Institute of Statistics Mimeo Series No. 1919, North Carolina State University.
引用格式
Nirvik Sinha (2024). Automated unpaired 2 sample statsitical test (https://www.mathworks.com/matlabcentral/fileexchange/78363-automated-unpaired-2-sample-statsitical-test), MATLAB Central File Exchange. 检索时间: .
MATLAB 版本兼容性
平台兼容性
Windows macOS Linux标签
致谢
参考作品: fitmethis
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!版本 | 已发布 | 发行说明 | |
---|---|---|---|
1.0.7 | Updated BS_non_param random generator seeding and reduced MC trials to 1000 for making runtime practical. |
|
|
1.0.6 | Updated notes. |
|
|
1.0.5 | 1. Added normal approximation where sample size for both sets > 100.
|
|
|
1.0.4 | Re-uploaded new files after correction of p-value calculation in previous version |
||
1.0.3 | Corrected p-value calculation from test statistic distribution |
||
1.0.2 | Added display image |
||
1.0.1 | Added citations. |
||
1.0.0 |