Trying to complete a t-test between two 925x902 matrices to find if the difference between the two is significant to the 5% level
2 次查看(过去 30 天)
显示 更早的评论
The two matrices are DEM and B where DEM is the standard matrices and B is the simulated one and thus the one the test needs to be carried out on to show how significantly different the two matrices are.
Trying to complete the test on the 5% confidence level
How would i complete this test?
6 个评论
Jeff Miller
2022-4-27
This test is telling you that the average DEM value is about 9 points lower than the average B value, and that a difference of 9 points would virtually never occur by chance (p=0) assuming that the variations among DEM scores and among the B scores are just due to chance. On that basis you can conclude that the DEM and B matrices are definitely not statistically similar.
I presume that the variation among DEM scores is not just due to chance, however, due to real, systematic differences such as row and column effects (and similarly for the variation among B scores). Correcting for these systematic differences will make the p value even smaller (i.e., 0 to even more decimal places), so it is not going to strengthen your intended conclusion (as I understand it) that the matrices are similar.
dpb
2022-4-27
And is, as the documentation for ttest2 says, a totally inappropriate test to apply to the subject data set -- to wit, "ttest2(x,y) returns a test decision for the null hypothesis that the data in vectors x and y comes from independent random samples from normal distributions with equal means and equal but unknown variances, ..."
There is no random sampling in sight in this problem definition; in fact the points are correlated identically in the grid of locations.
However, the returned test statistic of ~-9 probably illustrates that there is a bias between the model and the observed data; looking at the difference instead and for bias either by location or by magnitude of response could possibly lead to some useful observations.
Visualization of these differences would be a starting point.
回答(0 个)
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Hypothesis Tests 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!