Bootstrapped Confidence Intervals controlling for multiple hypothesis testing ?

7 次查看（过去 30 天）

Ricardo 2024-3-2

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2089396-bootstrapped-confidence-intervals-controlling-for-multiple-hypothesis-testing

评论： the cyclist 2024-3-2

I have another question related to bootstrapped confidence intervals.

I'm currently interested in comparing differences in means of two variables using bootstrapped confidence intervals. However, I'm unsure whether and how to control for multiple hypothesis testing when computing these intervals.

I need to calculate the pvalue first, right? And then adjust these raw pvalues for multiple hypothesis testing? Any guidance on this? Thank you

n = 1000;  % Number of data points
rng(42);   % Set seed for reproducibility
x1 = randn(n, 1);  % Random data for group 1
x2 = randn(n, 1);  % Random data for group 2
% Function to compute the difference of means
boot_func = @(x1, x2) mean(x1) - mean(x2);
% Bootstrap resampling and calculation of confidence intervals
boot_samples = 10000;  % Number of bootstrap samples
boot_ci = bootci(boot_samples, {boot_func, x1, x2}, 'type', 'per');
% Multiple Hypothesis testing?
% Bonferroni, Holm, Step Down?

The following function calculates p-values for the bca method, but not for the 'perc' method in bootci.

https://fr.mathworks.com/matlabcentral/answers/266682-bootstrapping-and-p-values-t-test-when-using-bootci

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

the cyclist 2024-3-2

I think your simple example here may be too simple to illustrate your question.

You only have two variables, and you are only calculating one difference of means. You don't seem to have multiple comparisons here, so there is no need to account for the testing of multiple hypotheses. (You seem to have one hypothesis: The difference in means is greater than one would see by chance, under the null hypothesis.)

请先登录，再进行评论。

请先登录，再回答此问题。