How to take mean of 3D matrices without storing them

Question

nlm 2021-5-27

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/841525-how-to-take-mean-of-3d-matrices-without-storing-them

评论： Jonas 2021-5-28

Hi,

I have 31 matrixes of 18000 by 36000 double type. The memory doesn't allow me to store more than 3 matrixes at once to take mean.

How can I take the mean of 31 matrixes without storing them ?

 all = [];
for KK = 1:31
   all = cat(3,all,data);
end
all_mean = nanmean(all,3);

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Walter Roberson 2021-5-28

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/841525-how-to-take-mean-of-3d-matrices-without-storing-them#answer_710990

在 MATLAB Online 中打开

%assuming that your data is currently in a cell array
total = zeros(size(data{1}));
validcounts = total;
for KK = 1:length(data)
   mat = data{K};
   mask = isnan(mat);
   validcounts = validcounts + ~mask;
   mat(mask) = 0;
   total = total + mat;
end
all_mean = total ./ validcounts;

Note: any location that was nan in all the matrices will be nan in all_mean.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Answer 2

Jonas 2021-5-27

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/841525-how-to-take-mean-of-3d-matrices-without-storing-them#answer_710785

sum them up one by one, this way you have one big summing matrix and the current loaded matrix. after summing you can divide all matrix elements by 31. if there really exist NaN in your matrix you have to create a third big matrix which counts for each entry if the value was NaN or not which results into a matrix with highest value 31 (at the end you then divide element wise by that matrix instead of all elements through 31). at the same time you have to set NaN entries to 0 before you add them

2 个评论
显示无隐藏无

nlm 2021-5-27

using a for loop ?

Jonas 2021-5-28

just like in the answer of Walter. only his assumption that all data is on a cell array may be wrong because you said you could not have more than 3 matrices in your workspace. depending on how you access your data you have to load maybe one file after the other and remove previously loaded data

请先登录，再进行评论。