How can I multiply two big matrices, avoiding out of memory?

14 次查看（过去 30 天）
Xin Liu
Xin Liu 2019-8-25
评论： Bruno Luong 2019-8-26
for example, I = A*B, in which size(A) = [1024^2, 3], size(B) = [3, 1001^2]. So, size(I) = [1024^2, 1001^2] which could cause out of memory.
I have tried using tall arrays like the following code:
AA = tall(A);
II = AA*B;
I = gather(II);
but the command line still shows error: out of memory.
Sincerely thanks!
%% update %%
Thanks for your answer very much! Originally, I want to calculate this equation:
微信截图_20190826095243.png
where
so I write the following matrix equation:
m and n are variable, for example,m = 1024, n=1001^2 whatever. It is worth noting that the two matrices in exp(...) are not too big, but the result of their multiplication is too large to be storaged in memory. I've tried to split the two matrices into several small patches, but it need to input the number of the patches manually rather than automatically, moreover, the for loop could not be avoided in this case.
I have no good ideal currently.
Best regards!
  2 个评论
Bruno Luong
Bruno Luong 2019-8-25
编辑：Bruno Luong 2019-8-25
Storage of your matrix requires 8 Terabytes. Do you have a HD that big?
Xin Liu
Xin Liu 2019-8-26
I don't have so big HD - -、, so I'm searching for a better method to avoid big matrix :)

请先登录，再进行评论。

请先登录，再回答此问题。

采纳的回答

Bruno Luong
Bruno Luong 2019-8-26
编辑：Bruno Luong 2019-8-26
You can process by chunk of smaller (100 here);
% Generate small test data
m = 100;
n = 100^2;
C = rand(m^2,3); % your [alpha,beta,gamma]
XYZ = rand(3,n); % your [x; y; z];
A = rand(1,m^2);
psize = 100; % chunk size
E = zeros(1,n);
count = 0;
while count < n
p = min(psize,n-count);
j = count+(1:p);
E(j) = A*exp(C*XYZ(:,j));
count = count + p;
end
  4 个评论
显示 2更早的评论
Xin Liu
Xin Liu 2019-8-26
Well, I think I should accept your answer, :), haha~thank you very much.
Bruno Luong
Bruno Luong 2019-8-26
Well if you have considered this option, then it is your answer too.

请先登录，再进行评论。

更多回答（0 个）

类别

在 Help Center 和 File Exchange 中查找有关 Logical 的更多信息

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by