Adding sparse matrices efficiently?

35 次查看(过去 30 天)
Hi, I have a cell array which consists of many sparse matrices. For example:
N.B. In my original problem each sparse matrix is about 4000*4000 in size and has many zero entries
A{1}=sparse(magic(150));
A{2}=sparse(magic(150));
A{3}=sparse(magic(150));
A{4}=sparse(magic(150));
....
% I want something like:
KK = A{1}+A{2}+A{3}+....
% KK should be a sparse matrix of 150*150
% Adding them in a loop is very time consuming
% I tried the following but did not work:
KK = sum(cat(2,KC{:}),3); % or 1,2 as the sum dimension
% also
KK = sum([KC{:}]); % gives a vector
  2 个评论
David Goodmanson
David Goodmanson 2018-11-17
Hi Mohammod,
It's not going to be a good idea to use sparse(magic(N)) as a benchmark for timing. This matrix is stored in the sparse convention but is absolutely not sparse, since it has no nonzero elements at all. Sparse has to do a lot of work in that case.
sparse(magic(N)) + sparse(magic(N)) takes more time than the addition of the full matrices, magic(N) + magic(N).
Mohammod Minhajur Rahman
Hi David, I am sorry to put it in that way, in my original problem the size of each sparse matrix is 4000*4000 and it has many zero entries. The comment that I have added that it takes huge time based on the original scenario

请先登录,再进行评论。

采纳的回答

James Tursa
James Tursa 2018-11-17
In general, everytime you add two sparse matrices together a bunch of sparse index sorting etc has to take place first and then the result of the additions gets put into new memory. Doing this at each iteration is what is slowing you down.
If your matrices are only 4000x4000, then maybe adding the individual matrices into a full matrix would be faster since there wouldn't be any need to sort the combined indexes or to put the result into new memory. You could try two different options with this approach.
1) Start with a full 0's matrix and add your sparse matrices into it. A good underlying algorithm will simply add the sparse stuff into the full matrix at the appropriate spots without any index sorting needed. So:
result = zeros(4000,4000);
for k=1:whatever
result = result + A{k};
end
result = sparse(result);
2) Do the equivalent of the above inside a mex routine. That way you could ensure that no large extraneous data copying was taking place, but everything was simply added directly into the result. This mex routine would not be too difficult to write. If you opt for this method let me know and I can help.
  3 个评论
Jin Yang
Jin Yang 2020-7-16
James, thank you for this answering! Is there anything we need to take care to write a c mex file with cell data?
James Tursa
James Tursa 2020-7-16
编辑:James Tursa 2020-7-16
Nothing special needed. Just pass in the cell array, create the full array inside the mex routine, and write a loop that does the adding. You could sparse the end result either inside or outside the mex routine.

请先登录,再进行评论。

更多回答(1 个)

Bruno Luong
Bruno Luong 2018-11-17
编辑:Bruno Luong 2018-11-17
The fatest way to add sparse matrices is to build the sum from scratch.
It takes 4 second for 1000 random matrices of 4000x4000 with density 1e-3.
I = [];
J = [];
V = [];
n = 0;
for k = 1:length(A)
[i,j,v] = find(A{k});
p = n + numel(i);
m = numel(I);
if p > m
m = max(p,2*m);
I(m) = 0;
J(m) = 0;
V(m) = 0;
end
idx = (n+1:p);
I(idx) = i;
J(idx) = j;
V(idx) = v;
n = p;
end
idx = (n+1:numel(I));
I(idx) = [];
J(idx) = [];
V(idx) = [];
[m,n] = size(A{1});
SUM = sparse(I,J,V,m,n)
  1 个评论
Mohammod Minhajur Rahman
Hi Bruno, thanks for your suggestion, I did implement your code in my settings and it gives perfect results. I don't know why but in my current code setting, starting with a 0's matrix results in faster to solve this.

请先登录,再进行评论。

类别

Help CenterFile Exchange 中查找有关 Sparse Matrices 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by