Multiplication of large matrix with its transpose
16 次查看(过去 30 天)
显示 更早的评论
What would be the best way to multiply a large matrix A say, 100000 x 10, by its transpose A' in MATLAB 2021b. The output will be a 100000x100000 matrix. This is giving a memory error > 40 GB.
Previous suggestions in Q&A include avoiding creation of A' before multiplication. This certainly helps in reducing time with smaller matrices as tested with 30,000 points. Thanks.
1 个评论
Chris Wilson
2024-4-15
Thanks a lot - this is extremely helpful to know - it helped me solve a related problem.
采纳的回答
John D'Errico
2021-12-15
Best is to never create it at all. Instead, use mathematics to work with it. And that depends on what you will do with this matrix. But there are many ways to work with such a matrix, that would completely avoid ever needing to create the matrix at all.
For example, do you want the eigenvalues? I'll do it on a small matrix A, because I want to show how to achieve the same results.
A = randn(1000,5);
[V0,D0] = eig(A*A');
D0(end + [-4:0],end + [-4:0]) % all other eigenvalues will be zero
% now, without computing A*A' at all.
[Q,R] = qr(A,0);
[V,D] = eig(R*R')
We can also compute the eigenvectors.
My point is, there are many things you can do without ever needing to compute that huge mess of a matrix.
0 个评论
更多回答(1 个)
James Tursa
2021-12-15
The fastest way is to simply write it as A * A', because MATLAB will see that the operands are the same and call a special multi-threaded symmetric BLAS library function to do the multiply without explicitly forming the transpose A' first.
As for your memory problems, that is an entirely different issue. If you really need this result and it is full, then you may be forced to chunk out the operation into smaller pieces and work on them individually. If A has lots of 0's then you could look into sparse representations.
0 个评论
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Matrix Indexing 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!