working with large matrices

Question

Bram Stegeman 2019-3-6

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/448655-working-with-large-matrices

评论： Stephan Koschel 2020-3-17

I have to work with large matrices (e.g. A = 8000 x 100.000, all non-zero values).

I want to calculate T= ((A'*A) + lamda*speye(n))\(A'*A); with lamda =e.g. 1-e-3.

I have installed 64 gb ddr and as expected I run out of memory (also when I introduce a threshold and force A to be sparse, and then create sparse(A) and sparse (A') and try to calculate T.

Are there alternative ways to calculate T without out of memory issues?

3 个评论
显示 1更早的评论隐藏 1更早的评论

Bram Stegeman 2019-3-7

Hello David,

That is correct. 1e5 x 1e5 could already results in memory issues is my experience.

Forget to mension that I'm only interested in the diagonal values of T.

Stephan Koschel 2020-3-17

You are only interested in the diagonals of a matrix multiplication?

I would implement an iteration over the diagonal elements and load the corresponding columns and rows from the two matrices. The entry on the diagonal becomes something like sum(current_row .* current_col)

The iteration could slow down the process, but you only need to load two vectors into memory.

请先登录，再进行评论。

请先登录，再回答此问题。