work with huge matrix

Hello, I have a matrix of which dimension is so huge (10^6 column and 37 rows). I have to do some computation with this matrix, like multiple, divide,...
But when I try to proceed computations with this matrix, the matlab could not work, it shows some problems with limitation of dimensions and memory.
So I plan to divide the matrix into 4 small matrix, and redo the job for each partitioned matrix. But it seems very tedious.
Is there anyone having an idea to deal with this issue?
Thank you,

1 个评论

In some cases tall array can take care of the work for you. However I wonder if your computations are correct. Is it intended that the computation for each column is independent of the other columns?

请先登录,再进行评论。

回答(2 个)

madhan ravi
madhan ravi 2018-10-24

0 个投票

As you said it’s also better you split the main huge matrix into subsets using rows which are few compared to columns
Steven Lord
Steven Lord 2018-10-24

0 个投票

Is the orientation of your data fixed? If you can store and work with your data in a matrix with many rows and a few columns (rather than the other way around) and your data has few non-zero elements consider storing it as a sparse matrix.
If not, as Walter suggested I'd consider using tall arrays constructed from a datastore.

类别

帮助中心File Exchange 中查找有关 Matrix Indexing 的更多信息

提问:

2018-10-24

回答:

2018-10-24

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by