work with huge matrix
2 次查看(过去 30 天)
显示 更早的评论
Hello, I have a matrix of which dimension is so huge (10^6 column and 37 rows). I have to do some computation with this matrix, like multiple, divide,...
But when I try to proceed computations with this matrix, the matlab could not work, it shows some problems with limitation of dimensions and memory.
So I plan to divide the matrix into 4 small matrix, and redo the job for each partitioned matrix. But it seems very tedious.
Is there anyone having an idea to deal with this issue?
Thank you,
1 个评论
Walter Roberson
2018-10-24
In some cases tall array can take care of the work for you. However I wonder if your computations are correct. Is it intended that the computation for each column is independent of the other columns?
回答(2 个)
madhan ravi
2018-10-24
As you said it’s also better you split the main huge matrix into subsets using rows which are few compared to columns
0 个评论
Steven Lord
2018-10-24
Is the orientation of your data fixed? If you can store and work with your data in a matrix with many rows and a few columns (rather than the other way around) and your data has few non-zero elements consider storing it as a sparse matrix.
If not, as Walter suggested I'd consider using tall arrays constructed from a datastore.
0 个评论
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Matrix Indexing 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!