Changing large matrices by not completely loading them into memory
显示 更早的评论
Hi,
I'm attempting to modify very large matrices (single, 50e3 x 50e3), which don't make sense to load into the memory. I was wondering what you could recommend me as a data handling strategy? I thought ideally I could always load a let us say 100x100 square modify it and write it back. My working machine uses a SSD connected via M2 so it should be relatively speedy (however of course not nearly as fast as RAM). What suggestions do you have?
Thanks,
Moritz
回答(2 个)
You should read TMW's own advice on working with big data:
And in particular you might find memmapfile to be of significant interest to you:
1 个评论
Walter Roberson
2015-6-18
Or instead of memmapfile, save the .mat with -v7.3 and then use matFile objects to read in portions of the array.
类别
在 帮助中心 和 File Exchange 中查找有关 Large Files and Big Data 的更多信息
产品
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!