Running a large array

Question

Sophie about 9 hours 前

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2139291-running-a-large-array

评论： Walter Roberson 12 minutes 前

Hi,

I am trying to load in an array (the array is 362x332x75x1032 (34.7GB)), which exceeds maximum array size preference (16.0GB). How do i go about loading it in.

It is a variable which is part of a .nc dataset

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Star Strider about 8 hours 前

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2139291-running-a-large-array#answer_1488871

See the documentation section on Tall Arrays (introduced in R2016b).

I have rarely needed to use them, so I have little experience with them.

2 个评论
显示无隐藏无

Sophie about 6 hours 前

They seem to not work with netCDF files

Star Strider about 5 hours 前

I was not aware that it was a CDF file. There is a set of functions to work with netCDF Files, and another set of functions to work with CDF Files. They may have options that would work. (I rarely use CDF files, so I do not have extensive experience with them and functions using them.)

请先登录，再进行评论。

Answer 2

John D'Errico about 4 hours 前

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2139291-running-a-large-array#answer_1488941

编辑：John D'Errico about 4 hours 前

Memory is cheap. Get more memory.

I'm sorry, but if you want to work with big data, you will often need sufficient capabilities to handle that data. No matter what, working with huge arrays, lacking sufficient will be slow. So your next question will be, how can I make my code run faster. Again ... get sufficient memory. Or, solve smaller problems.

2 个评论
显示无隐藏无

Sophie about 2 hours 前

This is for my masters dissertation, so unfortunantly upgrading my memory isn't an option

Walter Roberson 4 minutes 前

@Sophie

Did the professor assign the hardware and say "you must run it on this hardware" ?

If not, then:

if it is your own hardware, then there is always the option of upgrading it
if it is university hardware, then there is always negotiating with the university to obtain an upgrade

请先登录，再进行评论。