create a tall array from .mat files

Question

Ben Morrow 2018-6-4

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/403967-create-a-tall-array-from-mat-files

评论： Ben Morrow 2018-8-20

Hey,

I have 29 arrays of size approximately 150k x 13 stored in the form of .mat labeled 1-29. I want to add an extra column to each row and then store them in a single array. I figure that the data is too large to store in memory, so I want to use a tall array. ultimately the data is to be taken from the tall array, sorted and plotted as a surface plot. I want to know if a tall array is the best way to do this or if there is an eaiser way like appending the .mats together without loading them into memory and adding the 14th coloum to them without loading into memory.

Thanks

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Ben Morrow 2018-6-4

to clarify, it is an array, datak (the same name in every .mat) contained in mat1.mat to mat29.mat

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Nanda Gupta 2018-6-8

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/403967-create-a-tall-array-from-mat-files#answer_323846

I understand that you would like to add a column for each row(150) in each of your MAT files(29 files). Based on the description your entire data should be around ~450Mb.

150,000 * 13 * 8 Bytes = 15600000 Bytes = 15.6 MB

15.6 MB * 29 = 452.4 MB

In this case, you will likely be able to store all this at the same time in the MATLAB workspace, unless MATLAB is explicitly showing an error for insufficient memory.

So, an easier way would be to try using arrays before Tall arrays.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Ben Morrow 2018-8-20

I wanted to have multiple plots available of similar data sets, I got some kind of memory error. I resolved it by creating smaller .matfiles by cutting out every other data point.

请先登录，再进行评论。