saving variables in a single .mat file

Question

zozo 2012-3-26

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/33456-saving-variables-in-a-single-mat-file

Hello,

I have 360 .mat files containing same variable in with different data (row vectors) each of size in(1x3800000) stored in them. They are of size 9.84GB (all 360 files).

Now I want to save them all in 1 .mat file as a matrix out(360x3800000).

How can I do it?

2 个评论
显示无隐藏无

Daniel Shub 2012-3-26

What problems are you running into?

zozo 2012-3-26

I need to extract some data from each of these 360 files(row vectors) and do further processing. So, I do not want to load them 1 by 1,extract data, load again and so on. Having them all together in a cell/array makes it far easier.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

ndiaye bara 2012-3-26

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/33456-saving-variables-in-a-single-mat-file#answer_42060

Try this code m=zeros(3800000,360); for k=1:360, eval(sprintf('load F*_%d.mat',k)); % F*=name of all your files .mat% eval(sprintf('y=F*_%d(:,1);',k)); disp(k); clear F* if k==1, m=y; else m=[m,y]; end end

save File m t %save the new file .mat

4 个评论
显示 2更早的评论隐藏 2更早的评论

zozo 2012-3-27

Same variable 'in' was saved each time, but with different file names as data(1).mat,data(2).mat,data(3).mat.......data(360).mat

Please suggest the syntax for my case.

Jan 2012-3-27

Dear zozo, accepting an answer means, that it solves your problem.

Daniel and I have warned you that you cannot load a 11GB of data (360*3800000*8 byte per double) efficiently, if you have only 4GB of RAM. I assume you need 32GB RAM to work efficiently with such large data, 64GB is safer.

The above EVAL approach is cruel.

You currently did not specify in which format you want to store the data, DOUBLEs or SINGLEs, an integer type, as cell or matrix. Anyhow, I'm convinced, that it is the wrong approach due to the limited memory.

请先登录，再进行评论。

Answer 2

Jan 2012-3-26

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/33456-saving-variables-in-a-single-mat-file#answer_42052

Do you have a 64-bit Matlab version? How many RAM do you have installed? Do you want to store the values in one 360 x 3'800'000 array, a most likely more useful 3'800'000 x 360 array, of as separate vectors e.g. in a {1 x 360} cell. The later has the advantage, that it does not need a contiguos free block of memory.

4 个评论
显示 2更早的评论隐藏 2更早的评论

Jan 2012-3-26

4GB RAM is very lean for such a big chunk of data. If it is really necessary to keep all values in the RAM simultaneously, buy more RAM. Implementing workarounds to process the data in pieces will be more expensive.

Jan 2012-3-26

@Siva: Does you comment concern the current topic? If so, please explain the connection. If not, please delete the comment and post it as a new question - with more details. Thanks.

请先登录，再进行评论。