Merging contents of multiple MAT files

Question

Multiplexer 2018-10-25

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/425992-merging-contents-of-multiple-mat-files

编辑： Stephen23 2022-1-20

Hello,

I got a collection of MAT files (generated by External Mode data archiving) that have names such as below and their count can go into 1000's: - MyMatFile_0.mat - MyMatFile_1.mat (...) - MyMatFile_2999.mat - MyMatFile_3000.mat

What i want to achieve is to merge all the arrays from inside the MAT files vertically together (like [MyMatFile_0.mat ; MyMatFile_1.mat ... ] and save that new single array to a spearate MAT file or simply leave it in workspace.

So for, example, with the files I'm attaching, each of them contains a 20x2 double array and I want to merge them together to make one MAT file with 60x2 double array.

Also, this batch of files is generated per each experiment i do and for each experiment the total number of MAT files may vary and the amount of elements in array in each MAT file also may vary (but there will be always 2 columns).

Any help is appreciated.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Stephen23 2018-10-25

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/425992-merging-contents-of-multiple-mat-files#answer_343316

编辑：Stephen23 2021-4-18

在 MATLAB Online 中打开

To read the files in the correct order download my FEX submission natsortfiles:

https://www.mathworks.com/matlabcentral/fileexchange/47434-natural-order-filename-sort

Then all you need is this (the input and output files are attached):

D = 'path to the folder where the files are saved'
D = '.';
S = dir(fullfile(D,'TestLog_*.mat'));
S = natsortfiles(S); % alphanumeric sort by filename
for k = 1:numel(S)
    T = load(fullfile(D,S(k).name));
    S(k).data = struct2cell(T);
end
M = vertcat(S.data);
save('TestLog.mat','M')

This will work for any number of .mat files, with a few conditions:

each .mat file contains only one variable.
the output file is in a different folder or does not match the dir filename string (otherwise you could end up accumulating the same data repeatedly).

9 个评论
显示 7更早的评论隐藏 7更早的评论

Stephen23 2018-10-26

编辑：Stephen23 2018-10-26

在 MATLAB Online 中打开

"... would it be difficult to modify the script to work in suituation where MAT fail contains two variables each ..."

Your life would be much simpler if the variable names in each .mat file were exactly the same, then this task would be trivial: if you can change the code that writes the .mat files, then that is the best option:

C = cell(2,...)
for k = ...
    T = load(...);
    C{1,k} = T.hello;
    C{2,k} = T.world;
end

As it is you have a few options:

load the entire .mat file contents into a structure, use fieldnames, match the fieldnames (e.g. strncmp or strncmpi for your fieldnames) and use the indices to allocate to two cell arrays.
load one variable at-a-time using load's -regexp option, and use the same code as in my answer, once for each cell array.
load the entire .mat file contents into a structure, sort the fields using sortfields, convert to cell using struct2cell, use indexing to assign to two cell arrays.