How to recursively read in .TAB files that are located in a hierarchy, then save as one matlab table?

Question

Christy Lentz 2019-1-3

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/438174-how-to-recursively-read-in-tab-files-that-are-located-in-a-hierarchy-then-save-as-one-matlab-table

评论： Siddharth Bhutiya 2019-1-7

在 MATLAB Online 中打开

Hello, I want to create one GIANT matlab table (if possible) that contains 19 columns of chronological data:

I have the data sorted like this:

where each folder 001_031_JAN, 032_059_FEB, etc contains daily files:

The .LBL files are of no importance to me. All the data I want is located in the .TAB files.

I want to read in ALL of the .TAB files from each month and each year. There is ~25 GB worth of data.

Each of the .TAB files are organized into 19 tab delimited columns which I have specified as varNames below.

I want to create one GIANT matlab table (if possible) that contains 19 columns of data from the time period 2011 to 2015.

This is my attempt to go through the MAG_tab_and_lbl_files folder and subfolders to load all the data into one table:

Loc = dir('/Users/chle4971/Google Drive/LASP/MERCURY/MESSENGER_instruments/MAG_tab_and_lbl_files/')'
varNames = {'year','DOY', 'hour', 'min','sec','time_tag','navg', ...
     'Bx_sensor','By_sensor','Bz_sensor','DBx_sensor','DBy_sensor',...
     'DBz_sensor','Bx_spacecraft','By_spacecraft','Bz_spacecraft',...
     'DBx_spacecraft','DBy_spacecraft','DBz_spacecraft'};
 varTypes = {'int64','int64','double','double','double','double',...
     'double','double','double','double','double','double','double',...
     'double','double','double','double','double','double'};
 delimiter='\t';
 datastartline=1;
 opts = delimitedTextImportOptions('VariableNames',varNames,'VariableTypes',...
     varTypes,'Delimiter',delimiter,'DataLines',datastartline);
ttds = tabularTextDatastore(Loc,opts,'IncludeSubfolders','0','FileExtensions','.TAB')