applying timerange to a number of .mat files containing timetables

2 次查看（过去 30 天）
minomi
minomi 2018-4-10
评论： minomi 2018-7-3
I have a series of .mat files containing timetables that I have created by creating a table fist and then converting that to timetables using table2timetable. I then save the timetables in a location.
I then want to be able to create a datastore for the folder with all the timetables (.mat files), then create tall arrays, and then convert the tall array to timetables so that I can apply the timerange function to select data from all the files in the folder corresponding to the start and end time of the timerange.
Every method that I try has an issue somewhere along the steps described above. Either I am not able to use timerange with .mat files, or writetable does not create timetables, etc ...
  2 个评论
Hatem Helal
Hatem Helal 2018-4-12
How are you importing the data into matlab? Are you using datastore or readtable or something else? I think you might be able to bypass writing an intermediate copy of the data but some additional details would be helpful.

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

Anandan Rangasamy
Anandan Rangasamy 2018-4-11
编辑：Anandan Rangasamy 2018-4-11
I think the right way to do this is to begin with tall timetables first, that way you don't mess up the way timetables are formatted differently from different .mat files.
Did you try to create tall timetables and call write on the tall timetable you have? I think this will help you streamline your workflow. Here is the documentation for tall/write: tall/write
Note that you can create tall timetables from in-memory timetables, as well:
>> MeasurementTime = datetime({'2015-12-18 08:03:05';'2015-12-18 10:03:17';'2015-12-18 12:03:13'});
>> Temp = [37.3;39.1;42.3];
>> Pressure = [30.1;30.03;29.9];
>> WindSpeed = [13.4;6.5;7.3];
>> TT = timetable(MeasurementTime,Temp,Pressure,WindSpeed);
>> TT = retime(TT,'hourly','linear');
>> tallTT = tall(TT)
>> write('./myTimeTables', tallTT);
Later on, you can recreate the same tall timetable from the snapshot:
>> recreatedTallTT = tall(datastore('./myTimeTables'))
  1 个评论
minomi
minomi 2018-7-3
thanks and sorry for the late reply. I think one main issue I have is that using "write" or "writetable" seems to be very slow but in order to use "timerange" I would need to save the tables in ".txt" and hence I need to use the "write" functions as oppose to saving timetables as ".mat files.

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Large Files and Big Data 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by