Why does synchronize omit and duplicate rows from component timetables?

4 次查看（过去 30 天）
Will S
Will S 2023-12-15
评论： Will S 2023-12-16
When I synchronize two timetables, the result omits or duplicates rows from the component timetables, depending on options. The attached timetables.mat file contains two timetables, tt and TT, that reproduce the problem. Both TT and tt have a sample rate of 5e6, and were built using array2timetable, where I specified the vector of values, the sample rate (5e6), and a start time.
load('timetables.mat', 'TT', 'tt')
missing_rows = synchronize(TT, tt, 'regular', 'fillwithmissing', 'SampleRate', 5e6);
duplicate_rows = synchronize(TT, tt);
In missing_rows, variable 4 ("tt"), rows 14588-14594 are filled with NaNs, but data exist at these times, as seen in timetable tt rows 488-494. These kinds of omissions can be seen in many other places if you run stackedplot(missing_rows).
In duplicate_rows, look at rows 14105-14119 variable 4 ("tt"). TT and tt share times, but in these rows of duplicate_rows, each time is listed twice with NaNs interspersed. Again, this occurs in many places.
Is there a way to synchronize these tables without the missing or duplicate row problems?

请先登录，再回答此问题。

回答（1 个）

Will S
Will S 2023-12-16
Since posting, I figured out that the cause of this behavior is floating point errors in the timetable times. I'm not sure why synchronize leaves out data in the missing_rows case, but the give-away for floating point errors comes from taking the difference between the rows that look like duplicates in the duplicate_rows case.
>> duplicate_rows.Time(14117) - duplicate_rows.Time(14116)
ans =
duration
4.4409e-19 sec
I let matlab create the timetales with array2timetable, where I provide the sample rate and start time. Perhaps the floating point errors come from the different start times I provide?
There are already solutions posted to this floating point problem:
How to increase the tolerance for comparing time points when synchronizing timetables? - MATLAB Answers - MATLAB Central (mathworks.com)
I wanted to add an answer for my application, based on this related question.
Synchronize timetables with tolerance of 5 minutes - MATLAB Answers - MATLAB Central (mathworks.com)
In my case, I'm recording from data acquisition equipment with a constant sample rate, so I need to syncrhonize within the tolerance of the time step set by my sample rate. Therefore, prior to synchronizing timetables, I just round their times so the time steps have the same number of decimal places as 1/sample_rate:
tt.Time = seconds((round(seconds(tt.Time), -floor(log10(1 / sample_rate)))));

类别

在 Help Center 和 File Exchange 中查找有关 Timetables 的更多信息

标签

产品


版本

R2023b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by