Remove more than two consecutive NaNs and delete the same rows from the date column in a table

Question

YEMY 2022-6-17

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1742835-remove-more-than-two-consecutive-nans-and-delete-the-same-rows-from-the-date-column-in-a-table

评论： YEMY 2022-6-18

Hello,

I am going through a bit complicated problem, as I have some in-situ data that needs to be cleaned, and one of the things I have to do is to delete more than two consecutive NaN values. I managed to do that by applying the code below.

The second problem that I faced is that to apply that code, I had to separate my data column from the table (contains date + data columns). And what I want is a way to include the date column, so when I delete the NaNs, the relative date rows should be gone too.

In the example below, I had to select the second column which represents the data, while the first column is the date.

Thank you

workData = readtable('station_2015.xlsx');
a = workData{:,2};
idx1 = isnan(a);
idx1 = idx1'
idr1 = diff(find([1 diff(idx1) 1]));
D1 = mat2cell(a,idr1,size(a',1));
for i = 1:length(D1)
    if any(isnan(D1{i})) && length(D1{i})>2
        D1{i} = [] ;
    end
end
iwant1 = cell2mat(D1)

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Voss 2022-6-17

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1742835-remove-more-than-two-consecutive-nans-and-delete-the-same-rows-from-the-date-column-in-a-table#answer_987955

在 MATLAB Online 中打开

% a table with 2 columns, containing some NaNs in the second column:
data = (1:20).';
data([2:3 7:9 13 15:19]) = NaN;
workData = table(rand(20,1),data,'VariableNames',{'Date','Data'});
disp(workData);
     Date      Data
    _______    ____

    0.36148      1 
    0.34608    NaN 
    0.43743    NaN 
    0.78196      4 
    0.90405      5 
    0.46612      6 
    0.96308    NaN 
    0.57548    NaN 
    0.76747    NaN 
    0.26333     10 
    0.89622     11 
    0.28484     12 
    0.40249    NaN 
    0.29187     14 
    0.43846    NaN 
    0.51367    NaN 
    0.37457    NaN 
    0.51091    NaN 
    0.86945    NaN 
    0.26653     20 
% use regexp to find sequences of consecutive NaNs of length at least 3:
[start_idx,end_idx] = regexp(char('0'+isnan(workData{:,2}).'),'1{3,}','start','end')
start_idx = 1×2
     7    15
end_idx = 1×2
     9    19
% get the indices of all elements within those length-3+ sequences of NaNs:
to_remove = arrayfun(@(s,e)colon(s,e),start_idx,end_idx,'UniformOutput',false);
to_remove = [to_remove{:}]
to_remove = 1×8
     7     8     9    15    16    17    18    19
% remove the rows at those indices from the table:
workData(to_remove,:) = []
workData = 12×2 table
     Date      Data
    _______    ____

    0.36148      1 
    0.34608    NaN 
    0.43743    NaN 
    0.78196      4 
    0.90405      5 
    0.46612      6 
    0.26333     10 
    0.89622     11 
    0.28484     12 
    0.40249    NaN 
    0.29187     14 
    0.26653     20 

3 个评论
显示 1更早的评论隐藏 1更早的评论

Voss 2022-6-18

编辑：Voss 2022-6-18

You're welcome!

Yes, you can remove consecutive NaNs within a moving window, but removing them all at once is easier.

YEMY 2022-6-18

Thank you. I will try to figure out how to make this moving window as it will help me more.

请先登录，再进行评论。

Remove more than two consecutive NaNs and delete the same rows from the date column in a table

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

采纳的回答

3 个评论
显示 1更早的评论隐藏 1更早的评论

更多回答（0 个）

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

Remove more than two consecutive NaNs and delete the same rows from the date column in a table

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

采纳的回答

3 个评论 显示 1更早的评论隐藏 1更早的评论

更多回答（0 个）

另请参阅

类别

标签

产品

版本

Community Treasure Hunt

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

3 个评论
显示 1更早的评论隐藏 1更早的评论