Eliminate tables with more than 15% NaN data

Question

BN 2020-1-18

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/500828-eliminate-tables-with-more-than-15-nan-data

评论： BN 2020-1-18

C.mat

Hey all,

I have C.mat which has 125 tables. I want to remove tables if any of tmax_m or tmin_m or rrr24 or tmin_m columns have more than 15% NaN cells.

C.mat is attached.

Thank you all

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Adam Danz 2020-1-18

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/500828-eliminate-tables-with-more-than-15-nan-data#answer_410724

编辑：Adam Danz 2020-1-18

在 MATLAB Online 中打开

This cellfun is a bit obnoxious but it produces an output select that is a logical vector the same size as C where true values identify cells that will be eliminated due to having at least 1 column listed in cols that has more than maxNaN percent NaN values.

load('C.mat')
cols ={'tmax_m', 'in_m' 'rrr24' 'tmin_m'};
maxNan = 0.15; 
select = cellfun(@(T)any(mean(isnan(T{:,ismember(T.Properties.VariableNames,cols)}),1) > maxNan), C); 
C(select) = []; % eliminate selected cells

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

BN 2020-1-18

Both codes are accurate, I found this one more understandable for me. Thank you very much, Walter Roberson and Adam Danz

请先登录，再进行评论。

Answer 2

Walter Roberson 2020-1-18

2
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/500828-eliminate-tables-with-more-than-15-nan-data#answer_410717

在 MATLAB Online 中打开

filetables = load('C.mat');
numtables = numel(filetables);
tablenames = fieldnames(filetables);
droptable = false(1, numtables);
for K = 1 : numtables
    thistablename = tablenames{K};
    thistable = filetables.(thistablename);
    if mean(isnan(thistable.tmax_m)) > 0.15 || ...
       mean(isnan(thistable.tmin_m)) > 0.15 || ...
       mean(isnan(thistable.rrr24)) > 0.15
       droptable(K) = true;
    end
end
tables_to_drop = tablenames(droptable);
filetables = rmfield(filetables, tables_to_drop);
save('C_filtered.mat', '-struct', 'filetables');