How do I take an average around unusual values?

2 次查看（过去 30 天）
Veronika
Veronika 2013-6-25
Hi,
I have a matrix with two rows - one that has values of interest and then the other that has corresponding moving standard deviation values. Sometimes there are spikes in the second array (std gets too high) - and there could be several of them. I already know how to identify these spikes - they are 3 standard deviation away from the mean (of moving standard deviation values).
My problem is to remove these spikes once they are identified, by averaging the values in the first row: take a value right before the spike occurred, add the value right after the spike ended (std values are back to being less than 3 standard dev. from the mean), and then divide those by two - and fill the elements corresponding to the spike with those averages.
Could anyone please help? I'm confused with how the indexing would work in this case, since there could be multiple occurrences of an event, and the averages should be taken for each of those events, properly.
Thanks!!

请先登录，再回答此问题。

采纳的回答

Jan
Jan 2013-6-25
With interp1:
signal = rand(1000, 1); % Test data, the first column of your matrix
isSpike = rand(1000, 1) < 0.01;
signal(isSpike) = interp1(signal(~isSpike), find(~isSpike), find(isSpike));

更多回答（2 个）

Image Analyst
Image Analyst 2013-6-25
编辑：Image Analyst 2013-6-25
If you have the Image Processing Toolbox, you could use roifill(). Otherwise you could identify the "good" elements, pass them into interp1(), and get estimates for the "bad/missing" areas. If you want a higher order estimate (e.g. quadratic) then you could filter the signal with a Savitzky-Golay filter (sgolay() in the Signal Processing Toolbox) and use the filtered values to replace the values. Something like (untested):
badIndexes = stdDevSignal > someValue;
filteredSignal = sgolay(originalSignal, 2); % or use roifill() or interp1()
goodSignal = originalSignal; % Initialize
goodSignal(badIndexes) = filteredSignal(badIndexes); % Replace bad values.
Veronika
Veronika 2013-6-27
Thanks! I see that the interp1 turns those values corresponding to a spike into NaN values. Is there a way to instead replace them with the local average values?
I've tried so far nanmean and inpaint_nans - they seem to help with the problem, but do not really provide local averages.
  2 个评论
Jan
Jan 2013-6-27
INTERP1 does not insert NaNs for Spikes, except they are found on the edges. So please post the code, which creates the NaNs in your case.
Veronika
Veronika 2013-7-1
编辑：Veronika 2013-7-1
spike = s > mean(s) + 3*std(s);
sig(spike) = interp1(sig(~spike), find(~spike), find(spike));
sig = inpaint_nans(sig);

请先登录，再进行评论。

类别

在 Help Center 和 File Exchange 中查找有关 Linear Predictive Coding 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by