Moving average filter for large dataset

Question

Ajay Kumar 2019-9-2

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/478552-moving-average-filter-for-large-dataset

评论： Ajay Kumar 2019-9-2

Hello everyone.

I have a large dataset with for eg. 3500 Hz (i.e 3500 samples every second) for lets say 10 minutes. so in total I have 3500*60*10 = 2100000 samples.

example question: X = 2100000x1 double.

and now I want to perform moving average for 1 minute (i.e 60*3500 = 210000 samples).

I have worked out the solution using conv. code is written below.

Y = conv(X, ones(1,210000)/210000, 'valid');

This does exactly what I want, but it is taking too long to compute (~3-4 minutes).

Are there any other methods which are faster?

Thanks.

2 个评论
显示无隐藏无

Adam 2019-9-2

编辑：Adam 2019-9-2

在 MATLAB Online 中打开

Your code takes just a few seconds to run for me if I create a vector of random data of that size. Also

Y = movmean( X, 210000, 'Endpoints', 'discard' );

is also almost instantaneous and gives the same result.

Note: movmean is only available from R2016a

Ajay Kumar 2019-9-2

Ah, that's strange.

Anyways, thanks for the movmean thing. It works perfectly fine.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Dimitris Kalogiros 2019-9-2

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/478552-moving-average-filter-for-large-dataset#answer_390052

编辑：Dimitris Kalogiros 2019-9-2

在 MATLAB Online 中打开

Hi Ajay

You can try an iir filter like this

clear; clc;
%supose x contains your data.
% here , for simplicity, x is a constant with some gaussian noise
x= 5+randn(1,3500*60*10);
% output of iir filter (moving average)
y=zeros(1,length(x));
% time constant 
L=1/(60*3500);
% filtering process
for n=2:length(x)
    y(n)=(y(n-1)+L*x(n))/(1+L);
end
% plots of output and input
figure;
plot(x, '-b'); hold on;
plot(y, '-r', 'LineWidth', 2); zoom on; grid on;
legend('x: input', 'y: output');