Using reshape to get a block averaging of data when it is not divisible by the block?

Question

matlabuser12 2015-6-24

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/225120-using-reshape-to-get-a-block-averaging-of-data-when-it-is-not-divisible-by-the-block

编辑： Sean de Wolski 2015-6-26

Have varying data sets of varying lengths i want to block average (every 10 points), block max/min, stdev, etc. How can I use reshape to do so and avoid the not divisible error? for example my data set is 1086 rows and i want every 10, the last set can be an average of 6 points only which is fine.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Sean de Wolski 2015-6-24

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/225120-using-reshape-to-get-a-block-averaging-of-data-when-it-is-not-divisible-by-the-block#answer_183871

编辑：Sean de Wolski 2015-6-26

在 MATLAB Online 中打开

If you have the Image Processing Toolbox, you could use blockproc for this.

% data
x = rand(1086,104);
% Mean
blockproc(x,[10 10],@(s)mean(s.data(:)))
% Min
blockproc(x,[10 10],@(s)min(s.data(:)))

etc.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Answer 2

dpb 2015-6-24

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/225120-using-reshape-to-get-a-block-averaging-of-data-when-it-is-not-divisible-by-the-block#answer_183822

编辑：dpb 2015-6-24

在 MATLAB Online 中打开

Just use modulo arithmetic to compute the block size and remainder...

L=size(x,1);   % array length 
N=n*fix(L/n);  % N total lines of n length possible
M=mod(L,n);    % the remainder final block size

You then use reshape(x(1:N,:),n,[]) for the large section and concatenate the statistics for the final segment to the results of the larger.

Example:

Let n=4 and there be three columns...

>> x=rand(11,3);  % generate a set of data
>> n=4;           % the block size
>> L=length(x);   % the total length
>> N=n*fix(L/n)   % the number of lines _can_ reshape by n
N =
   8
>> m=[reshape(mean(reshape(x(1:N,:),n,[])),N/n,[]); ,,,
    mean(x(N+1:end,:))]
m =
  0.4124    0.6394    0.6423
  0.7079    0.4336    0.4435
  0.6019    0.7830    0.6274
>>

Show it agrees w/ explicitly calculated values...

>> [mean(x(1:4,:));mean(x(5:8,:));mean(x(9:11,:))]
ans =
  0.4124    0.6394    0.6423
  0.7079    0.4336    0.4435
  0.6019    0.7830    0.6274
>>

QED.

If you have multiple statistics to run you'll likely want to save the reshape'd array and operate on it by the various functions or perhaps there's one of the other Statistics Toolbox functions that generates the desired various statistics in a single call rather than do the explicit reshape multiple times.

ADDENDUM NB: the use of N/n in the second reshape operation to return to the original number of columns. I presume from your original posting that probably is obvious as apparently you've done this before, but just as a reminder to stick with the reduced array size for the blocked portion and then there's the final "cleanup" of the additional line if, as you've stated, you're ok with the lesser number of elements in the statistics for the last group. Obviously you then just ignore that set to have one less final observation but all are averaged of the full set of n records per.

4 个评论
显示 2更早的评论隐藏 2更早的评论

matlabuser12 2015-6-24

I am still getting an error at the reshape stage:

product of known dimensions, 108, not divisble into total number of elements, 1086

dpb 2015-6-24

Yes, you use that to determine the maximum size that can be reshaped by n and I was correct initially in computing N as the total; I just erred in the comment. Then I reacted too quickly and instead of thinking it thru changed to match the comment rather than fixing the comment.

I've revised the answer to correct it back as intended with appropriate comment and show a small illustrative example.

Sorry for the misdirection; tried to be too quick...

请先登录，再进行评论。