Surprising behavior in randsample

Question

the cyclist 2023-2-26

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1918955-surprising-behavior-in-randsample

移动：Image Analyst 2023-2-26

采纳的回答： Paul

在 MATLAB Online 中打开

I recently got surprised by the behavior of randsample.

1. Generating sequences with replacement -- not surprising

When I generate sequences with replacement (after setting the same seed), the first N values generated are the same, regardless of how many values I generate:

seed = 13;
N = 12;
for ni = 1:N
    rng(seed)
    fprintf("randsample (with replace), %2d value(s): ",ni); fprintf('%g ', randsample(N,ni,true)'); fprintf("\n");
end
randsample (with replace),  1 value(s): 10 
randsample (with replace),  2 value(s): 10 3 
randsample (with replace),  3 value(s): 10 3 10 
randsample (with replace),  4 value(s): 10 3 10 12 
randsample (with replace),  5 value(s): 10 3 10 12 12 
randsample (with replace),  6 value(s): 10 3 10 12 12 6 
randsample (with replace),  7 value(s): 10 3 10 12 12 6 8 
randsample (with replace),  8 value(s): 10 3 10 12 12 6 8 10 
randsample (with replace),  9 value(s): 10 3 10 12 12 6 8 10 8 
randsample (with replace), 10 value(s): 10 3 10 12 12 6 8 10 8 9 
randsample (with replace), 11 value(s): 10 3 10 12 12 6 8 10 8 9 1 
randsample (with replace), 12 value(s): 10 3 10 12 12 6 8 10 8 9 1 4 

2. Generating sequences without replacement -- surprising

When I generate sequences without replacement (after setting the same seed), I expected the same behavior. And that is the behavior -- but only if the sequence is long enough. For shorter sequences, the values are not in the same order.

seed = 13;
N = 12;
for ni = 1:N
    rng(seed)
    fprintf("randsample (without replace), %2d value(s): ",ni); fprintf('%g ', randsample(N,ni,false)'); fprintf("\n");
end
randsample (without replace),  1 value(s): 10 
randsample (without replace),  2 value(s): 3 10 
randsample (without replace),  3 value(s): 10 12 3 
randsample (without replace),  4 value(s): 11 2 12 6 
randsample (without replace),  5 value(s): 11 2 12 6 7 
randsample (without replace),  6 value(s): 11 2 12 6 7 9 
randsample (without replace),  7 value(s): 11 2 12 6 7 9 10 
randsample (without replace),  8 value(s): 11 2 12 6 7 9 10 8 
randsample (without replace),  9 value(s): 11 2 12 6 7 9 10 8 1 
randsample (without replace), 10 value(s): 11 2 12 6 7 9 10 8 1 3 
randsample (without replace), 11 value(s): 11 2 12 6 7 9 10 8 1 3 4 
randsample (without replace), 12 value(s): 11 2 12 6 7 9 10 8 1 3 4 5 

Notice how the first three rows don't follow the pattern. This seems odd to me, and perhaps buggy. (The behavior is consistent, and doesn't depend on the particular seed.)

I'm not sure I have a question, other than ... "Does this seem strange to anyone else?"

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Paul 2023-2-26

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1918955-surprising-behavior-in-randsample#answer_1180090

移动：the cyclist 2023-2-26

在 MATLAB Online 中打开

I don't see anything in the doc that says anything about the ordering. randsample is an .m file. The algorithm for without replacement changes when 4*k > n, consistent withthe results shown for randsample.

datasample works the same with replacement, but much differently without replacement.

datasample with replacement is the same as randsample.

seed = 13;
N = 12;
for ni = 1:N
    rng(seed)
    fprintf("datasample (with replace), %2d value(s): ",ni); fprintf('%g ', datasample(1:N,ni,'Replace',true)'); fprintf("\n");
end
datasample (with replace),  1 value(s): 10 
datasample (with replace),  2 value(s): 10 3 
datasample (with replace),  3 value(s): 10 3 10 
datasample (with replace),  4 value(s): 10 3 10 12 
datasample (with replace),  5 value(s): 10 3 10 12 12 
datasample (with replace),  6 value(s): 10 3 10 12 12 6 
datasample (with replace),  7 value(s): 10 3 10 12 12 6 8 
datasample (with replace),  8 value(s): 10 3 10 12 12 6 8 10 
datasample (with replace),  9 value(s): 10 3 10 12 12 6 8 10 8 
datasample (with replace), 10 value(s): 10 3 10 12 12 6 8 10 8 9 
datasample (with replace), 11 value(s): 10 3 10 12 12 6 8 10 8 9 1 
datasample (with replace), 12 value(s): 10 3 10 12 12 6 8 10 8 9 1 4 

But datasample without replacement is ...

seed = 13;
N = 12;
for ni = 1:N
    rng(seed)
    fprintf("datasample (without replace), %2d value(s): ",ni); fprintf('%g ', datasample(1:N,ni,'Replace',false)'); fprintf("\n");
end
datasample (without replace),  1 value(s): 10 
datasample (without replace),  2 value(s): 10 3 
datasample (without replace),  3 value(s): 5 12 9 
datasample (without replace),  4 value(s): 4 11 8 12 
datasample (without replace),  5 value(s): 3 10 6 12 11 
datasample (without replace),  6 value(s): 3 12 5 11 10 9 
datasample (without replace),  7 value(s): 2 10 4 9 8 11 7 
datasample (without replace),  8 value(s): 2 10 4 9 8 12 7 11 
datasample (without replace),  9 value(s): 2 9 4 12 7 11 6 10 8 
datasample (without replace), 10 value(s): 1 8 3 12 6 10 5 9 7 11 
datasample (without replace), 11 value(s): 1 7 12 11 5 9 4 8 6 10 2 
datasample (without replace), 12 value(s): 12 2 1 7 8 6 10 11 4 9 5 3 

2 个评论
显示无隐藏无

the cyclist 2023-2-26

移动：Image Analyst 2023-2-26

Nice catch on the algorithmic change! That at least explains the behavior, and confirms that it is not a bug (in the software development sense).

I'm not sure I love it, though.

Walter Roberson 2023-2-26

移动：the cyclist 2023-2-26

The algorithm for without replacement changes when 4*k > n

IIRC that is the point that the Fisher-Yates Shuffle stops being used.

That is, although the FY is pretty efficient, when you are asking to generate most or all of the available locations, then at some point it becomes more efficient to use the sort(rand()) algorithm, I gather.

请先登录，再进行评论。