why does parfor execute loops in a random order?

Question

Michael 2013-2-28

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/65350-why-does-parfor-execute-loops-in-a-random-order

I can't see any reason why, and if my PC crashes during a 20,000 loop iteration, it's a pain to figure out which iterations are still to be done.

Cheers Mike

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Jason Ross 2013-2-28

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/65350-why-does-parfor-execute-loops-in-a-random-order#answer_76882

Just to be clear -- parfor loops are of independent of iteration order, and do not guarantee deterministic results. It's not random.

The functional reason for this is if iteration 2 finishes before iteration 1 then iteration 3 can start work, and so on, since each iteration is independent of the other.

4 个评论
显示 2更早的评论隐藏 2更早的评论

Walter Roberson 2013-3-1

The choice of order for parfor() loops is best treated as being dependent on the exact version being used, and upon the number of iterations, and potentially upon information gathered from analyzing the loop. It is left up to MATLAB to do them in any order it feels is most efficient.

There are cases in which the most efficient order is to give each worker a "chunk" of iterations, with the chunk separation chosen so that the different iterations are not hitting the same cache line in the scheduling processor's memory. Whether or not parfor currently takes that level of detail into account, it could.

Different processors will potentially operate at slightly different speeds, or might get interrupted differently for devices they control, or might have "better luck" as to which parts of memory are in the operating system disk cache. So the order that iterations finish in is indeterminate, and the order of queueing for more work is indeterminate.

You should not be manually trying to figure out which iterations are still to be done: you should be building a "checkpoint" system.

Michael 2013-3-1

Thanks.

I suppose a vector of zeros (to be switched to 1's on completion) would automatically register which iterations are completed. It's not something I thought about before!

Jason Ross 2013-3-1

在 MATLAB Online 中打开

You might also want to investigate using the job/task interface, which gives you more control over the iterations and tracking down errors. A simple example:

c=parcluster();
alloutputs = [];
for ii=1:10
    job = c.createJob;
    for jj=1:10
        createTask(job,@rand, 1, {3,3});
    end
    job.submit;
    job.wait;
    outputs = job.fetchOutputs;
    alloutputs = [alloutputs ; outputs];
    disp(ii);
    job.destroy;
end

Note that things like preallocation, fancy formatting and error checking have been left out. Things that will likely be interesting to you:

The job object contains the Task ID of errors. You could use this information to know what failed.
You will likely need to figure out what work for you in terms of iteration display, number of tasks per job, dealing with the returns, etc.

请先登录，再进行评论。

why does parfor execute loops in a random order?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

采纳的回答

4 个评论
显示 2更早的评论隐藏 2更早的评论

更多回答（0 个）

另请参阅

类别

标签

产品

Community Treasure Hunt

why does parfor execute loops in a random order?

0 个评论 显示 -2更早的评论隐藏 -2更早的评论

采纳的回答

4 个评论 显示 2更早的评论隐藏 2更早的评论

更多回答（0 个）

另请参阅

类别

标签

产品

Community Treasure Hunt

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

4 个评论
显示 2更早的评论隐藏 2更早的评论