How do MATLAB workers/PC cores divide the work in a parallelized optimization inside a parfor loop?

Question

Mitsu 2020-8-21

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/582512-how-do-matlab-workers-pc-cores-divide-the-work-in-a-parallelized-optimization-inside-a-parfor-loop

评论： Mitsu 2020-8-22

For example:

parfor i = 1:20
    options = optimoptions('ga','UseParallel',true,'UseVectorized',false);
    x = gamultiobj(ObjectiveFunction,[],options);
end

Let's say there are 10 workers, and we are running the optimization algorithm with parallelization within a parallelized parfor loop.

Although my sample is not large, I have noticed that this is faster than using a simple for loop.

According to MATLAB docs, a parfor inside a parfor does not work. Yet this combination (which in the end is a parfor inside a parfor, I guess) does work.

Thus, my questions are:

How do workers divide the work? I notice that the first 10 loop cases are started at the same time, but do the workers then stop their loop iteration and help out whichever started the gamultiobj first?
Assuming "n" workers, do the parfor and for approaches deliver the same performance when num of cases >> n?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Raymond Norris 2020-8-21

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/582512-how-do-matlab-workers-pc-cores-divide-the-work-in-a-parallelized-optimization-inside-a-parfor-loop#answer_483095

在 MATLAB Online 中打开

Hi Taro,

Do you want to run gamultiobj 20 (in this example) times? If so, then parfor will run quicker than for. However, the parellel for loop you've written will negate the parallel for loop that is running in the optimization algorthim.

I suspect you simple need to call

    options = optimoptions('ga','UseParallel',true,'UseVectorized',false);
    x = gamultiobj(ObjectiveFunction,[],options);

And let the inner parallel for loop do its work.

Raymond

3 个评论
显示 1更早的评论隐藏 1更早的评论

Raymond Norris 2020-8-21

在 MATLAB Online 中打开

Good question, Taro. Ideally, you want the outter loop to be given the most amount of work. Therefore, generally speaking, the outter loop would be re-written as a parfor. But take the following example

p = parpool(2);
parfor idx = 1:2
    do some work
    parfor jdx = 1:1000
        do some other work
    end
end
p.delete

If I'm working on a 8- or 16-core machine, I might re-write the inner for loop as a parallel for loop. That's because even with 8 or 16 cores, I'm only using 2 cores for the parallel pool (threading aside). It might make more sense then to dedicate the cores to the inner loop instead of the outer loop.

Best to run this in the Profiler to see how it works for you.

Raymond

Mitsu 2020-8-22

Got it. I take that as a general rule, if the outer loop has more cases than number of workers, it makes sense to use an outer parfor loop; otherwise keep only the inner parfor (inside the optimization).

Thanks!

请先登录，再进行评论。