Why should I start a parallel pool manually?

2023 2 10
1 个回答
回答已采纳
更新时间：2023 2 11
10 次查看（30 天）

0 个投票

I want to run a parfor-loop. I can start a parallel pool "manually" with the command
parpool('local', 5);
but I can also directly start the loop with
parfor (i = 1:10, 5)
It is less code (and just as understandable) to use parfor directly. Are there advantages to starting (and then closing) the pool manually? If so, which?

请先登录，再回答此问题。

 采纳的回答

Walter Roberson
Walter Roberson 2023-2-10

0 个投票

Are you trying to measure how long the parallel portion of the code takes? Is it fair that the timing for the same code might be very different if the user just happens to run the code within half an hour of the previous parallel run, before the pool timed out?
When you create the pool manually (or use gcp to find a current pool if it exists) then you can be consistent about what you are measuring.
You also need the pool handle for some parallel constructs, such as parfeval to run a future on a cluster or to use background pool
Now suppose you want to retest with 6 pool members instead of 5. If you specified the size of the parfor call then you have to edit every such place.

3 个评论
显示 1更早的评论 隐藏 1更早的评论

Felix Müller
Felix Müller 2023-2-10
Ah, so if I were to run two of such loops back to back probably the second would be faster, because the pool is still open from the first loop? Good point!
parfeval is not used here, only one loop. Otherwise I do see the difference to be in the whole "parallel environment".
And finally I do use a variable for the number of cores to use anyway and just made it simpler for this example.
I'll wait a little if other answers come up but otherwise will accept your. Thanks either way!
Raymond Norris
Raymond Norris 2023-2-10
The way you're calling parfor, parpool doesn't honor the value 5. For example, I have a 4 core laptop. Notice, in both cases a pool of 4 workers start, regardless of the size of workers I want dedicated to the parfor-loop.
>> parfor (i = 1:10,2), rand; end
Starting parallel pool (parpool) using the 'Processes' profile ...
Connected to the parallel pool (number of workers: 4).
>> delete(gcp)
Parallel pool using the 'Processes' profile is shutting down.
>> parfor (i = 1:10,5), rand; end
Starting parallel pool (parpool) using the 'Processes' profile ...
Connected to the parallel pool (number of workers: 4).
Felix Müller
Felix Müller 2023-2-11
编辑：Felix Müller 2023-2-11
Hmm, okay. I have always opened a pool manually. I just found out about this other way and then wondered about the applications. Because I am only ever running one parfor loop only I thought it might be a better way to handle it (if there are no benefit opening a pool manually hence the question).
I got this info from the matlab documentation where it says
"parfor (loopvar = initval:endval, M); statements; end executes statements in a loop using a maximum of M workers or threads, where M is a nonnegative integer."
from https://de.mathworks.com/help/matlab/ref/parfor.html

请先登录，再进行评论。

更多回答（0 个）

类别

在 帮助中心 和 File Exchange 中查找有关 Parallel for-Loops (parfor) 的更多信息

产品

版本

R2020a

标签

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by