Parallel pool sizing for a parfor loop
显示 更早的评论
I run a parfor loop on an 8 cores workstation.
This loop is parfor i = 1:10 and the work in each iteration is substantial.
MATLAB automatically creates 8 workers.
Assuming that each iteration takes about the same time to complete, is this highly inefficient? I'm thinking that the 8 cores finish at about the same time, and then only 2 are assigned to the remaining 2 iterations.
Then again, I don't really understand the idea of parallel pools. How would I optimise the size?
1 个评论
Brendan Hamm
2016-9-15
Theoretically with nothing running on the machine these should finish "about the same time" if every iteration runs exactly the same (i.e. no branching with if statements etc.). However, your computer has other stuff running on it as well which will take some cpu time here and there for other processes. MATLAB does not block the use of these to other processes. So, I would conclude with don't worry if the last iteration only has 2 workers being used, the others are still available.
采纳的回答
Matt J
2016-9-16
0 个投票
Based on my own personal experience, the choice of the parpool size can be optimized only through experimentation. I have found that too many workers can be as counter-productive as too few, even when the selected pool size doesn't exceed the number of physical cores. There is an optimal middle ground that only experimentation allowed me to find.
Granted, this was a few years and a few MATLAB versions ago, and may have been a platform-dependent thing anyway... To be honest, I'm a bit surprised to hear that people still use parfor, given the time needed to launch a parpool. I use gpuArray all the time, but starting a parpool takes as long as most of the jobs I would like to accelerate.
更多回答（0 个）
类别
在 帮助中心 和 File Exchange 中查找有关 Parallel for-Loops (parfor) 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
Translated by 
