- You are oversubscribing the number of actual compute cores in your machine. Each one of the extra workers is now consuming additional RAM, which still being bottlenecked by the number of compute cores for compute operations. So you may be consuming more resources than you really need to, and not getting any additional performance from doing so.
- You may actually make performance worse if your system has to use things like virtual memory/swap to support the extra workers, which can slow down system performance overall.
Qustions about number of workers in parpool
33 次查看(过去 30 天)
显示 更早的评论
I'm trying to extend the number of workers when using parpool (my computer has a total of 16 cores and 32 threads)
If I do:
parpool(17)
I recived an error message
If I change by;
myCluster = parcluster('local');
myCluster.NumWorkers=30;
myCluster.NumThreads=1;
parpool('local',30)
I can use now 30 workers. It is correct the way I'm changing the number of workers? Is there any danger doing in this form?
0 个评论
采纳的回答
Jason Ross
2021-6-9
The default for number of workers is set to the number of actual cores you have in the system, not threads. As you have found, it is overridable. This is one way to do it, the other ways are to set is as the default in Settings, or in the Local cluster profile.
Risks from doing this:
The default was set as a default based on the anticipation that most operations people would be doing with MATLAB were math-heavy and using the compute cores, and threads were not of much use.
0 个评论
更多回答(0 个)
另请参阅
类别
在 Help Center 和 File Exchange 中查找有关 Parallel Computing Fundamentals 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!