How to check for number of vacant workers available in a parallel pool?

17 次查看（过去 30 天）
Viswanath Hariharan
回答： tommsch 2024-6-26
I have a branch and bound algorithm that needs to be executed in parallel. The main 'if' condition that I need to implement requires me to have the number of vacant workers available in the parallel pool. Numlabs returns total number of workers in the pool. But how to obtain the number of vacant workers available in the pool in both parfor and spmd blocks?
  2 个评论
Edric Ellis
Edric Ellis 2017-11-7
It's not clear to me quite what you're asking for here. At the MATLAB client, you can find out the total number of workers by getting the NumWorkers property of the parallel pool object returned by gcp. Both parfor and spmd execute synchronously - so from the client's perspective, either all workers are busy, or none are.
If you use instead parfeval, then the client is not blocked by the execution on the workers, and there you might want to find out how many workers are currently free. This can be inferred from the properties of the FevalQueue property of the parallel pool.
Viswanath Hariharan
Viswanath Hariharan 2017-11-7
Let's say I have 100 workers to use. I send problems in batches of 4 to be solved. The condition will be that if there are at least 4 workers available, I'll send the next batch of 4. Else I'll wait. What do you think I should be using to accomplish this?

请先登录，再进行评论。

请先登录，再回答此问题。

回答（1 个）

tommsch
tommsch 2024-6-26
I wrote a quick and dirty function, which returns whether there are workers available for a parfor loop. It can not return the number of workers available, nor do I know how well it works. You can find it on the File Exchange:
https://de.mathworks.com/matlabcentral/fileexchange/168896-can_execute_parfor

类别

在 Help Center 和 File Exchange 中查找有关 Parallel Computing Fundamentals 的更多信息

标签

产品

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by