what is the difference between running backgroundPool and parpool ('Threads') using a parfeval？

2023 11 25
1 个回答
更新时间：2023 11 27
15 次查看（30 天）

0 个投票

parpool('Threads')
delete(gcp('nocreate'))
pool=parpool('Threads')
f(1:8) = parallel.FevalFuture;
for i = 1:8
f(i) = parfeval(pool, @task, 1, i, 'parpool');
end
afterEach(f, @disp, 0);
function output = task(taskID,poolType)
pause(5);
output = sprintf('Task %d is done in %s at %s', taskID, poolType,datetime('now'));
end
backgroundPool
b(1:8) = parallel.FevalFuture;
for i = 1:8
b(i) = parfeval(backgroundPool, @task, 1, i, 'backgroundPool');
end
afterEach(b, @disp, 0);
function output = task(taskID,poolType)
pause(5);
output = sprintf('Task %d is done in %s at %s', taskID, poolType,datetime('now'));
end
I don't think there's any difference between them

请先登录，再回答此问题。

回答（1 个）

Walter Roberson
Walter Roberson 2023-11-25

0 个投票

"Pools created using parpool('Threads') and backgroundPool are both thread-based pools which utilize the same resources. It is possible that activity on one pool may block activity on the other and vice versa. Additionally, persistent data and random number generation stream state are shared in between these pools."
Unfortunately that talks more about the similarities than the differences. The differences are more difficult to find documentation on.
Background pools only support parfeval and parfevalOnAll but do not need the Parallel Computing Toolbox
Thread pools support additional constructs including parfor, but requires the Parallel Computing Toolbox
I do not know if there are any MATLAB functions that support one but not the other

3 个评论
显示 1更早的评论 隐藏 1更早的评论

Edric Ellis
Edric Ellis 2023-11-27
Function support should be identical on both types of pool. The main other difference I think is that the backgroundPool always exists - it does not need to be created like a parpool pool.
It is possible, but not useful, to use this syntax to run parfor on backgroundPool:
parfor (i = 1:10, backgroundPool)
out(i) = 7;
end
Jixiong Su
Jixiong Su 2023-11-27
@Edric Ellis Thanks! However, I have another question.
My computer has 8 cores.
* The 8 process-based parallel pools and 8 background pools have all completed their tasks simultaneously.
delete(gcp('nocreate'))
pool=parpool('Processes')
% Asynchronously execute multiple tasks in the parallel pool
f(1:8) = parallel.FevalFuture;
for i = 1:8
f(i) = parfeval(pool, @task, 1, i, 'parpool'); % Call the task function with parameter i and perform parallel computation
end
afterEach(f, @disp, 0);
b(1:8) = parallel.FevalFuture;
for i = 1:8
b(i) = parfeval(backgroundPool, @task, 1, i, 'backgroundPool'); % Call the task function with parameter i and perform background computation
end
afterEach(b, @disp, 0);
function output = task(taskID,poolType)
pause(5);
output = sprintf('Task %d is done in %s at %s', taskID, poolType,datetime('now'));
end
Output:
Task 4 is done in parpool at 2023-11-25 11:41:46
Task 2 is done in parpool at 2023-11-25 11:41:46
Task 3 is done in parpool at 2023-11-25 11:41:46
Task 5 is done in parpool at 2023-11-25 11:41:46
Task 8 is done in parpool at 2023-11-25 11:41:46
Task 6 is done in parpool at 2023-11-25 11:41:46
Task 1 is done in parpool at 2023-11-25 11:41:46
Task 7 is done in parpool at 2023-11-25 11:41:46
Task 1 is done in backgroundPool at 2023-11-25 11:41:46
Task 7 is done in backgroundPool at 2023-11-25 11:41:46
Task 5 is done in backgroundPool at 2023-11-25 11:41:46
Task 2 is done in backgroundPool at 2023-11-25 11:41:46
Task 6 is done in backgroundPool at 2023-11-25 11:41:46
Task 3 is done in backgroundPool at 2023-11-25 11:41:46
Task 4 is done in backgroundPool at 2023-11-25 11:41:46
Task 8 is done in backgroundPool at 2023-11-25 11:41:46
The 8 thread-based parallel pools and 8 background pools are running simultaneously. The background pool can only grab one thread, and it can only use other threads to execute tasks after all tasks in the thread-based parallel pool are completed.
Why can backgroundPool still run in the background when eight threads are full?
delete(gcp('nocreate'))
pool=parpool('Threads')
% Asynchronously execute multiple tasks in the parallel pool
f(1:8) = parallel.FevalFuture;
for i = 1:8
f(i) = parfeval(pool, @task, 1, i, 'parpool'); % Call the task function with parameter i and perform parallel computation
end
afterEach(f, @disp, 0);
b(1:8) = parallel.FevalFuture;
for i = 1:8
b(i) = parfeval(backgroundPool, @task, 1, i, 'backgroundPool'); % Call the task function with parameter i and perform background computation
end
afterEach(b, @disp, 0);
function output = task(taskID,poolType)
pause(5);
output = sprintf('Task %d is done in %s at %s', taskID, poolType,datetime('now'));
end
Output:
Task 7 is done in parpool at 2023-11-25 11:48:19
Task 6 is done in parpool at 2023-11-25 11:48:19
Task 3 is done in parpool at 2023-11-25 11:48:19
Task 4 is done in parpool at 2023-11-25 11:48:19
Task 8 is done in parpool at 2023-11-25 11:48:19
Task 2 is done in parpool at 2023-11-25 11:48:19
Task 5 is done in parpool at 2023-11-25 11:48:19
Task 1 is done in backgroundPool at 2023-11-25 11:48:19
Task 1 is done in parpool at 2023-11-25 11:48:19
Task 2 is done in backgroundPool at 2023-11-25 11:48:24
Task 3 is done in backgroundPool at 2023-11-25 11:48:24
Task 7 is done in backgroundPool at 2023-11-25 11:48:24
Task 8 is done in backgroundPool at 2023-11-25 11:48:24
Task 5 is done in backgroundPool at 2023-11-25 11:48:24
Task 4 is done in backgroundPool at 2023-11-25 11:48:24
Task 6 is done in backgroundPool at 2023-11-25 11:48:24
Edric Ellis
Edric Ellis 2023-11-27
Basically, although the pools share resources, they each have some exclusive resources to ensure that progress is never completely blocked by activity on the other pool.

请先登录，再进行评论。

类别

在 帮助中心 和 File Exchange 中查找有关 Parallel Computing Fundamentals 的更多信息

产品

版本

R2023b

标签

提问:

Jixiong Su
Jixiong Su
2023-11-25

评论：

Edric Ellis
Edric Ellis
2023-11-27

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by