parallel computing fitness function inside parallel optimization
显示 更早的评论
I have a calculation intensive fitness function to optimize in genetic optimization.
I plan to use matlab parallel server with 10 compute nodes, each on has 24core. Can I run each objFunction parallel in GA and parallel in each nodes?
Following is example code and target
- 40 poulation,
- UseParallel On in GA options
- Can assign each objFuntion evaluation to indivadual 24core compute and use another parfor inside objFunction?
- Therefore, it allowed me run 10 parallel objFunction on 10 node. Each objfunction run parallel in each node.
Thanks
% parallel on and 40 population
options = optimoptions('UseParallel',true,'PopulationSize',40);
[x,fval,exitflag,output] = gamultiobj(@objFunction,20,[],[],[],[],lb,ub,options);
%% fitness function required to run parallel
function output = objFunction(x)
a = 1:10000;
output = zeros(1,numel(a));
parfor i = 1:numel(a)
output(i) = a(i) + mean(x);
end
end
采纳的回答
Walter Roberson
2023-8-29
1 个投票
Inside a parallel worker you can vectorize, but not run anything in parallel.
You would need to run multiple matlab sessions, each taking on part of the task.
5 个评论
Rui
2023-8-29
Walter Roberson
2023-8-29
See also MultiStart global optimizer -- you can run a number of different gamultiobj in parallel (but each one would not be able to use parfor in such a case.)
If you do use explicit parfor, remember that by default each worker only has access to a single core, and that slows down some vectorized calculations that would otherwise be able to automatically split their work between multiple cores. You can, however, deliberately create a profile with fewer workers each of which is permitted access to multiple cores.
Sam Marshalik
2023-8-31
Rui, can you expand a bit more on what you are looking to do and how you ultimately want to run your code on MATLAB Parallel Server?
There is some level of nested parallelization with MATLAB Parallel Server. By default, the NumThreads value in the cluster profile is set to 1. Meaning that your parallel workers have access only to a single thread. You can change NumThreads to a value > 1 and do the following:
- Run a multi-threaded function on my parallel worker. If you have code that is heavily multi-threaded, you can offload a single worker per machine and give each worker access to NumThreads = number of cores on that machine.
- You can also use "parpool("Threads")" to start a thread pool on a parallel worker and run parallel worklows there. The catch is that not everything can run in a threaded environment (we are expanding this with every release). For example:
>> c = parcluster('cluster');
>> c.NumThreads = 4; % I am using 4 as an example, you can set that to a number that is right for you
>> c.parpool(1)
>> spmd, parpool("Threads", 4), end
Worker 1:
Starting parallel pool (parpool) using the 'Threads' profile ...
Connected to parallel pool with 4 workers.
ans =
ThreadPool with properties:
NumWorkers: 4
Busy: false
Rui
2023-8-31
Sam Marshalik
2023-9-1
Hey Rui,
It is a bit tricky, but you can do this.
I first wanted to make sure that gamultiobj could run in a Threaded environment. I confirmed that it is possible by startung a local Thread Pool and running an example there. This means that a MATLAB Parallel Server process worker will be able to start a Threaded pool of workers and run the optimization problem in parallel using Threads.
The next question is how to actually offload this to the cluster. Can you let me know what scheduler you are using? Depending on what scheduler you are using the answer will be different.
I think using batch jobs will be a good way forward, like the below. Each batch job will start a single process worker and then start X number of Threads. The detail to be worked out is how to request the right resources from ths scheduler. You will want to ask for a total of X + 1 cores (1 for the MATLAB Parallel Server worker and X for the Threads).
c = parcluster('myCluster');
c.NumThreads = X;
batchJob = batch(p,@optimFunc, c.NumThreads)
function optimFunc(NumThreads)
parpool("Threads", NumThreads)
rng default % For reproducibility
M = diag([-1 -1]) + randn(2)/4; % Two problem variables
fun = @(x)[(x').^2 / 30 + M*x']; % Two objectives
intcon = 2;
lb = [0 0];
ub = [100 50];
options = optimoptions("gamultiobj","PlotFcn","gaplotpareto",...
"PopulationSize",100, 'UseParallel', true);
nvars = 2;
A = [];
b = [];
Aeq = [];
beq = [];
nonlcon = [];
[x,fval] = gamultiobj(fun,nvars,A,b,Aeq,beq,lb,ub,nonlcon,intcon,options);
end
更多回答（0 个）
类别
在 帮助中心 和 File Exchange 中查找有关 Third-Party Cluster Configuration 的更多信息
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!
Translated by 
