I want my 200 jobs to wait in a queue so that they occupy only 40 workers out of 100 workers in our cluster

2 次查看(过去 30 天)
We have a cluster with 100 workers in our lab, and I am allowed to use up to 40 workers. The problem is that I cannot submit more than 40 jobs at once, because those extra jobs will use the idle workers of my colleagues. How can I tell MATLAB job scheduler to limit my access to only 40 workers? I don’t think the solution is setting “NumWorkersRange” to [1 40].

采纳的回答

Edric Ellis
Edric Ellis 2015-4-30
If you're using an MJS cluster, then NumWorkersRange on a single independent job is the way to do this. You'll need multiple createTask calls, a bit like this:
c = parcluster(...);
j = createJob(c, 'NumWorkersRange', [1 40]);
for idx = 1:N
createTask(j, @myFcn, numOutputArgs, {inputArgs, ...});
end
submit(j);

更多回答(0 个)

类别

Help CenterFile Exchange 中查找有关 MATLAB Parallel Server 的更多信息

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by