Editing plugin scripts for Generic scheduler

Question

Muh Alam 2022-3-11

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1669024-editing-plugin-scripts-for-generic-scheduler

评论： Muh Alam 2022-3-11

在 MATLAB Online 中打开

I have been trying to run simulations on a cluster using

batch()

function and/or using

parcluster

and I edited the plugin scripts that was provided by Mathworks at the time of downloading MPS with Slurm. I followed the instruction given here. However, none of the of the added sbtach options seem to work. My setup has a nonshared file cluster where I am trying to submit from Matlab client on Windows machine to a cluster running Linux nodes. I tried setting those options via 'EnvironmentVariables' in batch but that still does not work either.

So, how can I correctly add sbatch options to the jobs that I want to submit to the cluster?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Raymond Norris 2022-3-11

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1669024-editing-plugin-scripts-for-generic-scheduler#answer_915219

Can you post the MATLAB code you wrote to add the sbatch options? Setting EnvironmentVariables won't resolve this issue (sbatch won't pick them up).

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Muh Alam 2022-3-11

在 MATLAB Online 中打开

Sure! the code has this form: I tried by either editing the properties of the generic cluster using ResourceTemplate property and Additionalproperties property, or using batch with EnviromentVariables options.

c= parcluster('slurm_cluster');
% %edit the CJS cluster interface  to accept Slurm's sbatch options using ResourceTemplate property:
% c.ResourceTemplate = '--mincpus=^2^';
% c.ResourceTemplate = '- N=^10^';
% c.ResourceTemplate = '--mem-per-cpu=50G';
%then inside the script there is a parfor loop 
%or using batch():
myjob = batch(c,'script_to_run', 'AutoAddClientPath',false,...
    'EnvironmentVariables','SLURM_CPUS_ON_NODE = 4',...
    'EnvironmentVariables','SLURM_MEM_PER_CPU=15g',...
    'EnvironmentVariables','SLURM_NNODES=7'); 