Is it possible to assign specific nodes in a batch job?

Question

Maria 2021-10-15

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1564331-is-it-possible-to-assign-specific-nodes-in-a-batch-job

编辑： Maria 2021-10-15

采纳的回答： Raymond Norris

Hi,

I have a remote cluster with 8 nodes, for a total of 32 workers.

When I send a batch job to the cluster, is it possible to send the job specifically to only 1 or some of the nodes?

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

Raymond Norris 2021-10-15

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/1564331-is-it-possible-to-assign-specific-nodes-in-a-batch-job#answer_809271

I'm gathering you're using the MATLAB job scheduler (MJS). If so, then no, MJS doesn't provide a way to specify which node(s) to run on. However, it's feasible to do this with other common schedulers (e.g. PBS). If you're not using MJS, post back which scheduler you're using and we can give you suggestions.

1 个评论
显示 -1更早的评论隐藏 -1更早的评论

Maria 2021-10-15

编辑：Maria 2021-10-15

I am using MJS, but good to know that other schedulers give more options. As a follow up question, with a MJS, can I at least decide which node will be used to run the batch script?

We are thinking about building an a-symmetric cluster. In fact, I noticed that, when I send batch job to the cluster, if the function I call in the batch initializes a big matrix (and I do not use "distributed" because I want to use parfor), this happens on node 1, and I see that only on node 1 the memory gets full.

If with MJS I cannot change this behavior (initialization of matrices in the first node), then we need to plan the cluster properly, meaning, having the first node with more memory than the others. Or, we change scheduler.

请先登录，再进行评论。