Is it possible to assign specific nodes in a batch job?

3 views (last 30 days)
Hi,
I have a remote cluster with 8 nodes, for a total of 32 workers.
When I send a batch job to the cluster, is it possible to send the job specifically to only 1 or some of the nodes?

Accepted Answer

Raymond Norris
Raymond Norris on 15 Oct 2021
I'm gathering you're using the MATLAB job scheduler (MJS). If so, then no, MJS doesn't provide a way to specify which node(s) to run on. However, it's feasible to do this with other common schedulers (e.g. PBS). If you're not using MJS, post back which scheduler you're using and we can give you suggestions.
  1 Comment
Maria
Maria on 15 Oct 2021
Edited: Maria on 15 Oct 2021
I am using MJS, but good to know that other schedulers give more options. As a follow up question, with a MJS, can I at least decide which node will be used to run the batch script?
We are thinking about building an a-symmetric cluster. In fact, I noticed that, when I send batch job to the cluster, if the function I call in the batch initializes a big matrix (and I do not use "distributed" because I want to use parfor), this happens on node 1, and I see that only on node 1 the memory gets full.
If with MJS I cannot change this behavior (initialization of matrices in the first node), then we need to plan the cluster properly, meaning, having the first node with more memory than the others. Or, we change scheduler.

Sign in to comment.

More Answers (0)

Products


Release

R2021a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!