Actions

Running Jobs on HPC

From Montana Tech High Performance Computing

Revision as of 11:16, 22 September 2017 by Bdeng (talk | contribs) (Created page with "When you connect to hpc.mtech.edu, you will be logged into the "head" node, aka the "management" or "login" node. You can compile and test programs, submit jobs, and view resu...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

When you connect to hpc.mtech.edu, you will be logged into the "head" node, aka the "management" or "login" node. You can compile and test programs, submit jobs, and view results on the head node. Computationally intensive work should be done on the "compute" nodes. Jobs are assigned to the compute nodes through the Moab job scheduler. You can request a portion of a compute node, an entire node, or multiple nodes for distributed programs.

Primarily, there are two ways to run your jobs on the HPC:

  1. Running it interactively.
  2. Submitting it the hpc's job scheduler.

Both are done through the Moab commands. Below are just some basic examples, you can read more about Moab for detailed information.

Running an interactive job on compute nodes

After you are logged in, you will be at your home directory:

[YourUserName@scyld ~]$ ❚

You can do the following to start an interactive job

[YourUserName@scyld ~]$ msub -I

And you'll get similar output below:

qsub: waiting for job 4009.scyld.localdomain to start
qsub: job 4009.scyld.localdomain ready

[YourUserName@n0 ~]$❚

Note, the 4009 in the example above is just the job number, you'll get a different one. n0 is the name of a compute node. Depending on the cluster usage, you might get a different node, e.g. n2, n10, etc..

After the msub command, you'll notice 'scyld' changed into 'n0', which means you are now at compute node n0. One thing to note is that you'll be redirected to your home directory. You can now execute your calculations on the compute node.

Be default, the msub command in the example above will give your 1 process and 1 hour compute time. Again, refer to the Moab page for more options.

Submitting jobs to compute nodes

Loading a module