CHTC Examples
This post prepares a few examples on running jobs on the Center for High Throughout Computing (CHTC) at UW-Madison.
I. Getting Started
- Request an account.
- Log in.
- Write two files: a submit file including submit information and a bash script to execuate your job.
- Submit your job.
- (Optional) Check your job and/or edit it.
II. Parallel Jobs
Example 1: Run Multiple Jobs
Suppose you wish to run 20 jobs, you may change the queue
in r_example.submit
to be queue 20
.
Example 2: Read Arguments from File
Suppose one wishes to read arguments from args.txt
in order to run an R file run.R
taking several input arguments.
Then we can modify the last line of the submit file so that it reads from the args.txt
. Remember to transfer both args.txt
and run.R
by setting transfer_input_files
.
We may also update the bash script so that it runs the run.R
file.
III. Environment
Docker Images
The CHTC supports using pulling docker images; see their documentation. In fact, all the examples above used a toy docker image I made from this dockerfile. You may find some toy examples for R and python from my earlier repo.
Installing Packages
There are official tutorials on running R, Julia, Python, and others on CHTC.