Open OnDemand Usage
3 minute read
What is OnDemand?
Open OnDemand allows users to access our cluster resources purely through a web browser. No additional client software is required. OnDemand gives users the ability to launch “Interactive Apps” such as Jupyter, RStudio, Matlab, Mathematica, and VSCode and connect to them through your browser.
User’s also have the ability to upload/download files to/from the cluster, connect to the cluster via SSH, and create batch job templates.
The sections below go over using OnDemand, as well as a couple pieces of popular software.
Accessing OnDemand
Our OnDemand instance is located here: https://ondemand.hpcc.ucr.edu/. Log in with your cluster login details and verify your login with Duo’s two-factor authentication.
Jupyter on OnDemand
After logging in, select “Jupyter Notebook” from the “Interactive Apps” tab from the menu bar.
From there, select the resources you need, time you want, partition to run the job on, and click “Launch”.
Your job will then be queued and eventually start running.
Click “Connect to Jupyter” to open a new window containing Jupyter and start working!
RStudio on OnDemand
The process of launching RStudio is almost identical to that of starting Jupyter, but selecting “RStudio Server” instead of “Jupyter Notebook” from the menu.
Please see the Jupyter section for selecting resources and opening the RStudio window.
Desktop Session on OnDemand
A Desktop session is a Virtual Desktop that is running on the cluster. It will allow you to run programs that require GUIs without going through the steps of forwarding X11 sessions.
Similar to Jupyter and RStudio, a Desktop Session can be started by selecting “HPCC Desktop” from the menu dropdown.
Please see the Jupyter section for selecting resources and opening the Desktop Window.
Using GPUs on OnDemand
In many of the interactive session launch pages, the “Additional Slurm Arguments” option is available.
To select a GPU, you can use the same --gres
argument as you would with the srun
command or in sbatch
scripts.
For example, to get 1x A100 GPU for a job, be sure to select the gpu
partition and enter --gres=gpu:a100:1
in the Additional SLurm Arguments box.
Troubleshooting Jobs
RStudio Crashes
If your RStudio session crashes with an error similar to the following, first try increasing the memory allocated to your job. If your R program attempts to allocate too much memory it will be killed by Slurm, causing an error similar to the one pictured.
To confirm whether or not this is the problem you are encountering:
- Copy the Job ID from OnDemand
- Delete the job (This will remove the dialog, so make sure you copy the JobID first)
- Using a terminal, run
sacct -j ####
If one of the job steps existed with the reason “OUT_OF_MEM”, then you need to allocate more memory to RStudio.