Key Points
What is High-Performance Computing?
- High-performance computing enables research that would be infeasible on personal computers
- HPC clusters combine many powerful nodes with fast networks and shared storage
- Sagehen is Pomona College’s HPC cluster, available at no cost to researchers
- SLURM is the job scheduler that manages fair resource allocation among all users
Why Use an HPC Cluster?
- Use HPC when your data is large, your computation is long, or you need specialized hardware
- Sagehen has 12 compute nodes (128 cores, 500 GB each) and multiple GPU nodes
- The head node is for login and job submission only; never run jobs there
- Different storage locations serve different purposes: home, lab, scratch, tmpfs
- Contact its-hpc@pomona.edu for help or to request higher resource limits
Connecting to Sagehen HPC
- SSH (Secure Shell) is the standard for securely connecting to remote computers
- macOS and Linux include SSH built-in; Windows users can use PowerShell or PuTTY
- DUO two-factor authentication is required; push notification is fastest
- OnDemand (https://ondemand.hpc.pomona.edu/) provides a graphical alternative to SSH
- Always log out when done with
exitor Ctrl+D
Files and Directories
- Use
mkdir -pto create nested directories in one command - Be extremely careful with
rm -rf; always list contents first - Organize work into logical directories: projects, code, data, results
- File permissions control read, write, and execute access for owner, group, and others
- Use
chmodto change permissions; share files via/bigdataor by adjusting group permissions
Cluster Architecture
- Partitions group nodes by hardware type and enforce time/resource limits
- Sagehen has three partitions:
amd(general purpose),gpu(GPU-accelerated), andshort(quick / test / debug jobs with a shorter walltime) - Each compute node has 128 AMD EPYC cores and 500 GB RAM
- GPU partition offers 10 GPUs: A100, L40S, and RTX PRO 6000
- Use
sinfoto check partition status, node states, and available resources - Maximum job time: 720 hours (30 days) on
amdandgpu; checksinfo -p shortfor theshortpartition limit
Understanding Nodes and Partitions
- Each Sagehen node has 128 cores and 500 GB RAM; SLURM allocates whole cores
- SLURM finds the best-fit nodes for your resource request automatically
- Use
gpufor GPU-accelerated work,shortfor quick test / debug jobs (shorter walltime), andamdfor general CPU production work - Request only the resources you need to avoid wasting shared capacity
- Contact its-hpc@pomona.edu if you need limits increased for a project
Software Modules Basics
- The module system solves software version conflicts on shared HPC clusters
- Sagehen uses Lmod with 90+ pre-installed packages
- Use
module availto search,module loadto activate,module purgeto reset - Only one version of each module family can be loaded at a time
- Always use
module purgeat the start of job scripts for reproducibility - Request new software at its-hpc@pomona.edu
Running Your First Job
- Batch jobs are scripts submitted with
sbatch; they run when resources are available - Every batch script needs
#!/bin/bashand SBATCH directives for resources - Key directives: –partition, –time, –cpus-per-task, –mem, –output
- Monitor jobs with
squeue -u $USER(running) orsacct(history) - Always use
module purgein job scripts for reproducibility - Test on the
shortpartition before submitting long production jobs toamdorgpu - Common failures: TIMEOUT (increase –time), OUT_OF_MEMORY (increase –mem)
Next Steps and Resources
- Use
srun --pty bashfor interactive compute sessions instead of running on the head node - Email notifications keep you informed about job completion and failures
- Customize
~/.bashrcfor a more productive login environment - Additional workshops cover SLURM advanced features, data transfer, security, and more
- Contact its-hpc@pomona.edu for help; include your username, job ID, and error messages
- Use
quota_check.sh(notdu) to check BeeGFS storage usage