Ctrl+K

NVIDIA CUDA Toolkit

NVIDIA CUDA Toolkit#

Versions Installed

Kay: 10 / 10.1.243 / 11.2 / 11.3 / 11.4

LXP: 11.7 / 12.1.1 / 12.2.0

Description#

The NVIDIA CUDA Toolkit provides command-line and graphical tools for building, debugging and optimizing the performance of applications accelerated by NVIDIA GPUs, runtime and math libraries, and documentation including programming guides, user manuals, and API references.

License#

The CUDA toolkit is available under the CUDA Toolkit End User License Agreement (see CUDA Toolkit documentation).

Benchmarks#

N/A

Job Submission Example#

Like other jobs on ICHEC systems, CUDA Toolkit jobs must be submitted using a Slurm submission script. The following is an example Slurm submission script for allocating 1 node of Kay (40 cores) for 30 minutes, then running a CUDA-compiled tutorial program matmul, which multiplies large matrices using gpu acceleration.  Since CUDA takes advantage only of gpus, all CUDA jobs must be submitted to the GpuQ on Kay, and gpu on Meluxina.

On Kay we have two GPUs per node, while on Meluxina, gpu nodes have 4 GPUs. Below scripts are for example purpose only. On production runs, to utilise the resource fully, either run a code that can parallelize on multiple GPUs, or alternatively taskfarm so that all the GPUs are utilized.

On Kay#

Load the desired version of the toolkit module:

version=11.4
module load cuda/$version

Following the ICHEC tutorial, we compile the CUDA source file matmul.cu using nvcc as follows:

nvcc matmul.cu -o matmul -arch=sm_70 -O3

Create the submission script (and name it myjob.sh) for the SLURM Workload Manager and modify it with your parameters

#!/bin/sh
#SBATCH -p GpuQ
#SBATCH -N 1
#SBATCH -t 00:30:00
#SBATCH --job-name=myjobname
# Charge job to myproject
#SBATCH -A myproject
# Write stdout+stderr to file
#SBATCH -o output.txt
# Mail me on job start & end
#SBATCH --mail-user=myemailaddress@universityname.ie
#SBATCH --mail-type=BEGIN,END

cd $SLURM_SUBMIT_DIR

# Load the module for the specific version
version=11.4
module load cuda/$version

./matmul 10000

Submit the job with the following command

sbatch myjob.sh

On Meluxina#

Load the desired version of the toolkit module:

version=12.1.1
module load CUDA/$version

Following the ICHEC tutorial, we compile the CUDA source file matmul.cu using nvcc as follows:

nvcc matmul.cu -o matmul -arch=sm_70 -O3

Create the submission script (and name it myjob.sh) for the SLURM Workload Manager and modify it with your parameters

#!/bin/sh -l
#SBATCH -p gpu
#SBATCH --qos default
#SBATCH -N 1
#SBATCH -t 00:30:00
#SBATCH --job-name=myjobname
# Charge job to myproject
#SBATCH -A myproject
# Write stdout+stderr to file
#SBATCH -o output.txt
# Mail me on job start & end
#SBATCH --mail-user=myemailaddress@universityname.ie
#SBATCH --mail-type=BEGIN,END

cd $SLURM_SUBMIT_DIR

# Load the module for the specific version
version=12.1.1
module load CUDA/$version

./matmul 10000

Submit the job with the following command

sbatch myjob.sh

Additional Notes#

Further information can be obtained from the CUDA Toolkit website.

Contents