{"id":4051,"date":"2021-08-25T21:24:15","date_gmt":"2021-08-25T19:24:15","guid":{"rendered":"http:\/\/ucthpc.uct.ac.za\/?page_id=4051"},"modified":"2026-03-27T10:47:09","modified_gmt":"2026-03-27T08:47:09","slug":"gpu-partition","status":"publish","type":"page","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/","title":{"rendered":"GPU partition"},"content":{"rendered":"
\r\n\t
\r\n\t\t
\r\n\t\t\t

If you intend submitting jobs to the GPU partitions you need to read this entire document carefully or your jobs will not run.<\/p>\n

GPU access is not granted by default.\u00a0 If you require GPU access you will need to send a motivation via email to the HPC admins with your supervisor in CC.<\/p>\n

How to submit jobs<\/strong><\/h5>\n

There are several GPU partitions. Each is made up of several worker nodes and each worker node has four GPU cards. You need to let the scheduler know that you require a GPU resource. This is done via the generic resource (gres) tag. The format is type:label:quantity.\u00a0 The type for the gres is gpu, the label is the model of GPU card you have access to, and quantity is how many cards you require.\u00a0 For example to reserve a L40S card use:<\/p>\n

--gres=gpu:l40s:1<\/pre>\n
In addition you will need to set the account directive which is not the same as your default account.\u00a0 This account name will be sent to you when you are granted access to the GPU resources and it will also be embedded in the gpu-example-script.sh file in your home folder.<\/p>\n
Please do not reserve more than 1 GPU card per job unless you know for an absolute certainty that your code is capable of running on more than one GPU card simultaneously.<\/strong><\/span><\/p>\n
Example<\/strong><\/h5>\n
Via batch queue:<\/p>\n
#SBATCH --partition=a100\r\n#SBATCH --gres=gpu:ampere:1\r\n#SBATCH --account=mygpugroup\r\n#SBATCH --ntasks=2<\/pre>\n
Via interactive:<\/p>\n
sintx --partition=a100 --account=mygpugroup --ntasks=2 --gres=gpu:ampere:1<\/pre>\n
In the above examples the text mygpugroup<\/em> must be replaced by the GPU group you were granted access to. This is not your user account.\u00a0 Please do not submit jobs to the GPU queue without a gres directive.<\/p>\n\n\n\n\n\t\n\n\t\n\t\n\t\n\t\n\t\n\t\n\t\n\t\n\t\n\t\n\t
Server<\/th>Partition<\/th>Cards<\/th>Card Type<\/th>gres<\/th>Precision<\/th>Groups<\/th>\n<\/tr>\n<\/thead>\n
srvrocgpu005<\/td>gpumk<\/td>4<\/td>P100<\/td>gpumk<\/td>Double<\/td>Compsci vaccine<\/td>\n<\/tr>\n
srvrocgpu006<\/td>gpumk<\/td>4<\/td>P100<\/td>gpumk<\/td>Double<\/td>Compsci vaccine<\/td>\n<\/tr>\n
srvrocgpu007<\/td>gpumk<\/td>4<\/td>P100<\/td>gpumk<\/td>Double<\/td>Compsci vaccine<\/td>\n<\/tr>\n
srvrocgpu008<\/td>gpumk<\/td>4<\/td>P100<\/td>gpumk<\/td>Double<\/td>Compsci vaccine<\/td>\n<\/tr>\n
srvrocgpu009<\/td>a100<\/td>4<\/td>A100-40<\/td>amperemk<\/td>Double<\/td>Compsci vaccine<\/td>\n<\/tr>\n
srvrocgpu010<\/td>a100<\/td>4<\/td>A100-40<\/td>ampere<\/td>Double<\/td>a100free, aru<\/td>\n<\/tr>\n
srvrocgpu011<\/td>a100<\/td>4<\/td>A100-80<\/td>ampere80<\/td>Double<\/td>Compsci NLP, uct-cern<\/td>\n<\/tr>\n
srvrocgpu012<\/td>l40s<\/td>4<\/td>L40S<\/td>l40s<\/td>Single<\/td>l40sfree  l40sugrd acsl<\/td>\n<\/tr>\n
srvrocgpu013<\/td>l40s<\/td>4<\/td>L40S<\/td>l40s<\/td>Single<\/td>l40sfree  l40sugrd acsl<\/td>\n<\/tr>\n
srvrocgpu014<\/td>l40s<\/td>4<\/td>L40S<\/td>l40s<\/td>Single<\/td>l40sfree  l40sugrd acsl<\/td>\n<\/tr>\n
srvrocgpu015<\/td>l40s<\/td>4<\/td>L40S<\/td>l40s<\/td>Single<\/td>l40sfree  l40sugrd acsl<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n\n
Graphs and monitoring:<\/strong><\/h5>\n
Feedback is important to determine how well your job is running. You can use qstat<\/strong> to list the queue but on the head node you may use the gpuqueue<\/strong> command to determine where your GPU job is running and also which instance it is utilizing<\/p>\n
The HPC dashboard displays the GPU utilization percentage.\u00a0 The dashboard is updated once every minute.<\/p>\n
There are graphs<\/a> available which update once every minute.<\/p>\n
Who may apply for access to these servers?<\/strong><\/h5>\n
Groups from the Science and Engineering faculties contributed heavily to the cost of this resource. Members of these groups are granted access to resources proportional to their contribution, these levels being set by a committee of system owners.\u00a0 If you are a member of one of these groups you may apply for access by emailing the administrators and copying your supervisor.<\/p>\n
ICTS contributed to the cost of several of the A100 and L40S cards and has ‘donated’ these instances to the general pool of researchers free of charge. However this pool is limited in the type and number of instances available, the wall time as well as the number of jobs that can be queued at any one time.\u00a0 To access either the a100free or l40sfree partitions please email the administrators.<\/p>\n
Will more servers like these be purchased?<\/strong><\/h5>\n
The costs of these servers are understandably higher than the average research group can afford. We would strongly encourage research groups to pool their resources in order to share the cost of these servers\\cards. The money would then be transferred to ICTS who would purchase the server. The servers are housed in the UCT data center and are administered by the HPC staff who are also responsible for any repairs or replacements that may be required.\u00a0 HPC staff members can also facilitate the discussions around purchase and resource sharing.<\/p>\n\r\n\t\t<\/div>\r\n\t<\/div>\r\n<\/div><\/div><\/div><\/div><\/div><\/section>\n","protected":false},"excerpt":{"rendered":"If you intend submitting jobs to the GPU partitions you need to read this entire document carefully or your jobs will not run. GPU access is not granted by default.\u00a0 If you require GPU access you will need to send a motivation via email to the HPC admins with your supervisor in CC. How to...","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"yoast_head":"\nGPU partition - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"GPU partition - UCT HPC\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:modified_time\" content=\"2026-03-27T08:47:09+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/\",\"name\":\"GPU partition - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2021-08-25T19:24:15+00:00\",\"dateModified\":\"2026-03-27T08:47:09+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"GPU partition\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"GPU partition - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/","og_locale":"en_US","og_type":"article","og_title":"GPU partition - UCT HPC","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/","og_site_name":"UCT HPC","article_modified_time":"2026-03-27T08:47:09+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/","name":"GPU partition - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2021-08-25T19:24:15+00:00","dateModified":"2026-03-27T08:47:09+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/gpu-partition\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"GPU partition"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/pages\/4051"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=4051"}],"version-history":[{"count":36,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/pages\/4051\/revisions"}],"predecessor-version":[{"id":5077,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/pages\/4051\/revisions\/5077"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=4051"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}