{"id":4110,"date":"2021-11-17T11:32:39","date_gmt":"2021-11-17T09:32:39","guid":{"rendered":"http:\/\/ucthpc.uct.ac.za\/?p=4110"},"modified":"2021-11-17T11:32:39","modified_gmt":"2021-11-17T09:32:39","slug":"uct-hpc-update-nov-2021","status":"publish","type":"post","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/","title":{"rendered":"UCT HPC update Nov 2021"},"content":{"rendered":"

Please let us know if you no longer require your HPC account or if you have acknowledged the use of the UCTHPC cluster in any publications recently. We rely on acknowledgements in order to motivate for new equipment.<\/p>\n

Processes on the head node:<\/strong><\/p>\n

By agreeing to the Acceptable Usage Policy you confirm that all work will be carried out on the worker nodes, not the head node. This includes such activities as un\\compressing data with tar or zip. Small amounts of work that take only a few seconds are fine, however running zip or unzip for an hour directly on the head node is not acceptable. Starting an interactive job on the cluster is quick and easy, see below.<\/p>\n

Interactive jobs:<\/strong><\/p>\n

There is a new interactive job wrapper. You can now run sintx, instead of sint to start an interactive job. If you only have access to one partition and need only a single core then running sintx with no arguments starts a new job immediately as long as there are free cores. If you have been granted access to more than one partition then you will have to specify the partition name. If you require more than one core for your interactive job then add the –ntasks=4 argument for example. In addition sintx sets up the DISPLAY environment variable automatically allowing you to export graphical displays<\/a> to your desktop. The older wrapper, sint, is still available.<\/p>\n

Example: user@hpc ~$ sintx\r\nStarting interactive job\r\nexporting DISPLAY to :137.158.123.1\r\nuser@srvcnthpc126 ~$ _\r\n...\r\nuser@srvcnthpc126 ~$ exit (when done)<\/pre>\n
Matlab:<\/strong><\/p>\n
The latest version of Matlab has been installed on the cluster, R2021B. To activate it type:<\/p>\n
module load software\/matlab-R2021b<\/pre>\n
New GPU cards:<\/strong><\/p>\n
We recently installed 8 Nvidia A100 cards. This was funded by several research groups as well as ICTS. The ICTS portion has been donated to the general pool of researchers and is available on request. You can read more about this here<\/a>.<\/p>\n
DASK (Parallel Python):<\/strong><\/p>\n
We have created a new Python module which incorporates DASK<\/a>. This allows one to scale Python jobs in true parallel fashion on the cluster. If you are using Numpy, Pandas, joblib, scikit etc this has the potential to greatly speed up your jobs but does come with a significant learning curve.<\/p>\n
Training:<\/strong><\/p>\n
Online training courses can be arranged in Teams or Zoom. The number of participants is limited to four at a time.<\/p>\n
VPN:<\/strong><\/p>\n
The UCT VPN was updated some months back. The maximum length of a VPN session is 12 hours. If you are running long term interactive jobs you should make use of the screen function<\/a>. Given the amount of load shedding that is occurring at the moment the use of screen could save you a great deal of inconvenience.<\/p>\n","protected":false},"excerpt":{"rendered":"
Please let us know if you no longer require your HPC account or if you have acknowledged the use of the UCTHPC cluster in any publications recently. We rely on acknowledgements in order to motivate for new equipment. Processes on the head node: By agreeing to the Acceptable Usage Policy you confirm that all work…<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"yoast_head":"\nUCT HPC update Nov 2021 - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"UCT HPC update Nov 2021 - UCT HPC\" \/>\n<meta property=\"og:description\" content=\"Please let us know if you no longer require your HPC account or if you have acknowledged the use of the UCTHPC cluster in any publications recently. We rely on acknowledgements in order to motivate for new equipment. Processes on the head node: By agreeing to the Acceptable Usage Policy you confirm that all work...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:published_time\" content=\"2021-11-17T09:32:39+00:00\" \/>\n<meta name=\"author\" content=\"Andrew Lewis\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andrew Lewis\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/\"},\"author\":{\"name\":\"Andrew Lewis\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\"},\"headline\":\"UCT HPC update Nov 2021\",\"datePublished\":\"2021-11-17T09:32:39+00:00\",\"dateModified\":\"2021-11-17T09:32:39+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/\"},\"wordCount\":438,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"articleSection\":[\"hpc\"],\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/\",\"name\":\"UCT HPC update Nov 2021 - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2021-11-17T09:32:39+00:00\",\"dateModified\":\"2021-11-17T09:32:39+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"UCT HPC update Nov 2021\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\",\"name\":\"Andrew Lewis\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"caption\":\"Andrew Lewis\"},\"sameAs\":[\"http:\/\/blogs.uct.ac.za\/blog\/big-bytes\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"UCT HPC update Nov 2021 - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/","og_locale":"en_US","og_type":"article","og_title":"UCT HPC update Nov 2021 - UCT HPC","og_description":"Please let us know if you no longer require your HPC account or if you have acknowledged the use of the UCTHPC cluster in any publications recently. We rely on acknowledgements in order to motivate for new equipment. Processes on the head node: By agreeing to the Acceptable Usage Policy you confirm that all work...","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/","og_site_name":"UCT HPC","article_published_time":"2021-11-17T09:32:39+00:00","author":"Andrew Lewis","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Andrew Lewis","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/#article","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/"},"author":{"name":"Andrew Lewis","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e"},"headline":"UCT HPC update Nov 2021","datePublished":"2021-11-17T09:32:39+00:00","dateModified":"2021-11-17T09:32:39+00:00","mainEntityOfPage":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/"},"wordCount":438,"commentCount":0,"publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"articleSection":["hpc"],"inLanguage":"en-ZA","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/","name":"UCT HPC update Nov 2021 - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2021-11-17T09:32:39+00:00","dateModified":"2021-11-17T09:32:39+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2021\/11\/17\/uct-hpc-update-nov-2021\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"UCT HPC update Nov 2021"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e","name":"Andrew Lewis","image":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","caption":"Andrew Lewis"},"sameAs":["http:\/\/blogs.uct.ac.za\/blog\/big-bytes"]}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/4110"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=4110"}],"version-history":[{"count":1,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/4110\/revisions"}],"predecessor-version":[{"id":4111,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/4110\/revisions\/4111"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=4110"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/categories?post=4110"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/tags?post=4110"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}