{"id":4158,"date":"2022-08-05T20:51:16","date_gmt":"2022-08-05T18:51:16","guid":{"rendered":"http:\/\/ucthpc.uct.ac.za\/?p=4158"},"modified":"2022-10-05T15:12:45","modified_gmt":"2022-10-05T13:12:45","slug":"new-hpc-cluster","status":"publish","type":"post","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/","title":{"rendered":"New HPC cluster"},"content":{"rendered":"<p>It&#8217;s been a while since the HPC cluster has had a major update. Over the last few weeks we&#8217;ve been planning and constructing a new test environment. One of the major issues on the horizon is the impending demise of Centos. Free, stable, robust and well supported, Centos was the OS of choice for many institutes and companies. We&#8217;ve spent the last year watching the development of its successor, <a href=\"https:\/\/rockylinux.org\/\">Rocky Linux<\/a>, and given the community support and development we have decided to base our new test cluster on this OS.<\/p>\n<p>We&#8217;ll be keeping SLURM as our scheduler as it is popular, well supported and reliable. Our version has lagged considerably and there are several bugs which the latest release addresses.<\/p>\n<p>In a recent test we submitted just over 60,000 jobs in 10 minutes. The jobs were real-world MPI tasks submitted by two test users to a variety of partitions, each job having wildly differing wall times in order to stress test the backfill algorithm. The scheduler had no difficulties in handling this load, nor did the backend database.<\/p>\n<pre><a ref=\"magnificPopup\" href=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/08\/newhpcjobs.jpg\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-4159 \" src=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/08\/newhpcjobs.jpg\" alt=\"\" width=\"173\" height=\"141\" \/><\/a>\r\nSubmitted jobs<\/pre>\n<pre><a ref=\"magnificPopup\" href=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/08\/NewhpcBFS.jpg\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-4160\" src=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/08\/NewhpcBFS.jpg\" width=\"171\" height=\"153\" \/><\/a>\r\nBackfill scheduler workload<\/pre>\n<p>In addition to the OS and scheduler the monitoring and reporting tools will be streamlined and updated.<\/p>\n<p>We do not yet have a timeline for the upgrade, however we&#8217;re looking at implementing the new cluster some time in 2023.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It&#8217;s been a while since the HPC cluster has had a major update. Over the last few weeks we&#8217;ve been planning and constructing a new test environment. One of the major issues on the horizon is the impending demise of Centos. Free, stable, robust and well supported, Centos was the OS of choice for many&#8230;<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[4,11,5],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>New HPC cluster - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"New HPC cluster - UCT HPC\" \/>\n<meta property=\"og:description\" content=\"It&#8217;s been a while since the HPC cluster has had a major update. Over the last few weeks we&#8217;ve been planning and constructing a new test environment. One of the major issues on the horizon is the impending demise of Centos. Free, stable, robust and well supported, Centos was the OS of choice for many...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:published_time\" content=\"2022-08-05T18:51:16+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-10-05T13:12:45+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/08\/newhpcjobs.jpg\" \/>\n<meta name=\"author\" content=\"Andrew Lewis\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andrew Lewis\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/\"},\"author\":{\"name\":\"Andrew Lewis\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\"},\"headline\":\"New HPC cluster\",\"datePublished\":\"2022-08-05T18:51:16+00:00\",\"dateModified\":\"2022-10-05T13:12:45+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/\"},\"wordCount\":217,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"articleSection\":[\"hpc\",\"operating system\",\"SLURM\"],\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/\",\"name\":\"New HPC cluster - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2022-08-05T18:51:16+00:00\",\"dateModified\":\"2022-10-05T13:12:45+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"New HPC cluster\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\",\"name\":\"Andrew Lewis\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"caption\":\"Andrew Lewis\"},\"sameAs\":[\"http:\/\/blogs.uct.ac.za\/blog\/big-bytes\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"New HPC cluster - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/","og_locale":"en_US","og_type":"article","og_title":"New HPC cluster - UCT HPC","og_description":"It&#8217;s been a while since the HPC cluster has had a major update. Over the last few weeks we&#8217;ve been planning and constructing a new test environment. One of the major issues on the horizon is the impending demise of Centos. Free, stable, robust and well supported, Centos was the OS of choice for many...","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/","og_site_name":"UCT HPC","article_published_time":"2022-08-05T18:51:16+00:00","article_modified_time":"2022-10-05T13:12:45+00:00","og_image":[{"url":"http:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/08\/newhpcjobs.jpg"}],"author":"Andrew Lewis","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Andrew Lewis","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/#article","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/"},"author":{"name":"Andrew Lewis","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e"},"headline":"New HPC cluster","datePublished":"2022-08-05T18:51:16+00:00","dateModified":"2022-10-05T13:12:45+00:00","mainEntityOfPage":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/"},"wordCount":217,"commentCount":0,"publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"articleSection":["hpc","operating system","SLURM"],"inLanguage":"en-ZA","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/","name":"New HPC cluster - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2022-08-05T18:51:16+00:00","dateModified":"2022-10-05T13:12:45+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/08\/05\/new-hpc-cluster\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"New HPC cluster"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e","name":"Andrew Lewis","image":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","caption":"Andrew Lewis"},"sameAs":["http:\/\/blogs.uct.ac.za\/blog\/big-bytes"]}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/4158"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=4158"}],"version-history":[{"count":4,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/4158\/revisions"}],"predecessor-version":[{"id":4365,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/4158\/revisions\/4365"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=4158"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/categories?post=4158"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/tags?post=4158"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}