{"id":3544,"date":"2018-10-26T19:39:34","date_gmt":"2018-10-26T17:39:34","guid":{"rendered":"http:\/\/ucthpc.uct.ac.za\/?p=3544"},"modified":"2018-10-26T19:41:47","modified_gmt":"2018-10-26T17:41:47","slug":"testing-openmpi-on-our-new-infrastructure","status":"publish","type":"post","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/","title":{"rendered":"Testing OpenMPI on our new infrastructure"},"content":{"rendered":"<p>The result of a &#8220;data scatter&#8221; code test compiled with <a href=\"https:\/\/www.open-mpi.org\/\" target=\"_blank\" rel=\"noopener\">OpenMPI v3<\/a> and <a href=\"https:\/\/pmix.org\/\" target=\"_blank\" rel=\"noopener\">PMIx-3<\/a> and submitted to several nodes on our new cluster.\u00a0The transport layer is native infiniband and a transmission rate of 8000MB\/s is achieved (yes, we can&#8217;t get enough of that capital B) giving 64Gb\/s.<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2018\/10\/pmix.jpg\" \/><\/p>\n<p>PMI essentially allows sharing of messages between nodes without all the messy ssh key sharing of traditional clusters. PMIx is the exascale version of PMI because we have an EDR switch and that&#8217;s how we roll these days.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The result of a &#8220;data scatter&#8221; code test compiled with OpenMPI v3 and PMIx-3 and submitted to several nodes on our new cluster.\u00a0The transport layer is native infiniband and a transmission rate of 8000MB\/s is achieved (yes, we can&#8217;t get enough of that capital B) giving 64Gb\/s. PMI essentially allows sharing of messages between nodes&#8230;<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[24,10],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Testing OpenMPI on our new infrastructure - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Testing OpenMPI on our new infrastructure - UCT HPC\" \/>\n<meta property=\"og:description\" content=\"The result of a &#8220;data scatter&#8221; code test compiled with OpenMPI v3 and PMIx-3 and submitted to several nodes on our new cluster.\u00a0The transport layer is native infiniband and a transmission rate of 8000MB\/s is achieved (yes, we can&#8217;t get enough of that capital B) giving 64Gb\/s. PMI essentially allows sharing of messages between nodes...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:published_time\" content=\"2018-10-26T17:39:34+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2018-10-26T17:41:47+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2018\/10\/pmix.jpg\" \/>\n<meta name=\"author\" content=\"Andrew Lewis\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andrew Lewis\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/\"},\"author\":{\"name\":\"Andrew Lewis\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\"},\"headline\":\"Testing OpenMPI on our new infrastructure\",\"datePublished\":\"2018-10-26T17:39:34+00:00\",\"dateModified\":\"2018-10-26T17:41:47+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/\"},\"wordCount\":95,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"articleSection\":[\"Infiniband\",\"MPI\"],\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/\",\"name\":\"Testing OpenMPI on our new infrastructure - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2018-10-26T17:39:34+00:00\",\"dateModified\":\"2018-10-26T17:41:47+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Testing OpenMPI on our new infrastructure\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\",\"name\":\"Andrew Lewis\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"caption\":\"Andrew Lewis\"},\"sameAs\":[\"http:\/\/blogs.uct.ac.za\/blog\/big-bytes\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Testing OpenMPI on our new infrastructure - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/","og_locale":"en_US","og_type":"article","og_title":"Testing OpenMPI on our new infrastructure - UCT HPC","og_description":"The result of a &#8220;data scatter&#8221; code test compiled with OpenMPI v3 and PMIx-3 and submitted to several nodes on our new cluster.\u00a0The transport layer is native infiniband and a transmission rate of 8000MB\/s is achieved (yes, we can&#8217;t get enough of that capital B) giving 64Gb\/s. PMI essentially allows sharing of messages between nodes...","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/","og_site_name":"UCT HPC","article_published_time":"2018-10-26T17:39:34+00:00","article_modified_time":"2018-10-26T17:41:47+00:00","og_image":[{"url":"http:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2018\/10\/pmix.jpg"}],"author":"Andrew Lewis","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Andrew Lewis"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/#article","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/"},"author":{"name":"Andrew Lewis","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e"},"headline":"Testing OpenMPI on our new infrastructure","datePublished":"2018-10-26T17:39:34+00:00","dateModified":"2018-10-26T17:41:47+00:00","mainEntityOfPage":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/"},"wordCount":95,"commentCount":0,"publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"articleSection":["Infiniband","MPI"],"inLanguage":"en-ZA","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/","name":"Testing OpenMPI on our new infrastructure - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2018-10-26T17:39:34+00:00","dateModified":"2018-10-26T17:41:47+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2018\/10\/26\/testing-openmpi-on-our-new-infrastructure\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"Testing OpenMPI on our new infrastructure"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e","name":"Andrew Lewis","image":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","caption":"Andrew Lewis"},"sameAs":["http:\/\/blogs.uct.ac.za\/blog\/big-bytes"]}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/3544"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=3544"}],"version-history":[{"count":2,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/3544\/revisions"}],"predecessor-version":[{"id":3547,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/3544\/revisions\/3547"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=3544"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/categories?post=3544"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/tags?post=3544"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}