{"id":871,"date":"2013-01-22T10:57:25","date_gmt":"2013-01-22T08:57:25","guid":{"rendered":"http:\/\/oldblogs.uct.ac.za\/blog\/big-bytes\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi"},"modified":"2015-08-14T11:50:08","modified_gmt":"2015-08-14T09:50:08","slug":"supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi","status":"publish","type":"post","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/","title":{"rendered":"SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI"},"content":{"rendered":"<p style=\"margin-bottom: 0cm;\">For the past couple of days we have been\r\nbusy with setting up and configuring x2 SuperMicro GPU servers 2U\r\nwhich consists of x4 Fermi Nvidia M2090 cards per server. Coupled with that\r\nwe installed a Mellanox Infiniband SX6036 externally managed switch\r\nwith Mellanox ConnectX-3 VPI HCA adapters in each server. The infiniband drivers used was from\r\nthe <a title=\"OpenFabrics\" href=\"http:\/\/www.openfabrics.org\/\">OpenFrabics<\/a> distribution OFED 1.5.4.1 which has support for Linux Kernel v3.<\/p>\r\n<p style=\"margin-bottom: 0cm;\">I would like to document my findings\r\nabout setting up OFED on both Scientific Linux 5.8 and SLES 11.<\/p>\r\n<p style=\"margin-bottom: 0cm;\"><strong>Installation of OFED under SL 5.8 (\r\nRHEL 5.8 ) <\/strong><\/p>\r\n<p style=\"margin-bottom: 0cm;\">This was by far the most time consuming\r\nprocess for any troubleshooting exercise I have executed to date.\r\nBegin the installation by executing the .\/install script and select\r\nthe preferred option. The first thing to compile is the kernel-ib and\r\nkernel-devel. These will break. It should terminate with a error\r\ndisplayed below.<\/p>\r\n<p style=\"margin-bottom: 0cm;\"><strong> pci.h:164: error: conflicting\r\ntypes for 'pci_pcie_cap OFED<\/strong><\/p>\r\n<p style=\"margin-bottom: 0cm;\">OpenFrabics do not have a fix for it on\r\ntheir website from what we could see and decided to tinker around a\r\nbit. We found a developer hiding deep in the search archives of\r\ngoogle who had made modifications to the source RPM of the\r\nOFED-1.5.4.1 OFA kernel. The fix is as follows:<\/p>\r\n<p style=\"margin-bottom: 0cm;\">1. tar xfvz OFED-1.5.4.1.tgz<\/p>\r\n<p style=\"margin-bottom: 0cm;\">2. Change directory into the extracted\r\nOFED-1.5.4.1\/SRPMS<\/p>\r\n<p style=\"margin-bottom: 0cm;\">3. Download the modified version from\r\nhere -\r\n<a href=\"http:\/\/troels.arvin.dk\/code\/ofa_kernel\/rhel5.8-enablement\/modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm\">http:\/\/troels.arvin.dk\/code\/ofa_kernel\/rhel5.8-enablement\/modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm<\/a>\r\nand rename from <a href=\"http:\/\/troels.arvin.dk\/code\/ofa_kernel\/rhel5.8-enablement\/modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm\">modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm<\/a>\r\nto <a href=\"http:\/\/troels.arvin.dk\/code\/ofa_kernel\/rhel5.8-enablement\/modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm\">ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm<\/a>.\r\nDo not forget to backup the current file, although you can retrieve\r\nit from the tar.gz.<\/p>\r\n<p style=\"margin-bottom: 0cm;\">4. Re-run the install script and you\r\nshould be good.<\/p>\r\n<p style=\"margin-bottom: 0cm;\">You might also stumble across a compile\r\nerror of one of the networking modules from iWARP named \u201c cxgb3 and\r\ncxgb4 \u201c. I do not have these devices present so I can disable them\r\nfrom being compiled and causing the error. Disable the option in\r\nofed.conf . This file is created during the first run of the\r\ninstallation script. You can also find a sample copy of in the docs\/\r\nfolder. Edit the file, find the driver in the list and set the value\r\nto \u201cn\u201d. Re-run the installation script.<\/p>\r\n<p style=\"margin-bottom: 0cm;\">The above issue with the \u201c cxgb3 and\r\ncxgb4 \u201c modules occurred on SLES 11 as well. Do not disable the\r\nkernel-ib and kernel-devel modules from being compiled as if you\r\ndisable these will not provide you with all the init scripts and\r\ncorrect kernel modules.<\/p>","protected":false},"excerpt":{"rendered":"<p>For the past couple of days we have been<br \/>\nbusy with setting up and configuring x2 SuperMicro GPU servers 2U<br \/>\nwhich consists of x4 Fermi Nvidia M2090 cards per server. Coupled with that<br \/>\nwe installed a Mellanox Infiniband SX6036 externally managed switch<br \/>\nwith Mellanox ConnectX-3 VPI HCA adapters in each server. The infiniband drivers used was from<br \/>\nthe <a href=\"http:\/\/www.openfabrics.org\/\" title=\"OpenFabrics\">OpenFrabics<\/a> distribution OFED 1.5.4.1 which has support for Linux Kernel v3. <\/p>\n<p>I would like to document my findings<br \/>\nabout setting up OFED on both Scientific Linux 5.8 and SLES 11. <\/p>\n<p><strong>Installation of OFED under SL 5.8 (<br \/>\nRHEL 5.8 ) <\/strong>\n<\/p>\n<p>This was by far the most time consuming<br \/>\nprocess for any troubleshooting exercise I have executed to date.<br \/>\nBegin the installation by executing the .\/install script and select<br \/>\nthe preferred option. The first thing to compile is the kernel-ib and<br \/>\nkernel-devel. These will break. It should terminate with a error<br \/>\ndisplayed below.\n<\/p>\n<p><strong>\t\t<\/strong><\/p>\n<p><strong>\t\tpci.h:164: error: conflicting<br \/>\ntypes for &#8216;pci_pcie_cap OFED<\/strong><\/p>\n<p>OpenFrabics do not have a fix for it on<br \/>\ntheir website from what we could see and decided to tinker around a<br \/>\nbit. We found a developer hiding deep in the search archives of<br \/>\ngoogle who had made modifications to the source RPM of the<br \/>\nOFED-1.5.4.1 OFA kernel. The fix is as follows:\n<\/p>\n<p><\/p>\n<p>1. tar xfvz OFED-1.5.4.1.tgz<\/p>\n<p>2. Change directory into the extracted<br \/>\nOFED-1.5.4.1\/SRPMS<\/p>\n<p>3. Download the modified version from<br \/>\nhere &#8211;<br \/>\n<a href=\"http:\/\/troels.arvin.dk\/code\/ofa_kernel\/rhel5.8-enablement\/modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm\">http:\/\/troels.arvin.dk\/code\/ofa_kernel\/rhel5.8-enablement\/modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm<\/a><br \/>\nand rename from <a href=\"http:\/\/troels.arvin.dk\/code\/ofa_kernel\/rhel5.8-enablement\/modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm\">modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm<\/a><br \/>\nto <a href=\"http:\/\/troels.arvin.dk\/code\/ofa_kernel\/rhel5.8-enablement\/modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm\">ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm<\/a>.<br \/>\nDo not forget to backup the current file, although you can retrieve<br \/>\nit from the tar.gz.\n<\/p>\n<p>4. Re-run the install script and you<br \/>\nshould be good.<\/p>\n<p>You might also stumble across a compile<br \/>\nerror of one of the networking modules from iWARP named &ldquo; cxgb3 and<br \/>\ncxgb4 &ldquo;. I do not have these devices present so I can disable them<br \/>\nfrom being compiled and causing the error. Disable the option in<br \/>\nofed.conf . This file is created during the first run of the<br \/>\ninstallation script. You can also find a sample copy of in the docs\/<br \/>\nfolder. Edit the file, find the driver in the list and set the value<br \/>\nto &ldquo;n&rdquo;. Re-run the installation script.\n<\/p>\n<p>The above issue with the &ldquo; cxgb3 and<br \/>\ncxgb4 &ldquo; modules occurred on SLES 11 as well. Do not disable the<br \/>\nkernel-ib and kernel-devel modules from being compiled as if you<br \/>\ndisable these will not provide you with all the init scripts and<br \/>\ncorrect kernel modules.<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI - UCT HPC\" \/>\n<meta property=\"og:description\" content=\"For the past couple of days we have been busy with setting up and configuring x2 SuperMicro GPU servers 2U which consists of x4 Fermi Nvidia M2090 cards per server. Coupled with that we installed a Mellanox Infiniband SX6036 externally managed switch with Mellanox ConnectX-3 VPI HCA adapters in each server. The infiniband drivers used was from the OpenFrabics distribution OFED 1.5.4.1 which has support for Linux Kernel v3.   I would like to document my findings about setting up OFED on both Scientific Linux 5.8 and SLES 11.    Installation of OFED under SL 5.8 ( RHEL 5.8 )   This was by far the most time consuming process for any troubleshooting exercise I have executed to date. Begin the installation by executing the .\/install script and select the preferred option. The first thing to compile is the kernel-ib and kernel-devel. These will break. It should terminate with a error displayed below.      pci.h:164: error: conflicting types for &#039;pci_pcie_cap OFED  OpenFrabics do not have a fix for it on their website from what we could see and decided to tinker around a bit. We found a developer hiding deep in the search archives of google who had made modifications to the source RPM of the OFED-1.5.4.1 OFA kernel. The fix is as follows:    1. tar xfvz OFED-1.5.4.1.tgz 2. Change directory into the extracted  OFED-1.5.4.1\/SRPMS 3. Download the modified version from here - http:\/\/troels.arvin.dk\/code\/ofa_kernel\/rhel5.8-enablement\/modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm and rename from modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm to ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm. Do not forget to backup the current file, although you can retrieve it from the tar.gz.   4. Re-run the install script and you should be good.  You might also stumble across a compile error of one of the networking modules from iWARP named &ldquo; cxgb3 and cxgb4 &ldquo;. I do not have these devices present so I can disable them from being compiled and causing the error. Disable the option in ofed.conf . This file is created during the first run of the installation script. You can also find a sample copy of in the docs\/ folder. Edit the file, find the driver in the list and set the value to &ldquo;n&rdquo;. Re-run the installation script.   The above issue with the &ldquo; cxgb3 and cxgb4 &ldquo; modules occurred on SLES 11 as well. Do not disable the kernel-ib and kernel-devel modules from being compiled as if you disable these will not provide you with all the init scripts and correct kernel modules.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:published_time\" content=\"2013-01-22T08:57:25+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-08-14T09:50:08+00:00\" \/>\n<meta name=\"author\" content=\"Timothy Carr\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Timothy Carr\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/\"},\"author\":{\"name\":\"Timothy Carr\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0\"},\"headline\":\"SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI\",\"datePublished\":\"2013-01-22T08:57:25+00:00\",\"dateModified\":\"2015-08-14T09:50:08+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/\"},\"wordCount\":419,\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"articleSection\":[\"hpc\"],\"inLanguage\":\"en-ZA\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/\",\"name\":\"SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2013-01-22T08:57:25+00:00\",\"dateModified\":\"2015-08-14T09:50:08+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0\",\"name\":\"Timothy Carr\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g\",\"caption\":\"Timothy Carr\"},\"sameAs\":[\"http:\/\/ucthpc.uct.ac.za\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/","og_locale":"en_US","og_type":"article","og_title":"SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI - UCT HPC","og_description":"For the past couple of days we have been busy with setting up and configuring x2 SuperMicro GPU servers 2U which consists of x4 Fermi Nvidia M2090 cards per server. Coupled with that we installed a Mellanox Infiniband SX6036 externally managed switch with Mellanox ConnectX-3 VPI HCA adapters in each server. The infiniband drivers used was from the OpenFrabics distribution OFED 1.5.4.1 which has support for Linux Kernel v3.   I would like to document my findings about setting up OFED on both Scientific Linux 5.8 and SLES 11.    Installation of OFED under SL 5.8 ( RHEL 5.8 )   This was by far the most time consuming process for any troubleshooting exercise I have executed to date. Begin the installation by executing the .\/install script and select the preferred option. The first thing to compile is the kernel-ib and kernel-devel. These will break. It should terminate with a error displayed below.      pci.h:164: error: conflicting types for 'pci_pcie_cap OFED  OpenFrabics do not have a fix for it on their website from what we could see and decided to tinker around a bit. We found a developer hiding deep in the search archives of google who had made modifications to the source RPM of the OFED-1.5.4.1 OFA kernel. The fix is as follows:    1. tar xfvz OFED-1.5.4.1.tgz 2. Change directory into the extracted  OFED-1.5.4.1\/SRPMS 3. Download the modified version from here - http:\/\/troels.arvin.dk\/code\/ofa_kernel\/rhel5.8-enablement\/modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm and rename from modified-ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm to ofa_kernel-1.5.4.1-OFED.1.5.4.1.src.rpm. Do not forget to backup the current file, although you can retrieve it from the tar.gz.   4. Re-run the install script and you should be good.  You might also stumble across a compile error of one of the networking modules from iWARP named &ldquo; cxgb3 and cxgb4 &ldquo;. I do not have these devices present so I can disable them from being compiled and causing the error. Disable the option in ofed.conf . This file is created during the first run of the installation script. You can also find a sample copy of in the docs\/ folder. Edit the file, find the driver in the list and set the value to &ldquo;n&rdquo;. Re-run the installation script.   The above issue with the &ldquo; cxgb3 and cxgb4 &ldquo; modules occurred on SLES 11 as well. Do not disable the kernel-ib and kernel-devel modules from being compiled as if you disable these will not provide you with all the init scripts and correct kernel modules.","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/","og_site_name":"UCT HPC","article_published_time":"2013-01-22T08:57:25+00:00","article_modified_time":"2015-08-14T09:50:08+00:00","author":"Timothy Carr","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Timothy Carr","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/#article","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/"},"author":{"name":"Timothy Carr","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0"},"headline":"SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI","datePublished":"2013-01-22T08:57:25+00:00","dateModified":"2015-08-14T09:50:08+00:00","mainEntityOfPage":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/"},"wordCount":419,"publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"articleSection":["hpc"],"inLanguage":"en-ZA"},{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/","name":"SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2013-01-22T08:57:25+00:00","dateModified":"2015-08-14T09:50:08+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/01\/22\/supermicro-gpu-servers-and-mellanox-infiniband-fdr-connect-x3-vpi\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"SuperMicro GPU Servers and Mellanox Infiniband FDR \u2013 Connect X3-VPI"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0","name":"Timothy Carr","image":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g","caption":"Timothy Carr"},"sameAs":["http:\/\/ucthpc.uct.ac.za"]}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/871"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=871"}],"version-history":[{"count":3,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/871\/revisions"}],"predecessor-version":[{"id":2111,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/871\/revisions\/2111"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=871"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/categories?post=871"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/tags?post=871"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}