{"id":989,"date":"2012-04-05T12:37:31","date_gmt":"2012-04-05T10:37:31","guid":{"rendered":"http:\/\/oldblogs.uct.ac.za\/blog\/big-bytes\/2012\/04\/05\/backblaze-test"},"modified":"2022-09-26T20:14:10","modified_gmt":"2022-09-26T18:14:10","slug":"backblaze-test","status":"publish","type":"post","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/","title":{"rendered":"BackBlaze test"},"content":{"rendered":"We've started to test the new BackBlaze disk unit. \u00a0It's presenting an iSCSI mount but we don't have sufficient switch ports to wire up all our worker nodes. \u00a0As a compromise we've made the iSCSI mount available to nodes 408 (active) and 409 (passive) and exported a 2TB lun from node 408 via NFS to all other nodes, including the head node.\r\n\r\nTest results show that for optimal usage NFS should be avoided. \u00a0The best we could get via the NFS mount was a peak of 20MB\/s and 10Mb\/s sustained whereas the direct iSCSI data transfer direct from node 408 hit a peak of 60MB\/s and wrote at 20MB\/s sustained (see lower graph). \u00a0The upper graph is CPU utilization. \u00a0As the transfer was from an existing NFS mount on \/home the CPU took a double whammy. \u00a0Ideally all user disk IO should take place on one disk mount.\r\n\r\n<img src=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/07\/BB.jpg\" alt=\"backblaze\" border=\"0\" \/>","protected":false},"excerpt":{"rendered":"<p>We&#8217;ve started to test the new BackBlaze disk unit. &nbsp;It&#8217;s presenting an iSCSI mount but we don&#8217;t have sufficient switch ports to wire up all our worker nodes. &nbsp;As a compromise we&#8217;ve made the iSCSI mount available to nodes 408 (active) and 409 (passive) and exported a 2TB lun from node 408 via NFS to all other nodes, including the head node.<\/p>\n<p>Test results show that for optimal usage NFS should be avoided. &nbsp;The best we could get via the NFS mount was a peak of 20MB\/s and 10Mb\/s sustained whereas the direct iSCSI data transfer direct from node 408 hit a peak of 60MB\/s and wrote at 20MB\/s sustained (see lower graph). &nbsp;The upper graph is CPU utilization. &nbsp;As the transfer was from an existing NFS mount on \/home the CPU took a double whammy. &nbsp;Ideally all user disk IO should take place on one disk mount.<\/p>\n<p><img decoding=\"async\" src=\"http:\/\/blogs.uct.ac.za\/gallery\/1253\/BB.jpg\" border=\"0\" alt=\"backblaze\">&nbsp;<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>BackBlaze test - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"BackBlaze test - UCT HPC\" \/>\n<meta property=\"og:description\" content=\"We&#039;ve started to test the new BackBlaze disk unit. &nbsp;It&#039;s presenting an iSCSI mount but we don&#039;t have sufficient switch ports to wire up all our worker nodes. &nbsp;As a compromise we&#039;ve made the iSCSI mount available to nodes 408 (active) and 409 (passive) and exported a 2TB lun from node 408 via NFS to all other nodes, including the head node.Test results show that for optimal usage NFS should be avoided. &nbsp;The best we could get via the NFS mount was a peak of 20MB\/s and 10Mb\/s sustained whereas the direct iSCSI data transfer direct from node 408 hit a peak of 60MB\/s and wrote at 20MB\/s sustained (see lower graph). &nbsp;The upper graph is CPU utilization. &nbsp;As the transfer was from an existing NFS mount on \/home the CPU took a double whammy. &nbsp;Ideally all user disk IO should take place on one disk mount.&nbsp;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:published_time\" content=\"2012-04-05T10:37:31+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-09-26T18:14:10+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/07\/BB.jpg\" \/>\n<meta name=\"author\" content=\"Andrew Lewis\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andrew Lewis\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/\"},\"author\":{\"name\":\"Andrew Lewis\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\"},\"headline\":\"BackBlaze test\",\"datePublished\":\"2012-04-05T10:37:31+00:00\",\"dateModified\":\"2022-09-26T18:14:10+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/\"},\"wordCount\":150,\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"articleSection\":[\"hpc\"],\"inLanguage\":\"en-ZA\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/\",\"name\":\"BackBlaze test - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2012-04-05T10:37:31+00:00\",\"dateModified\":\"2022-09-26T18:14:10+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"BackBlaze test\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\",\"name\":\"Andrew Lewis\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"caption\":\"Andrew Lewis\"},\"sameAs\":[\"http:\/\/blogs.uct.ac.za\/blog\/big-bytes\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"BackBlaze test - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/","og_locale":"en_US","og_type":"article","og_title":"BackBlaze test - UCT HPC","og_description":"We've started to test the new BackBlaze disk unit. &nbsp;It's presenting an iSCSI mount but we don't have sufficient switch ports to wire up all our worker nodes. &nbsp;As a compromise we've made the iSCSI mount available to nodes 408 (active) and 409 (passive) and exported a 2TB lun from node 408 via NFS to all other nodes, including the head node.Test results show that for optimal usage NFS should be avoided. &nbsp;The best we could get via the NFS mount was a peak of 20MB\/s and 10Mb\/s sustained whereas the direct iSCSI data transfer direct from node 408 hit a peak of 60MB\/s and wrote at 20MB\/s sustained (see lower graph). &nbsp;The upper graph is CPU utilization. &nbsp;As the transfer was from an existing NFS mount on \/home the CPU took a double whammy. &nbsp;Ideally all user disk IO should take place on one disk mount.&nbsp;","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/","og_site_name":"UCT HPC","article_published_time":"2012-04-05T10:37:31+00:00","article_modified_time":"2022-09-26T18:14:10+00:00","og_image":[{"url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/07\/BB.jpg"}],"author":"Andrew Lewis","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Andrew Lewis","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/#article","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/"},"author":{"name":"Andrew Lewis","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e"},"headline":"BackBlaze test","datePublished":"2012-04-05T10:37:31+00:00","dateModified":"2022-09-26T18:14:10+00:00","mainEntityOfPage":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/"},"wordCount":150,"publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"articleSection":["hpc"],"inLanguage":"en-ZA"},{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/","name":"BackBlaze test - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2012-04-05T10:37:31+00:00","dateModified":"2022-09-26T18:14:10+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2012\/04\/05\/backblaze-test\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"BackBlaze test"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e","name":"Andrew Lewis","image":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","caption":"Andrew Lewis"},"sameAs":["http:\/\/blogs.uct.ac.za\/blog\/big-bytes"]}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/989"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=989"}],"version-history":[{"count":4,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/989\/revisions"}],"predecessor-version":[{"id":4304,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/989\/revisions\/4304"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=989"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/categories?post=989"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/tags?post=989"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}