{"id":727,"date":"2014-08-21T10:14:44","date_gmt":"2014-08-21T08:14:44","guid":{"rendered":"http:\/\/oldblogs.uct.ac.za\/blog\/big-bytes\/2014\/08\/21\/scaling-tests-for-ansys-fluent"},"modified":"2015-08-14T10:16:04","modified_gmt":"2015-08-14T08:16:04","slug":"scaling-tests-for-ansys-fluent","status":"publish","type":"post","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/","title":{"rendered":"Scaling tests for ANSYS Fluent"},"content":{"rendered":"Jonathan Bergh conducted the following benchmarks against our facilities. Tests were run on the HEX 64core AMD 6376 machine to test the\r\nscaling of a standardised CFD problem over an increasing no. of cores.\r\nThe test mesh was a turbomachinery blade passage and exhaust solving for\r\na low speed, incompressible, turbulent flow. A medium size mesh of\r\n~2.2M cells was used and flow was solved using a pressure-based, coupled\r\nsolver where all flow variables are solved in a blocked-coupled fashion\r\nand the additional turbulence variables were solved for in a segregated\r\nfashion. The coupled approach requires x2.5-3.5 times the amount of RAM\r\nthan a traditional segregated approach. Total mesh RAM requirements\r\nwere ~8GB which is not large but emphasis was on total solution time as\r\nthe optimisation algorithm which which will be coupled to the CFD\r\nproject to need (conservatively) 150-200 solutions to be calculated.\r\n\r\nThe tests scaled to jobs over 16 \/ 32 \/ 48 and 64 cores on the\r\nICTS Dell (Dell C6145 rack server). Total solution time was then\r\ncompared to two existing nodes (32) core based on the AMD 6276 and 6376\r\nCPU's (HP Proliant DL385p rack server). All machines use DDR3-1600MHz\r\nRAM and Intel MPI. The test was not disk read-write intensive as the\r\nsimulations performed were steady-state and so only minimal amounts of\r\ndata were written out to disk during each iteratio.\r\n\r\n<img src=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/07\/Ansyscomp.png\" alt=\"\" width=\"405\" height=\"294\" border=\"0\" \/>","protected":false},"excerpt":{"rendered":"<p>Jonathan Bergh conducted the following benchmarks against our facilities. Tests were run on the HEX 64core AMD 6376 machine to test the<br \/>\nscaling of a standardised CFD problem over an increasing no. of cores.<br \/>\nThe test mesh was a turbomachinery blade passage and exhaust solving for<br \/>\n a low speed, incompressible, turbulent flow. A medium size mesh of<br \/>\n~2.2M cells was used and flow was solved using a pressure-based, coupled<br \/>\n solver where all flow variables are solved in a blocked-coupled fashion<br \/>\n and the additional turbulence variables were solved for in a segregated<br \/>\n fashion. The coupled approach requires x2.5-3.5 times the amount of RAM<br \/>\n than a traditional segregated approach. Total mesh RAM requirements<br \/>\nwere ~8GB which is not large but emphasis was on total solution time as<br \/>\nthe optimisation algorithm which which will be coupled to the CFD<br \/>\nproject to need (conservatively) 150-200 solutions to be calculated.<\/p>\n<p>The tests scaled to jobs over 16 \/ 32 \/ 48 and 64 cores on the<br \/>\n ICTS Dell (Dell C6145 rack server). Total solution time was then<br \/>\ncompared to two existing nodes (32) core based on the AMD 6276 and 6376<br \/>\nCPU&#8217;s (HP Proliant DL385p rack server). All machines use DDR3-1600MHz<br \/>\nRAM and Intel MPI. The test was not disk read-write intensive as the<br \/>\nsimulations performed were steady-state and so only minimal amounts of<br \/>\ndata were written out to disk during each iteratio.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" src=\"http:\/\/blogs.uct.ac.za\/gallery\/1253\/Capture.PNG\" border=\"0\" width=\"405\" height=\"294\"><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Scaling tests for ANSYS Fluent - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Scaling tests for ANSYS Fluent - UCT HPC\" \/>\n<meta property=\"og:description\" content=\"Jonathan Bergh conducted the following benchmarks against our facilities. Tests were run on the HEX 64core AMD 6376 machine to test the  scaling of a standardised CFD problem over an increasing no. of cores.  The test mesh was a turbomachinery blade passage and exhaust solving for  a low speed, incompressible, turbulent flow. A medium size mesh of  ~2.2M cells was used and flow was solved using a pressure-based, coupled  solver where all flow variables are solved in a blocked-coupled fashion  and the additional turbulence variables were solved for in a segregated  fashion. The coupled approach requires x2.5-3.5 times the amount of RAM  than a traditional segregated approach. Total mesh RAM requirements  were ~8GB which is not large but emphasis was on total solution time as  the optimisation algorithm which which will be coupled to the CFD  project to need (conservatively) 150-200 solutions to be calculated.The tests scaled to jobs over 16 \/ 32 \/ 48 and 64 cores on the  ICTS Dell (Dell C6145 rack server). Total solution time was then  compared to two existing nodes (32) core based on the AMD 6276 and 6376  CPU&#039;s (HP Proliant DL385p rack server). All machines use DDR3-1600MHz  RAM and Intel MPI. The test was not disk read-write intensive as the  simulations performed were steady-state and so only minimal amounts of  data were written out to disk during each iteratio.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:published_time\" content=\"2014-08-21T08:14:44+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-08-14T08:16:04+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/07\/Ansyscomp.png\" \/>\n<meta name=\"author\" content=\"Timothy Carr\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Timothy Carr\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/\"},\"author\":{\"name\":\"Timothy Carr\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0\"},\"headline\":\"Scaling tests for ANSYS Fluent\",\"datePublished\":\"2014-08-21T08:14:44+00:00\",\"dateModified\":\"2015-08-14T08:16:04+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/\"},\"wordCount\":227,\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"articleSection\":[\"hpc\"],\"inLanguage\":\"en-ZA\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/\",\"name\":\"Scaling tests for ANSYS Fluent - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2014-08-21T08:14:44+00:00\",\"dateModified\":\"2015-08-14T08:16:04+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Scaling tests for ANSYS Fluent\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0\",\"name\":\"Timothy Carr\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g\",\"caption\":\"Timothy Carr\"},\"sameAs\":[\"http:\/\/ucthpc.uct.ac.za\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Scaling tests for ANSYS Fluent - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/","og_locale":"en_US","og_type":"article","og_title":"Scaling tests for ANSYS Fluent - UCT HPC","og_description":"Jonathan Bergh conducted the following benchmarks against our facilities. Tests were run on the HEX 64core AMD 6376 machine to test the  scaling of a standardised CFD problem over an increasing no. of cores.  The test mesh was a turbomachinery blade passage and exhaust solving for  a low speed, incompressible, turbulent flow. A medium size mesh of  ~2.2M cells was used and flow was solved using a pressure-based, coupled  solver where all flow variables are solved in a blocked-coupled fashion  and the additional turbulence variables were solved for in a segregated  fashion. The coupled approach requires x2.5-3.5 times the amount of RAM  than a traditional segregated approach. Total mesh RAM requirements  were ~8GB which is not large but emphasis was on total solution time as  the optimisation algorithm which which will be coupled to the CFD  project to need (conservatively) 150-200 solutions to be calculated.The tests scaled to jobs over 16 \/ 32 \/ 48 and 64 cores on the  ICTS Dell (Dell C6145 rack server). Total solution time was then  compared to two existing nodes (32) core based on the AMD 6276 and 6376  CPU's (HP Proliant DL385p rack server). All machines use DDR3-1600MHz  RAM and Intel MPI. The test was not disk read-write intensive as the  simulations performed were steady-state and so only minimal amounts of  data were written out to disk during each iteratio.","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/","og_site_name":"UCT HPC","article_published_time":"2014-08-21T08:14:44+00:00","article_modified_time":"2015-08-14T08:16:04+00:00","og_image":[{"url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/07\/Ansyscomp.png"}],"author":"Timothy Carr","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Timothy Carr","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/#article","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/"},"author":{"name":"Timothy Carr","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0"},"headline":"Scaling tests for ANSYS Fluent","datePublished":"2014-08-21T08:14:44+00:00","dateModified":"2015-08-14T08:16:04+00:00","mainEntityOfPage":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/"},"wordCount":227,"publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"articleSection":["hpc"],"inLanguage":"en-ZA"},{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/","name":"Scaling tests for ANSYS Fluent - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2014-08-21T08:14:44+00:00","dateModified":"2015-08-14T08:16:04+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2014\/08\/21\/scaling-tests-for-ansys-fluent\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"Scaling tests for ANSYS Fluent"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0","name":"Timothy Carr","image":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g","caption":"Timothy Carr"},"sameAs":["http:\/\/ucthpc.uct.ac.za"]}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/727"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=727"}],"version-history":[{"count":4,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/727\/revisions"}],"predecessor-version":[{"id":2036,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/727\/revisions\/2036"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=727"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/categories?post=727"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/tags?post=727"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}