{"id":4435,"date":"2022-11-08T21:29:42","date_gmt":"2022-11-08T19:29:42","guid":{"rendered":"https:\/\/ucthpc.uct.ac.za\/?p=4435"},"modified":"2022-11-08T21:29:42","modified_gmt":"2022-11-08T19:29:42","slug":"time-based-analysis-of-coreenergy-usage","status":"publish","type":"post","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/","title":{"rendered":"Time based analysis of core\\energy usage"},"content":{"rendered":"<p>Being able to analyze the energy usage of every core in every CPU of the cluster enables us to detect jobs that are not making good use of allocated cores over time.<\/p>\n<p>Here is a node that is using 1 core, but this is only a 1 dimensional snapshot in time:<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/badnode.jpg\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-4436 size-full\" src=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/badnode.jpg\" alt=\"\" width=\"127\" height=\"64\" \/><\/a><\/p>\n<p>Looking at the energy over time since the job started shows quite clearly that the job is single threaded, and not very intense at that. This node is undersubscribed and the parameters of this job should be adjusted:<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/badenergy.jpg\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-4437 size-full\" src=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/badenergy.jpg\" alt=\"\" width=\"909\" height=\"322\" srcset=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/badenergy.jpg 909w, https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/badenergy-300x106.jpg 300w, https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/badenergy-600x213.jpg 600w, https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/badenergy-768x272.jpg 768w\" sizes=\"(max-width: 909px) 100vw, 909px\" \/><\/a><\/p>\n<p>Alternately here is a node that appears to be underutilized:<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/goodnode.jpg\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-4438 size-full\" src=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/goodnode.jpg\" alt=\"\" width=\"128\" height=\"66\" \/><\/a><\/p>\n<p>However looking at the energy usage over time shows us that the job is &#8220;bursty&#8221;, utilizing all the cores from time to time and the parameters are in fact correct.<\/p>\n<p><a ref=\"magnificPopup\" href=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/goodenergy.jpg\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-4439 size-full\" src=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/goodenergy.jpg\" alt=\"\" width=\"917\" height=\"335\" srcset=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/goodenergy.jpg 917w, https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/goodenergy-300x110.jpg 300w, https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/goodenergy-600x219.jpg 600w, https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/goodenergy-768x281.jpg 768w\" sizes=\"(max-width: 917px) 100vw, 917px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Being able to analyze the energy usage of every core in every CPU of the cluster enables us to detect jobs that are not making good use of allocated cores over time. Here is a node that is using 1 core, but this is only a 1 dimensional snapshot in time: Looking at the energy&#8230;<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Time based analysis of core\\energy usage - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Time based analysis of core\\energy usage - UCT HPC\" \/>\n<meta property=\"og:description\" content=\"Being able to analyze the energy usage of every core in every CPU of the cluster enables us to detect jobs that are not making good use of allocated cores over time. Here is a node that is using 1 core, but this is only a 1 dimensional snapshot in time: Looking at the energy...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:published_time\" content=\"2022-11-08T19:29:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/badnode.jpg\" \/>\n<meta name=\"author\" content=\"Andrew Lewis\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andrew Lewis\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/\"},\"author\":{\"name\":\"Andrew Lewis\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\"},\"headline\":\"Time based analysis of core\\\\energy usage\",\"datePublished\":\"2022-11-08T19:29:42+00:00\",\"dateModified\":\"2022-11-08T19:29:42+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/\"},\"wordCount\":135,\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"articleSection\":[\"hpc\"],\"inLanguage\":\"en-ZA\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/\",\"name\":\"Time based analysis of core\\\\energy usage - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2022-11-08T19:29:42+00:00\",\"dateModified\":\"2022-11-08T19:29:42+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Time based analysis of core\\\\energy usage\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\",\"name\":\"Andrew Lewis\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"caption\":\"Andrew Lewis\"},\"sameAs\":[\"http:\/\/blogs.uct.ac.za\/blog\/big-bytes\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Time based analysis of core\\energy usage - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/","og_locale":"en_US","og_type":"article","og_title":"Time based analysis of core\\energy usage - UCT HPC","og_description":"Being able to analyze the energy usage of every core in every CPU of the cluster enables us to detect jobs that are not making good use of allocated cores over time. Here is a node that is using 1 core, but this is only a 1 dimensional snapshot in time: Looking at the energy...","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/","og_site_name":"UCT HPC","article_published_time":"2022-11-08T19:29:42+00:00","og_image":[{"url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2022\/11\/badnode.jpg"}],"author":"Andrew Lewis","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Andrew Lewis","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/#article","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/"},"author":{"name":"Andrew Lewis","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e"},"headline":"Time based analysis of core\\energy usage","datePublished":"2022-11-08T19:29:42+00:00","dateModified":"2022-11-08T19:29:42+00:00","mainEntityOfPage":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/"},"wordCount":135,"publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"articleSection":["hpc"],"inLanguage":"en-ZA"},{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/","name":"Time based analysis of core\\energy usage - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2022-11-08T19:29:42+00:00","dateModified":"2022-11-08T19:29:42+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2022\/11\/08\/time-based-analysis-of-coreenergy-usage\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"Time based analysis of core\\energy usage"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e","name":"Andrew Lewis","image":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","caption":"Andrew Lewis"},"sameAs":["http:\/\/blogs.uct.ac.za\/blog\/big-bytes"]}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/4435"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=4435"}],"version-history":[{"count":1,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/4435\/revisions"}],"predecessor-version":[{"id":4440,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/4435\/revisions\/4440"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=4435"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/categories?post=4435"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/tags?post=4435"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}