{"id":331,"date":"2015-06-26T09:19:13","date_gmt":"2015-06-26T09:19:13","guid":{"rendered":"http:\/\/blogs.uct.ac.za\/blog\/big-bytes\/2015\/06\/26\/slurm-and-memory-management"},"modified":"2015-08-14T10:01:07","modified_gmt":"2015-08-14T08:01:07","slug":"slurm-and-memory-management","status":"publish","type":"post","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/","title":{"rendered":"SLURM and memory management"},"content":{"rendered":"
SLURM allows a DefMemPerCPU and a MaxMemPerCPU to be set. If a user does not set a memory limit the default will be used. This is normally set to MaxMem\/NumCores. As memory is a consumable resource (SelectTypeParameters=CR_Core_Memory) MaxMemPerCPU serves not only to protect the node’s memory but will also automatically increase a job’s core count on submission where possible. Below are 5 similar jobs submited by a user, each one requiring more memory. The nodes all have 2GB of RAM per core. The initial –ntasks (cores) of each job is set to 1. However as MaxMemPerCPU is set to 2GB the number of cores is increased by the scheduler to a of multiple of each 2GB or RAM requested.<\/p>\n
#  JOBID              NAME   USER   CPUS       NODELIST      \r\n----------------------------------------------------------\r\n1   2043     Mem_Test_500M   andy      1   srvcnthpc408    \r\n2   2044    Mem_Test_2000M   andy      1   srvcnthpc408     \r\n3   2045    Mem_Test_5000M   andy      3   srvcnthpc406     \r\n4   2046    Mem_Test_8000M   andy      4   srvcnthpc406     \r\n5   2047   Mem_Test_10000M   andy      5   srvcnthpc407  \r\n<\/pre>\n<\/div>\n","protected":false},"excerpt":{"rendered":"
SLURM allows a DefMemPerCPU and a MaxMemPerCPU to be set. If a user does not set a memory limit the default will be used. This is normally set to MaxMem\/NumCores. As memory is a consumable resource (SelectTypeParameters=CR_Core_Memory) MaxMemPerCPU serves not only to protect the node’s memory but will also automatically increase a job’s core count on submission where possible. Below are 5 similar jobs submited by a user, each one requiring more memory. The nodes all have 2GB of RAM per core. The initial –ntasks (cores) of each job is set to 1. However as MaxMemPerCPU is set to 2GB the number of cores is increased by the scheduler to a of multiple of each 2GB or RAM requested.<\/div>\n
\n
#  JOBID                         NAME  USER CPUS      NODELIST      <\/span><\/div>\n
—————————————————————————-<\/span><\/div>\n
1   2043      Mem_Test_500M   andy       1    srvcnthpc408    <\/span><\/div>\n
2   2044    Mem_Test_2000M   andy       1    srvcnthpc408     <\/span><\/div>\n
3   2045    Mem_Test_5000M   andy       3    srvcnthpc406     <\/span><\/div>\n
4   2046    Mem_Test_8000M   andy       4    srvcnthpc406     <\/span><\/div>\n
5   2047  Mem_Test_10000M   andy       5    srvcnthpc407  <\/span><\/div>\n<\/div>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[4,5],"tags":[],"yoast_head":"\nSLURM and memory management - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"SLURM and memory management - UCT HPC\" \/>\n<meta property=\"og:description\" content=\"SLURM allows a DefMemPerCPU and a MaxMemPerCPU to be set. If a user does not set a memory limit the default will be used. This is normally set to MaxMem\/NumCores. As memory is a consumable resource (SelectTypeParameters=CR_Core_Memory) MaxMemPerCPU serves not only to protect the node's memory but will also automatically increase a job's core count on submission where possible. Below are 5 similar jobs submited by a user, each one requiring more memory. The nodes all have 2GB of RAM per core. The initial --ntasks (cores) of each job is set to 1. However as MaxMemPerCPU is set to 2GB the number of cores is increased by the scheduler to a of multiple of each 2GB or RAM requested.#  JOBID                         NAME  USER CPUS      NODELIST      ----------------------------------------------------------------------------1   2043      Mem_Test_500M   andy       1    srvcnthpc408    2   2044    Mem_Test_2000M   andy       1    srvcnthpc408     3   2045    Mem_Test_5000M   andy       3    srvcnthpc406     4   2046    Mem_Test_8000M   andy       4    srvcnthpc406     5   2047  Mem_Test_10000M   andy       5    srvcnthpc407  \" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:published_time\" content=\"2015-06-26T09:19:13+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-08-14T08:01:07+00:00\" \/>\n<meta name=\"author\" content=\"Andrew Lewis\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andrew Lewis\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/\"},\"author\":{\"name\":\"Andrew Lewis\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\"},\"headline\":\"SLURM and memory management\",\"datePublished\":\"2015-06-26T09:19:13+00:00\",\"dateModified\":\"2015-08-14T08:01:07+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/\"},\"wordCount\":125,\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"articleSection\":[\"hpc\",\"SLURM\"],\"inLanguage\":\"en-ZA\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/\",\"name\":\"SLURM and memory management - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2015-06-26T09:19:13+00:00\",\"dateModified\":\"2015-08-14T08:01:07+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"SLURM and memory management\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\",\"name\":\"Andrew Lewis\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"caption\":\"Andrew Lewis\"},\"sameAs\":[\"http:\/\/blogs.uct.ac.za\/blog\/big-bytes\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"SLURM and memory management - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/","og_locale":"en_US","og_type":"article","og_title":"SLURM and memory management - UCT HPC","og_description":"SLURM allows a DefMemPerCPU and a MaxMemPerCPU to be set. If a user does not set a memory limit the default will be used. This is normally set to MaxMem\/NumCores. As memory is a consumable resource (SelectTypeParameters=CR_Core_Memory) MaxMemPerCPU serves not only to protect the node's memory but will also automatically increase a job's core count on submission where possible. Below are 5 similar jobs submited by a user, each one requiring more memory. The nodes all have 2GB of RAM per core. The initial --ntasks (cores) of each job is set to 1. However as MaxMemPerCPU is set to 2GB the number of cores is increased by the scheduler to a of multiple of each 2GB or RAM requested.#  JOBID                         NAME  USER CPUS      NODELIST      ----------------------------------------------------------------------------1   2043      Mem_Test_500M   andy       1    srvcnthpc408    2   2044    Mem_Test_2000M   andy       1    srvcnthpc408     3   2045    Mem_Test_5000M   andy       3    srvcnthpc406     4   2046    Mem_Test_8000M   andy       4    srvcnthpc406     5   2047  Mem_Test_10000M   andy       5    srvcnthpc407  ","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/","og_site_name":"UCT HPC","article_published_time":"2015-06-26T09:19:13+00:00","article_modified_time":"2015-08-14T08:01:07+00:00","author":"Andrew Lewis","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Andrew Lewis","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/#article","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/"},"author":{"name":"Andrew Lewis","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e"},"headline":"SLURM and memory management","datePublished":"2015-06-26T09:19:13+00:00","dateModified":"2015-08-14T08:01:07+00:00","mainEntityOfPage":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/"},"wordCount":125,"publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"articleSection":["hpc","SLURM"],"inLanguage":"en-ZA"},{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/","name":"SLURM and memory management - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2015-06-26T09:19:13+00:00","dateModified":"2015-08-14T08:01:07+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2015\/06\/26\/slurm-and-memory-management\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"SLURM and memory management"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e","name":"Andrew Lewis","image":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","caption":"Andrew Lewis"},"sameAs":["http:\/\/blogs.uct.ac.za\/blog\/big-bytes"]}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/331"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=331"}],"version-history":[{"count":4,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/331\/revisions"}],"predecessor-version":[{"id":2017,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/331\/revisions\/2017"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=331"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/categories?post=331"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/tags?post=331"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}