{"id":831,"date":"2013-05-06T11:17:52","date_gmt":"2013-05-06T09:17:52","guid":{"rendered":"http:\/\/oldblogs.uct.ac.za\/blog\/big-bytes\/2013\/05\/06\/gpgpu-course"},"modified":"2022-09-26T20:28:58","modified_gmt":"2022-09-26T18:28:58","slug":"gpgpu-course","status":"publish","type":"post","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/","title":{"rendered":"GPGPU course"},"content":{"rendered":"
\"Kepler\"<\/div>\r\n
Last\r\nweek Andrew Lewis attended an honours course in GPGPU programming. \u00a0The\r\ncourse was hosted and organised by UCT's computer science department and funded by the\u00a0SKA<\/a>.\r\nWe were very privileged to have as our lecturers John Stone who is the\r\nAssociate Director of the CUDA Center of Excellence at University of\r\nIllinois and Associate Professor Manuel Ujald\u00f3n from the University of\r\nMalaga. \u00a0Both are also NVIDIA CUDA Fellows.<\/div>\r\n
The\r\ncourse covered introductory programming and architecture of CUDA cards,\u00a0new GPU technologies such as dynamic parallelism<\/a>\u00a0as well as more\r\nadvanced tricks and techniques for saving both time as well as\r\nelectrical power, the latter being of great importance when writing code\r\nfor portable devices as well as considering power consumption of\r\nextremely large data centres.<\/div>\r\n
As\r\nwe reach the limits of our manufacturing technology where physical\r\ntrack sizes on the chips can be measured in 10's of atoms our ability to\r\nachieve significant speed-ups decrease (in 2006 it was estimated that\r\nCPU speeds in 2013 would be around 7GHz). \u00a0GPGPU technology is a way\r\naround this barrier provided there are programmers capable of taking\r\nadvantage of these computing paradigms.<\/div>\r\n
Both\r\nlecturers gave extremely interesting glimpses into the future of GPU\r\ncomputing; the upcoming release of\u00a0Maxwell<\/a>, the successor to the\r\nNVIDIA Kepler card\r\nand the future\u00a0Volta<\/a>\u00a0card, all of which ofer\r\nmore capabilities at lower power. \u00a0The integration of HMC memory into\r\nGPU chips will also surmount the issue of memory transfer latency. \u00a0It\r\nis estimated that the stacked DRAM in the Volta card will have transfer\r\nrates in the order of 1TB\/s.<\/div>","protected":false},"excerpt":{"rendered":"
\"Kepler\"<\/div>\n
Last
\n week Andrew Lewis attended an honours course in GPGPU programming.  The
\n course was hosted and organised by UCT’s computer science department and funded by the SKA<\/a>.
\n We were very privileged to have as our lecturers John Stone who is the
\nAssociate Director of the CUDA Center of Excellence at University of
\nIllinois and Associate Professor Manuel Ujaldón from the University of
\nMalaga.  Both are also NVIDIA CUDA Fellows.<\/div>\n
The
\n course covered introductory programming and architecture of CUDA cards, new GPU technologies such as dynamic parallelism<\/a> as well as more
\nadvanced tricks and techniques for saving both time as well as
\nelectrical power, the latter being of great importance when writing code
\n for portable devices as well as considering power consumption of
\nextremely large data centres.<\/div>\n
As
\n we reach the limits of our manufacturing technology where physical
\ntrack sizes on the chips can be measured in 10’s of atoms our ability to
\n achieve significant speed-ups decrease (in 2006 it was estimated that
\nCPU speeds in 2013 would be around 7GHz).  GPGPU technology is a way
\naround this barrier provided there are programmers capable of taking
\nadvantage of these computing paradigms.<\/div>\n
Both
\n lecturers gave extremely interesting glimpses into the future of GPU
\ncomputing; the upcoming release of Maxwell<\/a>, the successor to the
\nNVIDIA Kepler card
\n and the future Volta<\/a> card, all of which ofer
\nmore capabilities at lower power.  The integration of HMC memory into
\nGPU chips will also surmount the issue of memory transfer latency.  It
\nis estimated that the stacked DRAM in the Volta card will have transfer
\nrates in the order of 1TB\/s.<\/div>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"yoast_head":"\nGPGPU course - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"GPGPU course - UCT HPC\" \/>\n<meta property=\"og:description\" content=\"Last week Andrew Lewis attended an honours course in GPGPU programming.  The course was hosted and organised by UCT's computer science department and funded by the SKA.  We were very privileged to have as our lecturers John Stone who is the Associate Director of the CUDA Center of Excellence at University of Illinois and Associate Professor Manuel Ujaldón from the University of Malaga.  Both are also NVIDIA CUDA Fellows. The course covered introductory programming and architecture of CUDA cards, new GPU technologies such as dynamic parallelism as well as more advanced tricks and techniques for saving both time as well as electrical power, the latter being of great importance when writing code for portable devices as well as considering power consumption of extremely large data centres. As we reach the limits of our manufacturing technology where physical track sizes on the chips can be measured in 10's of atoms our ability to achieve significant speed-ups decrease (in 2006 it was estimated that CPU speeds in 2013 would be around 7GHz).  GPGPU technology is a way around this barrier provided there are programmers capable of taking advantage of these computing paradigms. Both lecturers gave extremely interesting glimpses into the future of GPU computing; the upcoming release of Maxwell, the successor to the NVIDIA Kepler card and the future Volta card, all of which ofer more capabilities at lower power.  The integration of HMC memory into GPU chips will also surmount the issue of memory transfer latency.  It is estimated that the stacked DRAM in the Volta card will have transfer rates in the order of 1TB\/s.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:published_time\" content=\"2013-05-06T09:17:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-09-26T18:28:58+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/07\/nvidia_kepler_tesla_k10.jpg\" \/>\n<meta name=\"author\" content=\"Andrew Lewis\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andrew Lewis\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/\"},\"author\":{\"name\":\"Andrew Lewis\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\"},\"headline\":\"GPGPU course\",\"datePublished\":\"2013-05-06T09:17:52+00:00\",\"dateModified\":\"2022-09-26T18:28:58+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/\"},\"wordCount\":267,\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"articleSection\":[\"hpc\"],\"inLanguage\":\"en-ZA\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/\",\"name\":\"GPGPU course - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2013-05-06T09:17:52+00:00\",\"dateModified\":\"2022-09-26T18:28:58+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"GPGPU course\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e\",\"name\":\"Andrew Lewis\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g\",\"caption\":\"Andrew Lewis\"},\"sameAs\":[\"http:\/\/blogs.uct.ac.za\/blog\/big-bytes\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"GPGPU course - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/","og_locale":"en_US","og_type":"article","og_title":"GPGPU course - UCT HPC","og_description":"Last week Andrew Lewis attended an honours course in GPGPU programming.  The course was hosted and organised by UCT's computer science department and funded by the SKA.  We were very privileged to have as our lecturers John Stone who is the Associate Director of the CUDA Center of Excellence at University of Illinois and Associate Professor Manuel Ujaldón from the University of Malaga.  Both are also NVIDIA CUDA Fellows. The course covered introductory programming and architecture of CUDA cards, new GPU technologies such as dynamic parallelism as well as more advanced tricks and techniques for saving both time as well as electrical power, the latter being of great importance when writing code for portable devices as well as considering power consumption of extremely large data centres. As we reach the limits of our manufacturing technology where physical track sizes on the chips can be measured in 10's of atoms our ability to achieve significant speed-ups decrease (in 2006 it was estimated that CPU speeds in 2013 would be around 7GHz).  GPGPU technology is a way around this barrier provided there are programmers capable of taking advantage of these computing paradigms. Both lecturers gave extremely interesting glimpses into the future of GPU computing; the upcoming release of Maxwell, the successor to the NVIDIA Kepler card and the future Volta card, all of which ofer more capabilities at lower power.  The integration of HMC memory into GPU chips will also surmount the issue of memory transfer latency.  It is estimated that the stacked DRAM in the Volta card will have transfer rates in the order of 1TB\/s.","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/","og_site_name":"UCT HPC","article_published_time":"2013-05-06T09:17:52+00:00","article_modified_time":"2022-09-26T18:28:58+00:00","og_image":[{"url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/07\/nvidia_kepler_tesla_k10.jpg"}],"author":"Andrew Lewis","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Andrew Lewis","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/#article","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/"},"author":{"name":"Andrew Lewis","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e"},"headline":"GPGPU course","datePublished":"2013-05-06T09:17:52+00:00","dateModified":"2022-09-26T18:28:58+00:00","mainEntityOfPage":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/"},"wordCount":267,"publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"articleSection":["hpc"],"inLanguage":"en-ZA"},{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/","name":"GPGPU course - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2013-05-06T09:17:52+00:00","dateModified":"2022-09-26T18:28:58+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/05\/06\/gpgpu-course\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"GPGPU course"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/c183ad1c0a1063124a72d63963ae9c7e","name":"Andrew Lewis","image":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9652c9c73beeab594b8dc2383a880048?s=96&d=mm&r=g","caption":"Andrew Lewis"},"sameAs":["http:\/\/blogs.uct.ac.za\/blog\/big-bytes"]}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/831"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=831"}],"version-history":[{"count":4,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/831\/revisions"}],"predecessor-version":[{"id":4339,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/831\/revisions\/4339"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=831"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/categories?post=831"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/tags?post=831"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}