New packages and node RAM protection
The following packages have been installed on the Hex cluster:
Ncbi-tools 2.2.28+, Blastall, Qiime 1.7.0, Pyfasta 0.5.1, Krona 2.4, Samtools 0.1.19, Amos 3.1.0, Bowtie 1.0.0, Bowtie2 2.1.0, BWA 0.7.5a, Cufflinks 2.1.1
We've also implemented automatic node protection as some users'
…100,000 active hours
This evening our cluster achieved another small mile stone, 100,000 active computational hours, or put another way, all the current jobs running at the moment have consumed about 11.4 years of computation.
... and no, that's not 36 hours in…
... and no, that's not 36 hours in…Important: ICTS HPC cluster downtime
ICTS HPC cluster downtime:
The ICTS HPC team will be upgrading various components of both
clusters in early December. We will be putting the clusters into
draining mode on Friday the 6th of December. All worker nodes as
well…
SKA squeeze
ICTS HPC is very pleased to have played a small role in the development of SKA Squeeze, a data compression algorithm for the SKA radio telescope. Use was made of the GPGPU servers in order to achieve the speeds…
First HPC forum meeting
Several sysadmins met today at UWC for the first HPC forum meeting. Represented were UWC, UCT, CHPC, SANBI and the University of Stellenbosch. There was discussion on common schedulers, file systems and supporting technologies. Also several topics for further investigation…
Parallel tools
An intersting article on parallel tools by Jeff Layton. While there is a pssh utility for various transfer routines it's no longer being maintained. Other parallel versions of rsync seem to be script based: https://gist.github.com/rcoup/5358786 and http://blog.ciberterminal.net/2012/10/16/parallel-rsyncing-a-huge-directory-tree/…
New queue and the yellow blobs explained
What's up with the yellow warning lights on the cluster?
These nodes have been placed on hold and the reason for us doing this is so that we can 'drain' them of jobs prior to upgrading and patching. We prefer…
These nodes have been placed on hold and the reason for us doing this is so that we can 'drain' them of jobs prior to upgrading and patching. We prefer…SAM really, really wants to take out the trash
We encountered an issue where a user's jobs used far more cpus than allocated. This occured even though ppn was set to 1, the server load went up to 400+ and the individual processes were using up to 4000% CPU…
eResearch Africa Conference
The eResearch Africa conference hosted by UCT ICTS last week was a resounding success. We had 90 delegates and speakers from 9 countries covering a wide range of eResearch topics. Apart from researchers there were numerous IT system administrators or
…