SLURM allows a DefMemPerCPU and a MaxMemPerCPU to be set. If a user does not set a memory limit the default will be used. This is normally set to MaxMem/NumCores. As memory is a consumable resource (SelectTypeParameters=CR_Core_Memory) MaxMemPerCPU serves not
…SLURM job preemption
SLURM provides a preemption mechanism to deal with situations where cluster become overloaded. This can be configured in several ways:
FIFO:
This is the most simplistic method of queueing in which there is no preemption, jobs come in, queue and …
Where are all the HPC servers disappearing to?
Those users still making use of hpc.uct.ac.za will have noticed that a few worker nodes have vanished. As mentioned previously we’re investigating a new scheduler, SLURM, Simple Linux Utility for Resource Management. SLURM is a very different animal to
…Hardware Donation to the University of the Western Cape
During 2014 we decommissioned the “HP BL20p gen3/gen4” series of blades we used for our first HPC cluster. The hardware is still in good condition and still has a good few years of computing it could deliver. We decided to …
HPC training
The eResearch team will be running several HPC training courses this year, basic linux skills for HPC and advance HPC concepts. The first round of courses for February and March were booked up before we could advertise them here, however …
2014 Summary
This year has been a very productive one for UCT HPC. We completed more CPU hours than all previous years combined and expanded our cluster by more than doubling our core count and also adding a new GPU server with …
Module in action
The HPC team have been making use of “module” for a while now. A few of our users are aware of its availability but it hasn’t really been disclosed as a “production” ready setup. Well, it is now. Scientific packages …
FhGFS Metadata server migration
FhGFS is a awesome distributed parallel filesystem. Its simple and so powerful with a RDMA backend that knocks the performance socks off other distributed filesystems, IMHO. Today however I needed to migrate the metadata server from one host ( a…