Daily Bulletin

How to Reduce Charges for Single-processor Derecho Batch Jobs

June 11, 2024

The jobs of concern here are Derecho batch jobs that are run with directive prefix #PBS -l select=1:ncpus=1 in the main queue. In many cases it may be better to run them in the develop queue. 

It will be helpful if you use the qhist  command on some of your finished jobs to see if they are amenable to running in the develop queue. For example, command qhist -j 4701972 -d 5 -l will show you the memory and wallclock time used for jobid 4701972 that was run in the last five days. Jobs in the develop queue should specify memory required via -l select=...:mem=5GB up to 235GB, and specify wallclock time of six hours or less.  

Single-processor jobs run in the develop queue will run on one processor versus 128 processors in the main queue resulting in substantial savings, at the same time freeing up Derecho nodes for general use. It is worth noting that some jobs other than single-processor jobs may be suitable for running in the develop queue, as per  https://ncar-hpc-docs.readthedocs.io/en/latest/pbs/charging/.   

If you have questions or concerns about running your jobs in Derecho’s develop queue, please contact our Consulting Services Group by the methods shown on this page https://ncar-hpc-docs.readthedocs.io/en/latest/user-support/#virtual-consulting namely, how to initiate a support request and how to schedule an appointment with a consultant.