[Swift-devel] Submitting jobs on Blue Waters

[Tim Armstrong]

Hi All,
  I just had some preliminary success in getting Swift/T running on Blue
Waters.  Mike suggested I should email swift-devel to summarize what that
entailed.

Essentially things are the same as on other Cray systems (Beagle, Raven,
etc), except the PBS directives for job size are different.  You need to
use something of the form:

#PBS -l nodes=1:ppn=32

The regular mpp* directives don't work (and strange things like jobs stuck
in the queue seem to happen if you do specify them).

A complete submit script is pasted below for context.

Cheers,
Tim



-------------------------------------------------------------------------------------------------

#PBS -N TURBINE
#PBS -q normal
#PBS -l walltime=00:15:00
#PBS -o /u/sciteam/tarmstro/turbine-output/2013/08/30/16/09/40/output.txt

# Set the job size using appropriate directives for this system
#PBS -l nodes=1:ppn=32

# Pass all environment variables to the job
#PBS -V

# Merge stdout/stderr
#PBS -j oe
# Disable mail
#PBS -m n

SCRIPT=/mnt/a/u/sciteam/tarmstro/helloworld.tcl
ARGS=""
NODES=1
WALLTIME=00:15:00
TURBINE_OUTPUT=/u/sciteam/tarmstro/turbine-output/2013/08/30/16/09/40
TCLSH=/usr/bin/tclsh8.5

cd ${TURBINE_OUTPUT}
OUTPUT_FILE=/u/sciteam/tarmstro/turbine-output/2013/08/30/16/09/40/output.txt
aprun -n 32 -N 32 -cc none -d 1 ${TCLSH} ${SCRIPT} ${ARGS} \
            2>&1 > "${OUTPUT_FILE}.${PBS_JOBID}.out"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20130830/ef155b6d/attachment.html>