[Swift-devel] Submitting jobs on Blue Waters

[Ian Foster]

Nice!

On Aug 30, 2013, at 5:01 PM, Tim Armstrong <tim.g.armstrong at gmail.com> wrote:

> Hi All,
>   I just had some preliminary success in getting Swift/T running on Blue Waters.  Mike suggested I should email swift-devel to summarize what that entailed.
> 
> Essentially things are the same as on other Cray systems (Beagle, Raven, etc), except the PBS directives for job size are different.  You need to use something of the form:
> 
> #PBS -l nodes=1:ppn=32
> 
> The regular mpp* directives don't work (and strange things like jobs stuck in the queue seem to happen if you do specify them).
> 
> A complete submit script is pasted below for context.
> 
> Cheers,
> Tim
> 
> 
> 
> -------------------------------------------------------------------------------------------------
> 
> #PBS -N TURBINE
> #PBS -q normal
> #PBS -l walltime=00:15:00
> #PBS -o /u/sciteam/tarmstro/turbine-output/2013/08/30/16/09/40/output.txt
> 
> # Set the job size using appropriate directives for this system
> #PBS -l nodes=1:ppn=32
> 
> # Pass all environment variables to the job
> #PBS -V
> 
> # Merge stdout/stderr
> #PBS -j oe
> # Disable mail
> #PBS -m n
> 
> SCRIPT=/mnt/a/u/sciteam/tarmstro/helloworld.tcl
> ARGS=""
> NODES=1
> WALLTIME=00:15:00
> TURBINE_OUTPUT=/u/sciteam/tarmstro/turbine-output/2013/08/30/16/09/40
> TCLSH=/usr/bin/tclsh8.5
> 
> cd ${TURBINE_OUTPUT}
> OUTPUT_FILE=/u/sciteam/tarmstro/turbine-output/2013/08/30/16/09/40/output.txt
> aprun -n 32 -N 32 -cc none -d 1 ${TCLSH} ${SCRIPT} ${ARGS} \
>             2>&1 > "${OUTPUT_FILE}.${PBS_JOBID}.out"
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel