[Swift-devel] Submitting jobs on Blue Waters

[Lorenzo Pesce]

I hope that next year we will have the ppn=32 directive on Beagle too ;-)

On Aug 30, 2013, at 5:13 PM, Ian Foster wrote:

> Nice!
> 
> On Aug 30, 2013, at 5:01 PM, Tim Armstrong <tim.g.armstrong at gmail.com> wrote:
> 
>> Hi All,
>>  I just had some preliminary success in getting Swift/T running on Blue Waters.  Mike suggested I should email swift-devel to summarize what that entailed.
>> 
>> Essentially things are the same as on other Cray systems (Beagle, Raven, etc), except the PBS directives for job size are different.  You need to use something of the form:
>> 
>> #PBS -l nodes=1:ppn=32
>> 
>> The regular mpp* directives don't work (and strange things like jobs stuck in the queue seem to happen if you do specify them).
>> 
>> A complete submit script is pasted below for context.
>> 
>> Cheers,
>> Tim
>> 
>> 
>> 
>> -------------------------------------------------------------------------------------------------
>> 
>> #PBS -N TURBINE
>> #PBS -q normal
>> #PBS -l walltime=00:15:00
>> #PBS -o /u/sciteam/tarmstro/turbine-output/2013/08/30/16/09/40/output.txt
>> 
>> # Set the job size using appropriate directives for this system
>> #PBS -l nodes=1:ppn=32
>> 
>> # Pass all environment variables to the job
>> #PBS -V
>> 
>> # Merge stdout/stderr
>> #PBS -j oe
>> # Disable mail
>> #PBS -m n
>> 
>> SCRIPT=/mnt/a/u/sciteam/tarmstro/helloworld.tcl
>> ARGS=""
>> NODES=1
>> WALLTIME=00:15:00
>> TURBINE_OUTPUT=/u/sciteam/tarmstro/turbine-output/2013/08/30/16/09/40
>> TCLSH=/usr/bin/tclsh8.5
>> 
>> cd ${TURBINE_OUTPUT}
>> OUTPUT_FILE=/u/sciteam/tarmstro/turbine-output/2013/08/30/16/09/40/output.txt
>> aprun -n 32 -N 32 -cc none -d 1 ${TCLSH} ${SCRIPT} ${ARGS} \
>>            2>&1 > "${OUTPUT_FILE}.${PBS_JOBID}.out"
>> 
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel