[Swift-devel] using a reservation

[Michael Wilde]

Jon,

Regarding the walltime, your sites file mis-spells maxwalltime; hence the jobs emitted by your script probably dont sum to anything beyond 17:00h at the 10m default time.

I dont see why the res isnt making it through to the PBS script.

- Mike



----- Original Message -----
> From: "Jonathan Monette" <jonmon at mcs.anl.gov>
> To: "swift-devel at ci.uchicago.edu Devel" <swift-devel at ci.uchicago.edu>
> Sent: Wednesday, March 21, 2012 6:30:14 PM
> Subject: [Swift-devel] using a reservation
> Hello,
> I am trying to use a reservation I have on Beagle. Here is my sites
> file:
> 
> <config>
> 
> 
> <pool handle="local" >
> <execution provider="local" url="none" />
> <profile namespace="karajan" key="jobThrottle">0.5</profile>
> <profile namespace="karajan" key="initialScore">10000</profile>
> <filesystem provider="local"/>
> <workdirectory>_WORK_/local</workdirectory>
> </pool>
> 
> 
> <pool handle="beagleRes">
> 
> 
> <execution provider="coaster" jobmanager="local:pbs"/>
> 
> 
> <profile namespace="env" key="SWIFT_GEN_SCRIPTS">KEEP</profile>
> 
> 
> <profile namespace="globus" key="project">CI-MCB000119</profile>
> <profile namespace="globus" key="jobsPerNode">1</profile>
> <profile namespace="globus" key="workerLoggingLevel">DEBUG</profile>
> <profile namespace="globus"
> key="workerLoggingDirectory">_WORK_/beagleRes/workers</profile>
> <profile namespace="globus" key="lowOverAllocation">100</profile>
> <profile namespace="globus" key="highOverAllocation">100</profile>
> <profile namespace="globus"
> key="providerAttributes">pbs.aprun;pbs.mpp;depth=24</profile>
> <profile namespace="globus" key="maxTime">86400</profile>
> <profile namespace="globus" key="waxWallTime">00:04:00</profile>
> <profile namespace="globus" key="slots">1</profile>
> <profile namespace="globus" key="nodeGranularity">20</profile>
> <profile namespace="globus" key="maxNodes">20</profile>
> 
> 
> <profile namespace="globus"
> key="pbs.properties">advres=18833.687</profile>
> 
> 
> <profile namespace="karajan" key="jobThrottle">12.00</profile>
> <profile namespace="karajan" key="initialScore">10000</profile>
> 
> 
> <filesystem provider="local"/>
> <workdirectory>_WORK_/beagleRes</workdirectory>
> 
> 
> </pool>
> 
> 
> </config>
> 
> 
> I have tried both pbs.properties and pbs.resources as a sites entry, I
> got this information from
> https://sites.google.com/site/swiftdevel/sites/pbs
> However here is the pbs script that has been generated:
> 
> 
> 
> #CoG This script generated by CoG
> #CoG by class: class
> org.globus.cog.abstraction.impl.scheduler.pbs.PBSExecutor
> #CoG on date: 2012/03/21 23:22:35
> 
> 
> #PBS -S /bin/bash
> #PBS -N Block-0321-2211
> #PBS -m n
> #PBS -A CI-MCB000119
> #PBS -l mppwidth=20,mppnppn=1,mppdepth=24
> #PBS -l walltime=17:00:00
> #PBS -o
> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.stdout
> #PBS -e
> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.stderr
> WORKER_LOGGING_LEVEL=DEBUG
> #PBS -v WORKER_LOGGING_LEVEL
> cd / && aprun -n 20 -N 1 -cc none -d 24 -F exclusive /bin/sh -c
> '/usr/bin/perl
> /home/jonmon/.globus/coasters/cscript9177561070598799820.pl
> http://10.128.2.243:40904,http://127.0.0.2:40904,http://192.5.86.103:40904
> 0321-221135-000000
> /lustre/beagle/jonmon/Swift/SciColSim/run163/swiftwork/beagleRes/workers'
> /bin/echo $?
> >/home/jonmon/.globus/scripts/PBS1332885235909759395.submit.exitcode
> 
> 
> I have asked for a coaster block of 24 hours(my reservation is 96
> hours) but it shows a wall time of 17 hours. Furthermore, the line
> #PBS -l advres=<res_id> is missing so I am not using my reservation, I
> just get added to the batch queue and sit there. Does any remember how
> to specify a reservation in the sites file for PBS?
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory