[Swift-devel] using a reservation

[Justin M Wozniak]

I'll take a look at this tomorrow.

On Wed, 21 Mar 2012, Michael Wilde wrote:

> Jon,
>
> Regarding the walltime, your sites file mis-spells maxwalltime; hence the jobs emitted by your script probably dont sum to anything beyond 17:00h at the 10m default time.
>
> I dont see why the res isnt making it through to the PBS script.
>
> - Mike
>
>
>
> ----- Original Message -----
>> From: "Jonathan Monette" <jonmon at mcs.anl.gov>
>> To: "swift-devel at ci.uchicago.edu Devel" <swift-devel at ci.uchicago.edu>
>> Sent: Wednesday, March 21, 2012 6:30:14 PM
>> Subject: [Swift-devel] using a reservation
>> Hello,
>> I am trying to use a reservation I have on Beagle. Here is my sites
>> file:
>>
>> <config>
>>
>>
>> <pool handle="local" >
>> <execution provider="local" url="none" />
>> <profile namespace="karajan" key="jobThrottle">0.5</profile>
>> <profile namespace="karajan" key="initialScore">10000</profile>
>> <filesystem provider="local"/>
>> <workdirectory>_WORK_/local</workdirectory>
>> </pool>
>>
>>
>> <pool handle="beagleRes">
>>
>>
>> <execution provider="coaster" jobmanager="local:pbs"/>
>>
>>
>> <profile namespace="env" key="SWIFT_GEN_SCRIPTS">KEEP</profile>
>>
>>
>> <profile namespace="globus" key="project">CI-MCB000119</profile>
>> <profile namespace="globus" key="jobsPerNode">1</profile>
>> <profile namespace="globus" key="workerLoggingLevel">DEBUG</profile>
>> <profile namespace="globus"
>> key="workerLoggingDirectory">_WORK_/beagleRes/workers</profile>
>> <profile namespace="globus" key="lowOverAllocation">100</profile>
>> <profile namespace="globus" key="highOverAllocation">100</profile>
>> <profile namespace="globus"
>> key="providerAttributes">pbs.aprun;pbs.mpp;depth=24</profile>
>> <profile namespace="globus" key="maxTime">86400</profile>
>> <profile namespace="globus" key="waxWallTime">00:04:00</profile>
>> <profile namespace="globus" key="slots">1</profile>
>> <profile namespace="globus" key="nodeGranularity">20</profile>
>> <profile namespace="globus" key="maxNodes">20</profile>
>>
>>
>> <profile namespace="globus"
>> key="pbs.properties">advres=18833.687</profile>
>>
>>
>> <profile namespace="karajan" key="jobThrottle">12.00</profile>
>> <profile namespace="karajan" key="initialScore">10000</profile>
>>
>>
>> <filesystem provider="local"/>
>> <workdirectory>_WORK_/beagleRes</workdirectory>
>>
>>
>> </pool>
>>
>>
>> </config>
>>
>>
>> I have tried both pbs.properties and pbs.resources as a sites entry, I
>> got this information from
>> https://sites.google.com/site/swiftdevel/sites/pbs
>> However here is the pbs script that has been generated:
>>
>>
>>
>> #CoG This script generated by CoG
>> #CoG by class: class
>> org.globus.cog.abstraction.impl.scheduler.pbs.PBSExecutor
>> #CoG on date: 2012/03/21 23:22:35
>>
>>
>> #PBS -S /bin/bash
>> #PBS -N Block-0321-2211
>> #PBS -m n
>> #PBS -A CI-MCB000119
>> #PBS -l mppwidth=20,mppnppn=1,mppdepth=24
>> #PBS -l walltime=17:00:00
>> #PBS -o
>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.stdout
>> #PBS -e
>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.stderr
>> WORKER_LOGGING_LEVEL=DEBUG
>> #PBS -v WORKER_LOGGING_LEVEL
>> cd / && aprun -n 20 -N 1 -cc none -d 24 -F exclusive /bin/sh -c
>> '/usr/bin/perl
>> /home/jonmon/.globus/coasters/cscript9177561070598799820.pl
>> http://10.128.2.243:40904,http://127.0.0.2:40904,http://192.5.86.103:40904
>> 0321-221135-000000
>> /lustre/beagle/jonmon/Swift/SciColSim/run163/swiftwork/beagleRes/workers'
>> /bin/echo $?
>>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.exitcode
>>
>>
>> I have asked for a coaster block of 24 hours(my reservation is 96
>> hours) but it shows a wall time of 17 hours. Furthermore, the line
>> #PBS -l advres=<res_id> is missing so I am not using my reservation, I
>> just get added to the batch queue and sit there. Does any remember how
>> to specify a reservation in the sites file for PBS?
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>

-- 
Justin M Wozniak