[Swift-devel] using a reservation

Thu Mar 22 07:56:38 CDT 2012

Jon,

Here is a sites.xml that I used for a Beagle reservation a while ago for
modftdock. This worked well on swift-r4252 cog-r3088. See if it helps at
all comparing yours and this one:

=========

<config>
<pool handle="pbs">
<execution provider="coaster" jobmanager="local:pbs"/>
<profile namespace="globus" key="project">CI-CCR000013</profile>
<profile namespace="globus" key="jobsPerNode">24</profile>
<profile namespace="globus" key="ppn">24</profile>
<profile namespace="globus" key="maxTime">16000</profile>
<profile namespace="globus" key="lowOverallocation">100</profile>
<profile namespace="globus" key="highOverallocation">100</profile>
<profile namespace="globus" key="providerAttributes">
pbs.aprun;pbs.mpp;pbs.resource_list=advres=modFTDock.47
</profile>
<profile namespace="globus" key="slots">25</profile>
<profile namespace="globus" key="nodeGranularity">2</profile>
<profile namespace="globus" key="maxNodes">2</profile>
<profile namespace="karajan" key="jobThrottle">13.00</profile>
<profile namespace="karajan" key="initialScore">10000</profile>
<filesystem provider="local"/>
<workdirectory>/lustre/beagle/ketan/labs/modftdock/bgl.reserved.run/swift.workdir</workdirectory>
</pool>
</config>

=========

On Thu, Mar 22, 2012 at 12:37 AM, Jonathan Monette <jonmon at mcs.anl.gov>wrote:

> So I have been looking at this.  I tried adding my own reservation key to
> PBSExecutor but that does not seem to work.  So my question is, does this
> not work because the JobSpecification object does not know to look for this
> attribute?  If so, could this be the reason why I cannot seem to get the
> reservation to the PBS script using pbs.properties or pbs.resources(I also
> tried pbs.resource_list as that is what the code looks for).  Where does
> the JobSpecification get built?  Where is the xml sites file parsed?  I
> cannot seem to find this code.
>
> On Mar 21, 2012, at 10:57 PM, Justin M Wozniak wrote:
>
> >
> > I'll take a look at this tomorrow.
> >
> > On Wed, 21 Mar 2012, Michael Wilde wrote:
> >
> >> Jon,
> >>
> >> Regarding the walltime, your sites file mis-spells maxwalltime; hence
> the jobs emitted by your script probably dont sum to anything beyond 17:00h
> at the 10m default time.
> >>
> >> I dont see why the res isnt making it through to the PBS script.
> >>
> >> - Mike
> >>
> >>
> >>
> >> ----- Original Message -----
> >>> From: "Jonathan Monette" <jonmon at mcs.anl.gov>
> >>> To: "swift-devel at ci.uchicago.edu Devel" <swift-devel at ci.uchicago.edu>
> >>> Sent: Wednesday, March 21, 2012 6:30:14 PM
> >>> Subject: [Swift-devel] using a reservation
> >>> Hello,
> >>> I am trying to use a reservation I have on Beagle. Here is my sites
> >>> file:
> >>>
> >>> <config>
> >>>
> >>>
> >>> <pool handle="local" >
> >>> <execution provider="local" url="none" />
> >>> <profile namespace="karajan" key="jobThrottle">0.5</profile>
> >>> <profile namespace="karajan" key="initialScore">10000</profile>
> >>> <filesystem provider="local"/>
> >>> <workdirectory>_WORK_/local</workdirectory>
> >>> </pool>
> >>>
> >>>
> >>> <pool handle="beagleRes">
> >>>
> >>>
> >>> <execution provider="coaster" jobmanager="local:pbs"/>
> >>>
> >>>
> >>> <profile namespace="env" key="SWIFT_GEN_SCRIPTS">KEEP</profile>
> >>>
> >>>
> >>> <profile namespace="globus" key="project">CI-MCB000119</profile>
> >>> <profile namespace="globus" key="jobsPerNode">1</profile>
> >>> <profile namespace="globus" key="workerLoggingLevel">DEBUG</profile>
> >>> <profile namespace="globus"
> >>> key="workerLoggingDirectory">_WORK_/beagleRes/workers</profile>
> >>> <profile namespace="globus" key="lowOverAllocation">100</profile>
> >>> <profile namespace="globus" key="highOverAllocation">100</profile>
> >>> <profile namespace="globus"
> >>> key="providerAttributes">pbs.aprun;pbs.mpp;depth=24</profile>
> >>> <profile namespace="globus" key="maxTime">86400</profile>
> >>> <profile namespace="globus" key="waxWallTime">00:04:00</profile>
> >>> <profile namespace="globus" key="slots">1</profile>
> >>> <profile namespace="globus" key="nodeGranularity">20</profile>
> >>> <profile namespace="globus" key="maxNodes">20</profile>
> >>>
> >>>
> >>> <profile namespace="globus"
> >>> key="pbs.properties">advres=18833.687</profile>
> >>>
> >>>
> >>> <profile namespace="karajan" key="jobThrottle">12.00</profile>
> >>> <profile namespace="karajan" key="initialScore">10000</profile>
> >>>
> >>>
> >>> <filesystem provider="local"/>
> >>> <workdirectory>_WORK_/beagleRes</workdirectory>
> >>>
> >>>
> >>> </pool>
> >>>
> >>>
> >>> </config>
> >>>
> >>>
> >>> I have tried both pbs.properties and pbs.resources as a sites entry, I
> >>> got this information from
> >>> https://sites.google.com/site/swiftdevel/sites/pbs
> >>> However here is the pbs script that has been generated:
> >>>
> >>>
> >>>
> >>> #CoG This script generated by CoG
> >>> #CoG by class: class
> >>> org.globus.cog.abstraction.impl.scheduler.pbs.PBSExecutor
> >>> #CoG on date: 2012/03/21 23:22:35
> >>>
> >>>
> >>> #PBS -S /bin/bash
> >>> #PBS -N Block-0321-2211
> >>> #PBS -m n
> >>> #PBS -A CI-MCB000119
> >>> #PBS -l mppwidth=20,mppnppn=1,mppdepth=24
> >>> #PBS -l walltime=17:00:00
> >>> #PBS -o
> >>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.stdout
> >>> #PBS -e
> >>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.stderr
> >>> WORKER_LOGGING_LEVEL=DEBUG
> >>> #PBS -v WORKER_LOGGING_LEVEL
> >>> cd / && aprun -n 20 -N 1 -cc none -d 24 -F exclusive /bin/sh -c
> >>> '/usr/bin/perl
> >>> /home/jonmon/.globus/coasters/cscript9177561070598799820.pl
> >>> http://10.128.2.243:40904,http://127.0.0.2:40904,
> http://192.5.86.103:40904
> >>> 0321-221135-000000
> >>>
> /lustre/beagle/jonmon/Swift/SciColSim/run163/swiftwork/beagleRes/workers'
> >>> /bin/echo $?
> >>>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.exitcode
> >>>
> >>>
> >>> I have asked for a coaster block of 24 hours(my reservation is 96
> >>> hours) but it shows a wall time of 17 hours. Furthermore, the line
> >>> #PBS -l advres=<res_id> is missing so I am not using my reservation, I
> >>> just get added to the batch queue and sit there. Does any remember how
> >>> to specify a reservation in the sites file for PBS?
> >>> _______________________________________________
> >>> Swift-devel mailing list
> >>> Swift-devel at ci.uchicago.edu
> >>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> >>
> >>
> >
> > --
> > Justin M Wozniak
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>

-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120322/dc7ba0f9/attachment.html>