[Swift-devel] using a reservation
Michael Wilde
wilde at mcs.anl.gov
Thu Mar 22 08:03:29 CDT 2012
Thanks, Ketan.
We should match this against the 0.93 & trunk provider codes:
pbs.aprun;pbs.mpp;pbs.resource_list=advres=modFTDock.47
I was wondering if in fact pbs.properties needed to be specified in the manner you show here (above). Im wondering if pbs.resource_list was changed in a revision after you ran this?
- Mike
----- Original Message -----
> From: "Ketan Maheshwari" <ketancmaheshwari at gmail.com>
> To: "Jonathan Monette" <jonmon at mcs.anl.gov>
> Cc: "swift-devel at ci.uchicago.edu Devel" <swift-devel at ci.uchicago.edu>
> Sent: Thursday, March 22, 2012 7:56:38 AM
> Subject: Re: [Swift-devel] using a reservation
> Jon,
>
>
> Here is a sites.xml that I used for a Beagle reservation a while ago
> for modftdock. This worked well on swift-r4252 cog-r3088. See if it
> helps at all comparing yours and this one:
>
> =========
>
>
>
> <config>
> <pool handle="pbs">
> <execution provider="coaster" jobmanager="local:pbs"/>
> <profile namespace="globus" key="project">CI-CCR000013</profile>
> <profile namespace="globus" key="jobsPerNode">24</profile>
> <profile namespace="globus" key="ppn">24</profile>
> <profile namespace="globus" key="maxTime">16000</profile>
> <profile namespace="globus" key="lowOverallocation">100</profile>
> <profile namespace="globus" key="highOverallocation">100</profile>
> <profile namespace="globus" key="providerAttributes">
> pbs.aprun;pbs.mpp;pbs.resource_list=advres=modFTDock.47
> </profile>
> <profile namespace="globus" key="slots">25</profile>
> <profile namespace="globus" key="nodeGranularity">2</profile>
> <profile namespace="globus" key="maxNodes">2</profile>
> <profile namespace="karajan" key="jobThrottle">13.00</profile>
> <profile namespace="karajan" key="initialScore">10000</profile>
> <filesystem provider="local"/>
> <workdirectory>/lustre/beagle/ketan/labs/modftdock/bgl.reserved.run/swift.workdir</workdirectory>
> </pool>
> </config>
>
>
>
>
>
>
>
>
> =========
>
>
>
>
> On Thu, Mar 22, 2012 at 12:37 AM, Jonathan Monette <
> jonmon at mcs.anl.gov > wrote:
>
>
> So I have been looking at this. I tried adding my own reservation key
> to PBSExecutor but that does not seem to work. So my question is, does
> this not work because the JobSpecification object does not know to
> look for this attribute? If so, could this be the reason why I cannot
> seem to get the reservation to the PBS script using pbs.properties or
> pbs.resources(I also tried pbs.resource_list as that is what the code
> looks for). Where does the JobSpecification get built? Where is the
> xml sites file parsed? I cannot seem to find this code.
>
>
>
>
> On Mar 21, 2012, at 10:57 PM, Justin M Wozniak wrote:
>
> >
> > I'll take a look at this tomorrow.
> >
> > On Wed, 21 Mar 2012, Michael Wilde wrote:
> >
> >> Jon,
> >>
> >> Regarding the walltime, your sites file mis-spells maxwalltime;
> >> hence the jobs emitted by your script probably dont sum to anything
> >> beyond 17:00h at the 10m default time.
> >>
> >> I dont see why the res isnt making it through to the PBS script.
> >>
> >> - Mike
> >>
> >>
> >>
> >> ----- Original Message -----
> >>> From: "Jonathan Monette" < jonmon at mcs.anl.gov >
> >>> To: " swift-devel at ci.uchicago.edu Devel" <
> >>> swift-devel at ci.uchicago.edu >
> >>> Sent: Wednesday, March 21, 2012 6:30:14 PM
> >>> Subject: [Swift-devel] using a reservation
> >>> Hello,
> >>> I am trying to use a reservation I have on Beagle. Here is my
> >>> sites
> >>> file:
> >>>
> >>> <config>
> >>>
> >>>
> >>> <pool handle="local" >
> >>> <execution provider="local" url="none" />
> >>> <profile namespace="karajan" key="jobThrottle">0.5</profile>
> >>> <profile namespace="karajan" key="initialScore">10000</profile>
> >>> <filesystem provider="local"/>
> >>> <workdirectory>_WORK_/local</workdirectory>
> >>> </pool>
> >>>
> >>>
> >>> <pool handle="beagleRes">
> >>>
> >>>
> >>> <execution provider="coaster" jobmanager="local:pbs"/>
> >>>
> >>>
> >>> <profile namespace="env" key="SWIFT_GEN_SCRIPTS">KEEP</profile>
> >>>
> >>>
> >>> <profile namespace="globus" key="project">CI-MCB000119</profile>
> >>> <profile namespace="globus" key="jobsPerNode">1</profile>
> >>> <profile namespace="globus"
> >>> key="workerLoggingLevel">DEBUG</profile>
> >>> <profile namespace="globus"
> >>> key="workerLoggingDirectory">_WORK_/beagleRes/workers</profile>
> >>> <profile namespace="globus" key="lowOverAllocation">100</profile>
> >>> <profile namespace="globus" key="highOverAllocation">100</profile>
> >>> <profile namespace="globus"
> >>> key="providerAttributes">pbs.aprun;pbs.mpp;depth=24</profile>
> >>> <profile namespace="globus" key="maxTime">86400</profile>
> >>> <profile namespace="globus" key="waxWallTime">00:04:00</profile>
> >>> <profile namespace="globus" key="slots">1</profile>
> >>> <profile namespace="globus" key="nodeGranularity">20</profile>
> >>> <profile namespace="globus" key="maxNodes">20</profile>
> >>>
> >>>
> >>> <profile namespace="globus"
> >>> key="pbs.properties">advres=18833.687</profile>
> >>>
> >>>
> >>> <profile namespace="karajan" key="jobThrottle">12.00</profile>
> >>> <profile namespace="karajan" key="initialScore">10000</profile>
> >>>
> >>>
> >>> <filesystem provider="local"/>
> >>> <workdirectory>_WORK_/beagleRes</workdirectory>
> >>>
> >>>
> >>> </pool>
> >>>
> >>>
> >>> </config>
> >>>
> >>>
> >>> I have tried both pbs.properties and pbs.resources as a sites
> >>> entry, I
> >>> got this information from
> >>> https://sites.google.com/site/swiftdevel/sites/pbs
> >>> However here is the pbs script that has been generated:
> >>>
> >>>
> >>>
> >>> #CoG This script generated by CoG
> >>> #CoG by class: class
> >>> org.globus.cog.abstraction.impl.scheduler.pbs.PBSExecutor
> >>> #CoG on date: 2012/03/21 23:22:35
> >>>
> >>>
> >>> #PBS -S /bin/bash
> >>> #PBS -N Block-0321-2211
> >>> #PBS -m n
> >>> #PBS -A CI-MCB000119
> >>> #PBS -l mppwidth=20,mppnppn=1,mppdepth=24
> >>> #PBS -l walltime=17:00:00
> >>> #PBS -o
> >>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.stdout
> >>> #PBS -e
> >>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.stderr
> >>> WORKER_LOGGING_LEVEL=DEBUG
> >>> #PBS -v WORKER_LOGGING_LEVEL
> >>> cd / && aprun -n 20 -N 1 -cc none -d 24 -F exclusive /bin/sh -c
> >>> '/usr/bin/perl
> >>> /home/jonmon/.globus/coasters/ cscript9177561070598799820.pl
> >>> http://10.128.2.243:40904 , http://127.0.0.2:40904 ,
> >>> http://192.5.86.103:40904
> >>> 0321-221135-000000
> >>> /lustre/beagle/jonmon/Swift/SciColSim/run163/swiftwork/beagleRes/workers'
> >>> /bin/echo $?
> >>>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.exitcode
> >>>
> >>>
> >>> I have asked for a coaster block of 24 hours(my reservation is 96
> >>> hours) but it shows a wall time of 17 hours. Furthermore, the line
> >>> #PBS -l advres=<res_id> is missing so I am not using my
> >>> reservation, I
> >>> just get added to the batch queue and sit there. Does any remember
> >>> how
> >>> to specify a reservation in the sites file for PBS?
> >>> _______________________________________________
> >>> Swift-devel mailing list
> >>> Swift-devel at ci.uchicago.edu
> >>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> >>
> >>
> >
> > --
> > Justin M Wozniak
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>
>
>
> --
> Ketan
>
>
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
--
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory
More information about the Swift-devel
mailing list