Jon,<div><br></div><div>Here is a sites.xml that I used for a Beagle reservation a while ago for modftdock. This worked well on swift-r4252 cog-r3088. See if it helps at all comparing yours and this one:<br><br>=========</div>
<div><br></div><div><div><config></div><div><pool handle="pbs"></div><div><execution provider="coaster" jobmanager="local:pbs"/></div><div><profile namespace="globus" key="project">CI-CCR000013</profile></div>
<div><profile namespace="globus" key="jobsPerNode">24</profile></div><div><profile namespace="globus" key="ppn">24</profile></div><div><profile namespace="globus" key="maxTime">16000</profile></div>
<div><profile namespace="globus" key="lowOverallocation">100</profile></div><div><profile namespace="globus" key="highOverallocation">100</profile></div><div>
<profile namespace="globus" key="providerAttributes"></div><div>pbs.aprun;pbs.mpp;pbs.resource_list=advres=modFTDock.47</div><div></profile></div><div><profile namespace="globus" key="slots">25</profile></div>
<div><profile namespace="globus" key="nodeGranularity">2</profile></div><div><profile namespace="globus" key="maxNodes">2</profile></div><div><profile namespace="karajan" key="jobThrottle">13.00</profile></div>
<div><profile namespace="karajan" key="initialScore">10000</profile></div><div><filesystem provider="local"/></div><div><workdirectory>/lustre/beagle/ketan/labs/modftdock/bgl.reserved.run/swift.workdir</workdirectory></div>
<div></pool></div><div></config></div></div><div><br></div><div><br></div><div><br></div><div><br></div><div>=========<br><br><br><br><div class="gmail_quote">On Thu, Mar 22, 2012 at 12:37 AM, Jonathan Monette <span dir="ltr"><<a href="mailto:jonmon@mcs.anl.gov">jonmon@mcs.anl.gov</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">So I have been looking at this. I tried adding my own reservation key to PBSExecutor but that does not seem to work. So my question is, does this not work because the JobSpecification object does not know to look for this attribute? If so, could this be the reason why I cannot seem to get the reservation to the PBS script using pbs.properties or pbs.resources(I also tried pbs.resource_list as that is what the code looks for). Where does the JobSpecification get built? Where is the xml sites file parsed? I cannot seem to find this code.<br>
<div><div></div><div class="h5"><br>
On Mar 21, 2012, at 10:57 PM, Justin M Wozniak wrote:<br>
<br>
><br>
> I'll take a look at this tomorrow.<br>
><br>
> On Wed, 21 Mar 2012, Michael Wilde wrote:<br>
><br>
>> Jon,<br>
>><br>
>> Regarding the walltime, your sites file mis-spells maxwalltime; hence the jobs emitted by your script probably dont sum to anything beyond 17:00h at the 10m default time.<br>
>><br>
>> I dont see why the res isnt making it through to the PBS script.<br>
>><br>
>> - Mike<br>
>><br>
>><br>
>><br>
>> ----- Original Message -----<br>
>>> From: "Jonathan Monette" <<a href="mailto:jonmon@mcs.anl.gov">jonmon@mcs.anl.gov</a>><br>
>>> To: "<a href="mailto:swift-devel@ci.uchicago.edu">swift-devel@ci.uchicago.edu</a> Devel" <<a href="mailto:swift-devel@ci.uchicago.edu">swift-devel@ci.uchicago.edu</a>><br>
>>> Sent: Wednesday, March 21, 2012 6:30:14 PM<br>
>>> Subject: [Swift-devel] using a reservation<br>
>>> Hello,<br>
>>> I am trying to use a reservation I have on Beagle. Here is my sites<br>
>>> file:<br>
>>><br>
>>> <config><br>
>>><br>
>>><br>
>>> <pool handle="local" ><br>
>>> <execution provider="local" url="none" /><br>
>>> <profile namespace="karajan" key="jobThrottle">0.5</profile><br>
>>> <profile namespace="karajan" key="initialScore">10000</profile><br>
>>> <filesystem provider="local"/><br>
>>> <workdirectory>_WORK_/local</workdirectory><br>
>>> </pool><br>
>>><br>
>>><br>
>>> <pool handle="beagleRes"><br>
>>><br>
>>><br>
>>> <execution provider="coaster" jobmanager="local:pbs"/><br>
>>><br>
>>><br>
>>> <profile namespace="env" key="SWIFT_GEN_SCRIPTS">KEEP</profile><br>
>>><br>
>>><br>
>>> <profile namespace="globus" key="project">CI-MCB000119</profile><br>
>>> <profile namespace="globus" key="jobsPerNode">1</profile><br>
>>> <profile namespace="globus" key="workerLoggingLevel">DEBUG</profile><br>
>>> <profile namespace="globus"<br>
>>> key="workerLoggingDirectory">_WORK_/beagleRes/workers</profile><br>
>>> <profile namespace="globus" key="lowOverAllocation">100</profile><br>
>>> <profile namespace="globus" key="highOverAllocation">100</profile><br>
>>> <profile namespace="globus"<br>
>>> key="providerAttributes">pbs.aprun;pbs.mpp;depth=24</profile><br>
>>> <profile namespace="globus" key="maxTime">86400</profile><br>
>>> <profile namespace="globus" key="waxWallTime">00:04:00</profile><br>
>>> <profile namespace="globus" key="slots">1</profile><br>
>>> <profile namespace="globus" key="nodeGranularity">20</profile><br>
>>> <profile namespace="globus" key="maxNodes">20</profile><br>
>>><br>
>>><br>
>>> <profile namespace="globus"<br>
>>> key="pbs.properties">advres=18833.687</profile><br>
>>><br>
>>><br>
>>> <profile namespace="karajan" key="jobThrottle">12.00</profile><br>
>>> <profile namespace="karajan" key="initialScore">10000</profile><br>
>>><br>
>>><br>
>>> <filesystem provider="local"/><br>
>>> <workdirectory>_WORK_/beagleRes</workdirectory><br>
>>><br>
>>><br>
>>> </pool><br>
>>><br>
>>><br>
>>> </config><br>
>>><br>
>>><br>
>>> I have tried both pbs.properties and pbs.resources as a sites entry, I<br>
>>> got this information from<br>
>>> <a href="https://sites.google.com/site/swiftdevel/sites/pbs" target="_blank">https://sites.google.com/site/swiftdevel/sites/pbs</a><br>
>>> However here is the pbs script that has been generated:<br>
>>><br>
>>><br>
>>><br>
>>> #CoG This script generated by CoG<br>
>>> #CoG by class: class<br>
>>> org.globus.cog.abstraction.impl.scheduler.pbs.PBSExecutor<br>
>>> #CoG on date: 2012/03/21 23:22:35<br>
>>><br>
>>><br>
>>> #PBS -S /bin/bash<br>
>>> #PBS -N Block-0321-2211<br>
>>> #PBS -m n<br>
>>> #PBS -A CI-MCB000119<br>
>>> #PBS -l mppwidth=20,mppnppn=1,mppdepth=24<br>
>>> #PBS -l walltime=17:00:00<br>
>>> #PBS -o<br>
>>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.stdout<br>
>>> #PBS -e<br>
>>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.stderr<br>
>>> WORKER_LOGGING_LEVEL=DEBUG<br>
>>> #PBS -v WORKER_LOGGING_LEVEL<br>
>>> cd / && aprun -n 20 -N 1 -cc none -d 24 -F exclusive /bin/sh -c<br>
>>> '/usr/bin/perl<br>
>>> /home/jonmon/.globus/coasters/<a href="http://cscript9177561070598799820.pl" target="_blank">cscript9177561070598799820.pl</a><br>
>>> <a href="http://10.128.2.243:40904" target="_blank">http://10.128.2.243:40904</a>,<a href="http://127.0.0.2:40904" target="_blank">http://127.0.0.2:40904</a>,<a href="http://192.5.86.103:40904" target="_blank">http://192.5.86.103:40904</a><br>
>>> 0321-221135-000000<br>
>>> /lustre/beagle/jonmon/Swift/SciColSim/run163/swiftwork/beagleRes/workers'<br>
>>> /bin/echo $?<br>
>>>> /home/jonmon/.globus/scripts/PBS1332885235909759395.submit.exitcode<br>
>>><br>
>>><br>
>>> I have asked for a coaster block of 24 hours(my reservation is 96<br>
>>> hours) but it shows a wall time of 17 hours. Furthermore, the line<br>
>>> #PBS -l advres=<res_id> is missing so I am not using my reservation, I<br>
>>> just get added to the batch queue and sit there. Does any remember how<br>
>>> to specify a reservation in the sites file for PBS?<br>
>>> _______________________________________________<br>
>>> Swift-devel mailing list<br>
>>> <a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>
>>> <a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br>
>><br>
>><br>
><br>
> --<br>
> Justin M Wozniak<br>
<br>
_______________________________________________<br>
Swift-devel mailing list<br>
<a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><font face="'courier new', monospace">Ketan</font><br><br><br>
</div>