<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">This is the content of the file where we have the first complaint from swift (see attached): <div><div><div><config></div><div> <pool handle="pbs"></div><div> <execution provider="coaster" jobmanager="local:pbs"/></div><div> <!-- replace with your project --></div><div> <profile namespace="globus" key="project">CI-DEB000002</profile></div><div><br></div><div> <profile namespace="globus" key="providerAttributes">pbs.aprun;pbs.mpp;depth=24</profile></div><div><br></div><div><br></div><div> <profile namespace="globus" key="jobsPerNode">24</profile></div><div> <profile namespace="globus" key="maxTime">172800</profile></div><div> <profile namespace="globus" key="maxwalltime">0:10:00</profile></div><div> <profile namespace="globus" key="lowOverallocation">100</profile></div><div> <profile namespace="globus" key="highOverallocation">100</profile></div><div><br></div><div> <profile namespace="globus" key="slots">200</profile></div><div> <profile namespace="globus" key="nodeGranularity">1</profile></div><div> <profile namespace="globus" key="maxNodes">1</profile></div><div><br></div><div> <profile namespace="karajan" key="jobThrottle">47.99</profile></div><div> <profile namespace="karajan" key="initialScore">10000</profile></div><div><br></div><div> <filesystem provider="local"/></div><div> <!-- replace this with your home on lustre --></div><div> <workdirectory>/lustre/beagle/samseaver/GS/swift.workdir</workdirectory></div><div> </pool></div><div></config></div><div><br></div><div>Any ideas?</div><div><br><div>Begin forwarded message:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;"><span style="font-family:'Helvetica'; font-size:medium; color:rgba(0, 0, 0, 1);"><b>From: </b></span><span style="font-family:'Helvetica'; font-size:medium;">Sam Seaver <<a href="mailto:samseaver@gmail.com">samseaver@gmail.com</a>><br></span></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;"><span style="font-family:'Helvetica'; font-size:medium; color:rgba(0, 0, 0, 1);"><b>Date: </b></span><span style="font-family:'Helvetica'; font-size:medium;">February 19, 2013 1:16:28 PM CST<br></span></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;"><span style="font-family:'Helvetica'; font-size:medium; color:rgba(0, 0, 0, 1);"><b>To: </b></span><span style="font-family:'Helvetica'; font-size:medium;">Lorenzo Pesce <<a href="mailto:lpesce@uchicago.edu">lpesce@uchicago.edu</a>><br></span></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;"><span style="font-family:'Helvetica'; font-size:medium; color:rgba(0, 0, 0, 1);"><b>Subject: </b></span><span style="font-family:'Helvetica'; font-size:medium;"><b>Re: How are things going?</b><br></span></div><br><meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1"><div dir="ltr">I got this error. I suspect using the new SWIFT_HOME directory means that there's possibly a missing parameter someplace:<div><br></div><div><div>should we resume a previous calculation? [y/N] y</div><div>
rlog files displayed in reverse time order</div><div>should I use GS-20130203-0717-jgeppt98.0.rlog ?[y/n]</div><div>y</div><div>Using GS-20130203-0717-jgeppt98.0.rlog</div><div>[Error] GS_sites.xml:1:9: cvc-elt.1: Cannot find the declaration of element 'config'.</div>
<div><br></div><div>Execution failed:</div><div>Failed to parse site catalog</div><div> swift:siteCatalog @ scheduler.k, line: 31</div><div>Caused by: Invalid pool entry 'pbs': </div><div> swift:siteCatalog @ scheduler.k, line: 31</div>
<div>Caused by: java.lang.IllegalArgumentException: Missing URL</div><div> at org.griphyn.vdl.karajan.lib.SiteCatalog.execution(SiteCatalog.java:173)</div><div> at org.griphyn.vdl.karajan.lib.SiteCatalog.pool(SiteCatalog.java:100)</div>
<div> at org.griphyn.vdl.karajan.lib.SiteCatalog.buildResources(SiteCatalog.java:60)</div><div> at org.griphyn.vdl.karajan.lib.SiteCatalog.function(SiteCatalog.java:48)</div><div> at org.globus.cog.karajan.compiled.nodes.functions.AbstractFunction.runBody(AbstractFunction.java:38)</div>
<div> at org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:154)</div><div> at org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)</div><div> at org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:147)</div>
<div> at org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)</div><div> at org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:147)</div><div> at org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)</div>
<div> at org.globus.cog.karajan.compiled.nodes.FramedInternalFunction.run(FramedInternalFunction.java:63)</div><div> at org.globus.cog.karajan.compiled.nodes.Import.runBody(Import.java:269)</div><div> at org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:154)</div>
<div> at org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)</div><div> at org.globus.cog.karajan.compiled.nodes.FramedInternalFunction.run(FramedInternalFunction.java:63)</div>
<div> at org.globus.cog.karajan.compiled.nodes.Main.run(Main.java:79)</div><div> at k.thr.LWThread.run(LWThread.java:243)</div><div> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)</div>
<div> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)</div><div> at java.lang.Thread.run(Thread.java:722)</div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">
On Tue, Feb 19, 2013 at 1:13 PM, Sam Seaver <span dir="ltr"><<a href="mailto:samseaver@gmail.com" target="_blank">samseaver@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">OK, it got to the point where it really did hang. I'm retrying, but with your suggestions. The other three finished fine!<div><br></div><div><div>Progress: time: Tue, 19 Feb 2013 19:08:53 +0000 Selecting site:18147 Submitted:174 Active:96 Failed:2 Finished successfully:132323 Failed but can retry:183</div>
<div>Progress: time: Tue, 19 Feb 2013 19:09:23 +0000 Selecting site:18147 Submitted:174 Active:96 Failed:2 Finished successfully:132323 Failed but can retry:183</div><div>Progress: time: Tue, 19 Feb 2013 19:09:53 +0000 Selecting site:18147 Submitted:174 Active:96 Failed:2 Finished successfully:132323 Failed but can retry:183</div>
<div>Progress: time: Tue, 19 Feb 2013 19:10:23 +0000 Selecting site:18147 Submitted:174 Active:96 Failed:2 Finished successfully:132323 Failed but can retry:183</div><div>Progress: time: Tue, 19 Feb 2013 19:10:53 +0000 Selecting site:18147 Submitted:174 Active:96 Failed:2 Finished successfully:132323 Failed but can retry:183</div>
<div>Progress: time: Tue, 19 Feb 2013 19:11:23 +0000 Selecting site:18147 Submitted:174 Active:96 Failed:2 Finished successfully:132323 Failed but can retry:183</div></div></div><div class="HOEnZb"><div class="h5">
<div class="gmail_extra"><br><br><div class="gmail_quote">
On Tue, Feb 19, 2013 at 8:51 AM, Lorenzo Pesce <span dir="ltr"><<a href="mailto:lpesce@uchicago.edu" target="_blank">lpesce@uchicago.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">Hmm... <div><br></div><div>foreach.max.threads=100</div><div><br></div><div>maybe you should increase this number a bit and see what happens.</div><div><br></div><div>Also, I would try to replace</div>
<div><br></div><div>SWIFT_HOME=/home/wilde/swift/rev/swift-r6151-cog-r3552</div><div><br></div><div>with </div><div><br></div><div>SWIFT_HOME=/soft/swift/fast</div><div><br></div><div>Keep me posted. Let's get this rolling.</div>
<div><br></div><div>if it doesn't work, I can redo the packing.</div><div><div><div><br></div><div><br></div><div><br></div><div><br><div><div>On Feb 19, 2013, at 1:07 AM, Sam Seaver wrote:</div><br><blockquote type="cite">
<div dir="ltr">Actually, the ten agents job does seem to be stuck in a strange loop. It is incrementing the number of jobs that has finished successfully, and at a fast pace, but the number of jobs its starting is decrementing much more slowly, its almost as its repeatedly attempting the same set of parameters multiple times...<div>
<br></div><div>I'll see what it's doing in the morning</div><div>S</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, Feb 19, 2013 at 1:00 AM, Sam Seaver <span dir="ltr"><<a href="mailto:samseaver@gmail.com" target="_blank">samseaver@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Seems to have worked overall this time!<div><br></div><div>I resume four jobs, each were for a different number of agents (10,100,1000,10000) it made it easier for me to decide on the app time. Two of them have already finished i.e.:</div>
<div><br></div><div><div>Progress: time: Mon, 18 Feb 2013 23:50:12 +0000 Active:4 Checking status:1 Finished in previous run:148098 Finished successfully:37897</div><div>Progress: time: Mon, 18 Feb 2013 23:50:15 +0000 Active:2 Checking status:1 Finished in previous run:148098 Finished successfully:37899</div>
<div>Final status: Mon, 18 Feb 2013 23:50:15 +0000 Finished in previous run:148098 Finished successfully:37902</div><div><br></div><div>and the only one that is showing any failure (50/110000), is the ten agents version which is so short I can understand why, but its still actively trying to run jobs and is actively finishing jobs, so that's good.</div>
<div><br></div><div>Yay!</div><div><br></div></div></div><div><div><div class="gmail_extra"><br><br><div class="gmail_quote">On Mon, Feb 18, 2013 at 1:09 PM, Lorenzo Pesce <span dir="ltr"><<a href="mailto:lpesce@uchicago.edu" target="_blank">lpesce@uchicago.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Good. Keep me posted, I would really like to solve your problems in running on Beagle this week, I wish that Swift would have been friendlier.<div>
<div><div><br><div><div>On Feb 18, 2013, at 1:01 PM, Sam Seaver wrote:</div><br><blockquote type="cite"><div dir="ltr">I just resumed the jobs that I'd killed before the system went down, lets see how it does. I always did a mini-review of the data I've got and it seems to be working as expected.</div>
<div class="gmail_extra">
<br><br><div class="gmail_quote">On Mon, Feb 18, 2013 at 12:28 PM, Lorenzo Pesce <span dir="ltr"><<a href="mailto:lpesce@uchicago.edu" target="_blank">lpesce@uchicago.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">I have lost track a bit of what's up. I am happy to try and go over it with you when you are ready.<div><br></div><div>Some of the problems of swift might have improved with a new version and the new system.</div>
<div><div><div><br></div><div><br><div><div>On Feb 18, 2013, at 12:22 PM, Sam Seaver wrote:</div><br><blockquote type="cite"><div dir="ltr">They're not, I've not looked since Beagle came back up. Will do so later today.<div>
S</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Mon, Feb 18, 2013 at 12:20 PM, Lorenzo Pesce <span dir="ltr"><<a href="mailto:lpesce@uchicago.edu" target="_blank">lpesce@uchicago.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"></blockquote></div><br><br clear="all"><div><br></div>-- <br>Postdoctoral Fellow<br>Mathematics and Computer Science Division<br>
Argonne National Laboratory<br>9700 S. Cass Avenue<br>Argonne, IL 60439<br><br><a href="http://www.linkedin.com/pub/sam-seaver/0/412/168" target="_blank">http://www.linkedin.com/pub/sam-seaver/0/412/168</a><br><a href="mailto:samseaver@gmail.com" target="_blank">samseaver@gmail.com</a><br>
<a href="tel:%28773%29%20796-7144" value="+17737967144" target="_blank">(773) 796-7144</a><br><br>"We shall not cease from exploration<br>And the end of all our exploring<br>Will be to arrive where we started<br>And know the place for the first time."<br>
--T. S. Eliot
</div>
</blockquote></div><br></div></div></div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>Postdoctoral Fellow<br>Mathematics and Computer Science Division<br>Argonne National Laboratory<br>9700 S. Cass Avenue<br>
Argonne, IL 60439<br><br><a href="http://www.linkedin.com/pub/sam-seaver/0/412/168" target="_blank">http://www.linkedin.com/pub/sam-seaver/0/412/168</a><br><a href="mailto:samseaver@gmail.com" target="_blank">samseaver@gmail.com</a><br>
<a href="tel:%28773%29%20796-7144" value="+17737967144" target="_blank">(773) 796-7144</a><br><br>"We shall not cease from exploration<br>And the end of all our exploring<br>Will be to arrive where we started<br>And know the place for the first time."<br>
--T. S. Eliot
</div>
</blockquote></div><br></div></div></div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>Postdoctoral Fellow<br>Mathematics and Computer Science Division<br>Argonne National Laboratory<br>9700 S. Cass Avenue<br>
Argonne, IL 60439<br><br><a href="http://www.linkedin.com/pub/sam-seaver/0/412/168" target="_blank">http://www.linkedin.com/pub/sam-seaver/0/412/168</a><br><a href="mailto:samseaver@gmail.com" target="_blank">samseaver@gmail.com</a><br>
<a href="tel:%28773%29%20796-7144" value="+17737967144" target="_blank">(773) 796-7144</a><br><br>"We shall not cease from exploration<br>And the end of all our exploring<br>Will be to arrive where we started<br>And know the place for the first time."<br>
--T. S. Eliot
</div>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>Postdoctoral Fellow<br>Mathematics and Computer Science Division<br>Argonne National Laboratory<br>9700 S. Cass Avenue<br>Argonne, IL 60439<br><br>
<a href="http://www.linkedin.com/pub/sam-seaver/0/412/168" target="_blank">http://www.linkedin.com/pub/sam-seaver/0/412/168</a><br><a href="mailto:samseaver@gmail.com" target="_blank">samseaver@gmail.com</a><br><a href="tel:%28773%29%20796-7144" value="+17737967144" target="_blank">(773) 796-7144</a><br>
<br>"We shall not cease from exploration<br>And the end of all our exploring<br>Will be to arrive where we started<br>And know the place for the first time."<br> --T. S. Eliot
</div>
</blockquote></div><br></div></div></div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>Postdoctoral Fellow<br>Mathematics and Computer Science Division<br>Argonne National Laboratory<br>9700 S. Cass Avenue<br>
Argonne, IL 60439<br><br><a href="http://www.linkedin.com/pub/sam-seaver/0/412/168" target="_blank">http://www.linkedin.com/pub/sam-seaver/0/412/168</a><br><a href="mailto:samseaver@gmail.com" target="_blank">samseaver@gmail.com</a><br>
<a href="tel:%28773%29%20796-7144" value="+17737967144" target="_blank">(773) 796-7144</a><br><br>"We shall not cease from exploration<br>And the end of all our exploring<br>Will be to arrive where we started<br>And know the place for the first time."<br>
--T. S. Eliot
</div>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br>Postdoctoral Fellow<br>Mathematics and Computer Science Division<br>Argonne National Laboratory<br>9700 S. Cass Avenue<br>Argonne, IL 60439<br><br>
<a href="http://www.linkedin.com/pub/sam-seaver/0/412/168" target="_blank">http://www.linkedin.com/pub/sam-seaver/0/412/168</a><br><a href="mailto:samseaver@gmail.com" target="_blank">samseaver@gmail.com</a><br>(773) 796-7144<br>
<br>"We shall not cease from exploration<br>And the end of all our exploring<br>Will be to arrive where we started<br>And know the place for the first time."<br> --T. S. Eliot
</div>
</blockquote></div><br></div></div></body></html>