I saw similar things on my laptop (4 gb ram) this weekend when I was testing the galaxy demo scripts using the local provider. I was using trunk. In the output I would see things like "no activity for 10s" and it just would sit there and do nothing until I manually killed it. But most of the time it would work fine. I wrote a little shell script that would repeatedly run it until it hung. Then I was talking to Jon about this and he saw something similar with his montage work. He thought it might be related to a configuration issue - that either wrapper.parameter.mode=files or status.mode=provider should be set.<br>
<br>I can send my scripts as well if you need some help in tracking this down.<br><br>David<br><br><div class="gmail_quote">On Fri, Jun 17, 2011 at 2:38 PM, Michael Wilde <span dir="ltr"><<a href="mailto:wilde@mcs.anl.gov">wilde@mcs.anl.gov</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;"><div><div style="font-family: Times New Roman; font-size: 12pt; color: rgb(0, 0, 0);">Alberto, how long are you letting it run for, and under what environment? if you are running on your laptop, how much RAM do you have? Its possible that you are seeing paging delays if you are running the Swift Java app with too little memory.<div>
<br></div><div>Also, are you running trunk or 0.92.1? You should compare the two.</div><div><br></div><div>Its *possible* that this simple test is hanging under recent trunk mods, but its more likely that this is some kind of resource shortage.</div>
<div><br></div><div>Can you run this on one of the Swift lab machines bridled or communcado, or better yet on the MCS compute servers, or a PADS worker node (which you can get with qsub -I on pads)?</div><div><br></div><div>
Look at Swift under the "top" command to see if Swift is running and slow, or is hung.</div><div><br></div><div>Stop by and we can discuss in more detail.</div><div><br></div><div>- Mike</div><div><br><div><br><hr>
<blockquote style="border-left: 2px solid rgb(16, 16, 255); margin-left: 5px; padding-left: 5px;"><div><div></div><div class="h5">
<div dir="ltr">
<div dir="ltr" style="font-size: 10pt; font-family: Tahoma;"><div dir="ltr" style="text-indent: 0px ! important; font-size: 10pt; font-family: Tahoma;">When I run the following SwiftScript using suite.sh, the report shows an odd behavior, most of the time it times out, but once in a while it passes, however this outcome is completely random, since sometimes that test has passed 3 times in a row, and all of the sudden it fails.</div>
<div dir="ltr" style="text-indent: 0px ! important; font-family: Tahoma; font-size: 10pt;">This is my script:</div><div dir="ltr" style="text-indent: 0px ! important; font-family: Tahoma; font-size: 10pt;"><br style="text-indent: 0px ! important;">
</div><div dir="ltr" style="text-indent: 0px ! important; font-family: 'Times New Roman'; font-size: medium;"><div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">type messagefile;</font></div>
<div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"><br style="text-indent: 0px ! important;"></font></div><div dir="ltr" style="text-indent: 0px ! important;">
<font style="text-indent: 0px ! important;" face="Tahoma" size="2">app (messagefile t) greeting (string s[]) {</font></div><div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> echo s[0] s[1] s[2] stdout=@filename(t);</font></div>
<div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">}</font></div><div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"><br style="text-indent: 0px ! important;">
</font></div><div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">messagefile outfile <"q5out.txt">;</font></div><div dir="ltr" style="text-indent: 0px ! important;">
<font style="text-indent: 0px ! important;" face="Tahoma" size="2"><br style="text-indent: 0px ! important;"></font></div><div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">string words[] = ["how","are","you"];</font></div>
<div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"><br style="text-indent: 0px ! important;"></font></div><div dir="ltr" style="text-indent: 0px ! important;">
<font style="text-indent: 0px ! important;" face="Tahoma" size="2">outfile = greeting(words);</font></div><div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"><br style="text-indent: 0px ! important;">
</font></div><div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"><br style="text-indent: 0px ! important;"></font></div><div dir="ltr" style="text-indent: 0px ! important;">
<font style="text-indent: 0px ! important;" face="Tahoma" size="2"><br style="text-indent: 0px ! important;"></font></div><div dir="ltr" style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"><span style="text-indent: 0px ! important; font-family: 'Times New Roman'; font-size: 12pt;"></span></font></div>
<div style="text-indent: 0px ! important; font-family: Tahoma; font-size: 10pt;">Swift.properties contents:</div><div style="text-indent: 0px ! important; font-family: Tahoma; font-size: 10pt;"><br style="text-indent: 0px ! important;">
</div><div style="text-indent: 0px ! important;"><div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">$ cat swift.properties </font></div><div style="text-indent: 0px ! important;">
<font style="text-indent: 0px ! important;" face="Tahoma" size="2">wrapperlog.always.transfer=true</font></div><div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">sitedir.keep=true</font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">execution.retries=0</font></div><div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">lazy.errors=false</font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">status.mode=provider</font></div><div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">use.provider.staging=false</font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">provider.staging.pin.swiftfiles=false</font></div><div style="text-indent: 0px ! important; font-family: Tahoma; font-size: 10pt;">
<br style="text-indent: 0px ! important;"></div></div><div style="text-indent: 0px ! important; font-family: Tahoma; font-size: 10pt;">Sites.template.xml contents:</div><div style="text-indent: 0px ! important; font-family: Tahoma; font-size: 10pt;">
<br style="text-indent: 0px ! important;"></div><div style="text-indent: 0px ! important;"><div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2">$ cat sites.template.xml </font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"><config></font></div><div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <pool handle="localhost"></font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <filesystem provider="local" /></font></div><div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <execution provider="coaster" jobmanager="local:local"/></font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <profile namespace="globus" key="internalHostname">127.0.0.1</profile></font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <profile namespace="karajan" key="jobthrottle">1000</profile></font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <profile namespace="karajan" key="initialScore">10000</profile></font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <profile namespace="globus" key="jobsPerNode">4</profile></font></div><div style="text-indent: 0px ! important;">
<font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <profile namespace="globus" key="slots">8</profile></font></div><div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <profile namespace="globus" key="maxTime">1000</profile></font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <profile namespace="globus" key="nodeGranularity">1</profile></font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <profile namespace="globus" key="maxNodes">4</profile></font></div><div style="text-indent: 0px ! important;">
<font style="text-indent: 0px ! important;" face="Tahoma" size="2"> <workdirectory>/tmp</workdirectory></font></div><div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"> </pool></font></div>
<div style="text-indent: 0px ! important;"><font style="text-indent: 0px ! important;" face="Tahoma" size="2"></config></font></div><div><font style="text-indent: 0px ! important;" face="Tahoma" size="2"><br></font></div>
<div><font style="text-indent: 0px ! important;" face="Tahoma" size="2">-Alberto</font></div></div></div></div>
</div>
<br></div></div>_______________________________________________<br>Swift-devel mailing list<br><a href="mailto:Swift-devel@ci.uchicago.edu" target="_blank">Swift-devel@ci.uchicago.edu</a><br><a href="http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel" target="_blank">http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel</a><br>
</blockquote><font color="#888888"><br><span><br><br>-- <br><span name="x"></span>Michael Wilde<br>Computation Institute, University of Chicago<br>Mathematics and Computer Science Division<br>Argonne National Laboratory<br>
<span name="x"></span><br></span></font></div></div></div></div><br>_______________________________________________<br>
Swift-devel mailing list<br>
<a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>
<a href="http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel" target="_blank">http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel</a><br>
<br></blockquote></div><br>