No. It was the same. As I was digging deeper into the problem I started remembering that all this seemed familiar. I checked my properties file and accidentally deleted the wrapper.parameter.mode line. I wanted to confirm this was the problem before I reported back and it just took awhile before the workflow got to that section.<div>
<br></div><div>That error makes sense once I remembered what was wrong. This might be another place where a better error message(not just the one linux reported back) would have probably helped shed light on what is going on, imho.<br>
<br><div class="gmail_quote">On Tue, Apr 12, 2011 at 6:10 AM, Michael Wilde <span dir="ltr"><<a href="mailto:wilde@mcs.anl.gov">wilde@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
Jon, the error is "Argument list too long" (E2BIG) - most likely because you are trying to form an argument list to an app that is longer than the Linux limit (which is host-specific and settable during Linux configuration, *I think*).<br>
<br>
As I was writing this response, I realized you already dealt with this issue in a thread on swift-user in Oct 2010 (subject "Argument list too long"). Is your current problem some new manifestation of the prior argument passing problem?<br>
<br>
I also realized that I dont understand the interaction between property "wrapper.parameter.mode" and the need to use writeData() to form argument lists, and that this needs to be explained in a Cookbook -> User Guide section.<br>
<br>
So before I go deeper into this, can you explain if the current problem is different than the prior one?<br>
<br>
Thanks,<br>
<br>
- Mike<br>
<br>
----<br>
<br>
<br>
This page has some useful info on the limit:<br>
<a href="http://www.in-ulm.de/~mascheck/various/argmax/" target="_blank">http://www.in-ulm.de/~mascheck/various/argmax/</a><br>
<br>
On communicado the limit seems to be some percentage of the stack size, which defaults to 10M. The article above says that Linux 2.26 and above use .25 * stack size.<br>
<br>
Where are you running, and what is the likely command line length of your largest app invocations? (Keep in mind that pathnames may be longer than you expect and that Swift is running _swiftwrap which also has specific arg passing conventions).<br>
<br>
This is often an issue when you call a summarization app, and try to pass it all the files processed in some large prior foreach loop.<br>
<br>
Ben added some support for passing much longer argument lists in a file via the function writeData, and there is also this property:<br>
<br>
# Controls how swift will supply parameters to the remote wrapper script.<br>
# 'args' mode will pass parameters on the command line<br>
# 'files' mode will pass parameters through an additional input file<br>
#<br>
# valid values: args, files<br>
# Default: files<br>
#<br>
# wrapper.parameter.mode=args<br>
<div><div></div><div class="h5"><br>
<br>
<br>
<br>
----- Original Message -----<br>
> Does anyone know what is this error trying to tell me?<br>
><br>
><br>
> Caused by: Cannot run program "/bin/bash" (in directory<br>
> "/gpfs/pads/swift/jonmon/Swift/work/localhost/rectified-20110411-1923-pqygyay7"):<br>
> java.io.IOException: error=7, Argument list too long<br>
> Caused by: java.io.IOException: Cannot run program "/bin/bash" (in<br>
> directory<br>
> "/gpfs/pads/swift/jonmon/Swift/work/localhost/rectified-20110411-1923-pqygyay7"):<br>
> java.io.IOException: error=7, Argument list too long<br>
> --<br>
> Any intelligent fool can make things bigger and more complex... It<br>
> takes a touch of genius - and a lot of courage to move in the opposite<br>
> direction.<br>
> - Albert Einstein<br>
><br>
><br>
><br>
</div></div>> _______________________________________________<br>
> Swift-devel mailing list<br>
> <a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>
> <a href="http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel" target="_blank">http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel</a><br>
<font color="#888888"><br>
--<br>
Michael Wilde<br>
Computation Institute, University of Chicago<br>
Mathematics and Computer Science Division<br>
Argonne National Laboratory<br>
<br>
</font></blockquote></div><br><br clear="all"><br>-- <br>Any intelligent fool can make things bigger and more complex... It takes a touch of genius - and a lot of courage to move in the opposite direction.<br>- Albert Einstein<br>
<br><br>
</div>