[Swift-user] Argument list to long
Mihael Hategan
hategan at mcs.anl.gov
Mon Oct 4 21:44:52 CDT 2010
Ok. I believe that now you hit a bug in swift. Luckily there might be
something we can do about that.
May I have the log file?
On Mon, 2010-10-04 at 21:39 -0500, Jonathan Monette wrote:
> By setting "wrapper.parameter.mode=files" I get "failed to transfer
> wrapper logs". Here is my swift.properties file.
>
> execution.retries=0
> sitedir.keep=true
> status.mode=provider
> //wrapper.log.always.transfer=true
> foreach.maxthreads=1024
> wrapper.parameter.mode=files
>
> I have tried this with "wrapper.log.always.transfer=true" both commented
> and uncommented still get the same error.
>
> On 10/04/2010 08:25 PM, Mihael Hategan wrote:
> > Groovy. Then set "wrapper.parameter.mode=files" in swift.properties.
> >
> > On Mon, 2010-10-04 at 18:59 -0500, Jonathan Monette wrote:
> >> well if I am understanding the problem the input list will be about
> >> 4100 files and the output list will be a single file (unless Swift adds
> >> more input and output files). I do not think I am using provider
> >> staging though. In my swift.properties i do not set the
> >> use.provider.staging option and in etc/swift.properties
> >> use.provider.staging is set to false.
> >>
> >> On 10/4/10 6:46 PM, Mihael Hategan wrote:
> >>> On Mon, 2010-10-04 at 18:39 -0500, Jonathan Monette wrote:
> >>>> Yes. I have to make sure that all 4100 files are created before the
> >>>> failing app can execute.
> >>>>
> >>>> The writeData() way seems like a hack to get around the problem is Swift
> >>>> but I will try it out and see if my script completes.
> >>>>
> >>>> Mihael: pasted below is the stack trace that was generated in the log file.
> >>> Yeah. It's what Mike says.
> >>>
> >>> But it's not the app arguments. Instead, I'm guessing it's the
> >>> input/output file lists.
> >>>
> >>> There was a scheme in non-provider-staging swift to pass these things in
> >>> lists, but I'm guessing you are using provider staging. Perhaps some
> >>> mode to automatically do this for large numbers of arguments is in
> >>> order.
> >>>
> >>> Mihael
> >>>
> >
>
More information about the Swift-user
mailing list