[Swift-user] Argument list to long
Mihael Hategan
hategan at mcs.anl.gov
Sat Oct 9 13:41:08 CDT 2010
And these files would be where exactly?
On Mon, 2010-10-04 at 21:48 -0500, Jonathan Monette wrote:
> Sure can. I have two log files in my home directory on the ci
> machines. ~jonmon
> One is rather large(20M) and that is the one with
> "wrapper.paramter.mode=files" not set. The other is about 4.7M and that
> one has "wrapper.parameter.mode=files" set.
> You should have permissions to read them.
>
> On 10/04/2010 09:44 PM, Mihael Hategan wrote:
> > Ok. I believe that now you hit a bug in swift. Luckily there might be
> > something we can do about that.
> > May I have the log file?
> >
> > On Mon, 2010-10-04 at 21:39 -0500, Jonathan Monette wrote:
> >> By setting "wrapper.parameter.mode=files" I get "failed to transfer
> >> wrapper logs". Here is my swift.properties file.
> >>
> >> execution.retries=0
> >> sitedir.keep=true
> >> status.mode=provider
> >> //wrapper.log.always.transfer=true
> >> foreach.maxthreads=1024
> >> wrapper.parameter.mode=files
> >>
> >> I have tried this with "wrapper.log.always.transfer=true" both commented
> >> and uncommented still get the same error.
> >>
> >> On 10/04/2010 08:25 PM, Mihael Hategan wrote:
> >>> Groovy. Then set "wrapper.parameter.mode=files" in swift.properties.
> >>>
> >>> On Mon, 2010-10-04 at 18:59 -0500, Jonathan Monette wrote:
> >>>> well if I am understanding the problem the input list will be about
> >>>> 4100 files and the output list will be a single file (unless Swift adds
> >>>> more input and output files). I do not think I am using provider
> >>>> staging though. In my swift.properties i do not set the
> >>>> use.provider.staging option and in etc/swift.properties
> >>>> use.provider.staging is set to false.
> >>>>
> >>>> On 10/4/10 6:46 PM, Mihael Hategan wrote:
> >>>>> On Mon, 2010-10-04 at 18:39 -0500, Jonathan Monette wrote:
> >>>>>> Yes. I have to make sure that all 4100 files are created before the
> >>>>>> failing app can execute.
> >>>>>>
> >>>>>> The writeData() way seems like a hack to get around the problem is Swift
> >>>>>> but I will try it out and see if my script completes.
> >>>>>>
> >>>>>> Mihael: pasted below is the stack trace that was generated in the log file.
> >>>>> Yeah. It's what Mike says.
> >>>>>
> >>>>> But it's not the app arguments. Instead, I'm guessing it's the
> >>>>> input/output file lists.
> >>>>>
> >>>>> There was a scheme in non-provider-staging swift to pass these things in
> >>>>> lists, but I'm guessing you are using provider staging. Perhaps some
> >>>>> mode to automatically do this for large numbers of arguments is in
> >>>>> order.
> >>>>>
> >>>>> Mihael
> >>>>>
> >
>
More information about the Swift-user
mailing list