[Swift-user] Argument list to long
Jonathan Monette
jon.monette at gmail.com
Mon Oct 4 21:48:58 CDT 2010
Sure can. I have two log files in my home directory on the ci
machines. ~jonmon
One is rather large(20M) and that is the one with
"wrapper.paramter.mode=files" not set. The other is about 4.7M and that
one has "wrapper.parameter.mode=files" set.
You should have permissions to read them.
On 10/04/2010 09:44 PM, Mihael Hategan wrote:
> Ok. I believe that now you hit a bug in swift. Luckily there might be
> something we can do about that.
> May I have the log file?
>
> On Mon, 2010-10-04 at 21:39 -0500, Jonathan Monette wrote:
>> By setting "wrapper.parameter.mode=files" I get "failed to transfer
>> wrapper logs". Here is my swift.properties file.
>>
>> execution.retries=0
>> sitedir.keep=true
>> status.mode=provider
>> //wrapper.log.always.transfer=true
>> foreach.maxthreads=1024
>> wrapper.parameter.mode=files
>>
>> I have tried this with "wrapper.log.always.transfer=true" both commented
>> and uncommented still get the same error.
>>
>> On 10/04/2010 08:25 PM, Mihael Hategan wrote:
>>> Groovy. Then set "wrapper.parameter.mode=files" in swift.properties.
>>>
>>> On Mon, 2010-10-04 at 18:59 -0500, Jonathan Monette wrote:
>>>> well if I am understanding the problem the input list will be about
>>>> 4100 files and the output list will be a single file (unless Swift adds
>>>> more input and output files). I do not think I am using provider
>>>> staging though. In my swift.properties i do not set the
>>>> use.provider.staging option and in etc/swift.properties
>>>> use.provider.staging is set to false.
>>>>
>>>> On 10/4/10 6:46 PM, Mihael Hategan wrote:
>>>>> On Mon, 2010-10-04 at 18:39 -0500, Jonathan Monette wrote:
>>>>>> Yes. I have to make sure that all 4100 files are created before the
>>>>>> failing app can execute.
>>>>>>
>>>>>> The writeData() way seems like a hack to get around the problem is Swift
>>>>>> but I will try it out and see if my script completes.
>>>>>>
>>>>>> Mihael: pasted below is the stack trace that was generated in the log file.
>>>>> Yeah. It's what Mike says.
>>>>>
>>>>> But it's not the app arguments. Instead, I'm guessing it's the
>>>>> input/output file lists.
>>>>>
>>>>> There was a scheme in non-provider-staging swift to pass these things in
>>>>> lists, but I'm guessing you are using provider staging. Perhaps some
>>>>> mode to automatically do this for large numbers of arguments is in
>>>>> order.
>>>>>
>>>>> Mihael
>>>>>
>
--
Jon
Computers are incredibly fast, accurate, and stupid. Human beings are incredibly slow, inaccurate, and brilliant. Together they are powerful beyond imagination.
- Albert Einstein
More information about the Swift-user
mailing list