[Swift-user] Walltime Exceeded

[Michael Wilde]

In addition to Yadu's good pointers, I would add: if your app( ) call 
was terminated by Swift for running for 15 minutes, and you were trying 
to set that time limit down to 5 minutes, then you also need to 
investigate why your app( ) call was running for so long. Is it perhaps 
in an infinite loop, or running much less efficiently than you expected?

Based on how you are managing output files, you should look for a way to 
see if your app( ) run is executing productively and as expected.

- Mike

On 10/25/14 12:45 PM, Yadu Nand Babuji wrote:
> Hi Gagan,
>
> You are using swift-trunk on the cloud nodes, so you should be using 
> the (swift.conf) config files for trunk.
> The configs are specified using swift.conf files, and you should be 
> able to get a few examples from the 
> cloud-tutorials/swift-cloud-tutorial folders.
> If you have the swift.conf file in your current directory you need not 
> specify the conf file on the swift commandline, say "swift p5.swift" 
> while in the
> cloud-tutorials/swift-cloud-tutorials/part05 directory.
>
> Here's a sample config with the walltime for ALL apps set to 15 minutes :
>
> sites: local
>
> site.local {
>     filesystem {
>         type: "local"
>         URL: "localhost"
>     }
>     execution {
>         type: "local"
>         URL: "localhost"
>     }
>     workDirectory: /tmp/${env.USER}/swiftwork
>     maxParallelTasks: 32
>     initialParallelTasks: 31
>     app.ALL {
>         executable: "*"
>         maxWallTime: "00:15:00"
>     }
> }
>
> The swift-trunk userguide has more detailed documentation on the 
> various configuration options that the swift.conf file takes:
> http://swift-lang.org/guides/trunk/userguide/userguide.html
>
> Thanks,
> Yadu
>
>
>
> On 10/25/2014 06:53 AM, Gagan Munisiddha Gowda wrote:
>> Hi,
>>
>> I am running a swift program on 10gb data (split into 100mb each).
>>
>> I am using a Node.js script for processing.
>>
>> I did increase the Walltime by adding below to persistent-coaster and 
>> local-coaster files in /usr/local/bin/swift-trunk/etc/sites.
>>
>>  <profile namespace="globus" key="maxWallTime">00:05:00</profile>
>>
>> But, of no use. The entire program runs for around 14 minutes when it 
>> throws this exception.
>>
>>
>> Here's my error :
>>
>> 2014-10-25 10:29:04,113+0000 INFO  Execute TASK_STATUS_CHANGE 
>> taskid=urn:R-3-1414232059111 status=5 Walltime exceeded
>> 2014-10-25 10:29:04,121+0000 INFO  LateBindingScheduler jobs queued: 0
>> 2014-10-25 10:29:04,122+0000 DEBUG swift APPLICATION_EXCEPTION 
>> jobid=node-vvboibzl - Application exception: Walltime exceeded
>>
>> 2014-10-25 10:29:04,125+0000 INFO  swift END_FAILURE thread=R-3 tr=node
>> 2014-10-25 10:29:04,127+0000 INFO  Loader Swift finished with errors
>>
>> Please find complete log file attached.
>>
>> -- 
>> Regards,
>> Gagan
>>
>>
>> _______________________________________________
>> Swift-user mailing list
>> Swift-user at ci.uchicago.edu
>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>
>
>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user

-- 
Michael Wilde
Mathematics and Computer Science          Computation Institute
Argonne National Laboratory               The University of Chicago

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20141025/9fe9cd02/attachment.html>