[Swift-devel] using Swift Trunk for pbs/beagle: doesn't scale

Ketan Maheshwari ketancmaheshwari at gmail.com
Tue Jun 28 12:06:01 CDT 2011


A log of the run is here:
/lustre/beagle/ketan/labs/modftdock/production/campaign5/ftdock-20110627-1307-5uq66e5a.log

On Tue, Jun 28, 2011 at 11:36 AM, Ketan Maheshwari <
ketancmaheshwari at gmail.com> wrote:

> It seems at 1600 app task rate, after a while the run stalls. However, this
> does not get reflected on the std.err which seems to think tasks are still
> active. While std.out reports the waiting thread status and job queues die
> down.
>
>
> On Mon, Jun 27, 2011 at 2:00 PM, Ketan Maheshwari <
> ketancmaheshwari at gmail.com> wrote:
>
>> I was trying trunk on beagle today. Seems when I try to scale up the
>> number of app tasks, it hangs. To be more precise, I found that above a
>> threshold of 1600 app tasks, the run hangs with following periodic std.outs:
>>
>> No events in 10s.
>>
>> Registered futures:
>> string[] str_roots  Closed, 500 elements, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> int n  Closed, no listeners
>> ----
>>
>> Waiting threads:
>> 0-2
>> ----
>>
>> When, the threshold is <=1600 app tasks, it seems to work. The
>> SWIFT_MAX_HEAP is 7000MB.
>>
>>
>> --
>> Ketan
>>
>>
>
>
> --
> Ketan
>
>
>


-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110628/a4af85d0/attachment.html>


More information about the Swift-devel mailing list