[Swift-devel] Swift and BGP plots

[Ioan Raicu]

Mihael,
Did you figure out why I am seeing 8K and 12K active tasks, when we only 
had 4K and 6K CPU cores? Were there really 128K tasks in the workflow? 
Just want to make sure the log conversion worked as expected.

Also, assuming there were really 128K tasks of 60 sec each, and 8K CPUs, 
the ideal time to complete the run 4K would be 960 sec. Run4K ran in 
1183 sec, giving us an end-to-end efficiency of 81%.

For the run6K, the ideal time was 640 sec, so with an actual time of 
884, we got an end-to-end efficiency of 72%.

Not quite the 90%+ efficiencies when looking at a per task level, but 
still quite good!

Ioan


Ioan Raicu wrote:
> Alright, here it is again:
> 4K run: Average Task Execution Time (ms): 61946.37017455522 +/- 
> 4884.571426229936
> Efficiency: 96.8%
>
> 6K run: Average Task Execution Time (ms): 64415.056860142206 +/- 
> 6090.13371098675
> Efficiency: 93.1%
>
> These both look pretty nice.
>
> Now, the only thing that still looks odd, is that in the 4K run, I see 
> 8K active tasks, and in the 6K run I see 12K active tasks. I also have 
> 128K tasks in total. Are my plots off by 2X somehow?
>
> Ioan
>
>
> 4K run:
>
>
> 6K run:
>
>
>
> Ioan Raicu wrote:
>> Great!
>>
>> Mihael Hategan wrote:
>>> On Tue, 2009-10-27 at 15:10 -0500, Ioan Raicu wrote:
>>>   
>>>> Which of these should I use in finding the Complete event? Or are they
>>>> equivalent?
>>>>
>>>> 2009-10-25 21:42:10,717-0500 INFO  LateBindingScheduler
>>>> Task(type=JOB_SUBMISSION, identity=urn:0-1-12173-1-1-1256524749960)
>>>> Completed. Waiting: 3606, Running: 16387. Heap size: 1003M, Heap free:
>>>> 66M, Max heap: 1024M
>>>>
>>>> 2009-10-25 21:42:10,608-0500 DEBUG TaskImpl Task(type=JOB_SUBMISSION,
>>>> identity=urn:1256524752479-1256524793584-1256524793585) setting status
>>>> to Completed
>>>>     
>>>
>>> It's probably best if you used TaskImpl for both Active and Completed.
>>>
>>>
>>>   
>>
>> -- 
>> =================================================================
>> Ioan Raicu, Ph.D.
>> NSF/CRA Computing Innovation Fellow
>> =================================================================
>> Center for Ultra-scale Computing and Information Security (CUCIS)
>> Department of Electrical Engineering and Computer Science
>> Northwestern University
>> 2145 Sheridan Rd, Tech M384 
>> Evanston, IL 60208-3118
>> =================================================================
>> Cel:   1-847-722-0876
>> Tel:   1-847-491-8163
>> Email: iraicu at eecs.northwestern.edu
>> Web:   http://www.eecs.northwestern.edu/~iraicu/
>>        https://wiki.cucis.eecs.northwestern.edu/
>> =================================================================
>> =================================================================
>>
>>   
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>>   
>
> -- 
> =================================================================
> Ioan Raicu, Ph.D.
> NSF/CRA Computing Innovation Fellow
> =================================================================
> Center for Ultra-scale Computing and Information Security (CUCIS)
> Department of Electrical Engineering and Computer Science
> Northwestern University
> 2145 Sheridan Rd, Tech M384 
> Evanston, IL 60208-3118
> =================================================================
> Cel:   1-847-722-0876
> Tel:   1-847-491-8163
> Email: iraicu at eecs.northwestern.edu
> Web:   http://www.eecs.northwestern.edu/~iraicu/
>        https://wiki.cucis.eecs.northwestern.edu/
> =================================================================
> =================================================================
>
>   

-- 
=================================================================
Ioan Raicu, Ph.D.
NSF/CRA Computing Innovation Fellow
=================================================================
Center for Ultra-scale Computing and Information Security (CUCIS)
Department of Electrical Engineering and Computer Science
Northwestern University
2145 Sheridan Rd, Tech M384 
Evanston, IL 60208-3118
=================================================================
Cel:   1-847-722-0876
Tel:   1-847-491-8163
Email: iraicu at eecs.northwestern.edu
Web:   http://www.eecs.northwestern.edu/~iraicu/
       https://wiki.cucis.eecs.northwestern.edu/
=================================================================
=================================================================


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20091028/178d7181/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 79153 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20091028/178d7181/attachment.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 79671 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20091028/178d7181/attachment-0001.jpe>