[Swift-devel] Swift and BGP plots

[Ioan Raicu]

OK, I converted the logs, and here is what I got.

The thing that bugs me is that things ran faster (per task) at the 
larger scale (a bit counter intuitive). Also, the maximum number of 
concurrent tasks I found was 20K, in both experiments. This doesn't seem 
right, as the experiments should have 4K or 6K active tasks at any time. 
Could I be looking at the wrong entries from the Swift logs?

I did this to get the data I needed from the Swift logs:
cat dc-4000.log | grep "JOB_START" > dc-4000-start-end.txt
cat dc-4000.log | grep "JOB_END" >> dc-4000-start-end.txt

Is this correct? Or should I be looking for other job events?

Ioan

4K run:
Average Task Execution Time (ms): 326663.0046845912 +/- 283374.34801782423



6K run:
Average Task Execution Time (ms): 246982.0736259041 +/- 123059.82258438379



Mihael Hategan wrote:
> On Tue, 2009-10-27 at 00:51 -0500, Mihael Hategan wrote:
>   
>> On Tue, 2009-10-27 at 00:41 -0500, Ioan Raicu wrote:
>>     
>>> Where can I get the Swift logs for these runs, I'd like to pass them
>>> through my Swift-to-Falkon conversion tool :)
>>>       
>> I ignored that because I was going to post them tomorrow. So hang on
>> until then.
>>     
>
> http://www.mcs.anl.gov/~hategan/dc-4000.log.gz
> http://www.mcs.anl.gov/~hategan/dc-6000.log.gz
>
>
>
>   

-- 
=================================================================
Ioan Raicu, Ph.D.
NSF/CRA Computing Innovation Fellow
=================================================================
Center for Ultra-scale Computing and Information Security (CUCIS)
Department of Electrical Engineering and Computer Science
Northwestern University
2145 Sheridan Rd, Tech M384 
Evanston, IL 60208-3118
=================================================================
Cel:   1-847-722-0876
Tel:   1-847-491-8163
Email: iraicu at eecs.northwestern.edu
Web:   http://www.eecs.northwestern.edu/~iraicu/
       https://wiki.cucis.eecs.northwestern.edu/
=================================================================
=================================================================


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20091027/7f091a98/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: moz-screenshot-1.jpg
Type: image/jpeg
Size: 72663 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20091027/7f091a98/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: moz-screenshot.jpg
Type: image/jpeg
Size: 74354 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20091027/7f091a98/attachment-0001.jpg>