[Swift-devel] Re: swift performance optimization on BGP

Ioan Raicu iraicu at cs.uchicago.edu
Fri Oct 17 13:04:16 CDT 2008


Is this the right summary?
> Total number of events: 512
> Shortest event (s): 30
> Longest event (s): 43
> Total duration of all events (s): 17906
> Mean event duration (s): 34.97265625
> Standard deviation of event duration (s): 2.67205488703656
> Maximum number of events at one time: 262
>   
which shows that it takes ~35 sec for Swift to run a 30 sec task?  5 sec 
overhead sounds pretty good, if we can keep it this low as we scale up 
to more CPUs :)

Good job!

Ioan

Zhao Zhang wrote:
> Hi, All
>
> After the optimization last week, I was suffering the 2nd round task 
> poor performance, as you could tell
> from the "info trails" picture on 
> http://www.ci.uchicago.edu/~zzhang/report-sleep-20081016-1509-gqr8tea9/  
>
> with bunch of tests and verification, I found the poor performance 
> comes from the info log transfer. Thus I tried
> the collective IO for info log transfer, and it solves the problem, I 
> get such a beautiful picture:
>
> I am working more to integrate the Collective IO system along with 
> swift on BGP.
>
> zhao
>
> ------------------------------------------------------------------------
>
>
> ------------------------------------------------------------------------
>

-- 
===================================================
Ioan Raicu
Ph.D. Candidate
===================================================
Distributed Systems Laboratory
Computer Science Department
University of Chicago
1100 E. 58th Street, Ryerson Hall
Chicago, IL 60637
===================================================
Email: iraicu at cs.uchicago.edu
Web:   http://www.cs.uchicago.edu/~iraicu
http://dev.globus.org/wiki/Incubator/Falkon
http://dsl-wiki.cs.uchicago.edu/index.php/Main_Page
===================================================
===================================================


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20081017/09a806f2/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 5628 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20081017/09a806f2/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 4989 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20081017/09a806f2/attachment-0001.png>


More information about the Swift-devel mailing list