[Swift-devel] provider staging stage-in rate on localhost and PADS

[Allan Espinosa]

setup1:

N workers on localhost (10, 20, 40)
coaster service on localhost
swift client on localhost

10,000 2.3MB files in Localdisk (/var/tmp/RuptureVariations in communicado)
jobs are simple 'cat inputfile' jobs.  no data is explicitly staged
out in the app() invocation

Result:
max transfer rate is 7MB/s with 10 workers resulting to a 2.5 jobs
staged per second rate.

I attached the plot of bandwidth (red = 10 workers, green = 20
workers, blue = 40 workers).

We maybe CPU bound at this point.  i'll try testing on
communicado->bridled next.

setup2: (communicado->PADS)

N workers on PADS workers (10, 40)
coaster service on communicadp
swift client on communicado

pads.png shows the plot of bandwidth (max is around 5.5MB/s).
legend: black = 10 workers, red = 40 workers

this translates to a jobrate of  2 jobs/ second

-Allan

-- 
Allan M. Espinosa <http://amespinosa.wordpress.com>
PhD student, Computer Science
University of Chicago <http://people.cs.uchicago.edu/~aespinosa>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: local.png
Type: image/png
Size: 35236 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110112/111bfd1b/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pads.png
Type: image/png
Size: 28595 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110112/111bfd1b/attachment-0001.png>