[Swift-devel] Re: provider staging stage-in rate on localhost and PADS

Mihael Hategan hategan at mcs.anl.gov
Wed Jan 19 12:13:11 CST 2011


On Wed, 2011-01-19 at 10:45 -0600, Michael Wilde wrote:
> A few more test results:
> 
> moving 3 byte files: this runs at about 20 jobs/sec in the single-node 8-core test.
> 
> moving 30MB files: runs 100 jobs in 143 secs = about 40 MB/sec total in/out
> 
> Both tests are using a single input file going to all jobs and N unique output files coming back.
> 
> So the latter job I think is about the same ballpark as Mihael's
> latest results?  And the former job confirms that provider staging
> does not seem to slow down the job rate unacceptably.

It would be interesting to compare this with the local file provider
(i.e. NFS).





More information about the Swift-devel mailing list