[Swift-devel] re: IO overheads of swift wrapper scripts on BlueGene/P

[Ben Clifford]

swift r2970 changed copying outputs to a hard-link of outputs to improve 
performance at the output stage. you might be interested to see how that 
works.

(also, don't use the same runid for different runs. you'll get into 
trouble somehow sooner or later. )


r2970 | benc | 2009-06-22 23:40:53 +1000 (Mon, 22 Jun 2009) | 6 lines

Make wrapper use mv to stage out files to shared directory rather than cp.
This should be faster when the job directories are on the same filesystem
as the site shared cache.

(suggested by tuecke)


--