[Swift-devel] lots of very small files vs gridftp

Mihael Hategan hategan at mcs.anl.gov
Tue Sep 30 20:03:50 CDT 2008


On Wed, 2008-10-01 at 00:56 +0000, Ben Clifford wrote:
> On Tue, 30 Sep 2008, Mihael Hategan wrote:
> 
> > This reminds me of clustering of jobs we did initially with swift
> > versus Falkon.
> 
> yes. its half a cut-and-paste job of that code.

I was mostly thinking about the conceptual part and the implications. At
least for small jobs, Falkon turned out to be the better option.

> 
> > Could the untar job be done with fork straight through gram?
> 
> yes. though my feeling at the moment when there is something like coasters 
> around with spare nodes is that this wouldn't change much. In the case of 
> non-coaster runs using something like gram4 that can still take a 
> reasonable number of jobs, getting the untar pushed ahead of queued 'work' 
> jobs is probably good.
> 




More information about the Swift-devel mailing list