[Swift-devel] lots of very small files vs gridftp
Mihael Hategan
hategan at mcs.anl.gov
Tue Sep 30 20:03:50 CDT 2008
On Wed, 2008-10-01 at 00:56 +0000, Ben Clifford wrote:
> On Tue, 30 Sep 2008, Mihael Hategan wrote:
>
> > This reminds me of clustering of jobs we did initially with swift
> > versus Falkon.
>
> yes. its half a cut-and-paste job of that code.
I was mostly thinking about the conceptual part and the implications. At
least for small jobs, Falkon turned out to be the better option.
>
> > Could the untar job be done with fork straight through gram?
>
> yes. though my feeling at the moment when there is something like coasters
> around with spare nodes is that this wouldn't change much. In the case of
> non-coaster runs using something like gram4 that can still take a
> reasonable number of jobs, getting the untar pushed ahead of queued 'work'
> jobs is probably good.
>
More information about the Swift-devel
mailing list