[Swift-devel] Re: swift+glite

[Ben Clifford]

On Wed, 10 Sep 2008, Michael Wilde wrote:

> Please post info on what is needed in IO changes. I think this fits in with
> generalizing and improving the performance of the Swift IO strategy for other
> environments as well.

> What is the data transfer strategy when there is no cluster file system? Does
> the compute node need to pull data down as a gridftp client?

That's what I'm trying to do at the moment, using a site-local ftp server 
(that apparently doesn't share fs with the compute nodes).

That seems relatively straightforward.

There's a separate problem with no-shared-fs in that the wrapper script is 
also placed there prior to execution on the worker nodes, so a different 
mechanism for bootstrapping that on a worker node is necessary.

At the moment, I'm concentrating specifically on glite-specific 
mechanisms, not making a higher abstraction.

--