[Swift-devel] gridFTP urls for data in provider staging mode

Mihael Hategan hategan at mcs.anl.gov
Thu Nov 17 11:09:57 CST 2011


On Thu, 2011-11-17 at 10:49 -0600, Michael Wilde wrote:
> (moving this thread to the swift-devel list)
> 
> Mihael, can you clarify a few more aspects of this?
> 
> - the staging mode determines if the file is read by the client
> ("file") or service ("proxy"), correct?  Both should work?

Yes.

> 
> - when a gsiftp-protocol URI is read, is it read and sent to the
> worker in a read loop, with good-sized buffers? Or is it read into
> local disk and then sent to the worker?  Im hoping the former, so we
> can handle large files more reasonably.

The former, of course.

> 
> - the provider used to read the file is determined by the protocol
> field in the URI, and not by the data provider listed for the site the
> job is going to, right? 

Right.

>  The latter is used solely for accessing the workdirectory, and hence
> does not apply (ie is not needed or ignored) for the case of provider
> staging, right?

That is correct.




More information about the Swift-devel mailing list