[Swift-devel] gridFTP urls for data in provider staging mode
Mihael Hategan
hategan at mcs.anl.gov
Thu Nov 17 11:09:57 CST 2011
On Thu, 2011-11-17 at 10:49 -0600, Michael Wilde wrote:
> (moving this thread to the swift-devel list)
>
> Mihael, can you clarify a few more aspects of this?
>
> - the staging mode determines if the file is read by the client
> ("file") or service ("proxy"), correct? Both should work?
Yes.
>
> - when a gsiftp-protocol URI is read, is it read and sent to the
> worker in a read loop, with good-sized buffers? Or is it read into
> local disk and then sent to the worker? Im hoping the former, so we
> can handle large files more reasonably.
The former, of course.
>
> - the provider used to read the file is determined by the protocol
> field in the URI, and not by the data provider listed for the site the
> job is going to, right?
Right.
> The latter is used solely for accessing the workdirectory, and hence
> does not apply (ie is not needed or ignored) for the case of provider
> staging, right?
That is correct.
More information about the Swift-devel
mailing list