[Swift-devel] Issues in worker-side GridFTP

[Michael Wilde]

Justin, does current CDM and provider staging interact correctly? Ie, if we introduce a CDM mode called "worker-staging", will CDM operate with *provider staging* in the manner you described in your prior message?

The disadvantage of provider staging, at the moment, is that when enabled it applies to all sites. But for cases where that is acceptable, this might work.

So if CDM "direct" works with provider staging, then we could, as discussed in earlier meetings, use that as a base for a worker-staging mode.

- Mike

----- Original Message -----
> From: "Ketan Maheshwari" <ketancmaheshwari at gmail.com>
> To: "Michael Wilde" <wilde at mcs.anl.gov>
> Cc: "Justin M Wozniak" <wozniak at mcs.anl.gov>, "Swift Devel" <swift-devel at ci.uchicago.edu>, "Ketan Maheshwari"
> <ketan at mcs.anl.gov>
> Sent: Tuesday, November 1, 2011 9:22:23 AM
> Subject: Re: [Swift-devel] Issues in worker-side GridFTP
> Given that provider staging is good enough for small size data
> transfer, it could be used to transfer setup data while a worker side
> guc could be used for application data.
> 
> 
> On Tue, Nov 1, 2011 at 9:13 AM, Michael Wilde < wilde at mcs.anl.gov >
> wrote:
> 
> 
> Right, and that is the problem I'm asking about: if the site has no
> GridFTP server, the current "setup" operations will not work and must
> be done in some other way (I *think*).
> 
> - Mike
> 
> 
> ----- Original Message -----
> > From: "Justin M Wozniak" < wozniak at mcs.anl.gov >
> > To: "Michael Wilde" < wilde at mcs.anl.gov >
> > Cc: "Mihael Hategan" < hategan at mcs.anl.gov >, "Ketan Maheshwari" <
> > ketan at mcs.anl.gov >, "Swift Devel"
> > < swift-devel at ci.uchicago.edu >
> > Sent: Tuesday, November 1, 2011 8:50:51 AM
> > Subject: Re: Issues in worker-side GridFTP
> 
> > On Tue, 1 Nov 2011, Michael Wilde wrote:
> >
> > > I'm wondering how worker-side GridFTP will work with respect to
> > > data
> > > management functions like creation of the work directory, job
> > > directory,
> > > and transfer of utility files like swiftwrap etc.
> >
> > If you do this with CDM, only the user data files will be affected.
> > The
> > other file operations are unchanged.
> >
> > --
> > Justin M Wozniak
> 
> --
> Michael Wilde
> Computation Institute, University of Chicago
> Mathematics and Computer Science Division
> Argonne National Laboratory
> 
> 
> 
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> 
> 
> 
> 
> --
> Ketan

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory