[Swift-devel] Issues in worker-side GridFTP

[Justin M Wozniak]

Yes, the CDM features were copied into _swiftwrap.staging and 
vdl-int-staging.k .

On Tue, 1 Nov 2011, Michael Wilde wrote:

> Justin, does current CDM and provider staging interact correctly? Ie, if 
> we introduce a CDM mode called "worker-staging", will CDM operate with 
> *provider staging* in the manner you described in your prior message?
>
> The disadvantage of provider staging, at the moment, is that when 
> enabled it applies to all sites. But for cases where that is acceptable, 
> this might work.
>
> So if CDM "direct" works with provider staging, then we could, as 
> discussed in earlier meetings, use that as a base for a worker-staging 
> mode.
>
> - Mike
>
> ----- Original Message -----
>> From: "Ketan Maheshwari" <ketancmaheshwari at gmail.com>
>> To: "Michael Wilde" <wilde at mcs.anl.gov>
>> Cc: "Justin M Wozniak" <wozniak at mcs.anl.gov>, "Swift Devel" <swift-devel at ci.uchicago.edu>, "Ketan Maheshwari"
>> <ketan at mcs.anl.gov>
>> Sent: Tuesday, November 1, 2011 9:22:23 AM
>> Subject: Re: [Swift-devel] Issues in worker-side GridFTP
>> Given that provider staging is good enough for small size data
>> transfer, it could be used to transfer setup data while a worker side
>> guc could be used for application data.
>>
>>
>> On Tue, Nov 1, 2011 at 9:13 AM, Michael Wilde < wilde at mcs.anl.gov >
>> wrote:
>>
>>
>> Right, and that is the problem I'm asking about: if the site has no
>> GridFTP server, the current "setup" operations will not work and must
>> be done in some other way (I *think*).
>>
>> - Mike
>>
>>
>> ----- Original Message -----
>>> From: "Justin M Wozniak" < wozniak at mcs.anl.gov >
>>> To: "Michael Wilde" < wilde at mcs.anl.gov >
>>> Cc: "Mihael Hategan" < hategan at mcs.anl.gov >, "Ketan Maheshwari" <
>>> ketan at mcs.anl.gov >, "Swift Devel"
>>> < swift-devel at ci.uchicago.edu >
>>> Sent: Tuesday, November 1, 2011 8:50:51 AM
>>> Subject: Re: Issues in worker-side GridFTP
>>
>>> On Tue, 1 Nov 2011, Michael Wilde wrote:
>>>
>>>> I'm wondering how worker-side GridFTP will work with respect to
>>>> data
>>>> management functions like creation of the work directory, job
>>>> directory,
>>>> and transfer of utility files like swiftwrap etc.
>>>
>>> If you do this with CDM, only the user data files will be affected.
>>> The
>>> other file operations are unchanged.
>>>
>>> --
>>> Justin M Wozniak
>>
>> --
>> Michael Wilde
>> Computation Institute, University of Chicago
>> Mathematics and Computer Science Division
>> Argonne National Laboratory
>>
>>
>>
>>
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>>
>>
>>
>>
>> --
>> Ketan
>
>

-- 
Justin M Wozniak