[Swift-devel] Re: Kickstart

[Michael Wilde]

Dan, sounds good.  As a GRAM and GridFTP client (using CoG interfaces) 
how would Swift (or Karajan, which Swift calls) insert these identifiers?

(I'll step aside and let Mihael pick the discussion up with you when 
time permits - he's the developer of all layers of code involved from 
CoG up, and would know all the details).

- Mike


Dan Gunter wrote:
> Hi,
> 
> We (CEDPS) have prototype code to load logs, using a simple mapping of
> one event type to one table, into a relational DB (MySQL, Postgres,
> SQLite). We could use this as a starting point for some of the analysis.
> 
> One of the issues that comes up immediately is how to know which events
> belong to which workflow. Any help kickstart could provide w.r.t.
> inserting common identifiers would ease the correlation task down the line..
> 
> -Dan
> 
> Michael Wilde wrote:
>> Hi Brian,
>>
>> Lets continue this informally in email. Perhaps Ben (Swift Tech
>> Coordinator) can join one of the calls.
>>
>> It will be pretty simple to get kickstart data in the right form.
>>
>> But an intersting and perhaps valuable (dare I say exciting?) demo of
>> logging would be to do a multi-site workflow, and correlate all he
>> logs from GRAM, GridFTP, and Swift, into a meaningful ans useful
>> stream; then do queries/reports on that stream.
>>
>> I'm cc'ing the Swift devel list to encourage discussion, but I think
>> we can make small continuos steps in this direction and make something
>> interesting happen pretty readily.
>>
>> What would we need to do to get CEDPS-conformant logging from GRAM &
>> GridFTP at the sites we frequent? (the CI's TeraPort, uc-teragrid, and
>> tg sites at ncsa, sdsc, purdue, tacc, perhaps a few more?)  Plus OSG
>> sites as we start using them more?
>>
>> - Mike
>>
>>
>> Brian Tierney wrote:
>>> Mike:
>>>
>>> After reading the Kickstart paper, I think there are several possible
>>> areas of collaboration with CEDPS.
>>>
>>> Do you want to talk about this on one of the CEDPS calls, or perhaps
>>> better would be to discuss this in person when we are at ANL for the
>>> CEDPS meeting at the end of October.
>>>
>>> Thoughts?
>>>
> 
>