[Swift-devel] Re: Kickstart

[Dan Gunter]

Hi,

We (CEDPS) have prototype code to load logs, using a simple mapping of
one event type to one table, into a relational DB (MySQL, Postgres,
SQLite). We could use this as a starting point for some of the analysis.

One of the issues that comes up immediately is how to know which events
belong to which workflow. Any help kickstart could provide w.r.t.
inserting common identifiers would ease the correlation task down the line..

-Dan

Michael Wilde wrote:
> Hi Brian,
>
> Lets continue this informally in email. Perhaps Ben (Swift Tech
> Coordinator) can join one of the calls.
>
> It will be pretty simple to get kickstart data in the right form.
>
> But an intersting and perhaps valuable (dare I say exciting?) demo of
> logging would be to do a multi-site workflow, and correlate all he
> logs from GRAM, GridFTP, and Swift, into a meaningful ans useful
> stream; then do queries/reports on that stream.
>
> I'm cc'ing the Swift devel list to encourage discussion, but I think
> we can make small continuos steps in this direction and make something
> interesting happen pretty readily.
>
> What would we need to do to get CEDPS-conformant logging from GRAM &
> GridFTP at the sites we frequent? (the CI's TeraPort, uc-teragrid, and
> tg sites at ncsa, sdsc, purdue, tacc, perhaps a few more?)  Plus OSG
> sites as we start using them more?
>
> - Mike
>
>
> Brian Tierney wrote:
>>
>> Mike:
>>
>> After reading the Kickstart paper, I think there are several possible
>> areas of collaboration with CEDPS.
>>
>> Do you want to talk about this on one of the CEDPS calls, or perhaps
>> better would be to discuss this in person when we are at ANL for the
>> CEDPS meeting at the end of October.
>>
>> Thoughts?
>>


-- 
Dan Gunter. voice:510-495-2504 fax:510-486-6363 dsd.lbl.gov/~dang