[Swift-devel] Re: Kickstart

[Dan Gunter]

Newlines would be replaced with some other allowed character(s).

-Dan

Mihael Hategan wrote:
> So how would a java exception (being a multi-line thing) be logged in
> this format?
>
> Mihael
>
> On Wed, 2007-09-12 at 16:35 -0500, Michael Wilde wrote:
>   
>> Dan, sounds good.  As a GRAM and GridFTP client (using CoG interfaces) 
>> how would Swift (or Karajan, which Swift calls) insert these identifiers?
>>
>> (I'll step aside and let Mihael pick the discussion up with you when 
>> time permits - he's the developer of all layers of code involved from 
>> CoG up, and would know all the details).
>>
>> - Mike
>>
>>
>> Dan Gunter wrote:
>>     
>>> Hi,
>>>
>>> We (CEDPS) have prototype code to load logs, using a simple mapping of
>>> one event type to one table, into a relational DB (MySQL, Postgres,
>>> SQLite). We could use this as a starting point for some of the analysis.
>>>
>>> One of the issues that comes up immediately is how to know which events
>>> belong to which workflow. Any help kickstart could provide w.r.t.
>>> inserting common identifiers would ease the correlation task down the line..
>>>
>>> -Dan
>>>
>>> Michael Wilde wrote:
>>>       
>>>> Hi Brian,
>>>>
>>>> Lets continue this informally in email. Perhaps Ben (Swift Tech
>>>> Coordinator) can join one of the calls.
>>>>
>>>> It will be pretty simple to get kickstart data in the right form.
>>>>
>>>> But an intersting and perhaps valuable (dare I say exciting?) demo of
>>>> logging would be to do a multi-site workflow, and correlate all he
>>>> logs from GRAM, GridFTP, and Swift, into a meaningful ans useful
>>>> stream; then do queries/reports on that stream.
>>>>
>>>> I'm cc'ing the Swift devel list to encourage discussion, but I think
>>>> we can make small continuos steps in this direction and make something
>>>> interesting happen pretty readily.
>>>>
>>>> What would we need to do to get CEDPS-conformant logging from GRAM &
>>>> GridFTP at the sites we frequent? (the CI's TeraPort, uc-teragrid, and
>>>> tg sites at ncsa, sdsc, purdue, tacc, perhaps a few more?)  Plus OSG
>>>> sites as we start using them more?
>>>>
>>>> - Mike
>>>>
>>>>
>>>> Brian Tierney wrote:
>>>>         
>>>>> Mike:
>>>>>
>>>>> After reading the Kickstart paper, I think there are several possible
>>>>> areas of collaboration with CEDPS.
>>>>>
>>>>> Do you want to talk about this on one of the CEDPS calls, or perhaps
>>>>> better would be to discuss this in person when we are at ANL for the
>>>>> CEDPS meeting at the end of October.
>>>>>
>>>>> Thoughts?
>>>>>
>>>>>           
>>>       
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>>
>>     


-- 
Dan Gunter. voice:510-495-2504 fax:510-486-6363 dsd.lbl.gov/~dang