[Swift-devel] Drop kickstart, adopt wrapper logs?

Ian Foster foster at mcs.anl.gov
Fri Jul 25 10:25:47 CDT 2008


nicely put :)

On Jul 25, 2008, at 10:20 AM, Ben Clifford wrote:

>
> Its on my todo list. Its below the event horizon though (that being  
> the
> line at which more prioritised things are arriving at a rate such that
> this never rises and is instead sucked into the black hole of  
> infinity) so
> it won't get done.
>
> On Fri, 25 Jul 2008, Ian Foster wrote:
>
>> Mike:
>>
>> There was an agreement a year or more ago that the VDS group would  
>> work with
>> the GRAM team on integration. I suspect it got dropped, but I  
>> wanted to check.
>>
>> Ian.
>>
>> On Jul 25, 2008, at 8:17 AM, Michael Wilde wrote:
>>
>>> Im not aware of any work done in that direction.
>>> I would have to hunt back through emails for the last thing we  
>>> said we would
>>> do.
>>>
>>> Its been an often discussed topic, but one thats hard to move  
>>> forward on.
>>>
>>> The tradeoff is doing something that works well for swift, vs  
>>> having a
>>> significantly larger and longer discussion on what would work for  
>>> GRAM as
>>> well (and potentially Condor and ...)
>>>
>>> One possibility is that we stay with a kickstart like architecture  
>>> where
>>> kickstart is the last thing called to launch the app, and that  
>>> becomes a
>>> separable component that can be used elsewhere. We do it in a way  
>>> that its
>>> useful with GRAM and other systems, and which users can just use.
>>>
>>> Then the discussion becomes mostly one of data format.
>>> There the two likely candidates are XML or name/value pairs,  
>>> possibly in
>>> some other "standard" format, eg classads.
>>>
>>> Another possibility is to emit an xml doc in a rigid format that  
>>> doesnt need
>>> an xml parser to process it - sort of n/v pairs in xml. This gets
>>> complicated with multiline and escape issues of course.
>>>
>>> Its worth a chat with the GRAM team.  It will be a slower harder  
>>> route
>>> though.  Thats a tradeoff.
>>>
>>> - Mike
>>>
>>>
>>> On 7/25/08 8:01 AM, Ian Foster wrote:
>>>> Mike:
>>>> What is the status of the integration into kickstart into the  
>>>> Globus
>>>> release?
>>>> Ian.
>>>> On Jul 25, 2008, at 7:41 AM, Michael Wilde wrote:
>>>>> was: Re: Can we copy Swift execution logs to CI network?
>>>>>
>>>>> Should we make this transition, dropping kickstart, and making the
>>>>> wrapper log a useful format that becomes part of the Swift runtime
>>>>> specification?
>>>>>
>>>>> On 7/15/08 4:18 PM, Ben Clifford wrote:
>>>>> <snip>
>>>>>> ...there's substantial lack of information
>>>>>> for many runs as we have been tweaking the logs over time  
>>>>>> (especially
>>>>>> the worker node logs which take a similar place to kickstart  
>>>>>> records
>>>>>> now - giving the actual on-worker cpu usage but are relatively  
>>>>>> very
>>>>>> expensive to collect and move around).
>>>>>
>>>>> _______________________________________________
>>>>> Swift-devel mailing list
>>>>> Swift-devel at ci.uchicago.edu
>>>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>>




More information about the Swift-devel mailing list