[Swift-devel] Drop kickstart, adopt wrapper logs?
Ian Foster
foster at mcs.anl.gov
Fri Jul 25 10:25:47 CDT 2008
nicely put :)
On Jul 25, 2008, at 10:20 AM, Ben Clifford wrote:
>
> Its on my todo list. Its below the event horizon though (that being
> the
> line at which more prioritised things are arriving at a rate such that
> this never rises and is instead sucked into the black hole of
> infinity) so
> it won't get done.
>
> On Fri, 25 Jul 2008, Ian Foster wrote:
>
>> Mike:
>>
>> There was an agreement a year or more ago that the VDS group would
>> work with
>> the GRAM team on integration. I suspect it got dropped, but I
>> wanted to check.
>>
>> Ian.
>>
>> On Jul 25, 2008, at 8:17 AM, Michael Wilde wrote:
>>
>>> Im not aware of any work done in that direction.
>>> I would have to hunt back through emails for the last thing we
>>> said we would
>>> do.
>>>
>>> Its been an often discussed topic, but one thats hard to move
>>> forward on.
>>>
>>> The tradeoff is doing something that works well for swift, vs
>>> having a
>>> significantly larger and longer discussion on what would work for
>>> GRAM as
>>> well (and potentially Condor and ...)
>>>
>>> One possibility is that we stay with a kickstart like architecture
>>> where
>>> kickstart is the last thing called to launch the app, and that
>>> becomes a
>>> separable component that can be used elsewhere. We do it in a way
>>> that its
>>> useful with GRAM and other systems, and which users can just use.
>>>
>>> Then the discussion becomes mostly one of data format.
>>> There the two likely candidates are XML or name/value pairs,
>>> possibly in
>>> some other "standard" format, eg classads.
>>>
>>> Another possibility is to emit an xml doc in a rigid format that
>>> doesnt need
>>> an xml parser to process it - sort of n/v pairs in xml. This gets
>>> complicated with multiline and escape issues of course.
>>>
>>> Its worth a chat with the GRAM team. It will be a slower harder
>>> route
>>> though. Thats a tradeoff.
>>>
>>> - Mike
>>>
>>>
>>> On 7/25/08 8:01 AM, Ian Foster wrote:
>>>> Mike:
>>>> What is the status of the integration into kickstart into the
>>>> Globus
>>>> release?
>>>> Ian.
>>>> On Jul 25, 2008, at 7:41 AM, Michael Wilde wrote:
>>>>> was: Re: Can we copy Swift execution logs to CI network?
>>>>>
>>>>> Should we make this transition, dropping kickstart, and making the
>>>>> wrapper log a useful format that becomes part of the Swift runtime
>>>>> specification?
>>>>>
>>>>> On 7/15/08 4:18 PM, Ben Clifford wrote:
>>>>> <snip>
>>>>>> ...there's substantial lack of information
>>>>>> for many runs as we have been tweaking the logs over time
>>>>>> (especially
>>>>>> the worker node logs which take a similar place to kickstart
>>>>>> records
>>>>>> now - giving the actual on-worker cpu usage but are relatively
>>>>>> very
>>>>>> expensive to collect and move around).
>>>>>
>>>>> _______________________________________________
>>>>> Swift-devel mailing list
>>>>> Swift-devel at ci.uchicago.edu
>>>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>>
More information about the Swift-devel
mailing list