[Swift-devel] Swift Performance Data

[Ian Foster]

I think I disagree on both points:

i) I think that we could produce some tools that would grab the relevant 
files and stick them somewhere central. I've proposed some ideas in 
previous emails.

ii) Of course we can imagine sophisticated tools. But there are also 
tools that various of you have already produced that generate graphs of 
various sorts. We should package these and (I think) integrate them with 
(i) so that when we grab the files we also run the programs to generate 
the graphs.

Ian.



Ben Clifford wrote:
> As far as I see, Ian asked for two separate things:
>
>  i) most importantly (to him) the collection of raw data. that's a case of 
> collecting files and not changing them.
>
>  ii) the development of a log analysis stack. This very much overlaps with 
> what CEDPS and is a much bigger job. There are two fairly contradictory 
> views: that we shouldn't let CEDPS get in our way, and that we should have 
> a pile of hacked up tools.
>
> i) is something for app people to do.
>
> ii) is a much bigger development effort which really should go in the 
> bugzilla and wait its turn.
>
> On Mon, 25 Jun 2007, Mike Wilde wrote:
>
>   
>> collecting logs and generating reports/plots easily and in a standard format,
>> so we can set goals against specific metrics for each workflow/application and
>> track how we are progressing against those goals, for each.
>>
>> - Mike
>>
>> Mihael Hategan wrote, On 6/25/2007 11:15 AM:
>>     
>>> On Mon, 2007-06-25 at 11:03 -0500, Ian Foster wrote:
>>>       
>>>> So who is going to do this?
>>>>
>>>> I've been asking about this for some time, and nothing has happened. The
>>>> result, I think, has been a lot of confusion and delay.
>>>>         
>>> Are we still talking about collecting logs? I'm a bit confused.
>>>
>>>       
>>>>> I agree fully with Mihael's point that we can and should start gathering
>>>>> all execution logs into a uniformly structured gathering place. Then we
>>>>> can organize the current log tools and determine whats needed next in
>>>>> that area.
>>>>>
>>>>>           
>>>       
>>     
>
>   

-- 

   Ian Foster, Director, Computation Institute
Argonne National Laboratory & University of Chicago
Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439
Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637
Tel: +1 630 252 4619.  Web: www.ci.uchicago.edu.
      Globus Alliance: www.globus.org.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20070625/cca2e65e/attachment.html>