[Swift-devel] [Fwd: [Swft] Swift Performance Data]

[Ian Foster]

Hi,

I'd like to ask: can we agree to put all other work on hold until we 
have got in place tools to collect traces from every run, archive them, 
and process them--as described below?

We've been talking about having these tools for months now, and each 
time I ask, I am told that they are "sort of there." But we also keep 
finding that people are creating custom plots, losing data, etc. If we 
stop all other work until we have these tools, then we will have them, 
and other problems will likely get easier to resolve.

Ian.

-------- Original Message --------
Subject: 	[Swft] Swift Performance Data
Date: 	Thu, 21 Jun 2007 08:33:11 -0500
From: 	Ian Foster <foster at mcs.anl.gov>
To: 	Mike Wilde <wilde at mcs.anl.gov>
CC: 	swft <swft at ci.uchicago.edu>, swift-devel at ci.uchicago.edu
References: 	<4679FBC8.1080606 at mcs.anl.gov> 
<467A6D78.4020702 at mcs.anl.gov> <467A7AC6.7020400 at mcs.anl.gov>



Or maybe that is clear. I'd suggest that we want a tool that, after a 
run, one of us can run to:

* Generate the three plots that Ioan has created
* Generate a file containing as much information as we can about the run 
and its parameters--maybe a name=value format?--and some derived values 
such as those I mentioned in earlier email
* Move these things to a known place
* Create a Web page with pointers to these information and stick it 
somewhere [or add it to an existing web page?]

Ian.



Ian Foster wrote:
> Mike:
>
> It seems important to define what the specific goals and milestones 
> are here, as it seems that simply asking for it doesn't get it done. 
> Perhaps we need a brief specification?
>
> Ian.
>
> Mike Wilde wrote:
>> Yes, this is what Ganglia has been using.
>>
>> Regarding the auto-publishing - Jens has a machanism that regularly 
>> posted info in rrd format on the state of the VDS lab machines, using 
>> a perl mechanism like what Ian described.  Perhaps we can find and 
>> adapt that for Ioan's numbers.
>> It was running on gainly I think. But its not hard to develop from 
>> scratch.
>>
>> It would be good to see the same numbers for all the Swift apps being 
>> worked on, driven initially by kickstart summaries and digesting the 
>> swift logfile.
>> We've long had this as a goal - now is a good time to push forward 
>> and do this.
>>
>> Nika and Tibi, could you work with Ioan on this?
>>
>> - Mike
>>
>>
>>
>> Ian Foster wrote, On 6/20/2007 11:17 PM:
>>> Hi,
>>>
>>> I was pointed at http://oss.oetiker.ch/rrdtool/, has anyone seen 
>>> this? Seems nice to me.
>>>
>>> Ian.
>>>
>>>
>>
>

-- 

  Ian Foster, Director, Computation Institute
Argonne National Laboratory & University of Chicago
Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439
Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637
Tel: +1 630 252 4619.  Web: www.ci.uchicago.edu.
     Globus Alliance: www.globus.org.



-- 

   Ian Foster, Director, Computation Institute
Argonne National Laboratory & University of Chicago
Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439
Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637
Tel: +1 630 252 4619.  Web: www.ci.uchicago.edu.
      Globus Alliance: www.globus.org.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20070624/67ebf932/attachment.html>