<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
</head>
<body bgcolor="#ffffff" text="#000000">
Hi,<br>
<br>
I'd like to ask: can we agree to put all other work on hold until we
have got in place tools to collect traces from every run, archive them,
and process them--as described below?<br>
<br>
We've been talking about having these tools for months now, and each
time I ask, I am told that they are "sort of there." But we also keep
finding that people are creating custom plots, losing data, etc. If we
stop all other work until we have these tools, then we will have them,
and other problems will likely get easier to resolve.<br>
<br>
Ian.<br>
<br>
-------- Original Message --------
<table class="moz-email-headers-table" border="0" cellpadding="0"
cellspacing="0">
<tbody>
<tr>
<th align="right" nowrap="nowrap" valign="baseline">Subject: </th>
<td>[Swft] Swift Performance Data</td>
</tr>
<tr>
<th align="right" nowrap="nowrap" valign="baseline">Date: </th>
<td>Thu, 21 Jun 2007 08:33:11 -0500</td>
</tr>
<tr>
<th align="right" nowrap="nowrap" valign="baseline">From: </th>
<td>Ian Foster <a class="moz-txt-link-rfc2396E" href="mailto:foster@mcs.anl.gov"><foster@mcs.anl.gov></a></td>
</tr>
<tr>
<th align="right" nowrap="nowrap" valign="baseline">To: </th>
<td>Mike Wilde <a class="moz-txt-link-rfc2396E" href="mailto:wilde@mcs.anl.gov"><wilde@mcs.anl.gov></a></td>
</tr>
<tr>
<th align="right" nowrap="nowrap" valign="baseline">CC: </th>
<td>swft <a class="moz-txt-link-rfc2396E" href="mailto:swft@ci.uchicago.edu"><swft@ci.uchicago.edu></a>, <a class="moz-txt-link-abbreviated" href="mailto:swift-devel@ci.uchicago.edu">swift-devel@ci.uchicago.edu</a></td>
</tr>
<tr>
<th align="right" nowrap="nowrap" valign="baseline">References: </th>
<td><a class="moz-txt-link-rfc2396E" href="mailto:4679FBC8.1080606@mcs.anl.gov"><4679FBC8.1080606@mcs.anl.gov></a>
<a class="moz-txt-link-rfc2396E" href="mailto:467A6D78.4020702@mcs.anl.gov"><467A6D78.4020702@mcs.anl.gov></a>
<a class="moz-txt-link-rfc2396E" href="mailto:467A7AC6.7020400@mcs.anl.gov"><467A7AC6.7020400@mcs.anl.gov></a></td>
</tr>
</tbody>
</table>
<br>
<br>
<pre>Or maybe that is clear. I'd suggest that we want a tool that, after a
run, one of us can run to:
* Generate the three plots that Ioan has created
* Generate a file containing as much information as we can about the run
and its parameters--maybe a name=value format?--and some derived values
such as those I mentioned in earlier email
* Move these things to a known place
* Create a Web page with pointers to these information and stick it
somewhere [or add it to an existing web page?]
Ian.
Ian Foster wrote:
> Mike:
>
> It seems important to define what the specific goals and milestones
> are here, as it seems that simply asking for it doesn't get it done.
> Perhaps we need a brief specification?
>
> Ian.
>
> Mike Wilde wrote:
>> Yes, this is what Ganglia has been using.
>>
>> Regarding the auto-publishing - Jens has a machanism that regularly
>> posted info in rrd format on the state of the VDS lab machines, using
>> a perl mechanism like what Ian described. Perhaps we can find and
>> adapt that for Ioan's numbers.
>> It was running on gainly I think. But its not hard to develop from
>> scratch.
>>
>> It would be good to see the same numbers for all the Swift apps being
>> worked on, driven initially by kickstart summaries and digesting the
>> swift logfile.
>> We've long had this as a goal - now is a good time to push forward
>> and do this.
>>
>> Nika and Tibi, could you work with Ioan on this?
>>
>> - Mike
>>
>>
>>
>> Ian Foster wrote, On 6/20/2007 11:17 PM:
>>> Hi,
>>>
>>> I was pointed at <a class="moz-txt-link-freetext" href="http://oss.oetiker.ch/rrdtool/">http://oss.oetiker.ch/rrdtool/</a>, has anyone seen
>>> this? Seems nice to me.
>>>
>>> Ian.
>>>
>>>
>>
>
--
Ian Foster, Director, Computation Institute
Argonne National Laboratory & University of Chicago
Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439
Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637
Tel: +1 630 252 4619. Web: <a class="moz-txt-link-abbreviated" href="http://www.ci.uchicago.edu">www.ci.uchicago.edu</a>.
Globus Alliance: <a class="moz-txt-link-abbreviated" href="http://www.globus.org">www.globus.org</a>.
</pre>
<br>
<pre class="moz-signature" cols="72">--
Ian Foster, Director, Computation Institute
Argonne National Laboratory & University of Chicago
Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439
Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637
Tel: +1 630 252 4619. Web: <a class="moz-txt-link-abbreviated" href="http://www.ci.uchicago.edu">www.ci.uchicago.edu</a>.
Globus Alliance: <a class="moz-txt-link-abbreviated" href="http://www.globus.org">www.globus.org</a>.
</pre>
</body>
</html>