<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
<title></title>
</head>
<body bgcolor="#ffffff" text="#000000">
Mihael:<br>
<br>
Is it easy to do a version of this that shows what each specific CPU is
doing? That would be helpful in terms of understanding bottlenecks. I
guess it is difficult when a separate GRAM submission is performed per
task. It would be easy when using DeeF.<br>
<br>
Ian.<br>
<br>
Mihael Hategan wrote:
<blockquote cite="mid1173587575.24215.6.camel@blabla.mcs.anl.gov"
type="cite">
<pre wrap="">I updated it a bit.
Two interesting ones (warning: ~700kB files):
<a class="moz-txt-link-freetext" href="http://www-unix.mcs.anl.gov/~hategan/helloworld-i4lb1xpvedgs0.log.png">http://www-unix.mcs.anl.gov/~hategan/helloworld-i4lb1xpvedgs0.log.png</a>
and
<a class="moz-txt-link-freetext" href="http://www-unix.mcs.anl.gov/~hategan/helloworld-okdn8oj4qg411.log.png">http://www-unix.mcs.anl.gov/~hategan/helloworld-okdn8oj4qg411.log.png</a>
The first one has the gradual throttling disabled. The second one has it
set to a low value.
Granted, this is running /bin/sleep 2 (ignore the fact that the label
says "echo"), but the fact that lack of throttling can cause resource
saturation and slightly worse performance is interesting.
I still have to figure out what, besides checking the exit code file,
causes the long delays after the job is done. I'm guessing it's some CPU
intensive stuff that doesn't parallelize very well on my laptop.
Mihael
On Sat, 2007-03-10 at 22:09 -0600, Mike Wilde wrote:
</pre>
<blockquote type="cite">
<pre wrap="">That is beautiful! Nice work, Mihael.
- Mike
Mihael Hategan wrote, On 3/10/2007 7:44 PM:
</pre>
<blockquote type="cite">
<pre wrap="">There's a new tool in bin.
It's a spin off Jens' "show-id" tool.
After careful analysis of show-id, it became apparent that a lot of the
difficulty was in gathering and organizing the data, rather than in
generating the plots. This one's written in python and lacks the command
line options to control sizes, but includes the logic in Jens' tool that
automatically scale things.
It does not show individual stage-ins and stage-outs. I'll have to think
of a way to represent those on the plot without making it messy.
It needs the logs to contain debugging info from individual tasks:
log4j.logger.org.globus.cog.abstraction.impl.common.task.TaskImpl=DEBUG
I've updated this in SVN, but if you want to run it on older builds, you
need the above in log4j.properties.
I attached a sample output.
Mihael
------------------------------------------------------------------------
_______________________________________________
Swift-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a>
<a class="moz-txt-link-freetext" href="http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel">http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel</a>
</pre>
</blockquote>
</blockquote>
<pre wrap=""><!---->
_______________________________________________
Swift-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a>
<a class="moz-txt-link-freetext" href="http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel">http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel</a>
</pre>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
Ian Foster, Director, Computation Institute
Argonne National Laboratory & University of Chicago
Argonne: MCS/221, 9700 S. Cass Ave, Argonne, IL 60439
Chicago: Rm 405, 5640 S. Ellis Ave, Chicago, IL 60637
Tel: +1 630 252 4619. Web: <a class="moz-txt-link-abbreviated" href="http://www.ci.uchicago.edu">www.ci.uchicago.edu</a>.
Globus Alliance: <a class="moz-txt-link-abbreviated" href="http://www.globus.org">www.globus.org</a>.
</pre>
</body>
</html>