<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
Mihael,<br>
Did you figure out why I am seeing 8K and 12K active tasks, when we
only had 4K and 6K CPU cores? Were there really 128K tasks in the
workflow? Just want to make sure the log conversion worked as expected.<br>
<br>
Also, assuming there were really 128K tasks of 60 sec each, and 8K
CPUs, the ideal time to complete the run 4K would be 960 sec. Run4K ran
in 1183 sec, giving us an end-to-end efficiency of 81%.<br>
<br>
For the run6K, the ideal time was 640 sec, so with an actual time of
884, we got an end-to-end efficiency of 72%.<br>
<br>
Not quite the 90%+ efficiencies when looking at a per task level, but
still quite good! <br>
<br>
Ioan<br>
<br>
<br>
Ioan Raicu wrote:
<blockquote cite="mid:4AE76018.5090007@cs.uchicago.edu" type="cite">
<meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
Alright, here it is again:<br>
4K run: Average Task Execution Time (ms): 61946.37017455522 +/-
4884.571426229936<br>
Efficiency: 96.8%<br>
<br>
6K run: Average Task Execution Time (ms): 64415.056860142206 +/-
6090.13371098675<br>
Efficiency: 93.1%<br>
<br>
These both look pretty nice.<br>
<br>
Now, the only thing that still looks odd, is that in the 4K run, I see
8K active tasks, and in the 6K run I see 12K active tasks. I also have
128K tasks in total. Are my plots off by 2X somehow?<br>
<br>
Ioan<br>
<br>
<br>
4K run:<br>
<img src="cid:part1.05080501.00090109@cs.uchicago.edu" alt=""><br>
<br>
6K run:<br>
<img src="cid:part2.00020008.01040108@cs.uchicago.edu" alt=""><br>
<br>
<br>
Ioan Raicu wrote:
<blockquote cite="mid:4AE75708.8020404@cs.uchicago.edu" type="cite">
<meta content="text/html;charset=ISO-8859-1"
http-equiv="Content-Type">
Great!<br>
<br>
Mihael Hategan wrote:
<blockquote cite="mid:1256674591.26911.1.camel@localhost"
type="cite">
<pre wrap="">On Tue, 2009-10-27 at 15:10 -0500, Ioan Raicu wrote:
</pre>
<blockquote type="cite">
<pre wrap="">Which of these should I use in finding the Complete event? Or are they
equivalent?
2009-10-25 21:42:10,717-0500 INFO LateBindingScheduler
Task(type=JOB_SUBMISSION, identity=urn:0-1-12173-1-1-1256524749960)
Completed. Waiting: 3606, Running: 16387. Heap size: 1003M, Heap free:
66M, Max heap: 1024M
2009-10-25 21:42:10,608-0500 DEBUG TaskImpl Task(type=JOB_SUBMISSION,
identity=urn:1256524752479-1256524793584-1256524793585) setting status
to Completed
</pre>
</blockquote>
<pre wrap=""><!---->
It's probably best if you used TaskImpl for both Active and Completed.
</pre>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
=================================================================
Ioan Raicu, Ph.D.
NSF/CRA Computing Innovation Fellow
=================================================================
Center for Ultra-scale Computing and Information Security (CUCIS)
Department of Electrical Engineering and Computer Science
Northwestern University
2145 Sheridan Rd, Tech M384
Evanston, IL 60208-3118
=================================================================
Cel: 1-847-722-0876
Tel: 1-847-491-8163
Email: <a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:iraicu@eecs.northwestern.edu">iraicu@eecs.northwestern.edu</a>
Web: <a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://www.eecs.northwestern.edu/%7Eiraicu/">http://www.eecs.northwestern.edu/~iraicu/</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="https://wiki.cucis.eecs.northwestern.edu/">https://wiki.cucis.eecs.northwestern.edu/</a>
=================================================================
=================================================================
</pre>
<pre wrap=""><hr size="4" width="90%">
_______________________________________________
Swift-devel mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel">http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel</a>
</pre>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
=================================================================
Ioan Raicu, Ph.D.
NSF/CRA Computing Innovation Fellow
=================================================================
Center for Ultra-scale Computing and Information Security (CUCIS)
Department of Electrical Engineering and Computer Science
Northwestern University
2145 Sheridan Rd, Tech M384
Evanston, IL 60208-3118
=================================================================
Cel: 1-847-722-0876
Tel: 1-847-491-8163
Email: <a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:iraicu@eecs.northwestern.edu">iraicu@eecs.northwestern.edu</a>
Web: <a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://www.eecs.northwestern.edu/%7Eiraicu/">http://www.eecs.northwestern.edu/~iraicu/</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="https://wiki.cucis.eecs.northwestern.edu/">https://wiki.cucis.eecs.northwestern.edu/</a>
=================================================================
=================================================================
</pre>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
=================================================================
Ioan Raicu, Ph.D.
NSF/CRA Computing Innovation Fellow
=================================================================
Center for Ultra-scale Computing and Information Security (CUCIS)
Department of Electrical Engineering and Computer Science
Northwestern University
2145 Sheridan Rd, Tech M384
Evanston, IL 60208-3118
=================================================================
Cel: 1-847-722-0876
Tel: 1-847-491-8163
Email: <a class="moz-txt-link-abbreviated" href="mailto:iraicu@eecs.northwestern.edu">iraicu@eecs.northwestern.edu</a>
Web: <a class="moz-txt-link-freetext" href="http://www.eecs.northwestern.edu/~iraicu/">http://www.eecs.northwestern.edu/~iraicu/</a>
<a class="moz-txt-link-freetext" href="https://wiki.cucis.eecs.northwestern.edu/">https://wiki.cucis.eecs.northwestern.edu/</a>
=================================================================
=================================================================
</pre>
</body>
</html>