<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
OK, I converted the logs, and here is what I got.<br>
<br>
The thing that bugs me is that things ran faster (per task) at the
larger scale (a bit counter intuitive). Also, the maximum number of
concurrent tasks I found was 20K, in both experiments. This doesn't
seem right, as the experiments should have 4K or 6K active tasks at any
time. Could I be looking at the wrong entries from the Swift logs?<br>
<br>
I did this to get the data I needed from the Swift logs:<br>
cat dc-4000.log | grep "JOB_START" > dc-4000-start-end.txt<br>
cat dc-4000.log | grep "JOB_END" >> dc-4000-start-end.txt<br>
<br>
Is this correct? Or should I be looking for other job events?<br>
<br>
Ioan<br>
<br>
4K run:<br>
Average Task Execution Time (ms): 326663.0046845912 +/-
283374.34801782423<br>
<br>
<img src="cid:part1.00040103.06000406@cs.uchicago.edu" alt=""><br>
<br>
6K run:<br>
Average Task Execution Time (ms): 246982.0736259041 +/-
123059.82258438379<br>
<br>
<img src="cid:part2.02000505.04080509@cs.uchicago.edu" alt=""><br>
<br>
Mihael Hategan wrote:
<blockquote cite="mid:1256665502.23397.0.camel@localhost" type="cite">
<pre wrap="">On Tue, 2009-10-27 at 00:51 -0500, Mihael Hategan wrote:
</pre>
<blockquote type="cite">
<pre wrap="">On Tue, 2009-10-27 at 00:41 -0500, Ioan Raicu wrote:
</pre>
<blockquote type="cite">
<pre wrap="">Where can I get the Swift logs for these runs, I'd like to pass them
through my Swift-to-Falkon conversion tool :)
</pre>
</blockquote>
<pre wrap="">I ignored that because I was going to post them tomorrow. So hang on
until then.
</pre>
</blockquote>
<pre wrap=""><!---->
<a class="moz-txt-link-freetext" href="http://www.mcs.anl.gov/~hategan/dc-4000.log.gz">http://www.mcs.anl.gov/~hategan/dc-4000.log.gz</a>
<a class="moz-txt-link-freetext" href="http://www.mcs.anl.gov/~hategan/dc-6000.log.gz">http://www.mcs.anl.gov/~hategan/dc-6000.log.gz</a>
</pre>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
=================================================================
Ioan Raicu, Ph.D.
NSF/CRA Computing Innovation Fellow
=================================================================
Center for Ultra-scale Computing and Information Security (CUCIS)
Department of Electrical Engineering and Computer Science
Northwestern University
2145 Sheridan Rd, Tech M384
Evanston, IL 60208-3118
=================================================================
Cel: 1-847-722-0876
Tel: 1-847-491-8163
Email: <a class="moz-txt-link-abbreviated" href="mailto:iraicu@eecs.northwestern.edu">iraicu@eecs.northwestern.edu</a>
Web: <a class="moz-txt-link-freetext" href="http://www.eecs.northwestern.edu/~iraicu/">http://www.eecs.northwestern.edu/~iraicu/</a>
<a class="moz-txt-link-freetext" href="https://wiki.cucis.eecs.northwestern.edu/">https://wiki.cucis.eecs.northwestern.edu/</a>
=================================================================
=================================================================
</pre>
</body>
</html>