[Swift-commit] r2237 - log-processing

[noreply at svn.ci.uchicago.edu]

Author: benc
Date: 2008-09-21 14:20:54 -0500 (Sun, 21 Sep 2008)
New Revision: 2237

Added:
   log-processing/queue-state-transitions
Modified:
   log-processing/index.html.template
   log-processing/makefile.karatasks
   log-processing/makefile.webpage
Log:
Generate a transitions file for job queue times, and associated (not working)
graphs.

Patch supplied by: Andriy Fedorov <fedorov at cs.wm.edu> 


Modified: log-processing/index.html.template
===================================================================
--- log-processing/index.html.template	2008-09-20 15:47:35 UTC (rev 2236)
+++ log-processing/index.html.template	2008-09-21 19:20:54 UTC (rev 2237)
@@ -167,7 +167,15 @@
 <p>karatasks JOB_SUBMISSION trails:</p>
 <img src="karatasks.JOB_SUBMISSION-trails.png" />
 
+<p>Number of karajan level job submissions that are 'Submitted' - this means
+that the underlying execution layer (such as GRAM) has reported that the
+job is submitted for execution, but not executing (queued).</p>
+<img src="karatasks.JOB_SUBMISSION.Queue-total.png" />
 
+<p>karajan queued JOB_SUBMISSION tasks</p>
+<img src="karatasks.JOB_SUBMISSION.Queue.sorted-start.png" />
+
+
 <hr />
 <h2>falkon</h2>
 <p>Falkon taskperf log:</p>

Modified: log-processing/makefile.karatasks
===================================================================
--- log-processing/makefile.karatasks	2008-09-20 15:47:35 UTC (rev 2236)
+++ log-processing/makefile.karatasks	2008-09-21 19:20:54 UTC (rev 2237)
@@ -35,3 +35,7 @@
 
 karatasks.JOB_SUBMISSION.Active.transitions: karatasks.JOB_SUBMISSION.transitions
 	cat karatasks.JOB_SUBMISSION.transitions | ./swap-and-sort-and-swap | ./active-state-transitions > karatasks.JOB_SUBMISSION.Active.transitions
+
+karatasks.JOB_SUBMISSION.Queue.transitions: karatasks.JOB_SUBMISSION.transitions
+	cat karatasks.JOB_SUBMISSION.transitions | ./swap-and-sort-and-swap | ./queue-state-transitions > karatasks.JOB_SUBMISSION.Queue.transitions
+

Modified: log-processing/makefile.webpage
===================================================================
--- log-processing/makefile.webpage	2008-09-20 15:47:35 UTC (rev 2236)
+++ log-processing/makefile.webpage	2008-09-21 19:20:54 UTC (rev 2237)
@@ -10,7 +10,9 @@
 karatasks.FILE_OPERATION-trails.png karatasks.FILE_TRANSFER-trails.png \
 karatasks.FILE_TRANSFER.stats karatasks.FILE_OPERATION.stats \
 karatasks.JOB_SUBMISSION.stats karatasks-total.png \
-karatasks.JOB_SUBMISSION.Active-total.png index.html.kara
+karatasks.JOB_SUBMISSION.Active-total.png index.html.kara \
+karatasks.JOB_SUBMISSION.Queue-total.png \
+karatasks.JOB_SUBMISSION.Queue.sorted-start.png
 
 webpage.clusters: karatasks.clusters.png karatasks.clusters-total.png \
 karatasks.clusters.sorted-start.png karatasks.clusters-duration-histogram.png

Added: log-processing/queue-state-transitions
===================================================================
--- log-processing/queue-state-transitions	                        (rev 0)
+++ log-processing/queue-state-transitions	2008-09-21 19:20:54 UTC (rev 2237)
@@ -0,0 +1,34 @@
+#!/usr/bin/env perl
+
+# pull out transitions that go to submitted state and the immediately
+# following transition
+
+use Time::Local;
+
+$prevjob = "queue-state-transitions no previous event";
+
+$prevline = "";
+
+$active = 0;
+
+foreach $n (<STDIN>) {
+  $n =~ /^([^ ]*) ([^ ]*) ([^ ]*) (.*)$/;
+  $ts = $1;
+  $job = $2;
+  $state = $3;
+
+  if($state eq "Submitted") {
+    print "$n";
+    $active = 1;
+  } elsif( ($job eq $prevjob) && ($active) ) {
+    if($active == 1) {
+      print $n;
+      $active = 0;
+    }
+  } else {
+    $prevjob = $job;
+  };
+  $prevline = $n;
+}
+
+# print $prevline;


Property changes on: log-processing/queue-state-transitions
___________________________________________________________________
Name: svn:executable
   + *