[Swift-devel] log-processing

[Ben Clifford]

On Tue, 9 Dec 2008, Tiberiu Stef-Praun wrote:

> I was wondering if the log processing tool can create some graph where
> I can see useful information on a per-atomic-application basis. I'm
> interested in average, min. max time spent in each atomic application.

If you're intereted in doing some analysis yourself, I just modified the 
log-processing code to give you something more easy to work with.

Using log-processing >= r2365 will let you say:

  swift-plot-log 066-many-20081210-0834-xk5h3us8.log info.event

(i.e. add info.event onto the end of the command line)

This will give you a file info.event (in a directory under /tmp indicated 
at the end of the command output) with one line per info file, that looks 
like this:

1228919959.621686561 0.288390398025513 touch-0cej8i3j END touch

The fields are space separated and are, in order:
 1. start time in seconds since epoch
 2. time of wrapper script execution on worker node
 3. job id
 4. final wrapper script status
 5. application name

You can use this information now if you want to do your own further 
analysis, or you can wait for me to implement per-app stats (that will 
likely look like the per-site stats that appear at the end of 
execute2.html in a log report).

--