[Swift-devel] log-processing

[Michael Wilde]

I did something like this a while back with a perl script that 
summarized kickstart data. I agree - its very useful to the user.
Also for multi-site runs, to correlate performance with site 
architecture (and in other studies, with arguments/file sizes, but thats 
another step).

So I think this would be a good time to make a decision on kickstart 
data vs wrapper.sh data. I have no preference. I tend to favor data 
thats either tabular or can readily be converted to tabular.

Jens's two versions of kickstart both have a lot of features we'll 
likely find useful. wrapper.sh is nice, simple, and lightweight.

Ben and/or Mihael, I think you should work out an efficient and 
effective architecture for this important stats capture mechanism that 
will be useful for users and get it into general use.

- Mike


On 12/10/08 7:28 AM, Ben Clifford wrote:
> 
> On Tue, 9 Dec 2008, Tiberiu Stef-Praun wrote:
> 
>> I was wondering if the log processing tool can create some graph where
>> I can see useful information on a per-atomic-application basis. I'm
>> interested in average, min. max time spent in each atomic application.
> 
> As an already implemented graph, not at the moment; but most of the stuff 
> in in place to do so.
> 
> By 'time spent in each', do you mean time spent with a compute node 
> running your app code or with overhead such as stagein and queue time.
> 
> Information for both of those options is available (but not filtered by 
> app) at the moment.
>