[Swift-devel] Swift and BGP plots

[Mihael Hategan]

On Wed, 2009-10-28 at 23:11 -0500, Ioan Raicu wrote:
> Mihael,
> Did you figure out why I am seeing 8K and 12K active tasks, when we
> only had 4K and 6K CPU cores?

Haven't tried.

>  Were there really 128K tasks in the workflow?

Nope. 64K.

>  Just want to make sure the log conversion worked as expected.
> 
> Also, assuming there were really 128K tasks of 60 sec each, and 8K
> CPUs, the ideal time to complete the run 4K would be 960 sec.

That's one calculation that won't be bothered by doubling everything.
But no, there were 64k tasks.

>  Run4K ran in 1183 sec, giving us an end-to-end efficiency of 81%.
> 
> For the run6K, the ideal time was 640 sec, so with an actual time of
> 884, we got an end-to-end efficiency of 72%.

It depends whether you count from the time the partition boots or from
the time swift starts. We could count the queue/partition boot time, but
that doesn't tell us much about swift. On the other hand, if we don't
there's still some submission happening during that time, so that
counts.

The numbers for Falkon, were the workers started already?

> 
> Not quite the 90%+ efficiencies when looking at a per task level, but
> still quite good! 

I'm not quite sure what's happening. Maybe I wasn't clear. Though I was.
Is there some misunderstanding here about the different things being
measured and how?