[Swift-devel] Re: [Swft] Q about throttling

Ben Clifford benc at hawaga.org.uk
Thu Jun 21 11:40:33 CDT 2007


Its basically the same thing that is happening with the 6 steps in the 
1200000 .. 1500000 range. The graph is (slightly) too low resolution for 
me to count the number of jobs in each of those steps. (note to 
infographic producer - make chart use exactly two horizontal pixels per 
job for this scale of run)

On Thu, 21 Jun 2007, Tiberiu Stef-Praun wrote:

> So the other thing that might have happened is that Falkon quietly
> released some of the nodes (even though I requested a minimum of 30
> nodes and a maximum of 50)
> 
> 
> On 6/21/07, Ben Clifford <benc at hawaga.org.uk> wrote:
> > 
> > My interpretation of the graph is:
> > 
> > The two jobs that didn't get run till later (the 'spare' jobs) are
> > submitted into falkon at approx t=0, along with the 24 'run straight away'
> > jobs.
> > 
> > Swift isn't holding them back.
> > 
> > Falkon indicates that it is aware of them from approx time = 0 but doesn't
> > run them until t=500000.
> > 
> > That means, I think, that they're getting into Falkons queue right at the
> > start, and its something happening with how Falkon places them onto worker
> > nodes that isn't right here.
> > 
> > At least that's my first impression.
> > 
> > On Thu, 21 Jun 2007, Tiberiu Stef-Praun wrote:
> > 
> > > No
> > > I'm saying that swift throttle value will allow me to make full use of
> > > all the nodes that Falkon makes available for me. I know that I had 26
> > > jobs to be run, and I requested (and had) 30 nodes in the cluster.
> > > Somehow only 24 jobs run in the first time, so I'm going to push up
> > > the throttle value in Swift
> > >
> > > Tibi
> > >
> > >
> > > On 6/21/07, Ben Clifford <benc at hawaga.org.uk> wrote:
> > > >
> > > >
> > > >
> > > > On Thu, 21 Jun 2007, Tiberiu Stef-Praun wrote:
> > > >
> > > > > No
> > > > > My chart shows that if I had two more machines during the first stage
> > > > > run (the first 26 jobs), I would have avoided a long wait (50000 ms ,
> > > > > or about 9 minutes) for the last two jobs from the first batch to
> > > > > finish.
> > > > > This is why I need to redo the Econ run, with a different throttle
> > > > > value for Swift.
> > > >
> > > > So you are saying that changing the 'throttle value for swift' will
> > > > allocate more machines for you?
> > > >
> > > > --
> > > >
> > >
> > >
> > >
> > 
> 
> 
> 



More information about the Swift-devel mailing list