[Swift-devel] Re: [Swft] Q about throttling

Ben Clifford benc at hawaga.org.uk
Thu Jun 21 11:37:36 CDT 2007


Have a look at this thread:

 Date: Fri, 04 May 2007 09:04:44 -0500                                           
 From: Mihael Hategan <hategan at mcs.anl.gov>                                      
 To: Veronika V. Nefedova <nefedova at mcs.anl.gov>                                 
 Cc: Ben Clifford <benc at hawaga.org.uk>, swift-devel at ci.uchicago.edu              
 Subject: Re: [Swift-devel] limiting simultaneous jobs using the local           
     provider.       

There was a bit of discussion there.

On Thu, 21 Jun 2007, Veronika Nefedova wrote:

> There are two throttle parameters you might want to check. One is in
> swift.properties called throttle.submit and one in scheduler.xml called
> jobThrottle.
> I am curious whats the difference between them?
> 
> Nika
> 
> On Jun 21, 2007, at 11:25 AM, Tiberiu Stef-Praun wrote:
> 
> > No
> > I'm saying that swift throttle value will allow me to make full use of
> > all the nodes that Falkon makes available for me. I know that I had 26
> > jobs to be run, and I requested (and had) 30 nodes in the cluster.
> > Somehow only 24 jobs run in the first time, so I'm going to push up
> > the throttle value in Swift
> > 
> > Tibi
> > 
> > 
> > On 6/21/07, Ben Clifford <benc at hawaga.org.uk> wrote:
> > > 
> > > 
> > > 
> > > On Thu, 21 Jun 2007, Tiberiu Stef-Praun wrote:
> > > 
> > > > No
> > > > My chart shows that if I had two more machines during the first stage
> > > > run (the first 26 jobs), I would have avoided a long wait (50000 ms ,
> > > > or about 9 minutes) for the last two jobs from the first batch to
> > > > finish.
> > > > This is why I need to redo the Econ run, with a different throttle
> > > > value for Swift.
> > > 
> > > So you are saying that changing the 'throttle value for swift' will
> > > allocate more machines for you?
> > > 
> > > --
> > > 
> > 
> > 
> > -- 
> > Tiberiu (Tibi) Stef-Praun, PhD
> > Research Staff, Computation Institute
> > 5640 S. Ellis Ave, #405
> > University of Chicago
> > http://www-unix.mcs.anl.gov/~tiberius/
> > 
> 



More information about the Swift-devel mailing list