[Swift-devel] Re: [Swft] Q about throttling
Mihael Hategan
hategan at mcs.anl.gov
Sat Jun 23 15:06:34 CDT 2007
On Thu, 2007-06-21 at 11:32 -0500, Veronika Nefedova wrote:
> There are two throttle parameters you might want to check. One is in
> swift.properties called throttle.submit and one in scheduler.xml
> called jobThrottle.
> I am curious whats the difference between them?
throttle.submit is documented in many places, including swift.properties
and the user's guide. This should not affect things much since, as far
as I can tell, submissions in Falkon are done pretty fast.
JobThrottle is a site score scaling factor. It limits the initial set of
jobs sent to sites in order to achieve better load balancing in the long
run. This could be a cause for low number of concurrent jobs. Set it to
large numbers if you want to get rid of it.
Mihael
>
> Nika
>
> On Jun 21, 2007, at 11:25 AM, Tiberiu Stef-Praun wrote:
>
> > No
> > I'm saying that swift throttle value will allow me to make full use of
> > all the nodes that Falkon makes available for me. I know that I had 26
> > jobs to be run, and I requested (and had) 30 nodes in the cluster.
> > Somehow only 24 jobs run in the first time, so I'm going to push up
> > the throttle value in Swift
> >
> > Tibi
> >
> >
> > On 6/21/07, Ben Clifford <benc at hawaga.org.uk> wrote:
> >>
> >>
> >>
> >> On Thu, 21 Jun 2007, Tiberiu Stef-Praun wrote:
> >>
> >> > No
> >> > My chart shows that if I had two more machines during the first
> >> stage
> >> > run (the first 26 jobs), I would have avoided a long wait (50000
> >> ms ,
> >> > or about 9 minutes) for the last two jobs from the first batch to
> >> > finish.
> >> > This is why I need to redo the Econ run, with a different throttle
> >> > value for Swift.
> >>
> >> So you are saying that changing the 'throttle value for swift' will
> >> allocate more machines for you?
> >>
> >> --
> >>
> >
> >
> > --
> > Tiberiu (Tibi) Stef-Praun, PhD
> > Research Staff, Computation Institute
> > 5640 S. Ellis Ave, #405
> > University of Chicago
> > http://www-unix.mcs.anl.gov/~tiberius/
> >
>
More information about the Swift-devel
mailing list