[Swift-devel] Support request: Swift jobs flooding uc-teragrid?

[Mihael Hategan]

On Wed, 2008-01-30 at 10:34 -0600, Ti Leggett wrote:
> I can't say how many gram jobs can be submitted at one time or over a  
> time period X. I do know that Torque and Moab can handle 1000s of jobs  
> in the queue and rather quickly as well. I think you'll need to  
> discover what those limits are per resource per method. For instance  
> TG will have a different threshold than Teraport for instance.

And that is the very problem. This discovery doesn't happen by magic.

> 
> On Jan 30, 2008, at 01/30/08 10:09 AM, Ben Clifford wrote:
> 
> >
> > On Wed, 30 Jan 2008, Ti Leggett wrote:
> >
> >>> Its a self-reinforcing feedback loop, that will be broken at the  
> >>> point
> >
> >> For the short term, it seems that the Swift developers should
> >> manually find those limits for sites that the users use regularly  
> >> for them to
> >> use,
> >
> > In terms of peak jobs-on-a-site-at-once, we have
> > a parameter throttle.score.job.factor which limits the maximum  
> > number of
> > jobs on a site at any one time. by default, this is set to allow 402  
> > jobs
> > on a site at once.
> >
> > I guess that should be massively reduced by default. Do you have a
> > ballpark number for the most jobs that should be on eg. TG-UC?
> >
> > -- 
> >
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>