[Swift-devel] Why is Swift throttling at 1024 tasks?

[David Kelly]

Ahh, thanks. That was it, I am able use all 4096 cores now.

----- Original Message -----
> From: "Michael Wilde" <wilde at mcs.anl.gov>
> To: "David Kelly" <davidk at ci.uchicago.edu>
> Cc: "swift-devel" <swift-devel at ci.uchicago.edu>
> Sent: Thursday, January 24, 2013 4:36:23 PM
> Subject: Re: [Swift-devel] Why is Swift throttling at 1024 tasks?
> 
> It looks like you specified "foreach.maxthreads=5000"  instead of
> foreach.max.threads=5000 (missing a ".")
> 
> Obviously the swift command should have complained about this.
> 
> Can you verify where you specified this property?
> 
> And test to see if this is indeed the problem?
> 
> - Mike
> 
> 
> 
> ----- Original Message -----
> > From: "David Kelly" <davidk at ci.uchicago.edu>
> > To: "swift-devel" <swift-devel at ci.uchicago.edu>
> > Sent: Thursday, January 24, 2013 7:25:39 AM
> > Subject: [Swift-devel] Why is Swift throttling at 1024 tasks?
> > 
> > Hello all,
> > 
> > I am trying to run DSSAT using 4096 cores, but I can't seem to get
> > Swift to go beyond 1024 active tasks. Looking at the coaster log, I
> > see all 4096 connecting. I am using persistent coasters, with both
> > Swift and the coaster service running on the same node. I have my
> > job throttle set to 4000. I also tried explicitly setting
> > foreach.max.threads to 4096. I checked ulimit and have a limit of
> > 4096 open files. Is there some other limit I am missing?
> > 
> > http://www.ci.uchicago.edu/~davidk/logs/RunpSIMS-20130124-0657-6fhtq0vd.log
> > http://www.ci.uchicago.edu/~davidk/logs/cps-2013-01-24_06-56-56.log
> > 
> > Thanks,
> > David
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > 
>