[Swift-devel] Why is Swift throttling at 1024 tasks?

[Michael Wilde]

It looks like you specified "foreach.maxthreads=5000"  instead of foreach.max.threads=5000 (missing a ".")

Obviously the swift command should have complained about this.

Can you verify where you specified this property?

And test to see if this is indeed the problem?

- Mike



----- Original Message -----
> From: "David Kelly" <davidk at ci.uchicago.edu>
> To: "swift-devel" <swift-devel at ci.uchicago.edu>
> Sent: Thursday, January 24, 2013 7:25:39 AM
> Subject: [Swift-devel] Why is Swift throttling at 1024 tasks?
> 
> Hello all,
> 
> I am trying to run DSSAT using 4096 cores, but I can't seem to get
> Swift to go beyond 1024 active tasks. Looking at the coaster log, I
> see all 4096 connecting. I am using persistent coasters, with both
> Swift and the coaster service running on the same node. I have my
> job throttle set to 4000. I also tried explicitly setting
> foreach.max.threads to 4096. I checked ulimit and have a limit of
> 4096 open files. Is there some other limit I am missing?
> 
> http://www.ci.uchicago.edu/~davidk/logs/RunpSIMS-20130124-0657-6fhtq0vd.log
> http://www.ci.uchicago.edu/~davidk/logs/cps-2013-01-24_06-56-56.log
> 
> Thanks,
> David
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>