[Swift-user] Swift and allocations

Jonathan Ozik jozik at uchicago.edu
Tue Aug 12 11:53:08 CDT 2014


Hello all,

I had a discussion with Yadu and we thought we’d open it up to the list. Suppose that we are throttling the total number of concurrent tasks to 512 (taskThrottle=512) and by specifying that maxJobs=32 and tasksPerWorker=16. If there are a total of 2430 total tasks to run, there will be 2430 - 2048 = 382 tasks left for the last “go around” (assuming that each of the tasks take about the same time to complete). If there are 382 tasks left towards run completion and 512 cores (16 for each of the 32 nodes), would the last few jobs, end up spread across the 32 Nodes, effectively holding them and burning your allocation, or would they get pushed to 24 nodes and de-allocating 8 nodes?

Jonathan


More information about the Swift-user mailing list