[Swift-devel] Swift and BGP

[Mihael Hategan]

On Mon, 2009-10-26 at 11:56 -0500, Mihael Hategan wrote:
> So here's how one would go with this on intrepid:
> - determine the maximum number of workers (avg-exec-time * 100)
> - set the nodeGranularity to 512 nodes, 4 workers per node. Also set
> maxWorkers to 512 so that only 512 node blocks are requested. For some
> reason 512 node partitions start almost instantly (even if you have 6 of
> them) while 1024 node partitions you have to wait for.
> - set the total number of blocks ("slots" parameter) to
> no-of-workers/2048.
> - set the jobThrottle to 2*no-of-workers/100
> - make sure you also have foreach,max.threads set to 2*no-of-workers
> (though that depends on the structure of the program).
> - run on login6. There is no point in using the normal login machines
> since they have a limit of 1024 file descriptors per process.
> 
> I will actually code an xml element for sites.xml to capture this
> without that much pain.

In sites.xml under the intrepid pool element, you can use:

<intrepidCoasterParams [averageJobTime="<seconds>"]
[blockSize="<nodes>"]/>

This sets relevant stuff if averageJobTime is specified. Default block
size is 512 nodes. It will print the settings.