[Swift-devel] passive workers scheduler throttle

Mihael Hategan hategan at mcs.anl.gov
Mon Jul 11 17:22:56 CDT 2011


trunk cog r3179/swift r4816 supports the ability to scale the throttle
for a site based on the number of workers running on a site.

To enable it you need to have the passive worker manager and the
globus:throttleTracksWorkers profile set to "true". E.g.

    <profile namespace="globus" key="workerManager">passive</profile>
    <profile namespace="globus"
key="throttleTracksWorkers">true</profile>

One thing to mention is that while the throttle will match the number of
workers, it will never go below 1. That one job is needed to
start/connect to the service in the current scheme of things.

One other thing to mention was that there was a bit of trouble with
passive workers losing a connection to the service. It would typically
result in the jobs that were running on the lost workers to appear to
never complete. That has now been fixed.

Mihael




More information about the Swift-devel mailing list