[Swift-user] sites.xml entry for coasters on PADS

[Michael Wilde]

Here is an example of the sites.xml element I used for running on the CI PADS PBS cluster. It can be used on pretty much any PBS system.

This for for running directly on the PBS headnode:

  <pool handle="pbs">
    <execution provider="coaster" url="none" jobmanager="local:pbs"/>
    <profile namespace="globus" key="workersPerNode">8</profile>
    <profile namespace="globus" key="maxTime">3500</profile>
    <profile namespace="globus" key="maxWallTime">00:02:00</profile>
    <profile namespace="globus" key="slots">4</profile>
    <profile namespace="globus" key="nodeGranularity">4</profile>
    <profile namespace="globus" key="maxNodes">32</profile>
    <profile namespace="karajan" key="jobThrottle">2.55</profile>
    <profile namespace="karajan" key="initialScore">10000</profile>
    <filesystem provider="local" url="none"/>
    <workdirectory>/home/wilde/swiftwork</workdirectory>
  </pool>

You need to adjust the workdir and times according to your needs.
And we can fiddle with the granularity etc.

Ive also run ssh'ing to PADS from elsewhere, since it doesnt have Globus GRAM, using this entry:

  <pool handle="pbs">
    <execution provider="coaster" url="login.pads.ci.uchicago.edu" jobmanager="ssh:pbs"/>

    <profile namespace="globus" key="workersPerNode">8</profile>
    <profile namespace="globus" key="slots">1</profile>
    <profile namespace="globus" key="nodeGranularity">2</profile>
    <profile namespace="globus" key="maxNodes">2</profile>
    <profile namespace="karajan" key="jobThrottle">.63</profile>
    <profile namespace="karajan" key="initialScore">10000</profile>

    <filesystem provider="ssh" url="login.pads.ci.uchicago.edu"/>
    <workdirectory>/home/wilde/swiftwork</workdirectory>
  </pool>


In this case I used a /home/wilde/.ssh/auth.defaults file with something like this:

login.pads.ci.uchicago.edu.type=key
login.pads.ci.uchicago.edu.username=wilde
login.pads.ci.uchicago.edu.key=/home/wilde/.ssh/swift_rsa
login.pads.ci.uchicago.edu.passphrase=mypassphrasegoeshere

I will try to get this more well-documented in the Users Guide or SWFT wiki. For now, feel free to fire questions about it to the Swift-User list.

- Mike






-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory