[Swift-user] Swift runs one task despite slots set to higher number

Ketan Maheshwari ketan at mcs.anl.gov
Sun Feb 1 19:58:26 CST 2015


Hi,

Running a workflow, I need to run 10 PBS tasks each with a size of 16
nodes.

The workflow starts with 4 single task stages and then fans out to a
foreach loop with 10 tasks.

Here is the sites file I am using:

<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
<pool handle="blues">
  <execution provider="coaster" jobmanager="local:pbs"/>
  <filesystem provider="local" url="none" />
  <profile namespace="globus" key="maxtime">13400</profile>
  <profile namespace="globus" key="maxWalltime">03:41:00</profile>
  <profile namespace="globus" key="jobsPerNode">1</profile>
  <profile namespace="globus" key="slots">10</profile>
  <profile namespace="globus" key="ppn">2</profile>
  <profile namespace="globus" key="jobtype">single</profile>
  <profile namespace="globus" key="nodeGranularity">16</profile>
  <profile namespace="globus" key="maxnodes">16</profile>
  <profile namespace="karajan" key="jobThrottle">2.20</profile>
  <profile namespace="karajan" key="initialScore">10000</profile>
<!--  <profile namespace="globus" key="keepSiteDir">true</profile>-->
  <workdirectory>/home/ketan/swift.workdir</workdirectory>
</pool>

<pool handle="localhost">
  <execution provider="coaster" jobmanager="local:local" />
  <profile namespace="globus" key="slots">1</profile>
  <profile namespace="karajan" key="jobThrottle">2.06</profile>
  <profile namespace="karajan" key="initialScore">10000</profile>
  <profile namespace="globus" key="jobsPerNode">3</profile>
  <profile namespace="globus" key="maxtime">9700</profile>
  <profile namespace="globus" key="maxWalltime">02:39:00</profile>
  <profile namespace="globus" key="walltime">10060</profile>
  <profile namespace="globus" key="maxnodes">1</profile>
  <profile namespace="globus" key="nodegranularity">1</profile>
 <!-- <profile namespace="globus" key="keepSiteDir">true</profile>-->

  <workdirectory>/home/ketan/swift.workdir</workdirectory>
  <filesystem provider="local"/>
</pool>

</config>

However, Swift runs only 1 task throughout the workflow even after reaching
the foreach loop.

Any suggestions?

Thanks,
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20150201/5bcace1d/attachment.html>


More information about the Swift-user mailing list