[Swift-user] Swift runs one task despite slots set to higher number
Ketan Maheshwari
ketan at mcs.anl.gov
Sun Feb 1 19:58:26 CST 2015
Hi,
Running a workflow, I need to run 10 PBS tasks each with a size of 16
nodes.
The workflow starts with 4 single task stages and then fans out to a
foreach loop with 10 tasks.
Here is the sites file I am using:
<?xml version="1.0" encoding="UTF-8"?>
<config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
<pool handle="blues">
<execution provider="coaster" jobmanager="local:pbs"/>
<filesystem provider="local" url="none" />
<profile namespace="globus" key="maxtime">13400</profile>
<profile namespace="globus" key="maxWalltime">03:41:00</profile>
<profile namespace="globus" key="jobsPerNode">1</profile>
<profile namespace="globus" key="slots">10</profile>
<profile namespace="globus" key="ppn">2</profile>
<profile namespace="globus" key="jobtype">single</profile>
<profile namespace="globus" key="nodeGranularity">16</profile>
<profile namespace="globus" key="maxnodes">16</profile>
<profile namespace="karajan" key="jobThrottle">2.20</profile>
<profile namespace="karajan" key="initialScore">10000</profile>
<!-- <profile namespace="globus" key="keepSiteDir">true</profile>-->
<workdirectory>/home/ketan/swift.workdir</workdirectory>
</pool>
<pool handle="localhost">
<execution provider="coaster" jobmanager="local:local" />
<profile namespace="globus" key="slots">1</profile>
<profile namespace="karajan" key="jobThrottle">2.06</profile>
<profile namespace="karajan" key="initialScore">10000</profile>
<profile namespace="globus" key="jobsPerNode">3</profile>
<profile namespace="globus" key="maxtime">9700</profile>
<profile namespace="globus" key="maxWalltime">02:39:00</profile>
<profile namespace="globus" key="walltime">10060</profile>
<profile namespace="globus" key="maxnodes">1</profile>
<profile namespace="globus" key="nodegranularity">1</profile>
<!-- <profile namespace="globus" key="keepSiteDir">true</profile>-->
<workdirectory>/home/ketan/swift.workdir</workdirectory>
<filesystem provider="local"/>
</pool>
</config>
However, Swift runs only 1 task throughout the workflow even after reaching
the foreach loop.
Any suggestions?
Thanks,
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20150201/5bcace1d/attachment.html>
More information about the Swift-user
mailing list