[Swift-devel] local:slurm ppn and jobs per node not honored

Ketan Maheshwari ketancmaheshwari at gmail.com
Tue Oct 1 14:35:44 CDT 2013


Hi,

On stampede, I am observing that the sites parameters such as ppn and
jobspernode are being overridden by the throttle value. I intended to run 1
job per node on a single node run. However, it seems more jobs are running.
My sites parameters are as follows:

   <profile namespace="globus"  key="jobsPerNode">1</profile>
   <profile namespace="globus"  key="ppn">1</profile>
   <profile namespace="globus"  key="maxTime">7500</profile>
   <profile namespace="globus"  key="maxwalltime">00:10:00</profile>
   <profile namespace="globus"  key="lowOverallocation">100</profile>
   <profile namespace="globus"  key="highOverallocation">100</profile>
   <profile namespace="globus"  key="queue">normal</profile>
   <profile namespace="globus"  key="nodeGranularity">1</profile>
   <profile namespace="globus"  key="maxNodes">1</profile>
   <profile namespace="karajan" key="jobThrottle">.3199</profile>

To reproduce, I run a catsnsleep example with 100 tasks and sleep value 10
seconds. From the standard out and completion time, it seems Swift is
running more jobs in parallel despite jobsPerNode and ppn set to be 1.

Attached is the stdout and log for this run. I am setting throttle high
since otherwise coasters will leave resources and try to reacquire on each
job burst.

Thanks,
-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131001/fc390b68/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: stampederun.out
Type: application/octet-stream
Size: 8616 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131001/fc390b68/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: catsnsleep-20131001-1423-2q35a3ed.log
Type: application/octet-stream
Size: 915515 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131001/fc390b68/attachment-0001.obj>


More information about the Swift-devel mailing list