[Swift-user] Question about nr of nodes

Glen Hocky glen842 at uchicago.edu
Mon Apr 2 15:57:12 CDT 2012


What I used to use was (shell variables should be self explanatory). This
should limit your number of nodes to $nodes while putting 1 coaster on each
one to run your jobs...
Things may have changed in the last few months and this might not work
correctly any more...

    <profile key="jobsPerNode" namespace="globus">24</profile>
    <profile namespace="globus"
key="providerAttributes">pbs.aprun;pbs.mpp;depth=24</profile>

    <profile namespace="env" key="OMP_NUM_THREADS">$PPN</profile>
    <profile namespace="globus" key="maxwalltime">$TIME</profile>
    <profile namespace="globus" key="maxTime">$MAXTIME</profile>
    <profile namespace="globus" key="slots">$nodes</profile>
    <profile namespace="globus" key="nodeGranularity">1</profile>
    <profile namespace="globus" key="maxNodes">1</profile>
    <profile namespace="globus" key="lowOverAllocation">100</profile>
    <profile namespace="globus" key="highOverAllocation">100</profile>
    <profile namespace="karajan" key="jobThrottle">200.00</profile>
    <profile namespace="karajan" key="initialScore">10000</profile>



On Mon, Apr 2, 2012 at 4:54 PM, Jonathan Monette <jonmon at mcs.anl.gov> wrote:

> So you can very nodeGranulairty.  Right now in your sites file you have it
> set to 1.  That means that coasters will try jobs anywhere in the range
> 1-50 nodes. If you set nodeGranularity to 50, then coasters will submit a
> job with 50 nodes.
>
> On Apr 2, 2012, at 3:48 PM, Lorenzo Pesce wrote:
>
> > Nth question from me.
> >
> > Do you know of any implicit of explicit limitation in the number of
> nodes when one submits a job requesting less than 1 hr on Beagle?
> >
> > I asked for 50 nodes (I think) and I got only two.
> >
> > This is my sites file
> >
> > <config>
> >  <pool handle="pbs">
> >    <execution provider="coaster" jobmanager="local:pbs"/>
> >    <!-- replace with your project -->
> >    <profile namespace="globus" key="project">CI-IBN000103</profile>
> >
> >    <profile namespace="globus"
> key="providerAttributes">pbs.aprun;pbs.mpp;depth=24</profile>
> >
> >    <profile namespace="globus" key="jobsPerNode">24</profile>
> >    <profile namespace="globus" key="maxTime">3600</profile>
> >
> >    <profile namespace="globus" key="slots">1</profile>
> >    <profile namespace="globus" key="nodeGranularity">1</profile>
> >    <profile namespace="globus" key="maxNodes">50</profile>
> >
> >    <profile namespace="karajan" key="jobThrottle">12</profile>
> >    <profile namespace="karajan" key="initialScore">10000</profile>
> >
> >    <filesystem provider="local"/>
> >    <!-- replace this with your home on lustre -->
> >    <workdirectory>/lustre/beagle/GCNet/swift.workdir</workdirectory>
> >  </pool>
> > </config>
> >
> >
> > _______________________________________________
> > Swift-user mailing list
> > Swift-user at ci.uchicago.edu
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20120402/72af80b0/attachment.html>


More information about the Swift-user mailing list