<div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Hi Justin,</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Here are some tested configs and a small README from running the sanity test on Blacklight:</div><div class="gmail_default" style><font face="arial, helvetica, sans-serif"><a href="http://users.rcc.uchicago.edu/~yadunand/blacklight-sanity/">http://users.rcc.uchicago.edu/~yadunand/blacklight-sanity/</a></font><br></div><div class="gmail_default" style><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default" style><font face="arial, helvetica, sans-serif">There's an example each of configs for Swift 0.94, Swift 0.95 and the configs we would use going</font></div><div class="gmail_default" style><font face="arial, helvetica, sans-serif">forward (Swift 0.96 and current trunk) </font><span style="font-family:arial,helvetica,sans-serif">in that folder.</span></div><div class="gmail_default" style><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default" style><font face="arial, helvetica, sans-serif">In the example, I've used ppn=16 (or any multiple of 16) which seems to work as a substitute for ncpus.</font></div><div class="gmail_default" style><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default" style><font face="arial, helvetica, sans-serif">Hope that helps!</font></div><div class="gmail_default" style><font face="arial, helvetica, sans-serif"><br></font></div><div class="gmail_default" style><font face="arial, helvetica, sans-serif">-Yadu</font></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Sep 23, 2014 at 5:30 PM, Michael Wilde <span dir="ltr"><<a href="mailto:wilde@anl.gov" target="_blank">wilde@anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
Justin,<br>
<br>
Blacklight is an SGI machine, and thus a more standard PBS machine
to which the Cray-specific sites file settings do not apply.<br>
<br>
It does seem to have a few quirks, though, as describe at:<br>
<a href="https://portal.xsede.org/psc-blacklight#running" target="_blank">https://portal.xsede.org/psc-blacklight#running</a><br>
<br>
In particular, the page above suggests using "-l ncpus=N" where N is
the number of CPUS desired and a multiple of 16. But by default
Swift will generate "-l nodes=n" where n is the number of nodes.<br>
<br>
So we'll need to either do some testing (once we get on the machine)
or send you our best guess of the right sites settings and work with
you to test them for us.<br>
<br>
We'll look into this further and report back.<br>
<br>
- Mike<div><div class="h5"><br>
<br>
<div>On 9/23/14, 5:22 PM, Justin bbt wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Thank you very much.
<div><br>
<div>I am actually using the Blacklight, which I guess is PBS
based. </div>
</div>
<div>So, should I use the Crays tutorial and setting ? <a href="http://swift-lang.org/tutorials/cray/tutorial.html" target="_blank">http://swift-lang.org/tutorials/cray/tutorial.html</a></div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Sep 23, 2014 at 10:31 AM, Ketan
Maheshwari <span dir="ltr"><<a href="mailto:ketan@mcs.anl.gov" target="_blank">ketan@mcs.anl.gov</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div dir="ltr">Hi Justin,
<div><br>
</div>
<div>If you are using xsede Stampede regular nodes (non
xeon phi), here is a site configuration that has worked
for me in the past, connecting over ssh to slurm:</div>
<div><br>
</div>
<div>
<div><?xml version="1.0" encoding="UTF-8"?></div>
<div><config xmlns="<a href="http://www.ci.uchicago.edu/swift/SwiftSites" target="_blank">http://www.ci.uchicago.edu/swift/SwiftSites</a>"></div>
<div> <pool handle="stampede"></div>
<div> <execution provider="coaster"
jobmanager="ssh-cl:slurm" url="<a href="http://stampede.tacc.utexas.edu" target="_blank">stampede.tacc.utexas.edu</a>"/></div>
<div> <filesystem provider="local" /></div>
<div> <profile namespace="globus"
key="jobsPerNode">1</profile></div>
<div> <profile namespace="globus"
key="ppn">1</profile></div>
<div> <profile namespace="globus"
key="maxTime">7500</profile></div>
<div> <profile namespace="globus"
key="maxwalltime">00:10:00</profile></div>
<div> <profile namespace="globus"
key="lowOverallocation">100</profile></div>
<div> <profile namespace="globus"
key="highOverallocation">100</profile></div>
<div> <profile namespace="globus"
key="queue">normal</profile></div>
<div> <profile namespace="globus"
key="nodeGranularity">1</profile></div>
<div> <profile namespace="globus"
key="maxNodes">1</profile></div>
<div> <profile namespace="globus"
key="slots">1</profile></div>
<div> <profile namespace="globus"
key="project">TG-EAR130015</profile></div>
<div> <profile namespace="karajan"
key="jobThrottle">.3199</profile></div>
<div> <profile namespace="karajan"
key="initialScore">10000</profile></div>
<div>
<workdirectory>/tmp/{env.USER}/swift.work</workdirectory></div>
<div> </pool></div>
<div></config></div>
</div>
<div><br>
</div>
<div>You will need to replace project id with yours.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Ketan </div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">
<div>
<div>On Mon, Sep 22, 2014 at 8:32 PM,
Justin bbt <span dir="ltr"><<a href="mailto:justinbbt@gmail.com" target="_blank">justinbbt@gmail.com</a>></span>
wrote:<br>
</div>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div>
<div>
<div dir="ltr">Hi <br>
<div><br>
</div>
<div>If I want to use resources on the xsede </div>
<div><a href="https://www.xsede.org/overview" target="_blank">https://www.xsede.org/overview</a>
<br>
</div>
<div>which site config should I use ? </div>
<div><br>
</div>
</div>
<br>
</div>
</div>
_______________________________________________<br>
Swift-user mailing list<br>
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br>
</blockquote>
</div>
<br>
</div>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
Swift-user mailing list
<a href="mailto:Swift-user@ci.uchicago.edu" target="_blank">Swift-user@ci.uchicago.edu</a>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a></pre>
</blockquote>
<br>
</div></div><span class=""><font color="#888888"><pre cols="72">--
Michael Wilde
Mathematics and Computer Science Computation Institute
Argonne National Laboratory The University of Chicago
</pre>
</font></span></div>
<br>_______________________________________________<br>
Swift-user mailing list<br>
<a href="mailto:Swift-user@ci.uchicago.edu">Swift-user@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif;display:inline"></div>Yadu Nand B<div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"></div><br></div></div>
</div></div>