[Swift-commit] r8303 - www/Swift-T
wozniak at ci.uchicago.edu
wozniak at ci.uchicago.edu
Thu Nov 20 14:45:39 CST 2014
Author: wozniak
Date: 2014-11-20 14:45:39 -0600 (Thu, 20 Nov 2014)
New Revision: 8303
Modified:
www/Swift-T/turbine-sites.html
Log:
Updated Swift/T notes for BG/Q
Modified: www/Swift-T/turbine-sites.html
===================================================================
--- www/Swift-T/turbine-sites.html 2014-11-20 18:15:10 UTC (rev 8302)
+++ www/Swift-T/turbine-sites.html 2014-11-20 20:45:39 UTC (rev 8303)
@@ -746,8 +746,8 @@
<h1>Turbine Sites Guide</h1>
<span id="author">Justin M. Wozniak</span><br />
<span id="email"><code><<a href="mailto:wozniak at mcs.anl.gov">wozniak at mcs.anl.gov</a>></code></span><br />
-<span id="revnumber">version 0.6.1,</span>
-<span id="revdate">August 2014</span>
+<span id="revnumber">version 0.7.0,</span>
+<span id="revdate">November 2014</span>
<div id="toc">
<div id="toctitle">Table of Contents</div>
<noscript><p><b>JavaScript must be enabled in your browser to display the table of contents.</b></p></noscript>
@@ -894,7 +894,7 @@
</dt>
<dd>
<p>
-<code>turbine-aprun-run.zsh</code> (PBS with Cray’s <code>aprun</code>)
+<code>turbine-cray-run.zsh</code> (PBS with Cray’s <code>aprun</code>)
</p>
</dd>
<dt class="hdlist1">
@@ -910,22 +910,29 @@
<div class="paragraph"><p>A typical invocation is:</p></div>
<div class="listingblock">
<div class="content">
+<pre><code>swift-t -m pbs -n 96 -s settings.sh program.swift</code></pre>
+</div></div>
+<div class="paragraph"><p>or:</p></div>
+<div class="listingblock">
+<div class="content">
<pre><code>stc program.swift
-turbine-pbs-run.zsh -n 96 -s settings.sh program.tcl</code></pre>
+turbine-pbs-run.zsh -n 96 -s settings.sh program.tic</code></pre>
</div></div>
-<div class="paragraph"><p>where <code>program.tcl</code> is the output of STC and <code>settings.sh</code> contains:</p></div>
+<div class="paragraph"><p>which are equivalent.</p></div>
+<div class="paragraph"><p><code>program.tic</code> is the output of STC and <code>settings.sh</code> contains:</p></div>
<div class="listingblock">
<div class="content">
<pre><code>export QUEUE=bigqueue
export PPN=8</code></pre>
</div></div>
-<div class="paragraph"><p>which would run <code>program.tcl</code> in 96 MPI processes on 12 nodes (8
+<div class="paragraph"><p>which would run <code>program.tic</code> in 96 MPI processes on 12 nodes (8
processes per node), submitted by PBS to queue <code>bigqueue</code>.</p></div>
</div>
<div class="sect2">
<h3 id="variables">Turbine scheduler variables</h3>
<div class="paragraph"><p>For scheduled systems, Turbine accepts a common set of environment
-variables.</p></div>
+variables. These may be placed in <code>settings.sh</code> or set by the user in
+any other way.</p></div>
<div class="dlist"><dl>
<dt class="hdlist1">
<code>PROCS</code>
@@ -1073,7 +1080,7 @@
<p>
Run standalone Turbine executable
(created by <a href="swift.html#mkstatic">mkstatic.tcl</a>) instead of
- <code>program.tcl</code>.
+ <code>program.tic</code>.
</p>
</dd>
</dl></div>
@@ -1092,9 +1099,9 @@
<div class="title">Tip</div>
</td>
<td class="content">When running on a big HPC machine, it may be difficult to get STC
-(a Java-based program) running. STC output (<code>program.tcl</code>) is
+(a Java-based program) running. STC output (<code>program.tic</code>) is
platform-independent. You may run STC to develop and debug your
-script on your local workstation, then simply copy <code>program.tcl</code> to
+script on your local workstation, then simply copy <code>program.tic</code> to
the big machine for execution. Just make sure that the STC and
Turbine versions are compatible (the same release number).</td>
</tr></table>
@@ -1115,7 +1122,7 @@
will pass it to <code>mpiexec</code>.</p></div>
<div class="listingblock">
<div class="content">
-<pre><code>turbine -l -n 3 -f hosts.txt program.tcl</code></pre>
+<pre><code>turbine -l -n 3 -f hosts.txt program.tic</code></pre>
</div></div>
</div>
</div>
@@ -1127,7 +1134,7 @@
<div class="content">
<pre><code>echo crush.mcs.anl.gov > hosts.txt
echo crank.mcs.anl.gov >> hosts.txt
-turbine -l -n 3 -f hosts.txt program.tcl</code></pre>
+turbine -l -n 3 -f hosts.txt program.tic</code></pre>
</div></div>
<div class="sect3">
<h4 id="_public_installation">Public installation</h4>
@@ -1188,7 +1195,7 @@
<div class="listingblock">
<div class="content">
<pre><code>export TURBINE_LAUNCH_OPTS='-f hosts.txt'
-turbine -l -n 4 program.tcl</code></pre>
+turbine -l -n 4 program.tic</code></pre>
</div></div>
</li>
<li>
@@ -1226,7 +1233,7 @@
<div class="paragraph"><p>To run:</p></div>
<div class="listingblock">
<div class="content">
-<pre><code>srun ~wozniak/Public/turbine-0.1.1/scripts/submit/slurm/turbine-slurm.sh -n 3 ~/program.tcl</code></pre>
+<pre><code>srun ~wozniak/Public/turbine-0.1.1/scripts/submit/slurm/turbine-slurm.sh -n 3 ~/program.tic</code></pre>
</div></div>
</div>
<div class="sect3">
@@ -1308,7 +1315,7 @@
<pre><code>export MODE=cluster
export QUEUE=pubnet
export PROJECT=...
-turbine-cobalt-run.zsh -n 3 program.tcl</code></pre>
+turbine-cobalt-run.zsh -n 3 program.tic</code></pre>
</div></div>
</div>
<div class="sect3">
@@ -1354,7 +1361,7 @@
<div class="listingblock">
<div class="content">
<pre><code>export QUEUE=batch
-~wozniak/Public/turbine/scripts/submit/pbs/turbine-pbs-run.zsh -n 3 program.tcl</code></pre>
+~wozniak/Public/turbine/scripts/submit/pbs/turbine-pbs-run.zsh -n 3 program.tic</code></pre>
</div></div>
<div class="paragraph"><p>See the <a href="#variables">Turbine scheduler variables</a> and
<a href="#options">Turbine run script options</a> for additional settings.</p></div>
@@ -1417,7 +1424,7 @@
<div class="paragraph"><p>To run:</p></div>
<div class="listingblock">
<div class="content">
-<pre><code>~wozniak/Public/turbine/scripts/submit/cobalt/turbine-cobalt-run.zsh -n 3 ~/program.tcl</code></pre>
+<pre><code>~wozniak/Public/turbine/scripts/submit/cobalt/turbine-cobalt-run.zsh -n 3 ~/program.tic</code></pre>
</div></div>
</div>
<div class="sect4">
@@ -1535,19 +1542,18 @@
<div class="sect2">
<h3 id="_blue_gene_q">Blue Gene/Q</h3>
<div class="sect3">
-<h4 id="_vesta">Vesta</h4>
-<div class="sect4">
-<h5 id="_public_installation_6">Public installation</h5>
-<div class="paragraph"><p><strong>As of:</strong> 0.4.0 - 07/29/2013</p></div>
+<h4 id="_mira_cetus">Mira/Cetus</h4>
+<div class="paragraph"><p><strong>As of:</strong> 0.7.0 - 11/20/2014</p></div>
+<div class="paragraph"><p>Add to <code>PATH</code>:</p></div>
<div class="ulist"><ul>
<li>
<p>
-STC: <code>~wozniak/Public/stc-bgq/bin/stc</code>
+STC: <code>~wozniak/Public/ppc64/stc/bin</code>
</p>
</li>
<li>
<p>
-Turbine: <code>~wozniak/Public/turbine-bgq/scrips/submit/cobalt/turbine-cobalt-run.zsh</code>
+Turbine (optional): <code>~wozniak/Public/ppc64/turbine/scripts/submit/cobalt</code>
</p>
</li>
<li>
@@ -1557,39 +1563,45 @@
<div class="listingblock">
<div class="content">
<pre><code>export MODE=BGQ
-export QUEUE=<queue_name>
-turbine-cobalt-run.zsh -n 3 program.tcl</code></pre>
+export QUEUE=...
+export PROJECT=...
+swift-t -m cobalt -n 3 program.tic</code></pre>
</div></div>
</li>
</ul></div>
-<div class="paragraph"><p>The normal Turbine environment variables are honored, plus the
-<a href="#variables">Turbine scheduler variables</a>.</p></div>
</div>
-</div>
<div class="sect3">
-<h4 id="_mira_cetus">Mira/Cetus</h4>
-<div class="paragraph"><p><strong>As of:</strong> 0.5.0 - 4/4/2014</p></div>
-<div class="paragraph"><p>Add to <code>PATH</code>:
-* STC: <code><sub>wozniak/Public/ppc64/stc/bin</code>
-* Turbine:
-<code></sub>wozniak/Public/ppc64/turbine/scripts/submit/cobalt</code></p></div>
+<h4 id="_vesta">Vesta</h4>
+<div class="paragraph"><p><strong>As of:</strong> 0.7.0 - 11/20/2014</p></div>
<div class="ulist"><ul>
<li>
<p>
+STC: <code>~wozniak/Public/sfw/stc/bin</code>
+</p>
+</li>
+<li>
+<p>
+Turbine (optional): <code>~wozniak/Public/sfw/turbine/scripts/submit/turbine-cobalt-run.zsh</code>
+</p>
+</li>
+<li>
+<p>
Run as:
</p>
<div class="listingblock">
<div class="content">
<pre><code>export MODE=BGQ
-export QUEUE=...
-export PROJECT=...
-turbine-cobalt-run.zsh -n 3 program.tcl</code></pre>
+export QUEUE=default
+swift-t -m cobalt -n 2 program.tic</code></pre>
</div></div>
</li>
</ul></div>
-<div class="sect4">
-<h5 id="_build_procedure_6">Build procedure</h5>
-<div class="paragraph"><p><strong>As of:</strong> 0.5.0 - 4/4/2014</p></div>
+<div class="paragraph"><p>The normal Turbine environment variables are honored, plus the
+<a href="#variables">Turbine scheduler variables</a>.</p></div>
+</div>
+<div class="sect3">
+<h4 id="_build_procedure_6">Build procedure</h4>
+<div class="paragraph"><p><strong>As of:</strong> 0.7.0 - 11/20/2014</p></div>
<div class="paragraph"><p><strong>Tcl:</strong></p></div>
<div class="paragraph"><p>The GCC installation does not support shared libraries. Thus, you
must compile Tcl with <code>bgxlc</code>. You must modify the Makefile to use
@@ -1598,22 +1610,32 @@
<div class="paragraph"><p>You may get errors that say <code>wrong digit</code>. This is apparently a bgxlc
bug when applied to Tcl’s <code>StrToD.c</code>. Compiling this file with <code>-O3</code> fixes
the problem.</p></div>
-<div class="paragraph"><p>Put <code>/bgsys/drivers/V1R2M1/ppc64/comm/bin/gcc</code> in your <code>PATH</code>.</p></div>
<div class="ulist"><ul>
<li>
<p>
-Compile c-utils with <code>CC=/usr/bin/gcc</code>
+Compile c-utils with <code>CC=powerpc64-bgq-linux-gcc</code>
</p>
</li>
<li>
<p>
-Configure ADLB with <code>CC=mpixlc --enable-mpi-2 --enable-xlc</code>
+Configure ADLB with <code>CC=mpixlc --enable-mpi-2 --enable-xlc --disable-checkpoint</code>
</p>
</li>
<li>
<p>
-Configure Turbine with <code>CC=/usr/bin/gcc --disable-static --with-tcl=/home/wozniak/Public/sfw/ppc64/tcl-8.5.12 --with-mpi=/bgsys/drivers/V1R2M1/ppc64/comm --with-mpi-lib-name=mpich-gcc</code>
+Configure Turbine with:
</p>
+<div class="listingblock">
+<div class="content">
+<pre><code>CC=mpixlc
+--disable-static
+--with-tcl=/home/wozniak/Public/sfw/ppc64/bgxlc/dynamic/tcl-8.5.12
+--with-mpi=/bgsys/drivers/V1R2M1/ppc64/comm
+--with-mpi-lib-name=mpich-xl
+--without-zlib
+--without-hdf5
+--disable-static-pkg</code></pre>
+</div></div>
</li>
</ul></div>
<div class="paragraph"><p><strong>External scripting:</strong></p></div>
@@ -1656,7 +1678,6 @@
</div>
</div>
</div>
-</div>
<div class="sect1">
<h2 id="_cray">Cray</h2>
<div class="sectionbody">
@@ -1664,7 +1685,7 @@
<h3 id="_titan">Titan</h3>
<div class="paragraph"><p>Titan is a Cray XK7 at the Oak Ridge Leadership Computing Facility.</p></div>
<div class="sect3">
-<h4 id="_public_installation_7">Public installation</h4>
+<h4 id="_public_installation_6">Public installation</h4>
<div class="paragraph"><p><strong>As of:</strong> 8/27/2014</p></div>
<div class="ulist"><ul>
<li>
@@ -2002,7 +2023,7 @@
NFS (including home directories). Thus, you must install Turbine and
its libraries in <code>/lustre</code>. Also, your data must be in <code>/lustre</code>.</p></div>
<div class="sect3">
-<h4 id="_public_installation_8">Public installation</h4>
+<h4 id="_public_installation_7">Public installation</h4>
<div class="sect4">
<h5 id="_login_nodes">Login nodes</h5>
<div class="paragraph"><p>This installation is for use on the <a href="#login_node">login node</a>.</p></div>
@@ -2254,7 +2275,7 @@
<div class="listingblock">
<div class="content">
<pre><code>export TURBINE_LAUNCH_OPTS="-f $HOME/hosts.txt"
-turbine program.tcl</code></pre>
+turbine program.tic</code></pre>
</div></div>
</div>
</div>
@@ -2283,8 +2304,8 @@
<div id="footnotes"><hr /></div>
<div id="footer">
<div id="footer-text">
-Version 0.6.1<br />
-Last updated 2014-08-27 15:17:45 CDT
+Version 0.7.0<br />
+Last updated 2014-11-20 14:44:01 CST
</div>
</div>
</body>
More information about the Swift-commit
mailing list