[Swift-commit] r4454 - www/cookbook
ketan at ci.uchicago.edu
ketan at ci.uchicago.edu
Fri May 6 18:21:32 CDT 2011
Author: ketan
Date: 2011-05-06 18:21:32 -0500 (Fri, 06 May 2011)
New Revision: 4454
Modified:
www/cookbook/cookbook-asciidoc.html
www/cookbook/cookbook-asciidoc.txt
Log:
Modified: www/cookbook/cookbook-asciidoc.html
===================================================================
--- www/cookbook/cookbook-asciidoc.html 2011-05-06 21:53:34 UTC (rev 4453)
+++ www/cookbook/cookbook-asciidoc.html 2011-05-06 23:21:32 UTC (rev 4454)
@@ -1074,10 +1074,116 @@
</div>
</div>
<div class="sect1">
-<h2 id="_swift_on_diverse_infrastructures">3. Swift on Diverse Infrastructures</h2>
+<h2 id="_coasters">3. Coasters</h2>
<div class="sectionbody">
+<div class="paragraph"><p>Coasters were introduced in Swift v0.6 as an experimental feature. In many
+applications, Swift performance can be greatly enhanced by the use of CoG
+coasters. CoG coasters provide a low-overhead job submission and file transfer
+mechanism suited for the execution of short jobs (on the order of a few
+seconds). A detailed information on coasters can be found at <a href="http://www.ci.uchicago.edu/swift/guides/userguide.php#coasters">http://www.ci.uchicago.edu/swift/guides/userguide.php#coasters</a>.</p></div>
+<div class="paragraph"><p>Following is a coasters setup case-study for a PBS underlying provider where sites.xml coaster settings were:</p></div>
+<div class="listingblock">
+<div class="content"><!-- Generator: GNU source-highlight 3.1.4
+by Lorenzo Bettini
+http://www.lorenzobettini.it
+http://www.gnu.org/software/src-highlite -->
+<pre><tt><span style="font-weight: bold"><span style="color: #0000FF"><execution</span></span> <span style="color: #009900">provider</span><span style="color: #990000">=</span><span style="color: #FF0000">"coaster"</span> <span style="color: #009900">jobmanager</span><span style="color: #990000">=</span><span style="color: #FF0000">"local:pbs"</span><span style="font-weight: bold"><span style="color: #0000FF">/></span></span>
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"project"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>CI-CCR000013<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
+
+<span style="font-style: italic"><span style="color: #9A1900"><!-- Note that the following is going to be defunct in the new version (0.93+) and replaced by</span></span>
+<span style="font-style: italic"><span style="color: #9A1900">"ProviderAttributes" key and may not work in the future Swift versions--></span></span>
+
+<span style="font-style: italic"><span style="color: #9A1900"><!--<profile namespace="globus" key="ppn">24:cray:pack</profile>--></span></span>
+
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"providerAttributes"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>
+pbs.aprun
+pbs.mpp=true
+<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
+
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"workersPerNode"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>24<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"maxTime"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>100000<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
+
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"lowOverallocation"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>100<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"highOverallocation"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>100<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
+
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"slots"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>20<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"nodeGranularity"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>5<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"maxNodes"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>5<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"karajan"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"jobThrottle"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>20.00<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
+<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"karajan"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"initialScore"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>10000<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span></tt></pre></div></div>
+<div class="paragraph"><p>The following table briefly describes the elements on the coasters setup:</p></div>
+<div class="tableblock">
+<table rules="all"
+width="70%"
+frame="border"
+cellspacing="0" cellpadding="4">
+<col width="23%" />
+<col width="76%" />
+<thead>
+<tr>
+<th align="center" valign="top">profile key </th>
+<th align="left" valign="top"> brief description</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td align="center" valign="top"><p class="table">slots</p></td>
+<td align="left" valign="top"><p class="table">How many maximum LRM jobs/worker blocks are allowed</p></td>
+</tr>
+<tr>
+<td align="center" valign="top"><p class="table">workersPerNode</p></td>
+<td align="left" valign="top"><p class="table">How many coaster workers to run per execution node</p></td>
+</tr>
+<tr>
+<td align="center" valign="top"><p class="table">nodeGranularity</p></td>
+<td align="left" valign="top"><p class="table">Each worker block uses a number of nodes that is a multiple of this number</p></td>
+</tr>
+<tr>
+<td align="center" valign="top"><p class="table">lowOverallocation</p></td>
+<td align="left" valign="top"><p class="table">How many times larger than the job walltime should a block’s walltime be if all jobs are 1s long</p></td>
+</tr>
+<tr>
+<td align="center" valign="top"><p class="table">highOverallocation</p></td>
+<td align="left" valign="top"><p class="table">How many times larger than the job walltime should a block’s walltime be if all jobs are infinitely long</p></td>
+</tr>
+<tr>
+<td align="center" valign="top"><p class="table">workersPerNode</p></td>
+<td align="left" valign="top"><p class="table">How many coaster workers to run per execution node reserve How many seconds to reserve in a block’s walltime for starting/shutdown operations</p></td>
+</tr>
+<tr>
+<td align="center" valign="top"><p class="table">maxnodes</p></td>
+<td align="left" valign="top"><p class="table">The maximum number of nodes allowed in a block</p></td>
+</tr>
+<tr>
+<td align="center" valign="top"><p class="table">maxtime</p></td>
+<td align="left" valign="top"><p class="table">The maximum number of walltime allowed for a block coaster service</p></td>
+</tr>
+<tr>
+<td align="center" valign="top"><p class="table">jobThrottle</p></td>
+<td align="left" valign="top"><p class="table">the number of concurrent jobs allowed on a site</p></td>
+</tr>
+</tbody>
+</table>
+</div>
<div class="sect2">
-<h3 id="_beagle">3.1. Beagle</h3>
+<h3 id="_for_advanced_users">3.1. For Advanced Users</h3>
+<div class="paragraph"><p>One of the main reason that one would initially deviate from coaster
+defaults into more complex pool entries is to force jobs to fit into some
+site-imposed constraint. For instance a typical submission to the experimental
+queue requires a user to request upto 3 nodes for under 1 hour. This setup
+could be achieved with a careful tuning of coaters parameters.</p></div>
+</div>
+<div class="sect2">
+<h3 id="_coaster_providers_local_ssh_pbs">3.2. Coaster providers: local, ssh, pbs</h3>
+<div class="paragraph"><p>Settings and examples for different coaster providers mechanisms.</p></div>
+</div>
+</div>
+</div>
+<div class="sect1">
+<h2 id="_swift_on_diverse_infrastructures">4. Swift on Diverse Infrastructures</h2>
+<div class="sectionbody">
+<div class="sect2">
+<h3 id="_beagle">4.1. Beagle</h3>
<div class="paragraph"><p>Swift is now installed on Beagle as a module. Swift supports a Coasters based,
computing environment for Beagle. A detailed Swift documentation is maintained
[[<a href="http://www.ci.uchicago.edu/swift/docs/index.php]">here</a>]. To get started
@@ -1101,7 +1207,7 @@
will get fast prioritized execution. Good for small tests</p></div>
</div>
<div class="sect2">
-<h3 id="_pads">3.2. PADS</h3>
+<h3 id="_pads">4.2. PADS</h3>
<div class="paragraph"><p>Swift on PADS
To execute your Swift script on the PADS cluster use this command:</p></div>
<div class="listingblock">
@@ -1127,7 +1233,7 @@
<span style="font-weight: bold"><span style="color: #0000FF"></config></span></span></tt></pre></div></div>
</div>
<div class="sect2">
-<h3 id="_osg">3.3. OSG</h3>
+<h3 id="_osg">4.3. OSG</h3>
<div class="paragraph"><p>This section describes how to get Swift running on the OSG Grid. We will use a
manual coaster setup to get Swift running on OSG.</p></div>
<div class="paragraph"><div class="title">Coaster setup on OSG</div><p>The following figure shows an abstract scheme for the manual coasters setup on
@@ -1140,7 +1246,7 @@
<div class="paragraph"><p>In the following steps, we will go through the process of manually setting</p></div>
</div>
<div class="sect2">
-<h3 id="_bionimbus">3.4. Bionimbus</h3>
+<h3 id="_bionimbus">4.4. Bionimbus</h3>
<div class="paragraph"><p>This section explains a step by step procedure on getting Swift running on the
Bionimbus cloud. We will use the <em>manual</em> <em>coasters</em> configuration on the
Bionimbus cloud.</p></div>
@@ -1214,100 +1320,6 @@
</div>
</div>
<div class="sect1">
-<h2 id="_coasters">4. Coasters</h2>
-<div class="sectionbody">
-<div class="paragraph"><p>Coasters were introduced in Swift v0.6 as an experimental feature. In many
-applications, Swift performance can be greatly enhanced by the use of CoG
-coasters. CoG coasters provide a low-overhead job submission and file transfer
-mechanism suited for the execution of short jobs (on the order of a few
-seconds). A detailed information on coasters can be found at <a href="http://www.ci.uchicago.edu/swift/guides/userguide.php#coasters">http://www.ci.uchicago.edu/swift/guides/userguide.php#coasters</a>.</p></div>
-<div class="paragraph"><p>Following is a nice coasters setup case-study where sites.xml coaster settings were:</p></div>
-<div class="listingblock">
-<div class="content"><!-- Generator: GNU source-highlight 3.1.4
-by Lorenzo Bettini
-http://www.lorenzobettini.it
-http://www.gnu.org/software/src-highlite -->
-<pre><tt><span style="font-weight: bold"><span style="color: #0000FF"><execution</span></span> <span style="color: #009900">provider</span><span style="color: #990000">=</span><span style="color: #FF0000">"coaster"</span> <span style="color: #009900">jobmanager</span><span style="color: #990000">=</span><span style="color: #FF0000">"local:pbs"</span><span style="font-weight: bold"><span style="color: #0000FF">/></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"project"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>CI-CCR000013<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"ppn"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>24:cray:pack<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"workersPerNode"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>24<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"maxTime"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>100000<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"lowOverallocation"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>100<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"highOverallocation"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>100<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"slots"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>20<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"nodeGranularity"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>5<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"globus"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"maxNodes"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>5<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"karajan"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"jobThrottle"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>20.00<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span>
-<span style="font-weight: bold"><span style="color: #0000FF"><profile</span></span> <span style="color: #009900">namespace</span><span style="color: #990000">=</span><span style="color: #FF0000">"karajan"</span> <span style="color: #009900">key</span><span style="color: #990000">=</span><span style="color: #FF0000">"initialScore"</span><span style="font-weight: bold"><span style="color: #0000FF">></span></span>10000<span style="font-weight: bold"><span style="color: #0000FF"></profile></span></span></tt></pre></div></div>
-<div class="paragraph"><p>The following table briefly describes the elements on the coasters setup:</p></div>
-<div class="tableblock">
-<table rules="all"
-width="70%"
-frame="border"
-cellspacing="0" cellpadding="4">
-<col width="23%" />
-<col width="76%" />
-<thead>
-<tr>
-<th align="center" valign="top">profile key </th>
-<th align="left" valign="top"> brief description</th>
-</tr>
-</thead>
-<tbody>
-<tr>
-<td align="center" valign="top"><p class="table">slots</p></td>
-<td align="left" valign="top"><p class="table">How many maximum LRM jobs/worker blocks are allowed</p></td>
-</tr>
-<tr>
-<td align="center" valign="top"><p class="table">workersPerNode</p></td>
-<td align="left" valign="top"><p class="table">How many coaster workers to run per execution node</p></td>
-</tr>
-<tr>
-<td align="center" valign="top"><p class="table">nodeGranularity</p></td>
-<td align="left" valign="top"><p class="table">Each worker block uses a number of nodes that is a multiple of this number</p></td>
-</tr>
-<tr>
-<td align="center" valign="top"><p class="table">lowOverallocation</p></td>
-<td align="left" valign="top"><p class="table">How many times larger than the job walltime should a block’s walltime be if all jobs are 1s long</p></td>
-</tr>
-<tr>
-<td align="center" valign="top"><p class="table">highOverallocation</p></td>
-<td align="left" valign="top"><p class="table">How many times larger than the job walltime should a block’s walltime be if all jobs are infinitely long</p></td>
-</tr>
-<tr>
-<td align="center" valign="top"><p class="table">workersPerNode</p></td>
-<td align="left" valign="top"><p class="table">How many coaster workers to run per execution node reserve How many seconds to reserve in a block’s walltime for starting/shutdown operations</p></td>
-</tr>
-<tr>
-<td align="center" valign="top"><p class="table">maxnodes</p></td>
-<td align="left" valign="top"><p class="table">The maximum number of nodes allowed in a block</p></td>
-</tr>
-<tr>
-<td align="center" valign="top"><p class="table">maxtime</p></td>
-<td align="left" valign="top"><p class="table">The maximum number of walltime allowed for a block coaster service</p></td>
-</tr>
-<tr>
-<td align="center" valign="top"><p class="table">jobThrottle</p></td>
-<td align="left" valign="top"><p class="table">the number of concurrent jobs allowed on a site</p></td>
-</tr>
-</tbody>
-</table>
-</div>
-<div class="sect2">
-<h3 id="_for_advanced_users">4.1. For Advanced Users</h3>
-<div class="paragraph"><p>One of the main reason that one would initially deviate from coaster
-defaults into more complex pool entries is to force jobs to fit into some
-site-imposed constraint. For instance a typical submission to the experimental
-queue requires a user to request upto 3 nodes for under 1 hour. This setup
-could be achieved with a careful tuning of coaters parameters.</p></div>
-</div>
-<div class="sect2">
-<h3 id="_coaster_providers_local_ssh_pbs">4.2. Coaster providers: local, ssh, pbs</h3>
-<div class="paragraph"><p>Settings and examples for different coaster providers mechanisms.</p></div>
-</div>
-</div>
-</div>
-<div class="sect1">
<h2 id="_debugging_swift">5. Debugging Swift</h2>
<div class="sectionbody">
<div class="paragraph"><p>Swift errors are logged in several places:</p></div>
@@ -1483,7 +1495,7 @@
<div id="footer">
<div id="footer-text">
Version 0.92<br />
-Last updated 2011-05-06 10:25:32 CDT
+Last updated 2011-05-06 14:14:07 CDT
</div>
</div>
</body>
Modified: www/cookbook/cookbook-asciidoc.txt
===================================================================
--- www/cookbook/cookbook-asciidoc.txt 2011-05-06 21:53:34 UTC (rev 4453)
+++ www/cookbook/cookbook-asciidoc.txt 2011-05-06 23:21:32 UTC (rev 4454)
@@ -61,8 +61,12 @@
Setting up to run Swift
~~~~~~~~~~~~~~~~~~~~~~~~
This is simple. We will be using a pre-compiled version of Swift that can be
-downloaded from link:http://www.ci.uchicago.edu/swift/downloads/index.php[here].
+downloaded from link:http://www.ci.uchicago.edu/swift/downloads/index.php[here]. Download and untar the latest precompiled version as follows:
+----
+$ tar xf swift-0.92.1.tar.gz
+----
+
Environment Setup
^^^^^^^^^^^^^^^^^^
@@ -480,8 +484,118 @@
login1$
----
+Coasters
+--------
+Coasters were introduced in Swift v0.6 as an experimental feature. In many
+applications, Swift performance can be greatly enhanced by the use of CoG
+coasters. CoG coasters provide a low-overhead job submission and file transfer
+mechanism suited for the execution of short jobs (on the order of a few
+seconds). A detailed information on coasters can be found at http://www.ci.uchicago.edu/swift/guides/userguide.php#coasters.
+//**Include neat diagrams.**
+Following is a coasters setup case-study for a PBS underlying provider where sites.xml coaster settings were:
+[xml]
+source~~~~
+<execution provider="coaster" jobmanager="local:pbs"/>
+<profile namespace="globus" key="project">CI-CCR000013</profile>
+
+<!-- Note that the following is going to be defunct in the new version (0.93+) and replaced by
+"ProviderAttributes" key and may not work in the future Swift versions-->
+
+<!--<profile namespace="globus" key="ppn">24:cray:pack</profile>-->
+
+<profile namespace="globus" key="providerAttributes">
+pbs.aprun
+pbs.mpp=true
+</profile>
+
+<profile namespace="globus" key="workersPerNode">24</profile>
+<profile namespace="globus" key="maxTime">100000</profile>
+
+<profile namespace="globus" key="lowOverallocation">100</profile>
+<profile namespace="globus" key="highOverallocation">100</profile>
+
+<profile namespace="globus" key="slots">20</profile>
+<profile namespace="globus" key="nodeGranularity">5</profile>
+<profile namespace="globus" key="maxNodes">5</profile>
+<profile namespace="karajan" key="jobThrottle">20.00</profile>
+<profile namespace="karajan" key="initialScore">10000</profile>
+source~~~~
+
+The following table briefly describes the elements on the coasters setup:
+[width="70%", cols="^3,10", options="header"]
+|=============================================================================================
+|profile key | brief description
+|slots | How many maximum LRM jobs/worker blocks are allowed
+|workersPerNode | How many coaster workers to run per execution node
+|nodeGranularity | Each worker block uses a number of nodes that is a multiple of this number
+|lowOverallocation | How many times larger than the job walltime should a block's walltime be if all jobs are 1s long
+|highOverallocation | How many times larger than the job walltime should a block's walltime be if all jobs are infinitely long
+|workersPerNode | How many coaster workers to run per execution node reserve How many seconds to reserve in a block's walltime for starting/shutdown operations
+|maxnodes | The maximum number of nodes allowed in a block
+|maxtime | The maximum number of walltime allowed for a block coaster service
+|jobThrottle |the number of concurrent jobs allowed on a site
+|==============================================================================================
+
+//
+//For Beginners
+//~~~~~~~~~~~~~~
+//Coasters for beginners. Usage of existing, prebuilt templates.
+//
+//For Intermediate Users
+//~~~~~~~~~~~~~~~~~~~~~~~
+//Coasters for intermediate users.
+//
+//Using gensites
+//^^^^^^^^^^^^^^^
+//Usage of gensites to generate your own sites
+//configurations.
+//
+//
+//
+
+For Advanced Users
+~~~~~~~~~~~~~~~~~~
+
+//Coasters for advanced users. Getting your hands dirty.
+
+One of the main reason that one would initially deviate from coaster
+defaults into more complex pool entries is to force jobs to fit into some
+site-imposed constraint. For instance a typical submission to the experimental
+queue requires a user to request upto 3 nodes for under 1 hour. This setup
+could be achieved with a careful tuning of coaters parameters.
+
+//How to run Swift under different Coasters configurations
+//~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+//
+//Manual
+//^^^^^^^
+//Todo
+//
+//Passive
+//^^^^^^^^
+//Todo
+//
+//Persistent
+//^^^^^^^^^^^
+//Todo
+//
+//Summary of Differences Between different Coaster types
+//~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+//A tabular representations of highlights of different coaster setups
+//
+//
+//Data Management
+//
+
+Coaster providers: local, ssh, pbs
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+Settings and examples for different coaster providers mechanisms.
+
+
+
Swift on Diverse Infrastructures
---------------------------------
@@ -489,7 +603,7 @@
~~~~~~
Swift is now installed on Beagle as a module. Swift supports a Coasters based,
computing environment for Beagle. A detailed Swift documentation is maintained
-[[http://www.ci.uchicago.edu/swift/docs/index.php][here]]. To get started
+[[http://www.ci.uchicago.edu/swift/docs/index.php][here]]. To get started
with Swift on Beagle follow the steps outlined below:
*step 1.* Load the Swift module on Beagle as follows: +module load swift+
@@ -654,104 +768,7 @@
//~~~~~~~~
//Swift on Magellan
//
-Coasters
---------
-Coasters were introduced in Swift v0.6 as an experimental feature. In many
-applications, Swift performance can be greatly enhanced by the use of CoG
-coasters. CoG coasters provide a low-overhead job submission and file transfer
-mechanism suited for the execution of short jobs (on the order of a few
-seconds). A detailed information on coasters can be found at http://www.ci.uchicago.edu/swift/guides/userguide.php#coasters.
-//**Include neat diagrams.**
-Following is a nice coasters setup case-study where sites.xml coaster settings were:
-
-[xml]
-source~~~~
-<execution provider="coaster" jobmanager="local:pbs"/>
-<profile namespace="globus" key="project">CI-CCR000013</profile>
-<profile namespace="globus" key="ppn">24:cray:pack</profile>
-<profile namespace="globus" key="workersPerNode">24</profile>
-<profile namespace="globus" key="maxTime">100000</profile>
-<profile namespace="globus" key="lowOverallocation">100</profile>
-<profile namespace="globus" key="highOverallocation">100</profile>
-<profile namespace="globus" key="slots">20</profile>
-<profile namespace="globus" key="nodeGranularity">5</profile>
-<profile namespace="globus" key="maxNodes">5</profile>
-<profile namespace="karajan" key="jobThrottle">20.00</profile>
-<profile namespace="karajan" key="initialScore">10000</profile>
-source~~~~
-
-The following table briefly describes the elements on the coasters setup:
-[width="70%", cols="^3,10", options="header"]
-|=============================================================================================
-|profile key | brief description
-|slots | How many maximum LRM jobs/worker blocks are allowed
-|workersPerNode | How many coaster workers to run per execution node
-|nodeGranularity | Each worker block uses a number of nodes that is a multiple of this number
-|lowOverallocation | How many times larger than the job walltime should a block's walltime be if all jobs are 1s long
-|highOverallocation | How many times larger than the job walltime should a block's walltime be if all jobs are infinitely long
-|workersPerNode | How many coaster workers to run per execution node reserve How many seconds to reserve in a block's walltime for starting/shutdown operations
-|maxnodes | The maximum number of nodes allowed in a block
-|maxtime | The maximum number of walltime allowed for a block coaster service
-|jobThrottle |the number of concurrent jobs allowed on a site
-|==============================================================================================
-
-//
-//For Beginners
-//~~~~~~~~~~~~~~
-//Coasters for beginners. Usage of existing, prebuilt templates.
-//
-//For Intermediate Users
-//~~~~~~~~~~~~~~~~~~~~~~~
-//Coasters for intermediate users.
-//
-//Using gensites
-//^^^^^^^^^^^^^^^
-//Usage of gensites to generate your own sites
-//configurations.
-//
-//
-//
-
-For Advanced Users
-~~~~~~~~~~~~~~~~~~
-
-//Coasters for advanced users. Getting your hands dirty.
-
-One of the main reason that one would initially deviate from coaster
-defaults into more complex pool entries is to force jobs to fit into some
-site-imposed constraint. For instance a typical submission to the experimental
-queue requires a user to request upto 3 nodes for under 1 hour. This setup
-could be achieved with a careful tuning of coaters parameters.
-
-//How to run Swift under different Coasters configurations
-//~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-//
-//Manual
-//^^^^^^^
-//Todo
-//
-//Passive
-//^^^^^^^^
-//Todo
-//
-//Persistent
-//^^^^^^^^^^^
-//Todo
-//
-//Summary of Differences Between different Coaster types
-//~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-//A tabular representations of highlights of different coaster setups
-//
-//
-//Data Management
-//
-
-Coaster providers: local, ssh, pbs
-~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
-
-Settings and examples for different coaster providers mechanisms.
-
Debugging Swift
---------------
Swift errors are logged in several places:
More information about the Swift-commit
mailing list