[Swift-commit] r6241 - trunk/docs/cookbook
ketan at ci.uchicago.edu
ketan at ci.uchicago.edu
Thu Feb 7 14:20:42 CST 2013
Author: ketan
Date: 2013-02-07 14:20:42 -0600 (Thu, 07 Feb 2013)
New Revision: 6241
Modified:
trunk/docs/cookbook/infrastructures
Log:
adding fusion
Modified: trunk/docs/cookbook/infrastructures
===================================================================
--- trunk/docs/cookbook/infrastructures 2013-02-07 14:06:21 UTC (rev 6240)
+++ trunk/docs/cookbook/infrastructures 2013-02-07 20:20:42 UTC (rev 6241)
@@ -1,6 +1,26 @@
Swift on Computational Infrastructures
--------------------------------------
+Introduction
+~~~~~~~~~~~~
+
+We will use the following Swift example, called "catsn" throughout the present section of this cookbook:
+
+----
+type file;
+
+app (file o) cat (file i)
+{
+ cat @i stdout=@o;
+}
+
+file out[]<simple_mapper; location="odir", prefix="f.", suffix=".out">;
+foreach j in [1:@toint(@arg("n","1"))] {
+ file data<"data.txt">;
+ out[j] = cat(data);
+}
+----
+
Beagle
~~~~~~
Beagle is a University of Chicago's Computational Institute super computer
@@ -63,7 +83,7 @@
To execute your Swift script on the PADS cluster use this command:
----
-swift -tc.file tc -sites.file pbs.xml modis.swift
+swift -tc.file tc -sites.file pbs.xml catsn.swift
----
where the contents of a simple pbs.xml sites file could be:
[xml]
@@ -81,6 +101,41 @@
</config>
source~~~~
+Fusion
+~~~~~~
+Fusion is an Argonne-LCRC computational facility. More information on Fusion can be found link:http://www.lcrc.anl.gov/using-fusion[here].
+
+In the current section, we present a recipe to use Swift on Fusion system.
+Fusion employs a PBS schedular. Consequently, we will use the Coasters PBS provider.
+The jobmanager string will be "local:pbs" as follows:
+
+----
+<execution provider="coaster" jobmanager="local:pbs" url="none" />
+----
+
+The complete sites.xml file is as follows:
+
+[xml]
+source~~~~
+<config>
+ <pool handle="pbs">
+ <execution provider="coaster" jobmanager="local:pbs" url="none" />
+ <profile namespace="globus" key="project">ProteinPrediction</profile>
+ <profile namespace="globus" key="queue">batch</profile>
+ <profile namespace="globus" key="maxtime">1000</profile>
+ <profile namespace="globus" key="slots">1</profile>
+ <profile namespace="globus" key="nodeGranularity">2</profile>
+ <profile namespace="globus" key="maxNodes">2</profile>
+
+ <profile namespace="karajan" key="jobThrottle">0.23</profile>
+
+ <filesystem provider="local"/>
+ <workdirectory >/fusion/gpfs/home/${HOME}/SwiftWork</workdirectory>
+ </pool>
+</config>
+source~~~~
+
+
OSG
~~~
This section describes how to get Swift running on the OSG Grid. We will use a
More information about the Swift-commit
mailing list