From ketan at ci.uchicago.edu Fri May 6 10:26:03 2011
From: ketan at ci.uchicago.edu (ketan at ci.uchicago.edu)
Date: Fri, 6 May 2011 10:26:03 -0500 (CDT)
Subject: [Swift-commit] r4450 - www/cookbook
Message-ID: <20110506152603.B88969CFC7@svn.ci.uchicago.edu>
Author: ketan
Date: 2011-05-06 10:26:03 -0500 (Fri, 06 May 2011)
New Revision: 4450
Modified:
www/cookbook/cookbook-asciidoc.html
www/cookbook/cookbook-asciidoc.txt
Log:
Modified: www/cookbook/cookbook-asciidoc.html
===================================================================
--- www/cookbook/cookbook-asciidoc.html 2011-05-04 22:17:58 UTC (rev 4449)
+++ www/cookbook/cookbook-asciidoc.html 2011-05-06 15:26:03 UTC (rev 4450)
@@ -1079,18 +1079,24 @@
3.1. Beagle
Swift is now installed on Beagle as a module. Swift supports a Coasters based,
-PBS-enabled computing environment for Beagle. To get started with Swift on
-Beagle follow the steps outlined below:
+computing environment for Beagle. A detailed Swift documentation is maintained
+[[
here]. To get started
+with Swift on Beagle follow the steps outlined below:
step 1. Load the Swift module on Beagle as follows: module load swift
step 2. Create a Swift specific folder where all your Swift related work will
-stay. (say, mkdir swift-lab)
step 3. To get started with an example, copy the folder at
-/home/ketan/labs/catsn.works to the above created swift-lab. (cp -r
-/home/ketan/catsn.works ~/swift-lab).
step 4. From the sites file: catsn.works/beagle-coaster.xml, change the path
-of swift.workdir to your preferred location (say to ~/swift-lab/swift.workdir)
-and the project name to the one you are part of.
step 5. Run the example using following commandline: swift -config cf -tc.file tc -sites.file beagle-coaster-1.xml catsn.swift -n=1
step 2. Create and change to a directory where your Swift related work will
+stay. (say, mkdir swift-lab, followed by, cd swift-lab)
step 3. To get started with a simple example running /bin/cat to read an input file data.txt and write to an output file f.nnn.out, copy the folder at /home/ketan/labs/catsn to the above directory. (cp -r /home/ketan/catsn . followed by cd catsn).
step 4. In the sites file: beagle-coaster.xml, make the following two
+changes: 1) change the path of workdirectory to your preferred location
+(say to /lustre/beagle/$USER/swift-lab/swift.workdir) and 2) Change the
+project name to your project (CI-CCR000013) . The workdirectory will contain
+execution data related to each run, e.g. wrapper scripts, system information,
+inputs and outputs.
step 5. Run the example using following commandline (also found in run.sh):
+swift -config cf -tc.file tc -sites.file beagle-coaster.xml catsn.swift -n=1
+. You can further change the value of -n to any arbitrary number to run that
+many number of concurrent cat
step 6. Check the output in the generated outdir directory (ls outdir)
Note: Running from sandbox node or requesting 1 hour walltime for upto 3 nodes
will get fast prioritized execution. Good for small tests
Modified: www/cookbook/cookbook-asciidoc.txt
===================================================================
--- www/cookbook/cookbook-asciidoc.txt 2011-05-04 22:17:58 UTC (rev 4449)
+++ www/cookbook/cookbook-asciidoc.txt 2011-05-06 15:26:03 UTC (rev 4450)
@@ -488,24 +488,31 @@
Beagle
~~~~~~
Swift is now installed on Beagle as a module. Swift supports a Coasters based,
-PBS-enabled computing environment for Beagle. To get started with Swift on
-Beagle follow the steps outlined below:
+computing environment for Beagle. A detailed Swift documentation is maintained
+[[http://www.ci.uchicago.edu/swift/docs/index.php][here]]. To get started
+with Swift on Beagle follow the steps outlined below:
*step 1.* Load the Swift module on Beagle as follows: +module load swift+
-*step 2.* Create a Swift specific folder where all your Swift related work will
-stay. (say, +mkdir swift-lab+)
+*step 2.* Create and change to a directory where your Swift related work will
+stay. (say, +mkdir swift-lab+, followed by, +cd swift-lab+)
-*step 3.* To get started with an example, copy the folder at
-+/home/ketan/labs/catsn.works+ to the above created swift-lab. (+cp -r
-/home/ketan/catsn.works ~/swift-lab+).
+*step 3.* To get started with a simple example running +/bin/cat+ to read an input file +data.txt+ and write to an output file +f.nnn.out+, copy the folder at +/home/ketan/labs/catsn+ to the above directory. (+cp -r /home/ketan/catsn .+ followed by +cd catsn+).
-*step 4.* From the sites file: +catsn.works/beagle-coaster.xml+, change the path
-of swift.workdir to your preferred location (say to +~/swift-lab/swift.workdir+)
-and the project name to the one you are part of.
+*step 4.* In the sites file: +beagle-coaster.xml+, make the following two
+changes: *1)* change the path of +workdirectory+ to your preferred location
+(say to +/lustre/beagle/$USER/swift-lab/swift.workdir+) and *2)* Change the
+project name to your project (+CI-CCR000013+) . The workdirectory will contain
+execution data related to each run, e.g. wrapper scripts, system information,
+inputs and outputs.
-*step 5.* Run the example using following commandline: +swift -config cf -tc.file tc -sites.file beagle-coaster-1.xml catsn.swift -n=1+
+*step 5.* Run the example using following commandline (also found in run.sh):
++swift -config cf -tc.file tc -sites.file beagle-coaster.xml catsn.swift -n=1+
+. You can further change the value of +-n+ to any arbitrary number to run that
+many number of concurrent +cat+
+*step 6.* Check the output in the generated +outdir+ directory (+ls outdir+)
+
Note: Running from sandbox node or requesting 1 hour walltime for upto 3 nodes
will get fast prioritized execution. Good for small tests
From tga at ci.uchicago.edu Fri May 6 16:17:29 2011
From: tga at ci.uchicago.edu (tga at ci.uchicago.edu)
Date: Fri, 6 May 2011 16:17:29 -0500 (CDT)
Subject: [Swift-commit] r4452 - SwiftApps/SwiftR/Swift/exec
Message-ID: <20110506211729.AE71C9CFC7@svn.ci.uchicago.edu>
Author: tga
Date: 2011-05-06 16:17:29 -0500 (Fri, 06 May 2011)
New Revision: 4452
Modified:
SwiftApps/SwiftR/Swift/exec/start-swift
Log:
improved error message when swift fails to start correctly.
Modified: SwiftApps/SwiftR/Swift/exec/start-swift
===================================================================
--- SwiftApps/SwiftR/Swift/exec/start-swift 2011-05-06 19:49:43 UTC (rev 4451)
+++ SwiftApps/SwiftR/Swift/exec/start-swift 2011-05-06 21:17:29 UTC (rev 4452)
@@ -565,6 +565,7 @@
# Standard clenuup actions
function stdcleanup_start {
# don't accept any more requests: unlink fifo from filesystem
+ echo stdcleanup_start 1&>2
if [ -p requestpipe ]; then
rm requestpipe
fi
@@ -727,9 +728,17 @@
exitcode=$?
# Do any cleanup if swift exits in this manner
if [ "$exitcode" != 0 ]; then
- echo "error: Swift exited unexpectedly with $exitcode" > resultpipe &
- echopid=$!
- sleep 5
- kill $echopid &> /dev/null
+ echo "error: Swift exited unexpectedly with return code $exitcode"
+ if [ "$keepdir" = TRUE ]; then
+ echo "See logs in $trundir for more information"
+ else
+ echo "Turn on keep work option to retain logs"
+ fi
+
+ ( echo "error: swift exited unexpectedly with return code $exitcode" > resultpipe
+ echopid=$!
+ sleep 5
+ kill $echopid
+ ) &> /dev/null &
fi
From tga at ci.uchicago.edu Fri May 6 16:53:34 2011
From: tga at ci.uchicago.edu (tga at ci.uchicago.edu)
Date: Fri, 6 May 2011 16:53:34 -0500 (CDT)
Subject: [Swift-commit] r4453 - in SwiftApps/SwiftR/Swift: . exec
Message-ID: <20110506215334.68BAE9CFC7@svn.ci.uchicago.edu>
Author: tga
Date: 2011-05-06 16:53:34 -0500 (Fri, 06 May 2011)
New Revision: 4453
Modified:
SwiftApps/SwiftR/Swift/DESCRIPTION
SwiftApps/SwiftR/Swift/exec/start-swift
Log:
New version.
Modified: SwiftApps/SwiftR/Swift/DESCRIPTION
===================================================================
--- SwiftApps/SwiftR/Swift/DESCRIPTION 2011-05-06 21:17:29 UTC (rev 4452)
+++ SwiftApps/SwiftR/Swift/DESCRIPTION 2011-05-06 21:53:34 UTC (rev 4453)
@@ -1,12 +1,12 @@
Package: Swift
Type: Package
Title: R interface to Swift parallel scripting languaage
-Version: 0.2.3
-Date: 2011-04-20
+Version: 0.2.4
+Date: 2011-05-06
Author: Michael Wilde
Maintainer: Michael Wilde