[Swift-commit] r7664 - SwiftApps/cloud
ketan at ci.uchicago.edu
ketan at ci.uchicago.edu
Sun Mar 9 14:15:53 CDT 2014
Author: ketan
Date: 2014-03-09 14:15:53 -0500 (Sun, 09 Mar 2014)
New Revision: 7664
Modified:
SwiftApps/cloud/README
SwiftApps/cloud/docbuild
Log:
ec2 commands
Modified: SwiftApps/cloud/README
===================================================================
--- SwiftApps/cloud/README 2014-03-09 18:41:52 UTC (rev 7663)
+++ SwiftApps/cloud/README 2014-03-09 19:15:53 UTC (rev 7664)
@@ -1,6 +1,16 @@
Swift Cloud Provisioning Toolkit
=================================
+Introduction
+------------
+
+This README describes how you can set the http://aws.amazon.com/ec2/[Amazon] cloud
+resources to run applications via http://swift-lang.org/main/[Swift] along with
+its
+http://swift-lang.org/guides/release-0.94/userguide/userguide.html#_coasters[coaster-service].
+With the provisioning utilities packaged and described here you can
+add/remove/monitor resources on a current application run.
+
EC2 setup
----------
@@ -8,9 +18,9 @@
already, find instructions for setting the EC2 CLI API from
http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/SettingUp_CommandLine.html[here].
-Install Swift
---------------
-To install Swift, follow instructions found http://swift-lang.org/downloads/index.php[here]. Note that Swift
+Installation and setup
+----------------------
+To install Swift, follow instructions found http://swift-lang.org/downloads/index.php[here]. We use the Swift version 0.94 from the svn repo. Note that Swift
installation is required only on the submit host and not on cloud nodes. To checkout the current package from svn repository:
----
@@ -34,8 +44,20 @@
EC2
~~~~
-Make sure you have access to an EC2 image `ami-id`, have `security-group` and `keypair` set up. The `security-group` must be set such that the ports defined in `GLOBUS_TCP_PORT_RANGE` are open for both incoming and outgoing traffic. More information on setting up a security group can be found http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-network-security.html[here].
+Make sure you have access to an EC2 image `ami-id`, have `security-group` and `keypair` set up. If you already have `keypair` for EC2 installed, you can find via the following command:
+----
+ec2-describe-keypairs
+----
+
+The `security-group` must be set such that the ports defined in `GLOBUS_TCP_PORT_RANGE` are open for both incoming and outgoing traffic. Existing security groups can be queried as:
+
+----
+ec2-describe-security-groups
+----
+
+More information on setting up a security group can be found http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-network-security.html[here].
+
coaster-service.conf
~~~~~~~~~~~~~~~~~~~~~
@@ -92,6 +114,23 @@
swift -sites.file sites.xml -tc.file apps -config cf catsnsleep.swift -s=10 -n=20
----
+As a result, if the command is successful, you will see the output similar to following:
+
+----
+Swift 0.94 swift-r7645 (swift modified locally) cog-r3877
+
+RunID: 20140309-1354-sg9rjdja
+Progress: time: Sun, 09 Mar 2014 13:54:27 -0500
+Progress: time: Sun, 09 Mar 2014 13:54:28 -0500 Stage in:1 Submitted:14 Active:5
+Progress: time: Sun, 09 Mar 2014 13:54:38 -0500 Submitted:14 Active:5 Stage out:1
+Progress: time: Sun, 09 Mar 2014 13:54:48 -0500 Submitted:8 Active:5 Stage out:1 Finished successfully:6
+Progress: time: Sun, 09 Mar 2014 13:54:49 -0500 Submitted:2 Active:6 Finished successfully:12
+Progress: time: Sun, 09 Mar 2014 13:54:57 -0500 Submitted:2 Active:6 Finished successfully:12
+Progress: time: Sun, 09 Mar 2014 13:54:59 -0500 Submitted:2 Active:5 Stage out:1 Finished successfully:12
+Progress: time: Sun, 09 Mar 2014 13:55:10 -0500 Active:1 Stage out:1 Finished successfully:18
+Final status: Sun, 09 Mar 2014 13:55:10 -0500 Finished successfully:20
+----
+
The example `catsnsleep.swift` and `cf` properties files used in the above
command are provided with the package. Additionally, an executable `catnap.sh`
and a small `data.txt` files are provided with the package used by the
@@ -104,16 +143,30 @@
Add EC2 compute instances
~~~~~~~~~~~~~~~~~~~~~~~~~~
-Add more resources via addnodes. Use -n to add by number and -a to add by ip address. For example, the following commandline will add 10 cloud instances to the currently executing run:
+Add more resources via addnodes. Use -n to add by number and -a to add by ip
+address. For example, the following commandline will add 10 cloud instances to
+the currently executing run:
----
-./addnodes -n 10
+./addnodes -n 6
----
Note that the above command will trigger a create instance command on your EC2
account and can take upto 2 minutes before the newly created instances can
-actually join the existing Swift execution.
+actually join the existing Swift execution. Typically, you will see output as follows:
+----
+Configuration: coaster-service.conf
+6
+Waiting for instances to start
+Starting worker on 54.221.33.193
+Starting worker on 54.221.101.177
+Starting worker on 54.242.57.128
+Starting worker on 54.204.204.129
+Starting worker on 75.101.210.88
+Starting worker on 54.226.151.155
+----
+
The following command will add two nodes with ip `54.243.24.104` and `54.243.24.154`:
----
Modified: SwiftApps/cloud/docbuild
===================================================================
--- SwiftApps/cloud/docbuild 2014-03-09 18:41:52 UTC (rev 7663)
+++ SwiftApps/cloud/docbuild 2014-03-09 19:15:53 UTC (rev 7664)
@@ -2,7 +2,7 @@
if [ -z $1 ] ; then
- asciidoc -a toc -a toclevels=2 -a max-width=750px -a textwidth=80 -o /home/ketan/public_html/cloudreadme.html README
+ asciidoc -a toc -a toclevels=2 -a max-width=750px -a textwidth=80 -o /home/ketan/public_html/swiftcloudprovision.html README
else
asciidoc -a toc -a toclevels=2 -a max-width=750px -a textwidth=80 -o "$1" README
fi
More information about the Swift-commit
mailing list