[Swift-commit] r7169 - SwiftApps/Swift-MapRed/mapred_combiner_V4
yadunandb at ci.uchicago.edu
yadunandb at ci.uchicago.edu
Wed Oct 16 11:23:02 CDT 2013
Author: yadunandb
Date: 2013-10-16 11:23:02 -0500 (Wed, 16 Oct 2013)
New Revision: 7169
Modified:
SwiftApps/Swift-MapRed/mapred_combiner_V4/README
Log:
More docs
Modified: SwiftApps/Swift-MapRed/mapred_combiner_V4/README
===================================================================
--- SwiftApps/Swift-MapRed/mapred_combiner_V4/README 2013-10-16 16:17:51 UTC (rev 7168)
+++ SwiftApps/Swift-MapRed/mapred_combiner_V4/README 2013-10-16 16:23:02 UTC (rev 7169)
@@ -6,6 +6,13 @@
are differences in the way the user supplied Map and Reduce functions
should work.
+setup.sh
+--------
+
+Run the setup.sh script to embed the map_core.sh and reduce_core.sh scripts
+in the wrapper scripts used by swift in runtime. Usernames to use across
+midway and beagle should be defined here.
+
map_core.sh
-----------
@@ -22,12 +29,15 @@
stage and output its results to a file of its choosing. The filename of
the result file is output to stdout.
-setup.sh
---------
+run.sh
+------
-Run the setup.sh script to embed the map_core.sh and reduce_core.sh scripts
-in the wrapper scripts used by swift in runtime.
+USAGE: ./run.sh <sites.xml> <no: of map jobs> <args>
+In the default example ./run.sh multiple.xml 10 10
+results in 10 map jobs each generating ~10mb worth of records for processing.
+Each record is a number followed by count (1). The reduce stages find the
+sum and total count of these records.
Example - Teragen
=================
More information about the Swift-commit
mailing list