[Swift-commit] r7169 - SwiftApps/Swift-MapRed/mapred_combiner_V4

yadunandb at ci.uchicago.edu yadunandb at ci.uchicago.edu
Wed Oct 16 11:23:02 CDT 2013


Author: yadunandb
Date: 2013-10-16 11:23:02 -0500 (Wed, 16 Oct 2013)
New Revision: 7169

Modified:
   SwiftApps/Swift-MapRed/mapred_combiner_V4/README
Log:

More docs



Modified: SwiftApps/Swift-MapRed/mapred_combiner_V4/README
===================================================================
--- SwiftApps/Swift-MapRed/mapred_combiner_V4/README	2013-10-16 16:17:51 UTC (rev 7168)
+++ SwiftApps/Swift-MapRed/mapred_combiner_V4/README	2013-10-16 16:23:02 UTC (rev 7169)
@@ -6,6 +6,13 @@
 are differences in the way the user supplied Map and Reduce functions
 should work.
 
+setup.sh
+--------
+
+Run the setup.sh script to embed the map_core.sh and reduce_core.sh scripts
+in the wrapper scripts used by swift in runtime. Usernames to use across
+midway and beagle should be defined here.
+
 map_core.sh
 -----------
 
@@ -22,12 +29,15 @@
 stage and output its results to a file of its choosing. The filename of
 the result file is output to stdout.
 
-setup.sh
---------
+run.sh
+------
 
-Run the setup.sh script to embed the map_core.sh and reduce_core.sh scripts
-in the wrapper scripts used by swift in runtime.
+USAGE: ./run.sh <sites.xml> <no: of map jobs> <args>
 
+In the default example ./run.sh multiple.xml 10 10
+results in 10 map jobs each generating ~10mb worth of records for processing.
+Each record is a number followed by count (1). The reduce stages find the
+sum and total count of these records.
 
 Example - Teragen
 =================




More information about the Swift-commit mailing list