[Swift-commit] r7156 - SwiftApps/Swift-MapRed/mapred_combiner_V4
yadunandb at ci.uchicago.edu
yadunandb at ci.uchicago.edu
Mon Oct 14 00:52:53 CDT 2013
Author: yadunandb
Date: 2013-10-14 00:52:53 -0500 (Mon, 14 Oct 2013)
New Revision: 7156
Modified:
SwiftApps/Swift-MapRed/mapred_combiner_V4/LAB_RECORDS
SwiftApps/Swift-MapRed/mapred_combiner_V4/client.c
SwiftApps/Swift-MapRed/mapred_combiner_V4/combiner.sh
SwiftApps/Swift-MapRed/mapred_combiner_V4/multiple.xml
SwiftApps/Swift-MapRed/mapred_combiner_V4/reducer_template.sh
SwiftApps/Swift-MapRed/mapred_combiner_V4/run.sh
SwiftApps/Swift-MapRed/mapred_combiner_V4/server.c
SwiftApps/Swift-MapRed/mapred_combiner_V4/swiftreduce.swift
Log:
Added local combiner functionality
Modified: SwiftApps/Swift-MapRed/mapred_combiner_V4/LAB_RECORDS
===================================================================
--- SwiftApps/Swift-MapRed/mapred_combiner_V4/LAB_RECORDS 2013-10-14 05:37:26 UTC (rev 7155)
+++ SwiftApps/Swift-MapRed/mapred_combiner_V4/LAB_RECORDS 2013-10-14 05:52:53 UTC (rev 7156)
@@ -3205,3 +3205,1224 @@
ACTUAL COUNT : 100000
EXPECTED COUNT: 100000
---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:1
+Warning: Parameter aggr, on line 17, shadows variable of same name on line 32
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-0336-f9s7oxrc
+Progress: time: Fri, 11 Oct 2013 03:36:22 +0000
+Progress: time: Fri, 11 Oct 2013 03:36:23 +0000 Submitting:16 Submitted:1 Stage out:1 Finished successfully:2
+Progress: time: Fri, 11 Oct 2013 03:36:37 +0000 Submitting:15 Submitted:1 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 03:36:47 +0000 Stage in:1 Submitted:10 Finished successfully:9
+Progress: time: Fri, 11 Oct 2013 03:36:50 +0000 Active:1 Finished successfully:20
+Final status: Fri, 11 Oct 2013 03:36:51 +0000 Finished successfully:24
+real 32.14
+user 75.34
+sys 12.81
+chunks 20 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT matches expected records
+ACTUAL COUNT : 200000
+EXPECTED COUNT: 200000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1513-usrdt8i7
+Progress: time: Fri, 11 Oct 2013 15:13:33 +0000
+Progress: time: Fri, 11 Oct 2013 15:13:34 +0000 Stage in:1 Submitting:17 Submitted:2
+Progress: time: Fri, 11 Oct 2013 15:13:47 +0000 Submitting:16 Submitted:1 Finished successfully:3
+Progress: time: Fri, 11 Oct 2013 15:13:53 +0000 Stage in:1 Submitted:9 Finished successfully:10
+Progress: time: Fri, 11 Oct 2013 15:13:54 +0000 Stage out:1 Finished successfully:22
+Final status: Fri, 11 Oct 2013 15:13:55 +0000 Finished successfully:24
+real 26.26
+user 61.47
+sys 9.77
+chunks 20 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT matches expected records
+ACTUAL COUNT : 200000
+EXPECTED COUNT: 200000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1516-q87aflb0
+Progress: time: Fri, 11 Oct 2013 15:16:51 +0000
+Progress: time: Fri, 11 Oct 2013 15:16:52 +0000 Stage in:1 Submitting:17 Submitted:2
+Progress: time: Fri, 11 Oct 2013 15:17:03 +0000 Submitting:16 Submitted:1 Finished successfully:3
+Progress: time: Fri, 11 Oct 2013 15:17:12 +0000 Stage in:1 Submitted:7 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 15:17:14 +0000 Active:1 Finished successfully:20
+Final status: Fri, 11 Oct 2013 15:17:15 +0000 Finished successfully:24
+real 26.74
+user 65.25
+sys 10.69
+chunks 20 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 200000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1520-mxtt14fe
+Progress: time: Fri, 11 Oct 2013 15:20:25 +0000
+Progress: time: Fri, 11 Oct 2013 15:20:26 +0000 Submitting:17 Submitted:1 Stage out:1 Finished successfully:1
+Progress: time: Fri, 11 Oct 2013 15:20:52 +0000 Submitting:16 Submitted:1 Finished successfully:3
+Progress: time: Fri, 11 Oct 2013 15:20:55 +0000 Submitted:10 Finished successfully:10
+Progress: time: Fri, 11 Oct 2013 15:21:00 +0000 Stage in:1 Submitted:9 Finished successfully:10
+Progress: time: Fri, 11 Oct 2013 15:21:03 +0000 Active:1 Finished successfully:20
+Final status: Fri, 11 Oct 2013 15:21:03 +0000 Finished successfully:24
+real 41.48
+user 98.02
+sys 18.34
+chunks 20 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 200000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1522-v12yvpl3
+Progress: time: Fri, 11 Oct 2013 15:22:08 +0000
+Progress: time: Fri, 11 Oct 2013 15:22:21 +0000 Submitting:16 Submitted:1 Finished successfully:3
+Progress: time: Fri, 11 Oct 2013 15:22:28 +0000 Stage in:1 Submitted:9 Finished successfully:10
+Progress: time: Fri, 11 Oct 2013 15:22:29 +0000 Finished successfully:23
+Final status: Fri, 11 Oct 2013 15:22:29 +0000 Finished successfully:24
+real 23.63
+user 58.67
+sys 9.59
+chunks 20 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 200000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:4 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1523-2txs5gu7
+Progress: time: Fri, 11 Oct 2013 15:23:46 +0000
+Progress: time: Fri, 11 Oct 2013 15:23:48 +0000 Stage in:1 Submitting:3
+Progress: time: Fri, 11 Oct 2013 15:23:59 +0000 Submitting:2 Submitted:1 Finished successfully:1
+Progress: time: Fri, 11 Oct 2013 15:24:07 +0000 Stage in:1 Submitted:2 Finished successfully:1
+Progress: time: Fri, 11 Oct 2013 15:24:08 +0000 Stage in:1 Finished successfully:7
+Final status: Fri, 11 Oct 2013 15:24:08 +0000 Finished successfully:8
+real 24.61
+user 62.51
+sys 9.89
+chunks 4 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 40000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1540-tvezsbpc
+Progress: time: Fri, 11 Oct 2013 15:40:07 +0000
+Progress: time: Fri, 11 Oct 2013 15:40:19 +0000 Submitting:6 Submitted:1 Finished successfully:3
+Progress: time: Fri, 11 Oct 2013 15:40:36 +0000 Stage in:1 Submitted:6 Finished successfully:3
+Progress: time: Fri, 11 Oct 2013 15:40:38 +0000 Active:1 Finished successfully:10
+Final status: Fri, 11 Oct 2013 15:40:39 +0000 Finished successfully:14
+real 34.68
+user 84.79
+sys 14.85
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1541-knco22ne
+Progress: time: Fri, 11 Oct 2013 15:41:33 +0000
+Progress: time: Fri, 11 Oct 2013 15:41:45 +0000 Submitting:8 Submitted:1 Finished successfully:1
+Progress: time: Fri, 11 Oct 2013 15:41:52 +0000 Stage in:1 Submitted:3 Finished successfully:6
+Progress: time: Fri, 11 Oct 2013 15:41:53 +0000 Active:1 Finished successfully:10
+Final status: Fri, 11 Oct 2013 15:41:54 +0000 Finished successfully:14
+real 24.08
+user 58.62
+sys 9.88
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1758-dng1u1c2
+Progress: time: Fri, 11 Oct 2013 17:58:23 +0000
+Progress: time: Fri, 11 Oct 2013 17:58:24 +0000 Stage in:1 Submitting:5 Submitted:4
+Progress: time: Fri, 11 Oct 2013 17:58:35 +0000 Submitting:4 Submitted:1 Finished successfully:5
+Progress: time: Fri, 11 Oct 2013 17:58:41 +0000 Stage in:1 Submitted:3 Finished successfully:6
+Progress: time: Fri, 11 Oct 2013 17:58:43 +0000 Active:1 Finished successfully:10
+Final status: Fri, 11 Oct 2013 17:58:43 +0000 Finished successfully:14
+real 23.34
+user 56.46
+sys 9.78
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1759-vslygrqe
+Progress: time: Fri, 11 Oct 2013 17:59:49 +0000
+Progress: time: Fri, 11 Oct 2013 18:00:02 +0000 Submitting:5 Submitted:1 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:00:12 +0000 Stage in:1 Submitted:3 Finished successfully:6
+Progress: time: Fri, 11 Oct 2013 18:00:13 +0000 Finished successfully:13
+Final status: Fri, 11 Oct 2013 18:00:13 +0000 Finished successfully:14
+real 26.46
+user 65.32
+sys 11.31
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1804-5rs5vhzf
+Progress: time: Fri, 11 Oct 2013 18:04:16 +0000
+Progress: time: Fri, 11 Oct 2013 18:04:28 +0000 Submitting:3 Submitted:1 Finished successfully:6
+Progress: time: Fri, 11 Oct 2013 18:04:35 +0000 Stage in:1 Submitted:3 Finished successfully:6
+Progress: time: Fri, 11 Oct 2013 18:04:37 +0000 Active:1 Finished successfully:10
+Final status: Fri, 11 Oct 2013 18:04:37 +0000 Finished successfully:14
+real 23.78
+user 58.06
+sys 9.51
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1805-uzdjry40
+Progress: time: Fri, 11 Oct 2013 18:05:43 +0000
+Progress: time: Fri, 11 Oct 2013 18:05:55 +0000 Submitting:2 Submitted:1 Finished successfully:7
+Progress: time: Fri, 11 Oct 2013 18:06:03 +0000 Stage in:1 Submitted:2 Finished successfully:7
+Progress: time: Fri, 11 Oct 2013 18:06:04 +0000 Submitted:1 Finished successfully:13
+Final status: Fri, 11 Oct 2013 18:06:04 +0000 Finished successfully:14
+real 23.72
+user 59.86
+sys 9.09
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1810-u36rh967
+Progress: time: Fri, 11 Oct 2013 18:10:27 +0000
+Progress: time: Fri, 11 Oct 2013 18:10:40 +0000 Submitting:5 Submitted:1 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:10:46 +0000 Stage in:1 Submitted:4 Finished successfully:5
+Progress: time: Fri, 11 Oct 2013 18:10:47 +0000 Stage out:1 Finished successfully:13
+Final status: Fri, 11 Oct 2013 18:10:47 +0000 Finished successfully:14
+real 23.51
+user 56.77
+sys 10.20
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1814-58ykozqc
+Progress: time: Fri, 11 Oct 2013 18:14:04 +0000
+Progress: time: Fri, 11 Oct 2013 18:14:18 +0000 Submitting:4 Submitted:1 Finished successfully:5
+Progress: time: Fri, 11 Oct 2013 18:14:25 +0000 Stage in:1 Submitted:4 Finished successfully:5
+Progress: time: Fri, 11 Oct 2013 18:14:26 +0000 Finished successfully:13
+Final status: Fri, 11 Oct 2013 18:14:26 +0000 Finished successfully:14
+real 24.24
+user 59.62
+sys 10.08
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1816-3yf6vn7c
+Progress: time: Fri, 11 Oct 2013 18:16:53 +0000
+Progress: time: Fri, 11 Oct 2013 18:17:06 +0000 Submitting:3 Submitted:1 Finished successfully:6
+Progress: time: Fri, 11 Oct 2013 18:17:13 +0000 Stage in:1 Submitted:3 Finished successfully:6
+Progress: time: Fri, 11 Oct 2013 18:17:14 +0000 Active:1 Finished successfully:10
+Final status: Fri, 11 Oct 2013 18:17:15 +0000 Finished successfully:14
+real 24.70
+user 59.53
+sys 10.26
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1818-1p9bu0m9
+Progress: time: Fri, 11 Oct 2013 18:18:48 +0000
+Progress: time: Fri, 11 Oct 2013 18:19:00 +0000 Submitting:6 Submitted:1 Finished successfully:3
+Progress: time: Fri, 11 Oct 2013 18:19:08 +0000 Stage in:1 Submitted:4 Finished successfully:5
+Progress: time: Fri, 11 Oct 2013 18:19:09 +0000 Active:1 Finished successfully:12
+Final status: Fri, 11 Oct 2013 18:19:10 +0000 Finished successfully:14
+real 24.53
+user 60.34
+sys 10.01
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1819-zhqlv0s9
+Progress: time: Fri, 11 Oct 2013 18:19:48 +0000
+Progress: time: Fri, 11 Oct 2013 18:19:56 +0000 Submitting:7 Submitted:1 Finished successfully:2
+Progress: time: Fri, 11 Oct 2013 18:20:02 +0000 Stage in:1 Submitted:3 Finished successfully:6
+Progress: time: Fri, 11 Oct 2013 18:20:04 +0000 Active:1 Finished successfully:10
+Final status: Fri, 11 Oct 2013 18:20:04 +0000 Finished successfully:14
+real 19.16
+user 46.56
+sys 7.60
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1821-h6lit6i3
+Progress: time: Fri, 11 Oct 2013 18:21:50 +0000
+Progress: time: Fri, 11 Oct 2013 18:21:52 +0000 Stage in:1 Submitting:3 Submitted:6
+Progress: time: Fri, 11 Oct 2013 18:22:03 +0000 Submitting:2 Submitted:1 Finished successfully:7
+Progress: time: Fri, 11 Oct 2013 18:22:09 +0000 Stage in:1 Submitted:2 Finished successfully:7
+Progress: time: Fri, 11 Oct 2013 18:22:11 +0000 Finished successfully:13
+Final status: Fri, 11 Oct 2013 18:22:11 +0000 Finished successfully:14
+real 23.40
+user 57.25
+sys 9.76
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT matches expected records
+ACTUAL COUNT : 100000
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:20, CHUNKS:20 X FILESIZE:10
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Could not open: 20.xml
+Execution failed:
+
+ Could not find sites file: 20.xml
+
+real 1.72
+user 3.09
+sys 0.15
+chunks 20 filesize 10 site 20 type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 2000000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:20
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1834-bvutsobc
+Progress: time: Fri, 11 Oct 2013 18:34:45 +0000
+Progress: time: Fri, 11 Oct 2013 18:34:46 +0000 Active:1 Finished successfully:20
+Progress: time: Fri, 11 Oct 2013 18:34:49 +0000 Submitting:1 Stage out:1 Finished successfully:21
+Progress: time: Fri, 11 Oct 2013 18:34:59 +0000 Submitted:1 Finished successfully:22
+Progress: time: Fri, 11 Oct 2013 18:35:06 +0000 Stage in:1 Finished successfully:22
+Final status: Fri, 11 Oct 2013 18:35:07 +0000 Finished successfully:24
+real 24.39
+user 46.33
+sys 10.08
+chunks 20 filesize 20 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT matches expected records
+ACTUAL COUNT : 4000000
+EXPECTED COUNT: 4000000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:20
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1852-u9dv4ozc
+Progress: time: Fri, 11 Oct 2013 18:52:26 +0000
+Progress: time: Fri, 11 Oct 2013 18:52:39 +0000 Submitting:19 Submitted:1
+Progress: time: Fri, 11 Oct 2013 18:52:56 +0000 Submitted:20
+Progress: time: Fri, 11 Oct 2013 18:53:06 +0000 Stage in:1 Submitted:19
+Progress: time: Fri, 11 Oct 2013 18:53:07 +0000 Submitted:1 Finished successfully:20
+Progress: time: Fri, 11 Oct 2013 18:53:09 +0000 Active:1 Finished successfully:20
+Progress: time: Fri, 11 Oct 2013 18:53:13 +0000 Stage out:1 Finished successfully:22
+Final status: Fri, 11 Oct 2013 18:53:14 +0000 Finished successfully:24
+real 50.58
+user 120.37
+sys 21.95
+chunks 20 filesize 20 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT matches expected records
+ACTUAL COUNT : 4000000
+EXPECTED COUNT: 4000000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:50
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1853-vos3vkkd
+Progress: time: Fri, 11 Oct 2013 18:53:51 +0000
+Progress: time: Fri, 11 Oct 2013 18:54:03 +0000 Submitting:19 Submitted:1
+Progress: time: Fri, 11 Oct 2013 18:54:21 +0000 Submitted:20
+Progress: time: Fri, 11 Oct 2013 18:54:30 +0000 Stage in:1 Submitted:19
+Progress: time: Fri, 11 Oct 2013 18:54:51 +0000 Submitted:16 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:54:55 +0000 Stage in:1 Submitted:15 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:54:57 +0000 Stage in:4 Submitted:12 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:55:21 +0000 Stage in:4 Submitted:12 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:55:30 +0000 Stage in:5 Submitted:11 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:55:31 +0000 Stage in:8 Submitted:8 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:55:51 +0000 Stage in:8 Submitted:8 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:56:03 +0000 Stage in:9 Submitted:7 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:56:04 +0000 Stage in:11 Submitted:5 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:56:21 +0000 Stage in:12 Submitted:4 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:56:35 +0000 Stage in:13 Submitted:3 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:56:37 +0000 Stage in:16 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:56:51 +0000 Stage in:16 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:57:21 +0000 Stage in:16 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:57:51 +0000 Stage in:16 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:58:21 +0000 Stage in:16 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:58:51 +0000 Stage in:16 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:59:14 +0000 Stage in:15 Active:1 Finished successfully:4
+Progress: time: Fri, 11 Oct 2013 18:59:16 +0000 Stage in:14 Active:2 Finished successfully:4
+chunks 20 filesize 50 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 10000000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1912-9aljku32
+Progress: time: Fri, 11 Oct 2013 19:12:04 +0000
+Progress: time: Fri, 11 Oct 2013 19:12:18 +0000 Submitting:19 Submitted:1
+Progress: time: Fri, 11 Oct 2013 19:12:34 +0000 Submitted:20
+Progress: time: Fri, 11 Oct 2013 19:13:04 +0000 Submitted:20
+Progress: time: Fri, 11 Oct 2013 19:13:05 +0000 Stage in:1 Submitted:19
+Progress: time: Fri, 11 Oct 2013 19:13:06 +0000 Stage in:4 Submitted:16
+Progress: time: Fri, 11 Oct 2013 19:13:26 +0000 Stage in:6 Submitted:14
+Progress: time: Fri, 11 Oct 2013 19:13:28 +0000 Stage in:8 Submitted:12
+Progress: time: Fri, 11 Oct 2013 19:13:30 +0000 Stage in:10 Submitted:10
+Progress: time: Fri, 11 Oct 2013 19:13:34 +0000 Stage in:10 Submitted:10
+Progress: time: Fri, 11 Oct 2013 19:13:44 +0000 Stage in:11 Submitted:9
+Progress: time: Fri, 11 Oct 2013 19:13:52 +0000 Stage in:13 Submitted:7
+Progress: time: Fri, 11 Oct 2013 19:13:53 +0000 Stage in:14 Submitted:6
+Progress: time: Fri, 11 Oct 2013 19:14:04 +0000 Stage in:15 Submitted:5
+Progress: time: Fri, 11 Oct 2013 19:14:09 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:14:16 +0000 Stage in:18 Submitted:2
+Progress: time: Fri, 11 Oct 2013 19:14:17 +0000 Stage in:20
+Progress: time: Fri, 11 Oct 2013 19:14:34 +0000 Stage in:20
+Progress: time: Fri, 11 Oct 2013 19:15:04 +0000 Stage in:20
+Progress: time: Fri, 11 Oct 2013 19:15:27 +0000 Stage in:19 Active:1
+Progress: time: Fri, 11 Oct 2013 19:15:34 +0000 Stage in:18 Active:2
+Progress: time: Fri, 11 Oct 2013 19:15:35 +0000 Stage in:18 Active:1 Stage out:1
+Progress: time: Fri, 11 Oct 2013 19:15:53 +0000 Stage in:17 Active:1 Stage out:2
+Progress: time: Fri, 11 Oct 2013 19:15:54 +0000 Stage in:15 Active:3 Stage out:2
+Progress: time: Fri, 11 Oct 2013 19:16:00 +0000 Stage in:15 Active:2 Stage out:3
+Progress: time: Fri, 11 Oct 2013 19:16:01 +0000 Stage in:15 Stage out:5
+Progress: time: Fri, 11 Oct 2013 19:16:04 +0000 Stage in:15 Stage out:5
+Progress: time: Fri, 11 Oct 2013 19:16:12 +0000 Stage in:14 Active:1 Stage out:5
+Progress: time: Fri, 11 Oct 2013 19:16:13 +0000 Stage in:13 Active:2 Stage out:5
+Progress: time: Fri, 11 Oct 2013 19:16:34 +0000 Stage in:13 Active:2 Stage out:5
+Progress: time: Fri, 11 Oct 2013 19:16:41 +0000 Stage in:13 Active:1 Stage out:6
+Progress: time: Fri, 11 Oct 2013 19:16:48 +0000 Stage in:12 Active:1 Stage out:7
+Progress: time: Fri, 11 Oct 2013 19:16:49 +0000 Stage in:11 Active:2 Stage out:7
+Progress: time: Fri, 11 Oct 2013 19:17:04 +0000 Stage in:11 Active:2 Stage out:7
+Progress: time: Fri, 11 Oct 2013 19:17:15 +0000 Stage in:10 Active:3 Stage out:7
+Progress: time: Fri, 11 Oct 2013 19:17:22 +0000 Stage in:9 Active:4 Stage out:7
+Progress: time: Fri, 11 Oct 2013 19:17:24 +0000 Stage in:9 Active:3 Stage out:8
+Progress: time: Fri, 11 Oct 2013 19:17:25 +0000 Stage in:9 Active:2 Stage out:9
+Progress: time: Fri, 11 Oct 2013 19:17:30 +0000 Stage in:9 Active:1 Stage out:10
+Progress: time: Fri, 11 Oct 2013 19:17:34 +0000 Stage in:9 Active:1 Stage out:10
+Progress: time: Fri, 11 Oct 2013 19:17:42 +0000 Stage in:8 Active:2 Stage out:10
+Progress: time: Fri, 11 Oct 2013 19:17:45 +0000 Stage in:8 Active:1 Stage out:11
+Progress: time: Fri, 11 Oct 2013 19:17:49 +0000 Stage in:8 Stage out:12
+Progress: time: Fri, 11 Oct 2013 19:18:04 +0000 Stage in:8 Stage out:12
+Progress: time: Fri, 11 Oct 2013 19:18:19 +0000 Stage in:7 Active:1 Stage out:12
+Progress: time: Fri, 11 Oct 2013 19:18:29 +0000 Stage in:6 Active:2 Stage out:12
+Progress: time: Fri, 11 Oct 2013 19:18:34 +0000 Stage in:6 Active:2 Stage out:12
+Progress: time: Fri, 11 Oct 2013 19:18:47 +0000 Stage in:5 Active:3 Stage out:12
+Progress: time: Fri, 11 Oct 2013 19:18:49 +0000 Stage in:3 Active:5 Stage out:12
+Progress: time: Fri, 11 Oct 2013 19:18:57 +0000 Stage in:3 Active:4 Stage out:13
+Progress: time: Fri, 11 Oct 2013 19:18:58 +0000 Stage in:3 Active:1 Stage out:16
+Progress: time: Fri, 11 Oct 2013 19:19:04 +0000 Stage in:3 Stage out:17
+Progress: time: Fri, 11 Oct 2013 19:19:34 +0000 Stage in:3 Stage out:17
+Progress: time: Fri, 11 Oct 2013 19:19:45 +0000 Stage in:2 Active:1 Stage out:17
+Progress: time: Fri, 11 Oct 2013 19:20:04 +0000 Stage in:2 Active:1 Stage out:17
+Progress: time: Fri, 11 Oct 2013 19:20:11 +0000 Stage in:2 Active:1 Stage out:16 Finished successfully:1
+Progress: time: Fri, 11 Oct 2013 19:20:15 +0000 Stage in:2 Active:1 Stage out:15 Finished successfully:2
+Progress: time: Fri, 11 Oct 2013 19:20:19 +0000 Stage in:1 Active:2 Stage out:15 Finished successfully:2
+Progress: time: Fri, 11 Oct 2013 19:20:20 +0000 Active:2 Stage out:16 Finished successfully:2
+Progress: time: Fri, 11 Oct 2013 19:20:26 +0000 Active:1 Stage out:17 Finished successfully:2
+chunks 20 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 200000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:5
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1922-vy3k2i2a
+Progress: time: Fri, 11 Oct 2013 19:22:36 +0000
+Progress: time: Fri, 11 Oct 2013 19:22:51 +0000 Submitting:19 Submitted:1
+Progress: time: Fri, 11 Oct 2013 19:23:06 +0000 Submitted:20
+Progress: time: Fri, 11 Oct 2013 19:23:36 +0000 Submitted:20
+Progress: time: Fri, 11 Oct 2013 19:23:42 +0000 Stage in:1 Submitted:19
+Progress: time: Fri, 11 Oct 2013 19:23:48 +0000 Stage in:2 Submitted:18
+Progress: time: Fri, 11 Oct 2013 19:24:06 +0000 Stage in:4 Submitted:16
+Progress: time: Fri, 11 Oct 2013 19:24:17 +0000 Stage in:5 Submitted:15
+Progress: time: Fri, 11 Oct 2013 19:24:24 +0000 Stage in:6 Submitted:14
+Progress: time: Fri, 11 Oct 2013 19:24:36 +0000 Stage in:8 Submitted:12
+Progress: time: Fri, 11 Oct 2013 19:25:04 +0000 Stage in:9 Submitted:11
+Progress: time: Fri, 11 Oct 2013 19:25:06 +0000 Stage in:9 Submitted:11
+Progress: time: Fri, 11 Oct 2013 19:25:10 +0000 Stage in:10 Submitted:10
+Progress: time: Fri, 11 Oct 2013 19:25:11 +0000 Stage in:12 Submitted:8
+Progress: time: Fri, 11 Oct 2013 19:25:36 +0000 Stage in:12 Submitted:8
+Progress: time: Fri, 11 Oct 2013 19:25:41 +0000 Stage in:13 Submitted:7
+Progress: time: Fri, 11 Oct 2013 19:25:48 +0000 Stage in:14 Submitted:6
+Progress: time: Fri, 11 Oct 2013 19:26:06 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:26:36 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:27:06 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:27:36 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:28:06 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:28:26 +0000 Stage in:15 Submitted:4 Active:1
+Progress: time: Fri, 11 Oct 2013 19:28:31 +0000 Stage in:14 Submitted:4 Active:2
+Progress: time: Fri, 11 Oct 2013 19:28:36 +0000 Stage in:14 Submitted:4 Active:2
+Progress: time: Fri, 11 Oct 2013 19:28:38 +0000 Stage in:13 Submitted:4 Active:2 Stage out:1
+Progress: time: Fri, 11 Oct 2013 19:28:42 +0000 Stage in:12 Submitted:4 Active:2 Stage out:2
+Progress: time: Fri, 11 Oct 2013 19:28:51 +0000 Stage in:12 Submitted:4 Active:1 Stage out:3
+Progress: time: Fri, 11 Oct 2013 19:28:52 +0000 Stage in:12 Submitted:4 Stage out:4
+Progress: time: Fri, 11 Oct 2013 19:29:06 +0000 Stage in:12 Submitted:4 Stage out:4
+Progress: time: Fri, 11 Oct 2013 19:29:36 +0000 Stage in:12 Submitted:4 Stage out:4
+chunks 20 filesize 5 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 1000000
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:5
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131011-1930-kxp6l796
+Progress: time: Fri, 11 Oct 2013 19:30:10 +0000
+Progress: time: Fri, 11 Oct 2013 19:30:25 +0000 Submitting:19 Submitted:1
+Progress: time: Fri, 11 Oct 2013 19:30:40 +0000 Submitted:20
+Progress: time: Fri, 11 Oct 2013 19:31:10 +0000 Submitted:20
+Progress: time: Fri, 11 Oct 2013 19:31:12 +0000 Stage in:1 Submitted:19
+Progress: time: Fri, 11 Oct 2013 19:31:40 +0000 Stage in:4 Submitted:16
+chunks 20 filesize 5 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 1000000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:20 X FILESIZE:5
+Swift trunk swift-r7138 cog-r3806
+RunID: 20131011-1931-oqny95t8
+Warning: The @ syntax for function invocation is deprecated
+Progress: time: Fri, 11 Oct 2013 19:31:54 +0000
+Progress: time: Fri, 11 Oct 2013 19:31:55 +0000 Submitting:20
+Progress: time: Fri, 11 Oct 2013 19:32:10 +0000 Submitted:20
+Progress: time: Fri, 11 Oct 2013 19:32:40 +0000 Submitted:20
+Progress: time: Fri, 11 Oct 2013 19:33:08 +0000 Stage in:1 Submitted:19
+Progress: time: Fri, 11 Oct 2013 19:33:09 +0000 Stage in:4 Submitted:16
+Progress: time: Fri, 11 Oct 2013 19:33:39 +0000 Stage in:4 Submitted:16
+Progress: time: Fri, 11 Oct 2013 19:33:40 +0000 Stage in:5 Submitted:15
+Progress: time: Fri, 11 Oct 2013 19:33:41 +0000 Stage in:8 Submitted:12
+Progress: time: Fri, 11 Oct 2013 19:34:11 +0000 Stage in:8 Submitted:12
+Progress: time: Fri, 11 Oct 2013 19:34:12 +0000 Stage in:10 Submitted:10
+Progress: time: Fri, 11 Oct 2013 19:34:13 +0000 Stage in:12 Submitted:8
+Progress: time: Fri, 11 Oct 2013 19:34:43 +0000 Stage in:12 Submitted:8
+Progress: time: Fri, 11 Oct 2013 19:34:45 +0000 Stage in:14 Submitted:6
+Progress: time: Fri, 11 Oct 2013 19:34:46 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:35:16 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:35:46 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:36:16 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:36:46 +0000 Stage in:16 Submitted:4
+Progress: time: Fri, 11 Oct 2013 19:37:13 +0000 Stage in:15 Submitted:4 Active:1
+Progress: time: Fri, 11 Oct 2013 19:37:15 +0000 Stage in:14 Submitted:4 Active:2
+Progress: time: Fri, 11 Oct 2013 19:37:16 +0000 Stage in:13 Submitted:4 Active:3
+Progress: time: Fri, 11 Oct 2013 19:37:22 +0000 Stage in:12 Submitted:4 Active:4
+Progress: time: Fri, 11 Oct 2013 19:37:23 +0000 Stage in:12 Submitted:4 Active:3 Stage out:1
+Progress: time: Fri, 11 Oct 2013 19:37:25 +0000 Stage in:12 Submitted:4 Active:2 Stage out:2
+Progress: time: Fri, 11 Oct 2013 19:37:27 +0000 Stage in:12 Submitted:4 Active:1 Stage out:3
+Progress: time: Fri, 11 Oct 2013 19:37:32 +0000 Stage in:12 Submitted:4 Stage out:4
+Progress: time: Fri, 11 Oct 2013 19:38:02 +0000 Stage in:12 Submitted:4 Stage out:4
+Progress: time: Fri, 11 Oct 2013 19:38:32 +0000 Stage in:12 Submitted:4 Stage out:4
+Progress: time: Fri, 11 Oct 2013 19:39:02 +0000 Stage in:12 Submitted:4 Stage out:4
+Progress: time: Fri, 11 Oct 2013 19:39:13 +0000 Stage in:11 Submitted:4 Active:1 Stage out:4
+Progress: time: Fri, 11 Oct 2013 19:39:19 +0000 Stage in:9 Submitted:4 Active:3 Stage out:4
+Progress: time: Fri, 11 Oct 2013 19:39:26 +0000 Stage in:8 Submitted:4 Active:4 Stage out:4
+Progress: time: Fri, 11 Oct 2013 19:39:39 +0000 Stage in:8 Submitted:4 Active:3 Stage out:5
+Progress: time: Fri, 11 Oct 2013 19:39:41 +0000 Stage in:8 Submitted:4 Active:2 Stage out:6
+Progress: time: Fri, 11 Oct 2013 19:39:42 +0000 Stage in:8 Submitted:4 Active:1 Stage out:7
+Progress: time: Fri, 11 Oct 2013 19:39:49 +0000 Stage in:8 Submitted:4 Stage out:8
+Progress: time: Fri, 11 Oct 2013 19:40:19 +0000 Stage in:8 Submitted:4 Stage out:8
+Progress: time: Fri, 11 Oct 2013 19:40:49 +0000 Stage in:8 Submitted:4 Stage out:8
+Progress: time: Fri, 11 Oct 2013 19:41:19 +0000 Stage in:8 Submitted:4 Stage out:8
+Progress: time: Fri, 11 Oct 2013 19:41:49 +0000 Stage in:8 Submitted:4 Stage out:8
+Progress: time: Fri, 11 Oct 2013 19:41:54 +0000 Stage in:7 Submitted:4 Active:1 Stage out:8
+Progress: time: Fri, 11 Oct 2013 19:41:56 +0000 Stage in:5 Submitted:4 Active:3 Stage out:8
+Progress: time: Fri, 11 Oct 2013 19:42:01 +0000 Stage in:4 Submitted:4 Active:4 Stage out:8
+Progress: time: Fri, 11 Oct 2013 19:42:16 +0000 Stage in:4 Submitted:4 Active:2 Stage out:10
+Progress: time: Fri, 11 Oct 2013 19:42:17 +0000 Stage in:4 Submitted:4 Active:1 Stage out:11
+Progress: time: Fri, 11 Oct 2013 19:42:21 +0000 Stage in:4 Submitted:4 Stage out:12
+Progress: time: Fri, 11 Oct 2013 19:42:51 +0000 Stage in:4 Submitted:4 Stage out:12
+Progress: time: Fri, 11 Oct 2013 19:43:21 +0000 Stage in:4 Submitted:4 Stage out:12
+Progress: time: Fri, 11 Oct 2013 19:43:51 +0000 Stage in:4 Submitted:4 Stage out:12
+chunks 20 filesize 5 site multiple type Swift+Chirp
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:10
+Swift trunk swift-r7138 cog-r3806
+RunID: 20131011-1945-ofqi9iv3
+Warning: The @ syntax for function invocation is deprecated
+Progress: time: Fri, 11 Oct 2013 19:45:09 +0000
+Progress: time: Fri, 11 Oct 2013 19:45:10 +0000 Submitted:10
+Progress: time: Fri, 11 Oct 2013 19:45:40 +0000 Submitting:1 Active:1 Finished successfully:11
+Progress: time: Fri, 11 Oct 2013 19:45:43 +0000 Submitting:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 19:45:54 +0000 Submitted:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 19:46:23 +0000 Active:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 19:46:24 +0000 Submitted:1 Finished successfully:13
+Final status: Fri, 11 Oct 2013 19:46:29 +0000 Finished successfully:14
+real 82.48
+user 5.67
+sys 0.34
+chunks 10 filesize 10 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 1000000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:50
+Swift trunk swift-r7138 cog-r3806
+RunID: 20131011-1947-bofm1qm3
+Warning: The @ syntax for function invocation is deprecated
+Progress: time: Fri, 11 Oct 2013 19:47:24 +0000
+Progress: time: Fri, 11 Oct 2013 19:47:25 +0000 Submitted:10
+Progress: time: Fri, 11 Oct 2013 19:47:31 +0000 Submitted:1 Finished successfully:10
+Progress: time: Fri, 11 Oct 2013 19:47:32 +0000 Submitting:1 Active:1 Finished successfully:11
+Progress: time: Fri, 11 Oct 2013 19:47:35 +0000 Submitting:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 19:47:46 +0000 Submitted:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 19:48:16 +0000 Submitted:1 Finished successfully:13
+Progress: time: Fri, 11 Oct 2013 19:48:46 +0000 Submitted:1 Finished successfully:13
+Progress: time: Fri, 11 Oct 2013 19:49:16 +0000 Submitted:1 Finished successfully:13
+Final status: Fri, 11 Oct 2013 19:49:29 +0000 Finished successfully:14
+real 126.84
+user 6.07
+sys 0.38
+chunks 10 filesize 50 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 5000000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:50
+Swift trunk swift-r7138 cog-r3806
+RunID: 20131011-1953-gktd4535
+Warning: The @ syntax for function invocation is deprecated
+Progress: time: Fri, 11 Oct 2013 19:53:45 +0000
+Progress: time: Fri, 11 Oct 2013 19:53:46 +0000 Submitting:1 Active:1 Finished successfully:11
+Progress: time: Fri, 11 Oct 2013 19:53:47 +0000 Submitting:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 19:53:59 +0000 Submitted:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 19:54:25 +0000 Stage in:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 19:54:26 +0000 Submitted:1 Finished successfully:13
+Progress: time: Fri, 11 Oct 2013 19:54:56 +0000 Submitted:1 Finished successfully:13
+chunks 10 filesize 50 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 5000000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:10
+Swift trunk swift-r7138 cog-r3806
+RunID: 20131011-2001-podzqeo8
+Warning: The @ syntax for function invocation is deprecated
+Progress: time: Fri, 11 Oct 2013 20:01:52 +0000
+Progress: time: Fri, 11 Oct 2013 20:01:53 +0000 Submitted:10
+Progress: time: Fri, 11 Oct 2013 20:01:57 +0000 Submitting:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 20:02:10 +0000 Submitted:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 20:02:38 +0000 Submitted:1 Finished successfully:13
+Progress: time: Fri, 11 Oct 2013 20:03:08 +0000 Submitted:1 Finished successfully:13
+Progress: time: Fri, 11 Oct 2013 20:03:38 +0000 Submitted:1 Finished successfully:13
+Final status: Fri, 11 Oct 2013 20:03:54 +0000 Finished successfully:14
+real 124.13
+user 5.89
+sys 0.37
+chunks 10 filesize 10 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 1000000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:10
+Swift trunk swift-r7138 cog-r3806
+RunID: 20131011-2004-eiokher2
+Warning: The @ syntax for function invocation is deprecated
+Progress: time: Fri, 11 Oct 2013 20:04:21 +0000
+Progress: time: Fri, 11 Oct 2013 20:04:22 +0000 Submitted:10
+Progress: time: Fri, 11 Oct 2013 20:04:24 +0000 Submitting:1 Active:1 Finished successfully:11
+Progress: time: Fri, 11 Oct 2013 20:04:25 +0000 Submitting:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 20:04:37 +0000 Submitted:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 20:05:07 +0000 Submitted:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 20:05:11 +0000 Stage in:1 Finished successfully:12
+Progress: time: Fri, 11 Oct 2013 20:05:12 +0000 Submitted:1 Finished successfully:13
+Progress: time: Fri, 11 Oct 2013 20:05:42 +0000 Submitted:1 Finished successfully:13
+Progress: time: Fri, 11 Oct 2013 20:06:12 +0000 Submitted:1 Finished successfully:13
+Final status: Fri, 11 Oct 2013 20:06:24 +0000 Finished successfully:14
+real 125.04
+user 5.89
+sys 0.37
+chunks 10 filesize 10 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 1000000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:5 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0120-o9g5mtva
+Progress: time: Mon, 14 Oct 2013 01:20:04 +0000
+Progress: time: Mon, 14 Oct 2013 01:20:17 +0000 Stage in:1 Submitted:4
+Progress: time: Mon, 14 Oct 2013 01:20:33 +0000 Submitted:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:20:34 +0000 Submitted:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:21:04 +0000 Submitted:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:21:34 +0000 Submitted:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:22:04 +0000 Submitted:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:22:34 +0000 Submitted:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:23:04 +0000 Submitted:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:23:34 +0000 Submitted:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:23:51 +0000 Stage in:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:24:04 +0000 Stage in:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:24:34 +0000 Stage in:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:25:04 +0000 Stage in:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:25:34 +0000 Stage in:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:26:04 +0000 Stage in:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:26:34 +0000 Stage in:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:26:48 +0000 Active:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 01:26:53 +0000 Stage in:1 Finished successfully:8
+Final status: Mon, 14 Oct 2013 01:26:53 +0000 Finished successfully:9
+real 412.67
+user 730.60
+sys 181.23
+chunks 5 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 50000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:5 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0403-pruml2e9
+Progress: time: Mon, 14 Oct 2013 04:03:28 +0000
+Progress: time: Mon, 14 Oct 2013 04:03:42 +0000 Submitted:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 04:03:58 +0000 Submitted:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 04:04:10 +0000 Stage in:1 Finished successfully:7
+Progress: time: Mon, 14 Oct 2013 04:04:28 +0000 Submitted:1 Finished successfully:8
+Progress: time: Mon, 14 Oct 2013 04:04:58 +0000 Submitted:1 Finished successfully:8
+Progress: time: Mon, 14 Oct 2013 04:05:28 +0000 Submitted:1 Finished successfully:8
+Progress: time: Mon, 14 Oct 2013 04:05:29 +0000 Stage in:1 Finished successfully:8
+Final status: Mon, 14 Oct 2013 04:05:29 +0000 Finished successfully:9
+real 124.42
+user 83.24
+sys 19.31
+chunks 5 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 50000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0412-t6nb93l0
+Progress: time: Mon, 14 Oct 2013 04:12:56 +0000
+Progress: time: Mon, 14 Oct 2013 04:12:58 +0000 Submitting:1 Stage out:1 Finished successfully:11
+Progress: time: Mon, 14 Oct 2013 04:13:12 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:13:26 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:13:37 +0000 Stage in:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:13:56 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:14:26 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:14:56 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:14:58 +0000 Stage in:1 Finished successfully:13
+Final status: Mon, 14 Oct 2013 04:14:58 +0000 Finished successfully:14
+real 124.71
+user 81.24
+sys 20.21
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0437-h0ot38y8
+Progress: time: Mon, 14 Oct 2013 04:38:00 +0000
+Progress: time: Mon, 14 Oct 2013 04:38:14 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:38:30 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:38:44 +0000 Stage in:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:39:00 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:39:30 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:40:00 +0000 Submitted:1 Finished successfully:13
+Final status: Mon, 14 Oct 2013 04:40:01 +0000 Finished successfully:14
+real 123.56
+user 86.66
+sys 21.06
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0444-ijrtfdrg
+Progress: time: Mon, 14 Oct 2013 04:44:45 +0000
+Progress: time: Mon, 14 Oct 2013 04:45:01 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:45:15 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:45:30 +0000 Stage in:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:45:45 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:46:15 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:46:45 +0000 Submitted:1 Finished successfully:13
+Final status: Mon, 14 Oct 2013 04:46:46 +0000 Finished successfully:14
+real 123.54
+user 88.91
+sys 20.56
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0450-82li8ydb
+Progress: time: Mon, 14 Oct 2013 04:50:52 +0000
+Progress: time: Mon, 14 Oct 2013 04:51:08 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:51:22 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:51:36 +0000 Stage in:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:51:52 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:52:22 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:52:52 +0000 Submitted:1 Finished successfully:13
+Final status: Mon, 14 Oct 2013 04:52:53 +0000 Finished successfully:14
+real 123.55
+user 86.20
+sys 21.09
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0457-xvacvaeb
+Progress: time: Mon, 14 Oct 2013 04:57:24 +0000
+Progress: time: Mon, 14 Oct 2013 04:57:40 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:57:54 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:58:05 +0000 Stage in:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 04:58:24 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:58:54 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:59:24 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 04:59:25 +0000 Stage in:1 Finished successfully:13
+Final status: Mon, 14 Oct 2013 04:59:25 +0000 Finished successfully:14
+real 123.88
+user 82.29
+sys 17.37
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0510-yfumlbx4
+Progress: time: Mon, 14 Oct 2013 05:10:09 +0000
+Progress: time: Mon, 14 Oct 2013 05:10:25 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 05:10:39 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 05:10:49 +0000 Stage in:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 05:11:09 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 05:11:39 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 05:12:09 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 05:12:10 +0000 Stage in:1 Finished successfully:13
+Final status: Mon, 14 Oct 2013 05:12:10 +0000 Finished successfully:14
+real 125.12
+user 81.09
+sys 18.52
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 0
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0519-xkeoidmf
+Progress: time: Mon, 14 Oct 2013 05:19:38 +0000
+Progress: time: Mon, 14 Oct 2013 05:19:43 +0000 Submitting:1 Stage out:1 Finished successfully:11
+Progress: time: Mon, 14 Oct 2013 05:19:53 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 05:20:08 +0000 Submitted:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 05:20:16 +0000 Stage in:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 05:20:38 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 05:21:08 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 05:21:38 +0000 Submitted:1 Finished successfully:13
+Progress: time: Mon, 14 Oct 2013 05:21:39 +0000 Stage in:1 Finished successfully:13
+Final status: Mon, 14 Oct 2013 05:21:39 +0000 Finished successfully:14
+real 124.45
+user 77.75
+sys 17.31
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT matches expected records
+ACTUAL COUNT : 100000
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0522-6oz0dgn1
+Progress: time: Mon, 14 Oct 2013 05:22:06 +0000
+Progress: time: Mon, 14 Oct 2013 05:22:12 +0000 Stage out:1 Finished successfully:11
+Final status: Mon, 14 Oct 2013 05:22:12 +0000 Finished successfully:13
+real 8.53
+user 16.04
+sys 2.66
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT matches expected records
+ACTUAL COUNT : 100000
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0533-oouzz75b
+Progress: time: Mon, 14 Oct 2013 05:33:13 +0000
+Progress: time: Mon, 14 Oct 2013 05:33:26 +0000 Submitting:6 Submitted:1 Finished successfully:3
+Progress: time: Mon, 14 Oct 2013 05:33:43 +0000 Submitted:6 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:34:01 +0000 Stage in:1 Submitted:5 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:34:13 +0000 Stage in:2 Submitted:4 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:34:16 +0000 Stage in:3 Submitted:3 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:34:32 +0000 Stage in:5 Submitted:1 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:34:43 +0000 Stage in:5 Submitted:1 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:34:49 +0000 Stage in:6 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:34:58 +0000 Stage in:5 Active:1 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:35:06 +0000 Stage in:5 Stage out:1 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:35:13 +0000 Stage in:5 Stage out:1 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:35:43 +0000 Stage in:5 Stage out:1 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:36:07 +0000 Stage in:4 Active:1 Stage out:1 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:36:12 +0000 Stage in:3 Active:1 Stage out:2 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:36:43 +0000 Stage in:3 Stage out:3 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:36:44 +0000 Stage in:2 Active:1 Stage out:3 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:37:11 +0000 Stage in:2 Stage out:4 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:37:13 +0000 Stage in:2 Stage out:4 Finished successfully:4
+Progress: time: Mon, 14 Oct 2013 05:37:16 +0000 Stage in:2 Stage out:3 Finished successfully:5
+Progress: time: Mon, 14 Oct 2013 05:37:36 +0000 Stage in:2 Stage out:2 Finished successfully:6
+Progress: time: Mon, 14 Oct 2013 05:37:43 +0000 Stage in:2 Stage out:2 Finished successfully:6
+Progress: time: Mon, 14 Oct 2013 05:37:50 +0000 Stage in:1 Active:1 Stage out:2 Finished successfully:6
+Progress: time: Mon, 14 Oct 2013 05:37:51 +0000 Stage in:1 Finished successfully:12
+Progress: time: Mon, 14 Oct 2013 05:37:57 +0000 Stage out:1 Finished successfully:12
+Final status: Mon, 14 Oct 2013 05:37:57 +0000 Finished successfully:14
+real 286.88
+user 713.73
+sys 125.14
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT : 60000
+EXPECTED COUNT: 100000
+---------------------------------------------
+================================================================
+RUNTYPE :SWIFT+Chirp (With local combiners), SITE:multiple, CHUNKS:10 X FILESIZE:1
+Warning: Parameter reducer, on line 47, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 47, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 50, shadows variable of same name on line 30
+Warning: Parameter all_map, on line 50, shadows variable of same name on line 43
+Warning: Parameter reducer, on line 53, shadows variable of same name on line 30
+Swift 0.94.1 RC4 swift-r7109 cog-r3802
+
+RunID: 20131014-0544-iq36ih6b
+Progress: time: Mon, 14 Oct 2013 05:45:00 +0000
+Progress: time: Mon, 14 Oct 2013 05:45:15 +0000 Submitted:1 Finished successfully:9
+Progress: time: Mon, 14 Oct 2013 05:45:30 +0000 Submitted:1 Finished successfully:9
+Progress: time: Mon, 14 Oct 2013 05:45:41 +0000 Stage in:1 Finished successfully:9
+Progress: time: Mon, 14 Oct 2013 05:46:00 +0000 Submitted:1 Finished successfully:10
+Progress: time: Mon, 14 Oct 2013 05:46:30 +0000 Submitted:1 Finished successfully:10
+Progress: time: Mon, 14 Oct 2013 05:47:00 +0000 Submitted:1 Finished successfully:10
+Progress: time: Mon, 14 Oct 2013 05:47:01 +0000 Stage out:1 Finished successfully:10
+Final status: Mon, 14 Oct 2013 05:47:02 +0000 Finished successfully:13
+real 124.14
+user 250.64
+sys 58.16
+chunks 10 filesize 1 site multiple type Swift+Chirp
+---------------------------------------------
+COUNT does *NOT* match expected records
+ACTUAL COUNT :
+EXPECTED COUNT: 100000
+---------------------------------------------
Modified: SwiftApps/Swift-MapRed/mapred_combiner_V4/client.c
===================================================================
--- SwiftApps/Swift-MapRed/mapred_combiner_V4/client.c 2013-10-14 05:37:26 UTC (rev 7155)
+++ SwiftApps/Swift-MapRed/mapred_combiner_V4/client.c 2013-10-14 05:52:53 UTC (rev 7156)
@@ -103,7 +103,7 @@
fprintf(stderr, "File size: %d\n", file_size);
fseek(f_in, 0, SEEK_SET);
- buffer = (char *) malloc ((sizeof (char)) * (file_size+2));
+ buffer = (char *) malloc ((sizeof (char)) * (file_size+1));
fread(buffer, file_size, 1, f_in);
buffer[file_size] = '\0';
fclose(f_in);
Modified: SwiftApps/Swift-MapRed/mapred_combiner_V4/combiner.sh
===================================================================
--- SwiftApps/Swift-MapRed/mapred_combiner_V4/combiner.sh 2013-10-14 05:37:26 UTC (rev 7155)
+++ SwiftApps/Swift-MapRed/mapred_combiner_V4/combiner.sh 2013-10-14 05:52:53 UTC (rev 7156)
@@ -37,4 +37,4 @@
echo "Combiner [./exec_client $NODE $NODE.sh]" 1>&2
cat $NODE.sh 1>&2
./exec_client $NODE $NODE.sh
-exit 0
+exit 0
Modified: SwiftApps/Swift-MapRed/mapred_combiner_V4/multiple.xml
===================================================================
--- SwiftApps/Swift-MapRed/mapred_combiner_V4/multiple.xml 2013-10-14 05:37:26 UTC (rev 7155)
+++ SwiftApps/Swift-MapRed/mapred_combiner_V4/multiple.xml 2013-10-14 05:52:53 UTC (rev 7156)
@@ -14,20 +14,20 @@
<filesystem provider="local"/>
<workdirectory>/tmp/yadunand</workdirectory>
</pool>
-
+
<pool handle="beagle">
<execution provider="coaster" jobmanager="ssh-cl:pbs" url="login4.beagle.ci.uchicago.edu"/>
- <profile namespace="globus" key="jobsPerNode">24</profile>
+ <profile namespace="globus" key="jobsPerNode">4</profile>
<profile namespace="globus" key="lowOverAllocation">100</profile>
<profile namespace="globus" key="highOverAllocation">100</profile>
<profile namespace="globus" key="providerAttributes">pbs.aprun;pbs.mpp;depth=24</profile>
<profile namespace="globus" key="maxtime">1200</profile>
<profile namespace="globus" key="maxWalltime">00:10:00</profile>
- <profile namespace="globus" key="queue">development</profile>
+ <profile namespace="globus" key="queue">development</profile>
<profile namespace="globus" key="userHomeOverride">/lustre/beagle/yadunandb/swiftwork</profile>
<profile namespace="globus" key="slots">1</profile>
- <profile namespace="globus" key="maxnodes">1</profile>
- <profile namespace="globus" key="nodeGranularity">1</profile>
+ <profile namespace="globus" key="maxnodes">4</profile>
+ <profile namespace="globus" key="nodeGranularity">4</profile>
<profile namespace="karajan" key="jobThrottle">4.80</profile>
<profile namespace="karajan" key="initialScore">10000</profile>
<!-- <profile namespace="karajan" key="workerLoggingLevel">trace</profile> -->
@@ -83,14 +83,14 @@
<profile namespace="globus" key="queue">westmere</profile>
<!-- <profile namespace="globus" key="queue">sandyb</profile> -->
<!-- <profile namespace="globus" key="queue">amd</profile> -->
- <profile namespace="globus" key="jobsPerNode">1</profile>
+ <profile namespace="globus" key="jobsPerNode">4</profile>
<profile namespace="globus" key="maxtime">1200</profile>
<profile namespace="globus" key="maxWalltime">00:10:00</profile>
<profile namespace="globus" key="highOverAllocation">100</profile>
<profile namespace="globus" key="lowOverAllocation">100</profile>
- <profile namespace="globus" key="slots">4</profile>
- <profile namespace="globus" key="maxNodes">1</profile>
- <profile namespace="globus" key="nodeGranularity">1</profile>
+ <profile namespace="globus" key="slots">1</profile>
+ <profile namespace="globus" key="maxNodes">4</profile>
+ <profile namespace="globus" key="nodeGranularity">4</profile>
<profile namespace="karajan" key="jobThrottle">.64</profile>
<profile namespace="karajan" key="initialScore">10000</profile>
<workdirectory>/tmp/yadunand</workdirectory>
Modified: SwiftApps/Swift-MapRed/mapred_combiner_V4/reducer_template.sh
===================================================================
--- SwiftApps/Swift-MapRed/mapred_combiner_V4/reducer_template.sh 2013-10-14 05:37:26 UTC (rev 7155)
+++ SwiftApps/Swift-MapRed/mapred_combiner_V4/reducer_template.sh 2013-10-14 05:52:53 UTC (rev 7156)
@@ -12,6 +12,7 @@
HOSTNAME=$(hostname -f)
if [[ "$HOSTNAME" == *midway* ]]; then # On midway node
EXECSERVER=/scratch/midway/yadunand/bin/exec_server
+ EXECCLIENT=/scratch/midway/yadunand/bin/exec_client
LOGFOLDER=/scratch/midway/yadunand
FOLDER="/dev/shm"
HOSTID="midway_$HOSTNAME"
@@ -19,6 +20,7 @@
elif [[ "$HOSTNAME" == *nid* ]]; then # On beagle node
EXECSERVER=/lustre/beagle/yadunandb/bin/exec_server
+ EXECCLIENT=/lustre/beagle/yadunandb/bin/exec_client
LOGFOLDER=/lustre/beagle/yadunandb/Swift-MapRed/
FOLDER="/dev/shm"
HOSTID="beagle_$HOSTNAME"
@@ -54,7 +56,6 @@
plain ()
{
- #FILES=($(grep -h "$SITE" $*))
ID=$1; shift
IFS=$'\r\n' FILES=($(grep -h "$SITE" $*))
echo "Matching files : ${FILES[*]}" 1>&2
@@ -68,6 +69,40 @@
exit 0
}
+
+local_combine()
+{
+ ID=$1; shift
+ #IFS=$'\r\n' FILES=($(grep -h "$SITE" $*))
+ LOCATIONS=($(awk '{ print $1 }' $* | grep $SITE | sort -u))
+ for LOCATION in ${LOCATIONS[*]}
+ do
+ Node=($(echo "$LOCATION" | sed 's/[^ ]*_//' ))
+ FILES=($(grep -h $Node $* | awk '{ print $2 }'))
+############## LOCAL COMBINER CODE ###################
+ cat <<EOF > $Node.sh
+#!/bin/bash
+ID=$RANDOM
+FILES=(${FILES[*]})
+SITE=$SITE
+EOF
+ cat <<'EOF' >> $Node.sh
+#USER_REDUCE
+
+echo -e "$SITE"_"$(hostname -f) $(reduce ${FILES[*]})"
+EOF
+ chmod a+x $Node.sh;
+############# END LOCAL COMBINER #####################
+ #TODO: Move client with swift ?
+ # How does builds work on different architectures ?
+ cp $EXECCLIENT ./
+ ./exec_client $Node $Node.sh 1> $FOLDER/$LOCATION.$ID.imd &
+ done
+ wait
+ #cat $FOLDER/*.$ID.imd
+ plain $ID $FOLDER/*.$ID.imd
+}
+
case "$CMD" in
"naive")
echo "Using naive reduce" 1>&2
@@ -75,8 +110,15 @@
;;
"plain")
echo "Using plain reduce" 1>&2
- plain $ID ${FILES[*]};
+ plain $ID ${FILES[*]}
;;
+ "local")
+ echo "Using local combiners" 1>&2
+ local_combine $ID ${FILES[*]} #> $FOLDER/$ID.combine.results
+ #echo "Result from local_combines :" 1>&2
+ #cat $FOLDER/$ID.combine.results 1>&2
+ #plain $ID $FOLDER/$ID.combine.results
+ ;;
*)
echo "ERROR: Unknown reduction method requested" 1>&2
;;
Modified: SwiftApps/Swift-MapRed/mapred_combiner_V4/run.sh
===================================================================
--- SwiftApps/Swift-MapRed/mapred_combiner_V4/run.sh 2013-10-14 05:37:26 UTC (rev 7155)
+++ SwiftApps/Swift-MapRed/mapred_combiner_V4/run.sh 2013-10-14 05:52:53 UTC (rev 7156)
@@ -17,11 +17,11 @@
if [ "$SITE" != "beagle" ]
then
- ./compile
+ #./compile
# cp exec_server /lustre/beagle/yadunandb/bin/
# cp exec_client /lustre/beagle/yadunandb/bin/
- cp exec_client /scratch/midway/yadunand/bin/
- cp exec_server /scratch/midway/yadunand/bin/
+ #cp exec_client /scratch/midway/yadunand/bin/
+ #cp exec_server /scratch/midway/yadunand/bin/
echo "Skipping compile and copy"
fi;
#Call as check_error $? <ERR_CODE> <Error message>
Modified: SwiftApps/Swift-MapRed/mapred_combiner_V4/server.c
===================================================================
--- SwiftApps/Swift-MapRed/mapred_combiner_V4/server.c 2013-10-14 05:37:26 UTC (rev 7155)
+++ SwiftApps/Swift-MapRed/mapred_combiner_V4/server.c 2013-10-14 05:52:53 UTC (rev 7156)
@@ -165,6 +165,7 @@
// TODO
reply = (char *) malloc (2048);
+ memset(reply, '\0', 2048);
reply_size = exec_string(buf, numbytes, reply);
printf("Returning string of size %d \n%s\n", reply_size, reply);
Modified: SwiftApps/Swift-MapRed/mapred_combiner_V4/swiftreduce.swift
===================================================================
--- SwiftApps/Swift-MapRed/mapred_combiner_V4/swiftreduce.swift 2013-10-14 05:37:26 UTC (rev 7155)
+++ SwiftApps/Swift-MapRed/mapred_combiner_V4/swiftreduce.swift 2013-10-14 05:52:53 UTC (rev 7156)
@@ -14,9 +14,9 @@
bash @run recsize stdout=@out stderr=@err;
}
-app (fileptr out) aggregate (script aggr, fileptr map_results[])
+app (fileptr out) aggregate (script a, fileptr map_results[])
{
- bash @aggr @map_results stdout=@out;
+ bash @a @map_results stdout=@out;
}
int files = @toInt(@arg("files","0"));
@@ -78,8 +78,8 @@
}
*/
-(redsite_out[0], redsite_err[0]) = reduce_bgl (reducer, "plain", all_map);
-(redsite_out[1], redsite_err[1]) = reduce_mid (reducer, "plain", all_map);
+//(redsite_out[0], redsite_err[0]) = reduce_bgl (reducer, "local", all_map);
+(redsite_out[1], redsite_err[1]) = reduce_mid (reducer, "local", all_map);
file final_out <"final_result">;
file final_err <"final_errors">;
(final_out, final_err) = reduce_loc (reducer, "naive", redsite_out);
More information about the Swift-commit
mailing list