[Swift-commit] r6965 - SwiftApps/Swift-MapRed/Paper
ketan at ci.uchicago.edu
ketan at ci.uchicago.edu
Thu Aug 22 22:17:29 CDT 2013
Author: ketan
Date: 2013-08-22 22:17:28 -0500 (Thu, 22 Aug 2013)
New Revision: 6965
Modified:
SwiftApps/Swift-MapRed/Paper/.latex.out
SwiftApps/Swift-MapRed/Paper/swifthadoop.aux
SwiftApps/Swift-MapRed/Paper/swifthadoop.log
SwiftApps/Swift-MapRed/Paper/swifthadoop.tex
Log:
hadoop wc results on MCS
Modified: SwiftApps/Swift-MapRed/Paper/.latex.out
===================================================================
--- SwiftApps/Swift-MapRed/Paper/.latex.out 2013-08-22 21:50:43 UTC (rev 6964)
+++ SwiftApps/Swift-MapRed/Paper/.latex.out 2013-08-23 03:17:28 UTC (rev 6965)
@@ -133,9 +133,13 @@
[2 <./fig/hadoopflow.png>]
<fig/swiftreduce.png, id=19, 566.115pt x 379.4175pt> <use fig/swiftreduce.png>
<fig/combiner.png, id=20, 595.22375pt x 282.05376pt> <use fig/combiner.png>
-[3 <./fig/swiftflow.png>]
-Underfull \vbox (badness 1688) has occurred while \output is active
-(./swifthadoop.bbl [4 <./fig/swiftreduce.png>])
+<results/hadoop-wc-mcs.png, id=21, 642.4pt x 481.8pt>
+<use results/hadoop-wc-mcs.png>
+Overfull \hbox (36.03012pt too wide) in paragraph at lines 364--367
+ []
+[3 <./fig/swiftflow.png> <./results/hadoop-wc-mcs.png>]
+Underfull \vbox (badness 1688) has occurred while \output is active [4 <./fig/s
+wiftreduce.png>] (./swifthadoop.bbl)
** Conference Paper **
Before submitting the final camera ready copy, remember to:
@@ -154,5 +158,5 @@
s/utmb8a.pfb></opt/local/share/texmf-texlive/fonts/type1/urw/times/utmbi8a.pfb>
</opt/local/share/texmf-texlive/fonts/type1/urw/times/utmr8a.pfb></opt/local/sh
are/texmf-texlive/fonts/type1/urw/times/utmri8a.pfb>
-Output written on swifthadoop.pdf (5 pages, 190720 bytes).
+Output written on swifthadoop.pdf (5 pages, 210267 bytes).
Transcript written on swifthadoop.log.
Modified: SwiftApps/Swift-MapRed/Paper/swifthadoop.aux
===================================================================
--- SwiftApps/Swift-MapRed/Paper/swifthadoop.aux 2013-08-22 21:50:43 UTC (rev 6964)
+++ SwiftApps/Swift-MapRed/Paper/swifthadoop.aux 2013-08-23 03:17:28 UTC (rev 6965)
@@ -16,15 +16,12 @@
\@writefile{toc}{\contentsline {section}{\numberline {III}Swift versus Hadoop}{2}}
\citation{shellpipes}
\citation{friendfoes}
-\citation{bulkparallel}
-\citation{marissa}
-\citation{balkir}
-\citation{distdelayed}
-\citation{cdm}
\@writefile{lof}{\contentsline {figure}{\numberline {2}{\ignorespaces Dataflow of Swift \relax }}{3}}
\newlabel{fig:swiftarchi}{{2}{3}}
\@writefile{toc}{\contentsline {section}{\numberline {IV}Experiment Setup}{3}}
\@writefile{toc}{\contentsline {section}{\numberline {V}Analysis of Swift and Hadoop Runtimes}{3}}
+\@writefile{lof}{\contentsline {figure}{\numberline {5}{\ignorespaces Hadoop wordcount results with HDFS on RAMdisk and localdisk on a 10-workstation cluster \relax }}{3}}
+\newlabel{fig:wc}{{5}{3}}
\@writefile{toc}{\contentsline {section}{\numberline {VI}Illustrative Solutions}{3}}
\@writefile{toc}{\contentsline {subsection}{\numberline {\unhbox \voidb at x \hbox {VI-A}}Wordcount}{3}}
\@writefile{toc}{\contentsline {subsection}{\numberline {\unhbox \voidb at x \hbox {VI-B}}Weather Datamining}{3}}
@@ -33,22 +30,24 @@
\@writefile{toc}{\contentsline {subsection}{\numberline {\unhbox \voidb at x \hbox {VII-B}}Distributed File Systems}{3}}
\@writefile{toc}{\contentsline {subsection}{\numberline {\unhbox \voidb at x \hbox {VII-C}}Lessons Learned}{3}}
\@writefile{toc}{\contentsline {section}{\numberline {VIII}Related Work}{3}}
-\@writefile{toc}{\contentsline {subsection}{\numberline {\unhbox \voidb at x \hbox {VIII-A}}MapReduce Variants}{3}}
+\citation{bulkparallel}
+\citation{marissa}
+\citation{balkir}
+\citation{distdelayed}
+\citation{cdm}
+\@writefile{lot}{\contentsline {table}{\numberline {I}{\ignorespaces Swift versus Hadoop: Features and Characteristics\relax }}{4}}
+\newlabel{tbl:storage}{{I}{4}}
+\@writefile{lof}{\contentsline {figure}{\numberline {3}{\ignorespaces Setup of SwiftReduce \relax }}{4}}
+\newlabel{fig:swiftreduce}{{3}{4}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {\unhbox \voidb at x \hbox {VIII-A}}MapReduce Variants}{4}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {\unhbox \voidb at x \hbox {VIII-B}}Workflow Implementations}{4}}
+\@writefile{toc}{\contentsline {subsection}{\numberline {\unhbox \voidb at x \hbox {VIII-C}}Coupling MapReduce and Workflow}{4}}
\bibstyle{IEEEtran}
\bibdata{ref}
\bibcite{fired}{1}
\bibcite{hdfs-main}{2}
\bibcite{turing}{3}
\bibcite{shellpipes}{4}
-\@writefile{lot}{\contentsline {table}{\numberline {I}{\ignorespaces Swift versus Hadoop: Features and Characteristics\relax }}{4}}
-\newlabel{tbl:storage}{{I}{4}}
-\@writefile{lof}{\contentsline {figure}{\numberline {3}{\ignorespaces Setup of SwiftReduce \relax }}{4}}
-\newlabel{fig:swiftreduce}{{3}{4}}
-\@writefile{toc}{\contentsline {subsection}{\numberline {\unhbox \voidb at x \hbox {VIII-B}}Workflow Implementations}{4}}
-\@writefile{toc}{\contentsline {subsection}{\numberline {\unhbox \voidb at x \hbox {VIII-C}}Coupling MapReduce and Workflow}{4}}
-\@writefile{toc}{\contentsline {section}{\numberline {IX}Conclusions and Future Work}{4}}
-\@writefile{toc}{\contentsline {section}{\numberline {X}Acknowledgments}{4}}
-\@writefile{toc}{\contentsline {section}{References}{4}}
\bibcite{friendfoes}{5}
\bibcite{bulkparallel}{6}
\bibcite{marissa}{7}
@@ -57,3 +56,6 @@
\bibcite{cdm}{10}
\@writefile{lof}{\contentsline {figure}{\numberline {4}{\ignorespaces Setup of Combiner \relax }}{5}}
\newlabel{fig:swiftcombiner}{{4}{5}}
+\@writefile{toc}{\contentsline {section}{\numberline {IX}Conclusions and Future Work}{5}}
+\@writefile{toc}{\contentsline {section}{\numberline {X}Acknowledgments}{5}}
+\@writefile{toc}{\contentsline {section}{References}{5}}
Modified: SwiftApps/Swift-MapRed/Paper/swifthadoop.log
===================================================================
--- SwiftApps/Swift-MapRed/Paper/swifthadoop.log 2013-08-22 21:50:43 UTC (rev 6964)
+++ SwiftApps/Swift-MapRed/Paper/swifthadoop.log 2013-08-23 03:17:28 UTC (rev 6965)
@@ -1,4 +1,4 @@
-This is pdfTeX, Version 3.1415926-2.5-1.40.14 (TeX Live 2013/MacPorts 2013_2) (format=pdflatex 2013.8.16) 20 AUG 2013 15:54
+This is pdfTeX, Version 3.1415926-2.5-1.40.14 (TeX Live 2013/MacPorts 2013_2) (format=pdflatex 2013.8.16) 22 AUG 2013 22:16
entering extended mode
restricted \write18 enabled.
%&-line parsing enabled.
@@ -650,12 +650,22 @@
Package pdftex.def Info: fig/combiner.png used on input line 314.
(pdftex.def) Requested size: 289.07999pt x 136.98096pt.
-[3 <./fig/swiftflow.png>]
+<results/hadoop-wc-mcs.png, id=21, 642.4pt x 481.8pt>
+File: results/hadoop-wc-mcs.png Graphic file (type png)
+
+<use results/hadoop-wc-mcs.png>
+Package pdftex.def Info: results/hadoop-wc-mcs.png used on input line 364.
+(pdftex.def) Requested size: 289.07999pt x 216.81534pt.
+
+Overfull \hbox (36.03012pt too wide) in paragraph at lines 364--367
+ []
+ []
+
+[3 <./fig/swiftflow.png> <./results/hadoop-wc-mcs.png>]
Underfull \vbox (badness 1688) has occurred while \output is active []
+ [4 <./fig/swiftreduce.png>] (./swifthadoop.bbl)
-(./swifthadoop.bbl [4 <./fig/swiftreduce.png>])
-
** Conference Paper **
Before submitting the final camera ready copy, remember to:
@@ -666,27 +676,25 @@
uses only Type 1 fonts and that every step in the generation
process uses the appropriate paper size.
-[5
-
- <./fig/combiner.png>] (./swifthadoop.aux) )
+[5 <./fig/combiner.png>] (./swifthadoop.aux) )
Here is how much of TeX's memory you used:
- 14258 strings out of 493041
- 271743 string characters out of 6132992
- 342898 words of memory out of 5000000
- 17444 multiletter control sequences out of 15000+600000
+ 14265 strings out of 493041
+ 271895 string characters out of 6132992
+ 341906 words of memory out of 5000000
+ 17449 multiletter control sequences out of 15000+600000
41156 words of font info for 82 fonts, out of 8000000 for 9000
1176 hyphenation exceptions out of 8191
49i,13n,55p,416b,336s stack positions out of 5000i,500n,10000p,200000b,80000s
-{/opt/local/share/texmf-texlive/fon
-ts/enc/dvips/base/8r.enc}</opt/local/share/texmf-texlive/fonts/type1/public/ams
-fonts/cm/cmsy8.pfb></opt/local/share/texmf-texlive/fonts/type1/urw/times/utmb8a
-.pfb></opt/local/share/texmf-texlive/fonts/type1/urw/times/utmbi8a.pfb></opt/lo
-cal/share/texmf-texlive/fonts/type1/urw/times/utmr8a.pfb></opt/local/share/texm
-f-texlive/fonts/type1/urw/times/utmri8a.pfb>
-Output written on swifthadoop.pdf (5 pages, 190720 bytes).
+{/opt/local/share/texmf-texlive/f
+onts/enc/dvips/base/8r.enc}</opt/local/share/texmf-texlive/fonts/type1/public/a
+msfonts/cm/cmsy8.pfb></opt/local/share/texmf-texlive/fonts/type1/urw/times/utmb
+8a.pfb></opt/local/share/texmf-texlive/fonts/type1/urw/times/utmbi8a.pfb></opt/
+local/share/texmf-texlive/fonts/type1/urw/times/utmr8a.pfb></opt/local/share/te
+xmf-texlive/fonts/type1/urw/times/utmri8a.pfb>
+Output written on swifthadoop.pdf (5 pages, 210267 bytes).
PDF statistics:
- 48 PDF objects out of 1000 (max. 8388607)
+ 49 PDF objects out of 1000 (max. 8388607)
31 compressed objects within 1 object stream
0 named destinations out of 1000 (max. 500000)
- 33 words of extra memory for PDF output out of 10000 (max. 10000000)
+ 38 words of extra memory for PDF output out of 10000 (max. 10000000)
Modified: SwiftApps/Swift-MapRed/Paper/swifthadoop.tex
===================================================================
--- SwiftApps/Swift-MapRed/Paper/swifthadoop.tex 2013-08-22 21:50:43 UTC (rev 6964)
+++ SwiftApps/Swift-MapRed/Paper/swifthadoop.tex 2013-08-23 03:17:28 UTC (rev 6965)
@@ -358,6 +358,16 @@
%Two Hadoopy solutions, Swift and Hadoop implementations of each.
\subsection{Wordcount}
+
+\begin{figure}
+ \begin{center}
+ \includegraphics[width=4in]{results/hadoop-wc-mcs.png}
+ \caption{Hadoop wordcount results with HDFS on RAMdisk and localdisk on a 10-workstation cluster
+ \label{fig:wc}
+ }
+\end{center}
+\end{figure}
+hadoop-wc-mcs.png
%Hadoop implementation.
%Swift implementation.
More information about the Swift-commit
mailing list