[Swift-commit] r3368 - text/parco10submission

noreply at svn.ci.uchicago.edu noreply at svn.ci.uchicago.edu
Tue Jun 15 16:49:55 CDT 2010


Author: wozniak
Date: 2010-06-15 16:49:55 -0500 (Tue, 15 Jun 2010)
New Revision: 3368

Modified:
   text/parco10submission/paper.tex
Log:
Move FS notes


Modified: text/parco10submission/paper.tex
===================================================================
--- text/parco10submission/paper.tex	2010-06-15 21:44:50 UTC (rev 3367)
+++ text/parco10submission/paper.tex	2010-06-15 21:49:55 UTC (rev 3368)
@@ -837,24 +837,6 @@
 jobs) is delayed (in the worst case, activity dependant on the first job
 in a cluster must wait for all of the jobs to run).
 
-%%% Move this to Future Work
-
-%% \subsection{Avoiding filesystem inefficiency}
-
-%% When running a large number of jobs on a site at once, access to the
-%% shared filesystem on that site can be a bottleneck.
-
-%% On large systems, the shared file system is commonly provided by
-%% GPFS\cite{GPFS}. This can scale well but when used na\"ively can
-%% exhibit pathological behaviour. Early versions of Swift triggered this
-%% behaviour by targetting too much file system activity at a single
-%% working directory, so that GPFS lock contention came to dominate execution
-%% time.
-
-%% TODO more... - work done on arranging things in fs; presumably can
-%% forwardref collective IO section if that gets written, or include that
-%% entire section here?
-
 \subsection{Features to support use on dynamic resources}
 
 Using Swift to submit to a large number of sites poses a number of
@@ -1225,11 +1207,14 @@
 
 \subsection{Collective IO}
 
-  TODO: I don't actually grasp what is going on here (as in wtf is
-collective IO?), let alone what is going on that is "interesting", and
-would need a much better understanding of before I could write about it
-(let alone write about it in relation to Swift)
+%% On large systems, the shared file system is commonly provided by
+%% GPFS\cite{GPFS}. This can scale well but when used na\"ively can
+%% exhibit pathological behaviour. Early versions of Swift triggered this
+%% behaviour by targetting too much file system activity at a single
+%% working directory, so that GPFS lock contention came to dominate execution
+%% time.
 
+
 \subsection{Language development}
 
   TODO: describe how it becomes more functional as time passes, as is




More information about the Swift-commit mailing list