[Swift-commit] r3333 - text/internals/trunk

[noreply at svn.ci.uchicago.edu]

Author: aespinosa
Date: 2010-05-21 15:15:34 -0500 (Fri, 21 May 2010)
New Revision: 3333

Modified:
   text/internals/trunk/internals.tex
Log:
Last week's notes

Modified: text/internals/trunk/internals.tex
===================================================================
--- text/internals/trunk/internals.tex	2010-05-13 19:51:27 UTC (rev 3332)
+++ text/internals/trunk/internals.tex	2010-05-21 20:15:34 UTC (rev 3333)
@@ -361,4 +361,66 @@
 s=vdl:new(...)
 vdl:setfieldvalue(s, "x")
 
+\section{vdl:execute}
+
+vdl:tr - looks at the tc.data for program translation (not really).  somehow
+passes this deep down.  a wrapper that gets delegated down the line.
+
+vdl.k line 49 - decides which runmode to do.
+
+swift (runmode) - dryrun, normal, etc.
+
+different implementations delegated by vdl:execute execute-*.k files
+
+\section{Lazy errors}
+
+Poisoning vdl:closedataset
+
+\section{vdl:execute2}
+
+1.  staging setup/ retrieving
+2.  initialize job directories
+2.5 allocate a sie via allocateHost()
+3.  initialize shared dirs (if not already initialized)
+4.  create job directories.  job input file directories -> a.out a/x.txt b/y.txt
+   jobdir:
+  a/x.txt
+  b/b.txt
+
+5.  stage-in (parallel via uParallelFor)
+
+vdl:execute - used to be a plain karajan task:execute .  different from the
+outer vdl:execute
+
+gt2 option = status.mode = provider | files
+
+provider staging = not implemented
+
+a. status: files/ providers
+b. parameters: files/ providers
+
+6.  actual execute
+7.  check status
+7.5 transfer stdout/stderr/info/kickstart
+8.  stageout
+
+\section{uParallelFor vs parallel vs foreach.max.threads}
+
+\subsection{parallel}
+
+parallel(1,2) == (1,2) -> has some efficient barrier thing inside
+  - takes  more memory - storing ordering information
+
+\subsetion{uparallel}
+uParallel(1,2) -> (1,2) or (2,1)
+  - saves on memory usage
+
+\section{Replication groups}
+
+\section{Restarting}
+
+\section{Scheduler}
+
+\section{Coasters}
+
 \end{document}