[Swift-commit] r4060 - SwiftApps/SwiftR

[noreply at svn.ci.uchicago.edu]

Author: tga
Date: 2011-02-04 12:08:57 -0600 (Fri, 04 Feb 2011)
New Revision: 4060

Added:
   SwiftApps/SwiftR/IMMEDIATE-TODO
Log:
Checking in prioritised TODO list


Added: SwiftApps/SwiftR/IMMEDIATE-TODO
===================================================================
--- SwiftApps/SwiftR/IMMEDIATE-TODO	                        (rev 0)
+++ SwiftApps/SwiftR/IMMEDIATE-TODO	2011-02-04 18:08:57 UTC (rev 4060)
@@ -0,0 +1,75 @@
+
+HIGH:
+-- Test pbsf (on PADS?)
+
+HIGH:
+in swift.properties we should make sure we dont return info logs we should make sure that the amount of logging on both the worker side and the client side is as low as it can go
+* Turn off bashrc processing, etc shell script
+
+HIGH:
+- tests
+-- simple calibration tests (n args, arg sizes, durations, etc)
+-- openmx tests
+  --- OmxParallelCI
+  --- OmxParallelBootstrap
+
+HIGH:
+- perf approach
+ -- socket?
+ -- swift fast branch?
+ -- swift times?
+ -- micro studies on provider staging etc.
+ 
+HIGH:
+  - maybe needed for Bigger parallel bootstrp
+ Look at all OmxNNN parallel calls - see if any are used that we dont yet handle.
+
+MID:
+- saner approach to channels: channel per request to avoid the issue
+    of what happens if a "done" is never read
+
+MID:
+- Wiki: screen
+
+MID:
+- startup notes from Tim Bates
+ -- rlib rpackage sugg   
+ 
+MID:
+- SGE for Tim bates
+ -- ranger -- needs accounts
+ -- ibi
+ -- siraf
+ -- godzilla (if updated)
+
+MID:
+- user testing in general (ssh, pbs, sge) 
+* SGE testing: ranger, siraf (low priority)
+
+LOW: (unless needed by immediate OpenMx app or test)
+- complete sf compat functions (sapply, lapply -> for openMx, based on usage)
+
+LOW:
+- run modes
+ -- workspace stays up, server(s) are transient-> current
+ -- workspace is run as a job under batch scheduler -> new feature
+
+LOW: 
+-- perf issue wrt arg list copies (very low prio)
+
+LOW:
+- Batch option: number of jobs
+
+LOW:
+ idea:
+* swiftInit() should wait until batch job is submitted successfully, or
+    at least one ssh client starts correctly
+
+LOW:
+* swiftStat to check state of worker processes
+
+LOW:
+* feasibility of multithreaded server:
+    - each request provides a reply channel
+    - swift server forks off a worker thread for
+        each request