[Swift-commit] r6479 - in demo/cray/swift-1.0: . part08-cray-loop

wilde at ci.uchicago.edu wilde at ci.uchicago.edu
Thu Apr 18 13:05:18 CDT 2013


Author: wilde
Date: 2013-04-18 13:05:17 -0500 (Thu, 18 Apr 2013)
New Revision: 6479

Modified:
   demo/cray/swift-1.0/part08-cray-loop/README
   demo/cray/swift-1.0/setup.sh
Log:
set provider staging as default; provide instructions for switching to CDM DIRECT.

Modified: demo/cray/swift-1.0/part08-cray-loop/README
===================================================================
--- demo/cray/swift-1.0/part08-cray-loop/README	2013-04-18 17:46:54 UTC (rev 6478)
+++ demo/cray/swift-1.0/part08-cray-loop/README	2013-04-18 18:05:17 UTC (rev 6479)
@@ -36,15 +36,11 @@
   $ swift p8.swift -nsim=10 -steps=5 -range=1000 -count=5 
 
 
-Regular staging with direct data management:
+!!! STOP HERE - remaining needs adjustments
 
-  swift -config cf -tc.file apps -sites.file cray.xml -cdm.file dmrules p8.swift -steps=1 -range=1000 -count=6 -nsim=100
 
-Provider staging:
+Next, you can experiment with different size runs:
 
-  swift -config cf.ps -tc.file apps -sites.file ravenps.xml p8.swift -steps=5 -range=1000 -count=6 -nsim=100
-
-
 Adjust the job sizes:
 
     <profile namespace="globus" key="slots">6</profile>
@@ -52,6 +48,25 @@
     <profile namespace="globus" key="maxNodes">4</profile>
 
 
+
+
+
+In these runs, Swift was moving data to and from the data/ directory by
+staging to the compute node local (RAM) filesystem. For some workflows its
+better to bypass staging and access all input and output files directly.
+
+We do this by specifying a "data management rules" file on the command line
+and turning off staging to the local filesystem:
+
+  $ sed -i -e '/SET PROVIDER STAGING/s/=true/=false/p' $HOME/.swift/swift.properties
+
+Now run the script with "direct" data acces
+
+  swift -sites.file ravenps.xml -cdm.file dmrules p8.swift -steps=1 -range=1000 -count=6 -nsim=10
+
+
+
+
 The app list 
 
 

Modified: demo/cray/swift-1.0/setup.sh
===================================================================
--- demo/cray/swift-1.0/setup.sh	2013-04-18 17:46:54 UTC (rev 6478)
+++ demo/cray/swift-1.0/setup.sh	2013-04-18 18:05:17 UTC (rev 6479)
@@ -39,6 +39,6 @@
 provider.staging.pin.swiftfiles=true
 
 # Edit this line to change data management mode:
-use.provider.staging=true
+use.provider.staging=true  # SET PROVIDER STAGING
 
 END




More information about the Swift-commit mailing list