[Swift-commit] r6479 - in demo/cray/swift-1.0: . part08-cray-loop
wilde at ci.uchicago.edu
wilde at ci.uchicago.edu
Thu Apr 18 13:05:18 CDT 2013
Author: wilde
Date: 2013-04-18 13:05:17 -0500 (Thu, 18 Apr 2013)
New Revision: 6479
Modified:
demo/cray/swift-1.0/part08-cray-loop/README
demo/cray/swift-1.0/setup.sh
Log:
set provider staging as default; provide instructions for switching to CDM DIRECT.
Modified: demo/cray/swift-1.0/part08-cray-loop/README
===================================================================
--- demo/cray/swift-1.0/part08-cray-loop/README 2013-04-18 17:46:54 UTC (rev 6478)
+++ demo/cray/swift-1.0/part08-cray-loop/README 2013-04-18 18:05:17 UTC (rev 6479)
@@ -36,15 +36,11 @@
$ swift p8.swift -nsim=10 -steps=5 -range=1000 -count=5
-Regular staging with direct data management:
+!!! STOP HERE - remaining needs adjustments
- swift -config cf -tc.file apps -sites.file cray.xml -cdm.file dmrules p8.swift -steps=1 -range=1000 -count=6 -nsim=100
-Provider staging:
+Next, you can experiment with different size runs:
- swift -config cf.ps -tc.file apps -sites.file ravenps.xml p8.swift -steps=5 -range=1000 -count=6 -nsim=100
-
-
Adjust the job sizes:
<profile namespace="globus" key="slots">6</profile>
@@ -52,6 +48,25 @@
<profile namespace="globus" key="maxNodes">4</profile>
+
+
+
+In these runs, Swift was moving data to and from the data/ directory by
+staging to the compute node local (RAM) filesystem. For some workflows its
+better to bypass staging and access all input and output files directly.
+
+We do this by specifying a "data management rules" file on the command line
+and turning off staging to the local filesystem:
+
+ $ sed -i -e '/SET PROVIDER STAGING/s/=true/=false/p' $HOME/.swift/swift.properties
+
+Now run the script with "direct" data acces
+
+ swift -sites.file ravenps.xml -cdm.file dmrules p8.swift -steps=1 -range=1000 -count=6 -nsim=10
+
+
+
+
The app list
Modified: demo/cray/swift-1.0/setup.sh
===================================================================
--- demo/cray/swift-1.0/setup.sh 2013-04-18 17:46:54 UTC (rev 6478)
+++ demo/cray/swift-1.0/setup.sh 2013-04-18 18:05:17 UTC (rev 6479)
@@ -39,6 +39,6 @@
provider.staging.pin.swiftfiles=true
# Edit this line to change data management mode:
-use.provider.staging=true
+use.provider.staging=true # SET PROVIDER STAGING
END
More information about the Swift-commit
mailing list