[Swift-commit] r6803 - in SwiftApps/Scattering/paintgrid: . docs
davidk at ci.uchicago.edu
davidk at ci.uchicago.edu
Thu Aug 8 13:08:53 CDT 2013
Author: davidk
Date: 2013-08-08 13:08:53 -0500 (Thu, 08 Aug 2013)
New Revision: 6803
Added:
SwiftApps/Scattering/paintgrid/docs/
SwiftApps/Scattering/paintgrid/docs/README
SwiftApps/Scattering/paintgrid/docs/README.old
SwiftApps/Scattering/paintgrid/docs/build_docs.sh
Removed:
SwiftApps/Scattering/paintgrid/README
SwiftApps/Scattering/paintgrid/run-paintgrid
SwiftApps/Scattering/paintgrid/run-remote-persist.sh
SwiftApps/Scattering/paintgrid/sites-used
SwiftApps/Scattering/paintgrid/start-tunnels
SwiftApps/Scattering/paintgrid/tssh
Log:
Start of new doc structure and some cleanup
Deleted: SwiftApps/Scattering/paintgrid/README
===================================================================
--- SwiftApps/Scattering/paintgrid/README 2013-08-08 17:03:00 UTC (rev 6802)
+++ SwiftApps/Scattering/paintgrid/README 2013-08-08 18:08:53 UTC (rev 6803)
@@ -1,50 +0,0 @@
-Demo / tutorial application to mimic the needs of the PaintGrid application
-===========================================================================
-
-Setup:
-
- $ PATH=/clhome/WILDE/swift/rev/swift-0.94.1/bin:$PATH
-
-Create a test data file:
-
- $ dd bs=8M count=1 if=/dev/zero of=data.0001.tif
- $ dd bs=800 count=1 if=/dev/zero of=data.0001.tiny
-
-Run the Swift script:
-
- $ mkdir ~/swift
- $ cp swift.properties ~/.swift
-
- $ swift -tc.file apps -sites.file amd.xml paintgrid.swift -runDir=$PWD -params=genpoints.params -image=data.0001.tiny
-
-
-
-TODO:
-
-Execution scenarios:
-
- run.local.sh
-
- run.beagle.sh
-
- run.midway.sh
-
- run.midway+beagle.sh
-
- run.blues.sh
-
- run.orthros.sh
-
-
-Data transfer models:
-
-- provider staging without caching
-
-- provider staging with ad-hoc caching of big common files
-
-- gridftp staging
-
-- ssh (scp) staging
-
-- wrapper staging with scp and caching
-
Copied: SwiftApps/Scattering/paintgrid/docs/README (from rev 6800, SwiftApps/Scattering/paintgrid/README)
===================================================================
--- SwiftApps/Scattering/paintgrid/docs/README (rev 0)
+++ SwiftApps/Scattering/paintgrid/docs/README 2013-08-08 18:08:53 UTC (rev 6803)
@@ -0,0 +1,50 @@
+Demo / tutorial application to mimic the needs of the PaintGrid application
+===========================================================================
+
+Setup:
+
+ $ PATH=/clhome/WILDE/swift/rev/swift-0.94.1/bin:$PATH
+
+Create a test data file:
+
+ $ dd bs=8M count=1 if=/dev/zero of=data.0001.tif
+ $ dd bs=800 count=1 if=/dev/zero of=data.0001.tiny
+
+Run the Swift script:
+
+ $ mkdir ~/swift
+ $ cp swift.properties ~/.swift
+
+ $ swift -tc.file apps -sites.file amd.xml paintgrid.swift -runDir=$PWD -params=genpoints.params -image=data.0001.tiny
+
+
+
+TODO:
+
+Execution scenarios:
+
+ run.local.sh
+
+ run.beagle.sh
+
+ run.midway.sh
+
+ run.midway+beagle.sh
+
+ run.blues.sh
+
+ run.orthros.sh
+
+
+Data transfer models:
+
+- provider staging without caching
+
+- provider staging with ad-hoc caching of big common files
+
+- gridftp staging
+
+- ssh (scp) staging
+
+- wrapper staging with scp and caching
+
Copied: SwiftApps/Scattering/paintgrid/docs/README.old (from rev 6800, SwiftApps/Scattering/paintgrid/README)
===================================================================
--- SwiftApps/Scattering/paintgrid/docs/README.old (rev 0)
+++ SwiftApps/Scattering/paintgrid/docs/README.old 2013-08-08 18:08:53 UTC (rev 6803)
@@ -0,0 +1,50 @@
+Demo / tutorial application to mimic the needs of the PaintGrid application
+===========================================================================
+
+Setup:
+
+ $ PATH=/clhome/WILDE/swift/rev/swift-0.94.1/bin:$PATH
+
+Create a test data file:
+
+ $ dd bs=8M count=1 if=/dev/zero of=data.0001.tif
+ $ dd bs=800 count=1 if=/dev/zero of=data.0001.tiny
+
+Run the Swift script:
+
+ $ mkdir ~/swift
+ $ cp swift.properties ~/.swift
+
+ $ swift -tc.file apps -sites.file amd.xml paintgrid.swift -runDir=$PWD -params=genpoints.params -image=data.0001.tiny
+
+
+
+TODO:
+
+Execution scenarios:
+
+ run.local.sh
+
+ run.beagle.sh
+
+ run.midway.sh
+
+ run.midway+beagle.sh
+
+ run.blues.sh
+
+ run.orthros.sh
+
+
+Data transfer models:
+
+- provider staging without caching
+
+- provider staging with ad-hoc caching of big common files
+
+- gridftp staging
+
+- ssh (scp) staging
+
+- wrapper staging with scp and caching
+
Added: SwiftApps/Scattering/paintgrid/docs/build_docs.sh
===================================================================
--- SwiftApps/Scattering/paintgrid/docs/build_docs.sh (rev 0)
+++ SwiftApps/Scattering/paintgrid/docs/build_docs.sh 2013-08-08 18:08:53 UTC (rev 6803)
@@ -0,0 +1,4 @@
+#!/bin/bash -e
+
+# This assumes that docs will be built on communicado or bridled
+~davidk/asciidoc-8.6.4/asciidoc -a toc -a toplevels=2 -a stylesheet=~davidk/swift-0.94/cog/modules/swift/docs/stylesheets/asciidoc.css -a max-width=800px -o tutorial.html README
Deleted: SwiftApps/Scattering/paintgrid/run-paintgrid
===================================================================
--- SwiftApps/Scattering/paintgrid/run-paintgrid 2013-08-08 17:03:00 UTC (rev 6802)
+++ SwiftApps/Scattering/paintgrid/run-paintgrid 2013-08-08 18:08:53 UTC (rev 6803)
@@ -1,9 +0,0 @@
-#! /bin/sh
-
-PATH=/clhome/WILDE/swift/rev/swift-0.94.1/bin:$PATH
-
-export GLOBUS_HOSTNAME=localhost
-export GLOBUS_TCP_PORT_RANGE=59900,59909
-export GLOBUS_TCP_SOURCE_RANGE=59900,59909
-
-swift paintgrid.swift -params=genpoints.params -image=data.0001.tiny -runTime=0.0001
Deleted: SwiftApps/Scattering/paintgrid/run-remote-persist.sh
===================================================================
--- SwiftApps/Scattering/paintgrid/run-remote-persist.sh 2013-08-08 17:03:00 UTC (rev 6802)
+++ SwiftApps/Scattering/paintgrid/run-remote-persist.sh 2013-08-08 18:08:53 UTC (rev 6803)
@@ -1,52 +0,0 @@
-swift$ cat run-persist.sh
-#! /bin/sh
-
-# Start a persistent swift coaster service, capturing its port # in portfile
-
-portfile=$(mktemp portfile.XXXX)
-coaster-service -portfile $portfile -nosec >& coaster.log &
-coasterpid=$!
-sleep 5 # Wait for the service to record its port
-port=$(cat $portfile)
-
-# Report the coaster service port and process id
-
-echo coaster pid: $coasterpid port: $port
-echo $coasterpid >coasterpid
-echo started coaster service:
-ps -p $coasterpid --ppid $coasterpid -H -j # display parent shell and java child processes
-
-# Create a sites file pointing to the service we just started
-
-cat >sites.xml <<END
-<config>
- <pool handle="cluster">
- <execution provider="coaster-persistent" url="http://localhost:$port" jobmanager="local:slurm"/>
- <profile namespace="globus" key="jobsPerNode">4</profile>
- <profile namespace="globus" key="ppn">16</profile>
- <profile namespace="globus" key="slots">1</profile>
- <profile namespace="globus" key="maxnodes">1</profile>
- <profile namespace="globus" key="nodegranularity">1</profile>
- <profile namespace="globus" key="maxWalltime">00:01:00</profile>
- <profile namespace="globus" key="walltime">600</profile>
- <profile namespace="globus" key="highOverAllocation">100</profile>
- <profile namespace="globus" key="lowOverAllocation">100</profile>
- <profile namespace="globus" key="queue">sandyb</profile>
- <profile namespace="karajan" key="jobThrottle">1.00</profile>
- <profile namespace="karajan" key="initialScore">10000</profile>
- <profile namespace="globus" key="jobtype">single</profile>
- <profile namespace="globus" key="slurm.exclusive">true</profile>
- <filesystem provider="local"/>
- <workdirectory>/scratch/midway/{env.USER}/work</workdirectory>
- </pool>
-</config>
-END
-
-# Now run several Swift scripts, one at a time, just like MD_String will do
-
-NUM_SWIFT_RUNS=$1
-for ((i=0;i<$NUM_SWIFT_RUNS;i++)); do
- set -x
- swift -sites.file sites.xml -tc.file tc.intelmpi -config cf mpicatnap.swift -n=${2:-1} -t=${3:-2}
- set +x
-done
Deleted: SwiftApps/Scattering/paintgrid/sites-used
===================================================================
--- SwiftApps/Scattering/paintgrid/sites-used 2013-08-08 17:03:00 UTC (rev 6802)
+++ SwiftApps/Scattering/paintgrid/sites-used 2013-08-08 18:08:53 UTC (rev 6803)
@@ -1,3 +0,0 @@
-#! /bin/sh
-
-for l in $(/bin/ls -1t paint*.log) ; do echo $l; ./stats $l | grep -v localhost ; done | more
Deleted: SwiftApps/Scattering/paintgrid/start-tunnels
===================================================================
--- SwiftApps/Scattering/paintgrid/start-tunnels 2013-08-08 17:03:00 UTC (rev 6802)
+++ SwiftApps/Scattering/paintgrid/start-tunnels 2013-08-08 18:08:53 UTC (rev 6803)
@@ -1,11 +0,0 @@
-ssh -n -N login1.beagle.ci.uchicago.edu \
- -R 59900:orthros.xray.aps.anl.gov:59900 \
- -R 59901:orthros.xray.aps.anl.gov:59901 \
- -R 59902:orthros.xray.aps.anl.gov:59902 \
- -R 59903:orthros.xray.aps.anl.gov:59903 \
- -R 59904:orthros.xray.aps.anl.gov:59904 \
- -R 59905:orthros.xray.aps.anl.gov:59905 \
- -R 59906:orthros.xray.aps.anl.gov:59906 \
- -R 59907:orthros.xray.aps.anl.gov:59907 \
- -R 59908:orthros.xray.aps.anl.gov:59908 \
- -R 59909:orthros.xray.aps.anl.gov:59909
Deleted: SwiftApps/Scattering/paintgrid/tssh
===================================================================
--- SwiftApps/Scattering/paintgrid/tssh 2013-08-08 17:03:00 UTC (rev 6802)
+++ SwiftApps/Scattering/paintgrid/tssh 2013-08-08 18:08:53 UTC (rev 6803)
@@ -1,3 +0,0 @@
-# ssh login1.beagle.ci.uchicago.edu -L 59900:localhost:59900 'sleep 1234'
- ssh -n login1.beagle.ci.uchicago.edu 'sleep 1234 & echo $!; exit'
-
More information about the Swift-commit
mailing list