[Swift-commit] r5237 - in trunk/tests: . groups stress stress/persistent-coasters stress/persistent-coasters/many-jobs stress/persistent-coasters/mcs stress/persistent-coasters/mcs/10x10 stress/persistent-coasters/mcs/500x10 stress/persistent-coasters/pass-fail-pass
davidk at ci.uchicago.edu
davidk at ci.uchicago.edu
Mon Oct 17 10:44:28 CDT 2011
Author: davidk
Date: 2011-10-17 10:44:28 -0500 (Mon, 17 Oct 2011)
New Revision: 5237
Added:
trunk/tests/groups/group-stress.sh
trunk/tests/stress/
trunk/tests/stress/persistent-coasters/
trunk/tests/stress/persistent-coasters/many-jobs/
trunk/tests/stress/persistent-coasters/many-jobs/catsn.0001.out.expected
trunk/tests/stress/persistent-coasters/many-jobs/catsn.0002.out.expected
trunk/tests/stress/persistent-coasters/many-jobs/catsn.0003.out.expected
trunk/tests/stress/persistent-coasters/many-jobs/catsn.0004.out.expected
trunk/tests/stress/persistent-coasters/many-jobs/catsn.0005.out.expected
trunk/tests/stress/persistent-coasters/many-jobs/catsn.0006.out.expected
trunk/tests/stress/persistent-coasters/many-jobs/catsn.0007.out.expected
trunk/tests/stress/persistent-coasters/many-jobs/catsn.0008.out.expected
trunk/tests/stress/persistent-coasters/many-jobs/catsn.0009.out.expected
trunk/tests/stress/persistent-coasters/many-jobs/catsn.repeat
trunk/tests/stress/persistent-coasters/many-jobs/catsn.setup.sh
trunk/tests/stress/persistent-coasters/many-jobs/catsn.swift
trunk/tests/stress/persistent-coasters/many-jobs/catsn.timeout
trunk/tests/stress/persistent-coasters/many-jobs/coaster-service.conf
trunk/tests/stress/persistent-coasters/many-jobs/data.txt
trunk/tests/stress/persistent-coasters/mcs/
trunk/tests/stress/persistent-coasters/mcs/10x10/
trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.check.sh
trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.clean.sh
trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.setup.sh
trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.swift
trunk/tests/stress/persistent-coasters/mcs/10x10/coaster-service.conf
trunk/tests/stress/persistent-coasters/mcs/10x10/gendata.pl
trunk/tests/stress/persistent-coasters/mcs/500x10/
trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.check.sh
trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.clean.sh
trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.setup.sh
trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.swift
trunk/tests/stress/persistent-coasters/mcs/500x10/coaster-service.conf
trunk/tests/stress/persistent-coasters/mcs/500x10/gendata.pl
trunk/tests/stress/persistent-coasters/pass-fail-pass/
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0001.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0002.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0003.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0004.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0005.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0006.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0007.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0008.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0009.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.setup.sh
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.swift
trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.timeout
trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0001.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0002.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0003.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0004.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0005.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0006.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0007.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0008.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0009.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.swift
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0001.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0002.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0003.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0004.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0005.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0006.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0007.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0008.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0009.out.expected
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.setup.sh
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.swift
trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.timeout
trunk/tests/stress/persistent-coasters/pass-fail-pass/coaster-service.conf
trunk/tests/stress/persistent-coasters/pass-fail-pass/data.txt
trunk/tests/stress/persistent-coasters/pass-fail-pass/sites.template.xml
Log:
Adding stress tests to trunk
Added: trunk/tests/groups/group-stress.sh
===================================================================
--- trunk/tests/groups/group-stress.sh (rev 0)
+++ trunk/tests/groups/group-stress.sh 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,9 @@
+
+# GROUPLIST definition to run all local tests
+
+GROUPLIST=(
+ $TESTDIR/stress/persistent-coasters/many-jobs \
+ $TESTDIR/stress/persistent-coasters/pass-fail-pass \
+ )
+
+checkvars WORK
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.0001.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.0001.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.0001.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.0002.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.0002.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.0002.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.0003.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.0003.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.0003.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.0004.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.0004.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.0004.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.0005.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.0005.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.0005.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.0006.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.0006.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.0006.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.0007.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.0007.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.0007.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.0008.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.0008.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.0008.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.0009.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.0009.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.0009.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.repeat
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.repeat (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.repeat 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+1000
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.setup.sh
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.setup.sh (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.setup.sh 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,4 @@
+#!/bin/bash
+
+cp $GROUP/coaster-service.conf .
+cp $GROUP/data.txt .
Property changes on: trunk/tests/stress/persistent-coasters/many-jobs/catsn.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.swift
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.swift (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.swift 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,12 @@
+type file;
+
+app (file o) cat (file i)
+{
+ cat @i stdout=@o;
+}
+
+file out[]<simple_mapper; location=".", prefix="catsn.",suffix=".out">;
+foreach j in [1:@toint(@arg("n","10"))] {
+ file data<"data.txt">;
+ out[j] = cat(data);
+}
Added: trunk/tests/stress/persistent-coasters/many-jobs/catsn.timeout
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/catsn.timeout (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/catsn.timeout 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+999999
Added: trunk/tests/stress/persistent-coasters/many-jobs/coaster-service.conf
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/coaster-service.conf (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/coaster-service.conf 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,42 @@
+# Keep all interesting settings in one place
+# User should modify this to fit environment
+
+# Location of SWIFT. If empty, PATH is searched
+export SWIFT=
+
+# Where to copy worker.pl on the remote machine for sites.xml
+export WORKER_WORK=$HOME/swiftwork
+
+# How to launch workers: local, ssh, cobalt, or futuregrid
+export WORKER_MODE=ssh
+
+# SSH hosts to start workers on (ssh mode only)
+export WORKER_HOSTS="localhost"
+
+# Do all the worker nodes you're using have a shared filesystem? (yes/no)
+export SHARED_FILESYSTEM=yes
+
+# Username to use on worker nodes
+export WORKER_USERNAME=$USER
+
+# Enable SSH tunneling? (yes/no)
+export SSH_TUNNELING=no
+
+# Directory to keep log files, relative to working directory when launching start-coaster-service
+export LOG_DIR=logs
+
+# Manually define ports. If not specified, an available port will be used
+export LOCAL_PORT=
+export SERVICE_PORT=
+
+# start-coaster-service tries to automatically detect the IP address of this system. Specify here if you have multiple network interfaces
+export IPADDR=
+
+# Location of the swift-vm-boot scripts
+export SWIFTVMBOOT_DIR=$HOME/swift-vm-boot
+
+# Swift information for creating sites.xml
+export WORK=$HOME/swiftwork
+export QUEUE=prod-devel
+export MAXTIME=20
+export NODE=64
Added: trunk/tests/stress/persistent-coasters/many-jobs/data.txt
===================================================================
--- trunk/tests/stress/persistent-coasters/many-jobs/data.txt (rev 0)
+++ trunk/tests/stress/persistent-coasters/many-jobs/data.txt 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.check.sh
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.check.sh (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.check.sh 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,17 @@
+#!/bin/bash
+
+for file in `ls data/tmp.*|grep -v out`
+do
+ if [ ! -f "$file.out" ]; then
+ echo $file.out was not created
+ exit 1
+ fi
+
+ FILE_SUM=`sum $data/$file`
+ OUT_SUM=`sum $data/$file.out`
+
+ if [ "$FILE_SUM" != "$OUT_SUM" ]; then
+ echo Checksums of $file and $file.out are not the same
+ exit 1
+ fi
+done
Property changes on: trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.check.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.clean.sh
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.clean.sh (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.clean.sh 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,4 @@
+#!/bin/bash
+
+rm data/tmp.*
+stop-coaster-service
Property changes on: trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.clean.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.setup.sh
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.setup.sh (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.setup.sh 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,18 @@
+#!/bin/bash
+
+NUMFILES=10
+FILESIZE=10
+FILESIZE=$(($FILESIZE*1000000))
+
+if [ -n "$GROUP" ]; then
+ cp $RUNDIR/* .
+fi
+
+mkdir -p data
+for count in `seq 1 $NUMFILES`
+do
+ FILENAME=`mktemp -p data`
+ ./gendata.pl $FILESIZE > $FILENAME
+done
+
+start-coaster-service
Property changes on: trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.swift
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.swift (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/10x10/catsn_random.swift 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,13 @@
+type file;
+
+app (file o) cat (file i)
+{
+ cat @i stdout=@o;
+}
+
+file input_files[]<filesys_mapper; location="data", pattern="tmp.*">;
+
+foreach j in input_files {
+ file output<single_file_mapper; location="data", file=@strcat(@filename(j), ".out")>;
+ output = cat(j);
+}
Added: trunk/tests/stress/persistent-coasters/mcs/10x10/coaster-service.conf
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/10x10/coaster-service.conf (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/10x10/coaster-service.conf 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,43 @@
+# Keep all interesting settings in one place
+# User should modify this to fit environment
+
+# Location of SWIFT. If empty, PATH is referenced
+export SWIFT=
+
+# Where to place/launch worker.pl on the remote machine
+export WORKER_WORK=/nfs/proj-davidk/swiftwork
+
+# How to launch workers: local, ssh, futuregrid, or cobalt
+export WORKER_MODE=ssh
+export WORKER_USERNAME=$USER
+
+# Worker host names for ssh
+export WORKER_HOSTS="crush.mcs.anl.gov thwomp.mcs.anl.gov stomp.mcs.anl.gov crank.mcs.anl.gov
+steamroller.mcs.anl.gov grind.mcs.anl.gov churn.mcs.anl.gov trounce.mcs.anl.gov
+thrash.mcs.anl.gov vanquish.mcs.anl.gov"
+
+# Directory to keep log files, relative to working directory when launching start-coaster-service
+export LOG_DIR=logs
+
+# Manually define ports. If not specified, ports will be automatically generated
+export LOCAL_PORT=
+export SERVICE_PORT=
+
+# start-coaster-service tries to automatically detect IP address.
+# Specify here if auto detection is not working correctly
+export IPADDR=
+
+# Gensites values
+export WORK=$HOME/work
+
+# If SHARED_FILESYSTEM is set to no, provider staging will be turned on
+export SHARED_FILESYSTEM=no
+
+# If running outside of mcs network, set WORKER_RELAY_HOST below
+# export WORKER_RELAY_HOST="login.mcs.anl.gov"
+
+export WORKER_LOGGING_LEVEL=DEBUG
+export WORKER_LOG_DIR="/nfs/proj-davidk/logs"
+
+# Set applications here
+#app cat=/bin/cat
Added: trunk/tests/stress/persistent-coasters/mcs/10x10/gendata.pl
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/10x10/gendata.pl (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/10x10/gendata.pl 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,21 @@
+#!/usr/bin/perl
+
+use strict;
+
+my @characters=('a'..'z', 'A'..'Z', '0'..'9');
+my $string="";
+my $length = $ARGV[0];
+my $width_count=0;
+
+foreach (1..$length)
+{
+ if($width_count == 80) {
+ $string .= "\n";
+ $width_count=0;
+ next;
+ }
+ $string .= $characters[rand @characters];
+ $width_count++;
+}
+
+print $string;
Property changes on: trunk/tests/stress/persistent-coasters/mcs/10x10/gendata.pl
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.check.sh
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.check.sh (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.check.sh 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,17 @@
+#!/bin/bash
+
+for file in `ls data/tmp.*|grep -v out`
+do
+ if [ ! -f "$file.out" ]; then
+ echo $file.out was not created
+ exit 1
+ fi
+
+ FILE_SUM=`sum $data/$file`
+ OUT_SUM=`sum $data/$file.out`
+
+ if [ "$FILE_SUM" != "$OUT_SUM" ]; then
+ echo Checksums of $file and $file.out are not the same
+ exit 1
+ fi
+done
Property changes on: trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.check.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.clean.sh
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.clean.sh (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.clean.sh 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,4 @@
+#!/bin/bash
+
+rm data/tmp.*
+stop-coaster-service
Property changes on: trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.clean.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.setup.sh
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.setup.sh (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.setup.sh 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,18 @@
+#!/bin/bash
+
+NUMFILES=500
+FILESIZE=10
+FILESIZE=$(($FILESIZE*1000000))
+
+if [ -n "$GROUP" ]; then
+ cp $RUNDIR/* .
+fi
+
+mkdir -p data
+for count in `seq 1 $NUMFILES`
+do
+ FILENAME=`mktemp -p data`
+ ./gendata.pl $FILESIZE > $FILENAME
+done
+
+start-coaster-service
Property changes on: trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.swift
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.swift (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/500x10/catsn_random.swift 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,13 @@
+type file;
+
+app (file o) cat (file i)
+{
+ cat @i stdout=@o;
+}
+
+file input_files[]<filesys_mapper; location="data", pattern="tmp.*">;
+
+foreach j in input_files {
+ file output<single_file_mapper; location="data", file=@strcat(@filename(j), ".out")>;
+ output = cat(j);
+}
Added: trunk/tests/stress/persistent-coasters/mcs/500x10/coaster-service.conf
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/500x10/coaster-service.conf (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/500x10/coaster-service.conf 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,43 @@
+# Keep all interesting settings in one place
+# User should modify this to fit environment
+
+# Location of SWIFT. If empty, PATH is referenced
+export SWIFT=
+
+# Where to place/launch worker.pl on the remote machine
+export WORKER_WORK=/nfs/proj-davidk/swiftwork
+
+# How to launch workers: local, ssh, futuregrid, or cobalt
+export WORKER_MODE=ssh
+export WORKER_USERNAME=$USER
+
+# Worker host names for ssh
+export WORKER_HOSTS="crush.mcs.anl.gov thwomp.mcs.anl.gov stomp.mcs.anl.gov crank.mcs.anl.gov
+steamroller.mcs.anl.gov grind.mcs.anl.gov churn.mcs.anl.gov trounce.mcs.anl.gov
+thrash.mcs.anl.gov vanquish.mcs.anl.gov"
+
+# Directory to keep log files, relative to working directory when launching start-coaster-service
+export LOG_DIR=logs
+
+# Manually define ports. If not specified, ports will be automatically generated
+export LOCAL_PORT=
+export SERVICE_PORT=
+
+# start-coaster-service tries to automatically detect IP address.
+# Specify here if auto detection is not working correctly
+export IPADDR=
+
+# Gensites values
+export WORK=$HOME/work
+
+# If SHARED_FILESYSTEM is set to no, provider staging will be turned on
+export SHARED_FILESYSTEM=no
+
+# If running outside of mcs network, set WORKER_RELAY_HOST below
+# export WORKER_RELAY_HOST="login.mcs.anl.gov"
+
+export WORKER_LOGGING_LEVEL=DEBUG
+export WORKER_LOG_DIR="/nfs/proj-davidk/logs"
+
+# Set applications here
+#app cat=/bin/cat
Added: trunk/tests/stress/persistent-coasters/mcs/500x10/gendata.pl
===================================================================
--- trunk/tests/stress/persistent-coasters/mcs/500x10/gendata.pl (rev 0)
+++ trunk/tests/stress/persistent-coasters/mcs/500x10/gendata.pl 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,21 @@
+#!/usr/bin/perl
+
+use strict;
+
+my @characters=('a'..'z', 'A'..'Z', '0'..'9');
+my $string="";
+my $length = $ARGV[0];
+my $width_count=0;
+
+foreach (1..$length)
+{
+ if($width_count == 80) {
+ $string .= "\n";
+ $width_count=0;
+ next;
+ }
+ $string .= $characters[rand @characters];
+ $width_count++;
+}
+
+print $string;
Property changes on: trunk/tests/stress/persistent-coasters/mcs/500x10/gendata.pl
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0001.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0001.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0001.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0002.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0002.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0002.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0003.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0003.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0003.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0004.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0004.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0004.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0005.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0005.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0005.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0006.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0006.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0006.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0007.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0007.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0007.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0008.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0008.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0008.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0009.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0009.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.0009.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.setup.sh
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.setup.sh (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.setup.sh 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,7 @@
+#!/bin/bash
+
+cp $GROUP/coaster-service.conf .
+cp $GROUP/data.txt .
+if [ ! -f "$HOME/.swift/.coaster-service-pids" ]; then
+ start-coaster-service
+fi
Property changes on: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.swift
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.swift (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.swift 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,12 @@
+type file;
+
+app (file o) cat (file i)
+{
+ cat @i stdout=@o;
+}
+
+file out[]<simple_mapper; location=".", prefix="001-catsn.",suffix=".out">;
+foreach j in [1:@toint(@arg("n","10"))] {
+ file data<"data.txt">;
+ out[j] = cat(data);
+}
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.timeout
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.timeout (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/001-catsn.timeout 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+999999
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0001.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0001.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0001.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0002.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0002.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0002.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0003.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0003.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0003.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0004.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0004.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0004.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0005.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0005.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0005.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0006.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0006.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0006.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0007.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0007.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0007.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0008.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0008.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0008.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0009.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0009.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.0009.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.swift
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.swift (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/002-catsnbroken.swift 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,12 @@
+type file;
+
+app (file o) cat (file i)
+{
+ cat @i stdout=@o;
+}
+
+file out[]<simple_mapper; location=".", prefix="002-catsnbroken.",suffix=".out">;
+foreach j in [1:@toint(@arg("n","10"))] {
+ file data<"nodata.txt">;
+ out[j] = cat(data);
+}
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0001.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0001.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0001.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0002.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0002.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0002.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0003.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0003.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0003.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0004.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0004.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0004.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0005.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0005.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0005.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0006.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0006.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0006.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0007.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0007.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0007.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0008.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0008.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0008.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0009.out.expected
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0009.out.expected (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.0009.out.expected 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.setup.sh
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.setup.sh (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.setup.sh 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,4 @@
+#!/bin/bash
+
+cp $GROUP/coaster-service.conf .
+cp $GROUP/data.txt .
Property changes on: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.swift
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.swift (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.swift 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,12 @@
+type file;
+
+app (file o) cat (file i)
+{
+ cat @i stdout=@o;
+}
+
+file out[]<simple_mapper; location=".", prefix="003-catsn.",suffix=".out">;
+foreach j in [1:@toint(@arg("n","10"))] {
+ file data<"data.txt">;
+ out[j] = cat(data);
+}
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.timeout
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.timeout (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/003-catsn.timeout 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+999999
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/coaster-service.conf
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/coaster-service.conf (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/coaster-service.conf 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,42 @@
+# Keep all interesting settings in one place
+# User should modify this to fit environment
+
+# Location of SWIFT. If empty, PATH is searched
+export SWIFT=
+
+# Where to copy worker.pl on the remote machine for sites.xml
+export WORKER_WORK=$HOME/swiftwork
+
+# How to launch workers: local, ssh, cobalt, or futuregrid
+export WORKER_MODE=ssh
+
+# SSH hosts to start workers on (ssh mode only)
+export WORKER_HOSTS="localhost"
+
+# Do all the worker nodes you're using have a shared filesystem? (yes/no)
+export SHARED_FILESYSTEM=yes
+
+# Username to use on worker nodes
+export WORKER_USERNAME=$USER
+
+# Enable SSH tunneling? (yes/no)
+export SSH_TUNNELING=no
+
+# Directory to keep log files, relative to working directory when launching start-coaster-service
+export LOG_DIR=logs
+
+# Manually define ports. If not specified, an available port will be used
+export LOCAL_PORT=
+export SERVICE_PORT=
+
+# start-coaster-service tries to automatically detect the IP address of this system. Specify here if you have multiple network interfaces
+export IPADDR=
+
+# Location of the swift-vm-boot scripts
+export SWIFTVMBOOT_DIR=$HOME/swift-vm-boot
+
+# Swift information for creating sites.xml
+export WORK=$HOME/swiftwork
+export QUEUE=prod-devel
+export MAXTIME=20
+export NODE=64
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/data.txt
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/data.txt (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/data.txt 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1 @@
+Hello world
Added: trunk/tests/stress/persistent-coasters/pass-fail-pass/sites.template.xml
===================================================================
--- trunk/tests/stress/persistent-coasters/pass-fail-pass/sites.template.xml (rev 0)
+++ trunk/tests/stress/persistent-coasters/pass-fail-pass/sites.template.xml 2011-10-17 15:44:28 UTC (rev 5237)
@@ -0,0 +1,9 @@
+persistent-coasters echo /bin/echo null null null
+persistent-coasters cat /bin/cat null null null
+persistent-coasters ls /bin/ls null null null
+persistent-coasters grep /bin/grep null null null
+persistent-coasters sort /bin/sort null null null
+persistent-coasters paste /bin/paste null null null
+persistent-coasters cp /bin/cp null null null
+persistent-coasters wc /usr/bin/wc null null null
+persistent-coasters hostname /bin/hostname null null null
More information about the Swift-commit
mailing list