[Swift-commit] r7696 - in branches/release-0.94/tests: groups stress/IO stress/IO/osgc stress/apps/modis_osgc
davidk at ci.uchicago.edu
davidk at ci.uchicago.edu
Tue Mar 11 15:11:06 CDT 2014
Author: davidk
Date: 2014-03-11 15:11:06 -0500 (Tue, 11 Mar 2014)
New Revision: 7696
Added:
branches/release-0.94/tests/stress/IO/osgc/
branches/release-0.94/tests/stress/IO/osgc/run
branches/release-0.94/tests/stress/IO/osgc/script.args
branches/release-0.94/tests/stress/IO/osgc/script.setup.sh
branches/release-0.94/tests/stress/IO/osgc/sites.backup.xml
branches/release-0.94/tests/stress/IO/osgc/sites.template.xml
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.check.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.setup.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.source.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.swift
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.timeout
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.check.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.setup.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.source.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.swift
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.timeout
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.check.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.setup.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.source.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.swift
branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.timeout
branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.check.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.setup.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.source.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.swift
branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.timeout
branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.check.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.setup.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.source.sh
branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.swift
branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.timeout
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.args
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.check.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.setup.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.source.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.swift
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.timeout
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.check.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.setup.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.source.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.swift
branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.timeout
branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.check.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.setup.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.source.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.swift
branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.timeout
branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.check.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.setup.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.source.sh
branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.swift
branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.timeout
branches/release-0.94/tests/stress/IO/osgc/swift.properties
branches/release-0.94/tests/stress/IO/osgc/tc.template.data
branches/release-0.94/tests/stress/IO/osgc/title.txt
branches/release-0.94/tests/stress/IO/osgc/wrapper.sh
branches/release-0.94/tests/stress/IO/osgc/z_stats.clean.sh
branches/release-0.94/tests/stress/IO/osgc/z_stats.swift
Removed:
branches/release-0.94/tests/stress/IO/uc3/
Modified:
branches/release-0.94/tests/groups/group-daily-remote.sh
branches/release-0.94/tests/groups/group-sites.sh
branches/release-0.94/tests/groups/group-stress-midway.sh
branches/release-0.94/tests/stress/apps/modis_osgc/title.txt
Log:
More changes to related to uc3->osgc testing
Modified: branches/release-0.94/tests/groups/group-daily-remote.sh
===================================================================
--- branches/release-0.94/tests/groups/group-daily-remote.sh 2014-03-11 19:48:33 UTC (rev 7695)
+++ branches/release-0.94/tests/groups/group-daily-remote.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -5,51 +5,51 @@
$TESTDIR/language/should-not-work \
# $TESTDIR/cdm \
# $TESTDIR/cdm/ps \
- # $TESTDIR/cdm/star
+ # $TESTDIR/cdm/star \
$TESTDIR/language-behaviour/arrays \
$TESTDIR/language-behaviour/broken \
- $TESTDIR/language-behaviour/compounds \
+ $TESTDIR/language-behaviour/compounds \
$TESTDIR/language-behaviour/control_structures \
$TESTDIR/language-behaviour/datatypes \
- $TESTDIR/language-behaviour/IO \
- $TESTDIR/language-behaviour/logic \
- $TESTDIR/language-behaviour/mappers \
- $TESTDIR/language-behaviour/math \
- $TESTDIR/language-behaviour/params \
+ $TESTDIR/language-behaviour/IO \
+ $TESTDIR/language-behaviour/logic \
+ $TESTDIR/language-behaviour/mappers \
+ $TESTDIR/language-behaviour/math \
+ $TESTDIR/language-behaviour/params \
$TESTDIR/language-behaviour/procedures \
$TESTDIR/language-behaviour/strings \
- $TESTDIR/language-behaviour/variables \
- $TESTDIR/language-behaviour/cleanup \
+ $TESTDIR/language-behaviour/variables \
+ $TESTDIR/language-behaviour/cleanup \
$TESTDIR/bugs \
- $TESTDIR/documentation/tutorial \
+ $TESTDIR/documentation/tutorial \
$TESTDIR/functions \
# Site testing test-group
$TESTDIR/sites/beagle \
- $TESTDIR/sites/mcs \
+ $TESTDIR/sites/mcs \
$TESTDIR/sites/midway \
- $TESTDIR/sites/uc3 \
- # Frisbee will fail due to Bug 1030
- $TESTDIR/sites/mac-frisbee \
- $TESTDIR/sites/blues \
+ $TESTDIR/sites/osgconnect \
+ # Frisbee will fail due to Bug 1030
+ $TESTDIR/sites/mac-frisbee \
+ $TESTDIR/sites/blues \
$TESTDIR/sites/fusion \
- #$TESTDIR/sites/raven \
+ # $TESTDIR/sites/raven \
- # Remote-cluster IO tests
- $TESTDIR/stress/IO/beagle \
+ # Remote-cluster IO tests
+ $TESTDIR/stress/IO/beagle \
$TESTDIR/stress/IO/bagOnodes \
$TESTDIR/stress/IO/multiple \
- $TESTDIR/stress/IO/uc3 \
+ $TESTDIR/stress/IO/osgc \
# Language stress tests
$TESTDIR/stress/internals \
- # Remote-cluster Apps tests - MODIS
- $TESTDIR/stress/apps/modis_beagle \
- $TESTDIR/stress/apps/modis_local \
- $TESTDIR/stress/apps/modis_midway \
- $TESTDIR/stress/apps/modis_uc3 \
- # $TESTDIR/stress/apps/modis_multiple\
+ # Remote-cluster Apps tests - MODIS
+ $TESTDIR/stress/apps/modis_beagle \
+ $TESTDIR/stress/apps/modis_local \
+ $TESTDIR/stress/apps/modis_midway \
+ $TESTDIR/stress/apps/modis_osgc \
+ # $TESTDIR/stress/apps/modis_multiple \
# Local cluster tests.
$TESTDIR/stress/local_cluster \
@@ -57,7 +57,7 @@
$TESTDIR/stress/jobs_per_node \
# Recursive Test invocation
- $TESTDIR/multi_remote
+ $TESTDIR/multi_remote
)
Modified: branches/release-0.94/tests/groups/group-sites.sh
===================================================================
--- branches/release-0.94/tests/groups/group-sites.sh 2014-03-11 19:48:33 UTC (rev 7695)
+++ branches/release-0.94/tests/groups/group-sites.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -3,10 +3,10 @@
GROUPLIST=(
$TESTDIR/sites/beagle \
- $TESTDIR/sites/mcs \
+ $TESTDIR/sites/mcs \
$TESTDIR/sites/midway \
- $TESTDIR/sites/uc3 \
- $TESTDIR/sites/mac-frisbee \
+ $TESTDIR/sites/osgconnect \
+ $TESTDIR/sites/mac-frisbee \
)
checkvars WORK
Modified: branches/release-0.94/tests/groups/group-stress-midway.sh
===================================================================
--- branches/release-0.94/tests/groups/group-stress-midway.sh 2014-03-11 19:48:33 UTC (rev 7695)
+++ branches/release-0.94/tests/groups/group-stress-midway.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -4,8 +4,8 @@
$TESTDIR/stress/apps/modis_local \
$TESTDIR/stress/apps/modis_midway \
$TESTDIR/stress/apps/modis_beagle \
- $TESTDIR/stress/apps/modis_uc3 \
+ $TESTDIR/stress/apps/modis_osgc \
$TESTDIR/stress/apps/modis_multiple \
)
-checkvars WORK
\ No newline at end of file
+checkvars WORK
Added: branches/release-0.94/tests/stress/IO/osgc/run
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/run (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/run 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,11 @@
+#! /bin/sh
+
+set -x
+export STRESS="S1"
+
+export GLOBUS_HOSTNAME=swift.rcc.uchicago.edu
+./stage_to_remote1x1.setup.sh
+. stage_to_remote1x1.source.sh
+
+ARGS=`cat stage_to_remote1x1.args`
+swift -config cf -sites.file sites.template.xml -tc.file tc.template.data stage_to_remote1x1.swift $ARGS
Property changes on: branches/release-0.94/tests/stress/IO/osgc/run
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/script.args
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/script.args (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/script.args 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+-loops=10
Added: branches/release-0.94/tests/stress/IO/osgc/script.setup.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/script.setup.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/script.setup.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,28 @@
+#!/bin/bash
+
+ARGS_FILE=script.args
+case $STRESS in
+ "S1")
+ FILES=10
+ LOOPS=10
+ ;;
+ "S2")
+ FILES=100
+ LOOPS=10
+ ;;
+ "S3")
+ FILES=200
+ LOOPS=20
+ ;;
+ "S4")
+ FILES=300
+ LOOPS=10
+ ;;
+ *)
+ FILES=10
+ LOOPS=10
+ ;;
+esac
+
+dd if=/dev/zero of=dummy bs=1024 count=0 seek=$((1024*FILES))
+echo "-loops=$LOOPS" > $ARGS_FILE
\ No newline at end of file
Property changes on: branches/release-0.94/tests/stress/IO/osgc/script.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/sites.backup.xml
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/sites.backup.xml (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/sites.backup.xml 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,19 @@
+<config>
+ <pool handle="uc3">
+ <execution provider="coaster" url="uc3-sub.uchicago.edu" jobmanager="local:condor"/>
+ <profile namespace="karajan" key="jobThrottle">.99</profile>
+ <profile namespace="karajan" key="initialScore">1000</profile>
+ <profile namespace="globus" key="jobsPerNode">1</profile>
+ <profile namespace="globus" key="maxWalltime">3600</profile>
+ <profile namespace="globus" key="nodeGranularity">10</profile>
+ <profile namespace="globus" key="highOverAllocation">100</profile>
+ <profile namespace="globus" key="lowOverAllocation">100</profile>
+ <profile namespace="globus" key="slots">1</profile>
+ <profile namespace="globus" key="condor.Requirements">UidDomain == "osg-gk.mwt2.org"</profile>
+ <profile namespace="globus" key="maxNodes">10</profile>
+ <profile namespace="globus" key="condor.+AccountingGroup">"group_friends.{env.USER}"</profile>
+ <profile namespace="globus" key="jobType">nonshared</profile>
+ <filesystem provider="local" url="none" />
+ <workdirectory>/tmp/workdir</workdirectory>
+ </pool>
+</config>
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/sites.template.xml
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/sites.template.xml (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/sites.template.xml 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,20 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
+
+ <pool handle="osgc">
+ <execution provider="coaster" url="login01.osgconnect.net" jobmanager="ssh-cl:condor"/>
+ <profile namespace="karajan" key="jobThrottle">10.00</profile>
+ <profile namespace="karajan" key="initialScore">10000</profile>
+ <profile namespace="globus" key="jobsPerNode">1</profile>
+ <profile namespace="globus" key="maxtime">3600</profile>
+ <profile namespace="globus" key="maxWalltime">00:30:00</profile>
+ <profile namespace="globus" key="highOverAllocation">100</profile>
+ <profile namespace="globus" key="lowOverAllocation">100</profile>
+ <profile namespace="globus" key="slots">2</profile>
+ <profile namespace="globus" key="maxNodes">1</profile>
+ <profile namespace="globus" key="nodeGranularity">1</profile>
+ <profile namespace="globus" key="jobType">nonshared</profile>
+ <profile namespace="globus" key="condor.+ProjectName">"Swift"</profile>
+ <workdirectory>.</workdirectory>
+ </pool>
+</config>
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.check.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.check.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.check.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,4 @@
+#!/bin/bash
+echo "Cleaning up"
+rm -rf "dummy" driver*.out &> /dev/null
+
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.setup.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.setup.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.setup.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,13 @@
+#!/bin/bash
+
+echo "-loops=10 -size=10 -Dtcp.channel.log.io.performance=true" > stage_from_remote.args
+
+cat <<'EOF' > filemaker.sh
+#!/bin/bash
+
+echo "From filemaker.sh $1 $2 on Host:$HOSTNAME"
+MAXSIZE=$1
+OUT=$2
+dd if=/dev/zero of=$OUT bs=1024 count=0 seek=$((1024*MAXSIZE))
+
+EOF
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.source.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.source.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.source.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,7 @@
+#!/bin/bash
+
+if [ "midway001" == "midway001" ]
+then
+ export GLOBUS_HOSTNAME=swift.rcc.uchicago.edu
+ export GLOBUS_TCP_PORT_RANGE=50000,51000
+fi;
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.source.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.swift
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.swift (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.swift 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+type file;
+file script <"filemaker.sh">;
+
+app (file out, file log) remote_driver (file run, int size)
+{
+ bash @run size @out stdout=@filename(log);
+}
+
+file driver_out[] <simple_mapper; prefix="driver", suffix=".out">;
+file driver_log[] <simple_mapper; prefix="driver", suffix=".log">;
+
+int filesize = @toInt(@arg("size","10"));
+int loop = @toInt(@arg("loops","0"));
+
+foreach item,i in [0:loop] {
+ (driver_out[i], driver_log[i]) = remote_driver(script, filesize);
+}
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.timeout
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.timeout (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote.timeout 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+600
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.check.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.check.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.check.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+
+#!/bin/bash
+
+echo "Cleaning up"
+rm -rf "dummy" *.out &> /dev/null
+
+if [ "$KILL_JAVA" == "true" ];
+then
+ echo "Killing Java.."
+ for dead in `ps axf -u $USER | grep HeapDumpOnOutOfMemoryError | grep -o ^[0-9]*`
+ do
+ kill -9 $dead
+ done
+else
+ echo "No"
+fi
+
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.setup.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.setup.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.setup.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,39 @@
+#!/bin/bash
+
+ARGS_FILE=${0%.setup.sh}.args
+UC3_USERNAME=$UC3_USERNAME
+
+case $STRESS in
+ "S1")
+ SIZE=10
+ LOOPS=0
+ ;;
+ "S2")
+ SIZE=15
+ LOOPS=0
+ ;;
+ *)
+ SIZE=10
+ LOOPS=0
+ ;;
+esac
+
+echo "-loops=$LOOPS -size=$SIZE " > $ARGS_FILE
+
+cat <<'EOF' > filemaker.sh
+#!/bin/bash
+
+echo "From filemaker.sh $1 $2 on Host:$HOSTNAME"
+MAXSIZE=$1
+OUT=$2
+dd if=/dev/zero of=$OUT bs=1024 count=0 seek=$((1024*MAXSIZE))
+
+EOF
+
+if [[ -z $UC3_USERNAME ]]
+then
+ echo "Remote username not provided. Skipping sites configs"
+else
+ ls *xml
+ cat sites.xml | sed "s/{env.USER}/$UC3_USERNAME/" > tmp && mv tmp sites.xml
+fi
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.source.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.source.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.source.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,6 @@
+#!/bin/bash
+if [ "midway001" == "midway001" ]
+then
+ export GLOBUS_HOSTNAME=swift.rcc.uchicago.edu
+ export GLOBUS_TCP_PORT_RANGE=50000,51000
+fi;
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.source.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.swift
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.swift (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.swift 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+type file;
+file script <"filemaker.sh">;
+
+app (file out, file log) remote_driver (file run, int size)
+{
+ bash @run size @out stdout=@filename(log);
+}
+
+file driver_out[] <simple_mapper; prefix="driver", suffix=".out">;
+file driver_log[] <simple_mapper; prefix="driver", suffix=".log">;
+
+int filesize = @toInt(@arg("size","10"));
+int loop = @toInt(@arg("loops","0"));
+
+foreach item,i in [0:loop] {
+ (driver_out[i], driver_log[i]) = remote_driver(script, filesize);
+}
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.timeout
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.timeout (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x1.timeout 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+600
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.check.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.check.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.check.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,19 @@
+#!/bin/bash
+
+rm -rf "dummy" *.out &> /dev/null
+if [ "$KILL_JAVA" == "true" ];
+then
+ echo "Killing Java.."
+ killall -u $USER java -9
+fi
+
+IN=`grep "PerformanceDiagnosticInputStream\ \[IN\]" $BASE*log | tail -n 1`
+MEM=`grep "PerformanceDiagnosticInputStream\ \[MEM\]" $BASE*log`
+OUT=`grep "PerformanceDiagnosticOutputStream\ \[OUT\]" $BASE*log | tail -n 1`
+
+echo "====="
+echo "IN : $IN"
+echo "MEM : $MEM"
+echo "OUT : $OUT"
+echo "====="
+
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.setup.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.setup.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.setup.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,39 @@
+#!/bin/bash
+
+ARGS_FILE=${0%.setup.sh}.args
+UC3_USERNAME=$UC3_USERNAME
+
+case $STRESS in
+ "S1")
+ SIZE=100
+ LOOPS=0
+ ;;
+ "S2")
+ SIZE=150
+ LOOPS=0
+ ;;
+ *)
+ SIZE=100
+ LOOPS=0
+ ;;
+esac
+
+echo "-loops=$LOOPS -size=$SIZE " > $ARGS_FILE
+
+cat <<'EOF' > filemaker.sh
+#!/bin/bash
+
+echo "From filemaker.sh $1 $2 on Host:$HOSTNAME"
+MAXSIZE=$1
+OUT=$2
+dd if=/dev/zero of=$OUT bs=1024 count=0 seek=$((1024*MAXSIZE))
+
+EOF
+
+if [[ -z $UC3_USERNAME ]]
+then
+ echo "Remote username not provided. Skipping sites configs"
+else
+ ls *xml
+ cat sites.xml | sed "s/{env.USER}/$UC3_USERNAME/" > tmp && mv tmp sites.xml
+fi
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.source.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.source.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.source.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,6 @@
+#!/bin/bash
+if [ "midway001" == "midway001" ]
+then
+ export GLOBUS_HOSTNAME=swift.rcc.uchicago.edu
+ export GLOBUS_TCP_PORT_RANGE=50000,51000
+fi;
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.source.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.swift
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.swift (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.swift 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+type file;
+file script <"filemaker.sh">;
+
+app (file out, file log) remote_driver (file run, int size)
+{
+ bash @run size @out stdout=@filename(log);
+}
+
+file driver_out[] <simple_mapper; prefix="driver", suffix=".out">;
+file driver_log[] <simple_mapper; prefix="driver", suffix=".log">;
+
+int filesize = @toInt(@arg("size","10"));
+int loop = @toInt(@arg("loops","0"));
+
+foreach item,i in [0:loop] {
+ (driver_out[i], driver_log[i]) = remote_driver(script, filesize);
+}
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.timeout
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.timeout (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remote1x2.timeout 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+600
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.check.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.check.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.check.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+
+#!/bin/bash
+
+echo "Cleaning up"
+rm -rf "dummy" *.out &> /dev/null
+
+if [ "$KILL_JAVA" == "true" ];
+then
+ echo "Killing Java.."
+ for dead in `ps axf -u $USER | grep HeapDumpOnOutOfMemoryError | grep -o ^[0-9]*`
+ do
+ kill -9 $dead
+ done
+else
+ echo "No"
+fi
+
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.setup.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.setup.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.setup.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,39 @@
+#!/bin/bash
+
+ARGS_FILE=${0%.setup.sh}.args
+UC3_USERNAME=$UC3_USERNAME
+
+case $STRESS in
+ "S1")
+ SIZE=20
+ LOOPS=10
+ ;;
+ "S2")
+ SIZE=30
+ LOOPS=20
+ ;;
+ *)
+ SIZE=20
+ LOOPS=10
+ ;;
+esac
+
+echo "-loops=$LOOPS -size=$SIZE " > $ARGS_FILE
+
+cat <<'EOF' > filemaker.sh
+#!/bin/bash
+
+echo "From filemaker.sh $1 $2 on Host:$HOSTNAME"
+MAXSIZE=$1
+OUT=$2
+dd if=/dev/zero of=$OUT bs=1024 count=0 seek=$((1024*MAXSIZE))
+
+EOF
+
+if [[ -z $UC3_USERNAME ]]
+then
+ echo "Remote username not provided. Skipping sites configs"
+else
+ ls *xml
+ cat sites.xml | sed "s/{env.USER}/$UC3_USERNAME/" > tmp && mv tmp sites.xml
+fi
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.source.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.source.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.source.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,6 @@
+#!/bin/bash
+if [ "midway001" == "midway001" ]
+then
+ export GLOBUS_HOSTNAME=swift.rcc.uchicago.edu
+ export GLOBUS_TCP_PORT_RANGE=50000,51000
+fi;
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.source.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.swift
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.swift (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.swift 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+type file;
+file script <"filemaker.sh">;
+
+app (file out, file log) remote_driver (file run, int size)
+{
+ bash @run size @out stdout=@filename(log);
+}
+
+file driver_out[] <simple_mapper; prefix="driver", suffix=".out">;
+file driver_log[] <simple_mapper; prefix="driver", suffix=".log">;
+
+int filesize = @toInt(@arg("size","10"));
+int loop = @toInt(@arg("loops","0"));
+
+foreach item,i in [0:loop] {
+ (driver_out[i], driver_log[i]) = remote_driver(script, filesize);
+}
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.timeout
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.timeout (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx1.timeout 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+600
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.check.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.check.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.check.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,19 @@
+#!/bin/bash
+
+rm -rf "dummy" *.out &> /dev/null
+if [ "$KILL_JAVA" == "true" ];
+then
+ echo "Killing Java.."
+ killall -u $USER java -9
+fi
+
+IN=`grep "PerformanceDiagnosticInputStream\ \[IN\]" $BASE*log | tail -n 1`
+MEM=`grep "PerformanceDiagnosticInputStream\ \[MEM\]" $BASE*log`
+OUT=`grep "PerformanceDiagnosticOutputStream\ \[OUT\]" $BASE*log | tail -n 1`
+
+echo "====="
+echo "IN : $IN"
+echo "MEM : $MEM"
+echo "OUT : $OUT"
+echo "====="
+
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.setup.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.setup.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.setup.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,39 @@
+#!/bin/bash
+
+ARGS_FILE=${0%.setup.sh}.args
+UC3_USERNAME=$UC3_USERNAME
+
+case $STRESS in
+ "S1")
+ SIZE=20
+ LOOPS=50
+ ;;
+ "S2")
+ SIZE=50
+ LOOPS=50
+ ;;
+ *)
+ SIZE=20
+ LOOPS=50
+ ;;
+esac
+
+echo "-loops=$LOOPS -size=$SIZE " > $ARGS_FILE
+
+cat <<'EOF' > filemaker.sh
+#!/bin/bash
+
+echo "From filemaker.sh $1 $2 on Host:$HOSTNAME"
+MAXSIZE=$1
+OUT=$2
+dd if=/dev/zero of=$OUT bs=1024 count=0 seek=$((1024*MAXSIZE))
+
+EOF
+
+if [[ -z $UC3_USERNAME ]]
+then
+ echo "Remote username not provided. Skipping sites configs"
+else
+ ls *xml
+ cat sites.xml | sed "s/{env.USER}/$UC3_USERNAME/" > tmp && mv tmp sites.xml
+fi
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.source.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.source.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.source.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,6 @@
+#!/bin/bash
+if [ "midway001" == "midway001" ]
+then
+ export GLOBUS_HOSTNAME=swift.rcc.uchicago.edu
+ export GLOBUS_TCP_PORT_RANGE=50000,51000
+fi;
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.source.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.swift
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.swift (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.swift 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+type file;
+file script <"filemaker.sh">;
+
+app (file out, file log) remote_driver (file run, int size)
+{
+ bash @run size @out stdout=@filename(log);
+}
+
+file driver_out[] <simple_mapper; prefix="driver", suffix=".out">;
+file driver_log[] <simple_mapper; prefix="driver", suffix=".log">;
+
+int filesize = @toInt(@arg("size","10"));
+int loop = @toInt(@arg("loops","0"));
+
+foreach item,i in [0:loop] {
+ (driver_out[i], driver_log[i]) = remote_driver(script, filesize);
+}
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.timeout
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.timeout (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_from_remoteNx2.timeout 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+1800
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.args
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.args (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.args 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+-loops=0
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.check.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.check.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.check.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+
+#!/bin/bash
+
+echo "Cleaning up"
+rm -rf "dummy" *.out &> /dev/null
+
+if [ "$KILL_JAVA" == "true" ];
+then
+ echo "Killing Java.."
+ for dead in `ps axf -u $USER | grep HeapDumpOnOutOfMemoryError | grep -o ^[0-9]*`
+ do
+ kill -9 $dead
+ done
+else
+ echo "No"
+fi
+
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.setup.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.setup.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.setup.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,56 @@
+#!/bin/bash
+
+ARGS_FILE=${0%.setup.sh}.args
+UC3_USERNAME=$UC3_USERNAME
+
+case $STRESS in
+ "S1")
+ FILES=50
+ LOOPS=0
+ ;;
+ "S2")
+ FILES=100
+ LOOPS=0
+ ;;
+
+ *)
+ FILES=50
+ LOOPS=0
+ ;;
+esac
+
+
+dd if=/dev/zero of=dummy bs=1024 count=0 seek=$((1024*FILES))
+echo "-loops=$LOOPS" > $ARGS_FILE
+
+cat <<'EOF' > wrapper.sh
+#!/bin/bash
+ARG1=$1
+ls | grep "$1" &> /dev/null
+if [ $? == 0 ]
+then
+ echo "Hey this is wrapper and the $1 exists as a file";
+ ls -lah;
+else
+ echo "Doinks! the file we need isn't here";
+ ls -lah
+fi
+cat $ARG1 > $ARG1.test
+if [ $? == 0 ]
+then
+ echo "The cat worked! ";
+else
+ echo "The cat failed ";
+fi
+
+rm $ARG1 $ARG1.test
+echo "Residual files cleaned up"
+EOF
+
+if [[ -z $UC3_USERNAME ]]
+then
+ echo "Remote username not provided. Skipping sites configs"
+else
+ ls *xml
+ cat sites.xml | sed "s/{env.USER}/$UC3_USERNAME/" > tmp && mv tmp sites.xml
+fi
\ No newline at end of file
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.source.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.source.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.source.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,6 @@
+#!/bin/bash
+if [ "midway001" == "midway001" ]
+then
+ export GLOBUS_HOSTNAME=swift.rcc.uchicago.edu
+ export GLOBUS_TCP_PORT_RANGE=50000,51000
+fi;
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.source.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.swift
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.swift (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.swift 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+type file;
+
+file package <"dummy">;
+file script <"wrapper.sh">;
+int loop = @toInt(@arg("loops","0"));
+
+app (file out, file err) remote_driver (file run, file tar)
+{
+ bash @run @filename(tar) stdout=@filename(out) stderr=@filename(err);
+}
+
+file driver_out[] <simple_mapper; prefix="driver", suffix=".out">;
+file driver_err[] <simple_mapper; prefix="driver", suffix=".err">;
+
+foreach item,i in [0:loop] {
+ (driver_out[i], driver_err[i]) = remote_driver(script, package);
+}
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.timeout
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.timeout (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x1.timeout 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+600
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.check.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.check.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.check.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,19 @@
+#!/bin/bash
+
+rm -rf "dummy" *.out &> /dev/null
+if [ "$KILL_JAVA" == "true" ];
+then
+ echo "Killing Java.."
+ killall -u $USER java -9
+fi
+
+IN=`grep "PerformanceDiagnosticInputStream\ \[IN\]" $BASE*log | tail -n 1`
+MEM=`grep "PerformanceDiagnosticInputStream\ \[MEM\]" $BASE*log`
+OUT=`grep "PerformanceDiagnosticOutputStream\ \[OUT\]" $BASE*log | tail -n 1`
+
+echo "====="
+echo "IN : $IN"
+echo "MEM : $MEM"
+echo "OUT : $OUT"
+echo "====="
+
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.setup.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.setup.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.setup.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,55 @@
+#!/bin/bash
+
+ARGS_FILE=${0%.setup.sh}.args
+UC3_USERNAME=$UC3_USERNAME
+
+case $STRESS in
+ "S1")
+ FILES=100
+ LOOPS=0
+ ;;
+ "S2")
+ FILES=500
+ LOOPS=0
+ ;;
+ *)
+ FILES=100
+ LOOPS=0
+ ;;
+esac
+
+
+dd if=/dev/zero of=dummy bs=1024 count=0 seek=$((1024*FILES))
+echo "-loops=$LOOPS" > $ARGS_FILE
+
+cat <<'EOF' > wrapper.sh
+#!/bin/bash
+ARG1=$1
+ls | grep "$1" &> /dev/null
+if [ $? == 0 ]
+then
+ echo "Hey this is wrapper and the $1 exists as a file";
+ ls -lah;
+else
+ echo "Doinks! the file we need isn't here";
+ ls -lah
+fi
+cat $ARG1 > $ARG1.test
+if [ $? == 0 ]
+then
+ echo "The cat worked! ";
+else
+ echo "The cat failed ";
+fi
+
+rm $ARG1 $ARG1.test
+echo "Residual files cleaned up"
+EOF
+
+if [[ -z $UC3_USERNAME ]]
+then
+ echo "Remote username not provided. Skipping sites configs"
+else
+ ls *xml
+ cat sites.xml | sed "s/{env.USER}/$UC3_USERNAME/" > tmp && mv tmp sites.xml
+fi
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.source.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.source.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.source.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,6 @@
+#!/bin/bash
+if [ "midway001" == "midway001" ]
+then
+ export GLOBUS_HOSTNAME=swift.rcc.uchicago.edu
+ export GLOBUS_TCP_PORT_RANGE=50000,51000
+fi;
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.source.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.swift
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.swift (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.swift 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+type file;
+
+file package <"dummy">;
+file script <"wrapper.sh">;
+int loop = @toInt(@arg("loops","0"));
+
+app (file out, file err) remote_driver (file run, file tar)
+{
+ bash @run @filename(tar) stdout=@filename(out) stderr=@filename(err);
+}
+
+file driver_out[] <simple_mapper; prefix="driver", suffix=".out">;
+file driver_err[] <simple_mapper; prefix="driver", suffix=".err">;
+
+foreach item,i in [0:loop] {
+ (driver_out[i], driver_err[i]) = remote_driver(script, package);
+}
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.timeout
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.timeout (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remote1x2.timeout 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+600
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.check.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.check.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.check.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+
+#!/bin/bash
+
+echo "Cleaning up"
+rm -rf "dummy" *.out &> /dev/null
+
+if [ "$KILL_JAVA" == "true" ];
+then
+ echo "Killing Java.."
+ for dead in `ps axf -u $USER | grep HeapDumpOnOutOfMemoryError | grep -o ^[0-9]*`
+ do
+ kill -9 $dead
+ done
+else
+ echo "No"
+fi
+
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.setup.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.setup.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.setup.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,55 @@
+#!/bin/bash
+
+ARGS_FILE=${0%.setup.sh}.args
+UC3_USERNAME=$UC3_USERNAME
+
+case $STRESS in
+ "S1")
+ FILES=10
+ LOOPS=10
+ ;;
+ "S2")
+ FILES=10
+ LOOPS=50
+ ;;
+ *)
+ FILES=10
+ LOOPS=10
+ ;;
+esac
+
+
+dd if=/dev/zero of=dummy bs=1024 count=0 seek=$((1024*FILES))
+echo "-loops=$LOOPS" > $ARGS_FILE
+
+cat <<'EOF' > wrapper.sh
+#!/bin/bash
+ARG1=$1
+ls | grep "$1" &> /dev/null
+if [ $? == 0 ]
+then
+ echo "Hey this is wrapper and the $1 exists as a file";
+ ls -lah;
+else
+ echo "Doinks! the file we need isn't here";
+ ls -lah
+fi
+cat $ARG1 > $ARG1.test
+if [ $? == 0 ]
+then
+ echo "The cat worked! ";
+else
+ echo "The cat failed ";
+fi
+
+rm $ARG1 $ARG1.test
+echo "Residual files cleaned up"
+EOF
+
+if [[ -z $UC3_USERNAME ]]
+then
+ echo "Remote username not provided. Skipping sites configs"
+else
+ ls *xml
+ cat sites.xml | sed "s/{env.USER}/$UC3_USERNAME/" > tmp && mv tmp sites.xml
+fi
\ No newline at end of file
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.source.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.source.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.source.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,6 @@
+#!/bin/bash
+if [ "midway001" == "midway001" ]
+then
+ export GLOBUS_HOSTNAME=swift.rcc.uchicago.edu
+ export GLOBUS_TCP_PORT_RANGE=50000,51000
+fi;
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.source.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.swift
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.swift (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.swift 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+type file;
+
+file package <"dummy">;
+file script <"wrapper.sh">;
+int loop = @toInt(@arg("loops","0"));
+
+app (file out, file err) remote_driver (file run, file tar)
+{
+ bash @run @tar stdout=@out stderr=@err;
+}
+
+file driver_out[] <simple_mapper; prefix="driver", suffix=".out">;
+file driver_err[] <simple_mapper; prefix="driver", suffix=".err">;
+
+foreach item,i in [0:loop] {
+ (driver_out[i], driver_err[i]) = remote_driver(script, package);
+}
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.timeout
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.timeout (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx1.timeout 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+1200
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.check.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.check.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.check.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,19 @@
+#!/bin/bash
+
+rm -rf "dummy" *.out &> /dev/null
+if [ "$KILL_JAVA" == "true" ];
+then
+ echo "Killing Java.."
+ killall -u $USER java -9
+fi
+
+IN=`grep "PerformanceDiagnosticInputStream\ \[IN\]" $BASE*log | tail -n 1`
+MEM=`grep "PerformanceDiagnosticInputStream\ \[MEM\]" $BASE*log`
+OUT=`grep "PerformanceDiagnosticOutputStream\ \[OUT\]" $BASE*log | tail -n 1`
+
+echo "====="
+echo "IN : $IN"
+echo "MEM : $MEM"
+echo "OUT : $OUT"
+echo "====="
+
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.setup.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.setup.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.setup.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,55 @@
+#!/bin/bash
+
+ARGS_FILE=${0%.setup.sh}.args
+UC3_USERNAME=$UC3_USERNAME
+
+case $STRESS in
+ "S1")
+ FILES=50
+ LOOPS=50
+ ;;
+ "S2")
+ FILES=100
+ LOOPS=100
+ ;;
+ *)
+ FILES=50
+ LOOPS=50
+ ;;
+esac
+
+
+dd if=/dev/zero of=dummy bs=1024 count=0 seek=$((1024*FILES))
+echo "-loops=$LOOPS" > $ARGS_FILE
+
+cat <<'EOF' > wrapper.sh
+#!/bin/bash
+ARG1=$1
+ls | grep "$1" &> /dev/null
+if [ $? == 0 ]
+then
+ echo "Hey this is wrapper and the $1 exists as a file";
+ ls -lah;
+else
+ echo "Doinks! the file we need isn't here";
+ ls -lah
+fi
+cat $ARG1 > $ARG1.test
+if [ $? == 0 ]
+then
+ echo "The cat worked! ";
+else
+ echo "The cat failed ";
+fi
+
+rm $ARG1 $ARG1.test
+echo "Residual files cleaned up"
+EOF
+
+if [[ -z $UC3_USERNAME ]]
+then
+ echo "Remote username not provided. Skipping sites configs"
+else
+ ls *xml
+ cat sites.xml | sed "s/{env.USER}/$UC3_USERNAME/" > tmp && mv tmp sites.xml
+fi
\ No newline at end of file
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.setup.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.source.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.source.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.source.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,6 @@
+#!/bin/bash
+if [ "midway001" == "midway001" ]
+then
+ export GLOBUS_HOSTNAME=swift.rcc.uchicago.edu
+ export GLOBUS_TCP_PORT_RANGE=50000,51000
+fi;
Property changes on: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.source.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.swift
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.swift (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.swift 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,17 @@
+type file;
+
+file package <"dummy">;
+file script <"wrapper.sh">;
+int loop = @toInt(@arg("loops","0"));
+
+app (file out, file err) remote_driver (file run, file tar)
+{
+ bash @run @tar stdout=@out stderr=@err;
+}
+
+file driver_out[] <simple_mapper; prefix="driver", suffix=".out">;
+file driver_err[] <simple_mapper; prefix="driver", suffix=".err">;
+
+foreach item,i in [0:loop] {
+ (driver_out[i], driver_err[i]) = remote_driver(script, package);
+}
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.timeout
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.timeout (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/stage_to_remoteNx2.timeout 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+1200
Added: branches/release-0.94/tests/stress/IO/osgc/swift.properties
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/swift.properties (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/swift.properties 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,8 @@
+use.provider.staging=true
+use.wrapper.staging=false
+wrapperlog.always.transfer=true
+execution.retries=0
+lazy.errors=false
+provider.staging.pin.swiftfiles=false
+sitedir.keep=true
+tcp.port.range=50000,51000
\ No newline at end of file
Added: branches/release-0.94/tests/stress/IO/osgc/tc.template.data
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/tc.template.data (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/tc.template.data 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,2 @@
+beagle bash /bin/bash null null null
+osgc bash /bin/bash null null null
Added: branches/release-0.94/tests/stress/IO/osgc/title.txt
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/title.txt (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/title.txt 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+IO stress testing at remote site: OSG Connect
Added: branches/release-0.94/tests/stress/IO/osgc/wrapper.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/wrapper.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/wrapper.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,21 @@
+#!/bin/bash
+ARG1=$1
+ls | grep "$1" &> /dev/null
+if [ $? == 0 ]
+then
+ echo "Hey this is wrapper and the $1 exists as a file";
+ ls -lah;
+else
+ echo "Doinks! the file we need isn't here";
+ ls -lah
+fi
+cat $ARG1 > $ARG1.test
+if [ $? == 0 ]
+then
+ echo "The cat worked! ";
+else
+ echo "The cat failed ";
+fi
+
+rm $ARG1 $ARG1.test
+echo "Residual files cleaned up"
Property changes on: branches/release-0.94/tests/stress/IO/osgc/wrapper.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/z_stats.clean.sh
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/z_stats.clean.sh (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/z_stats.clean.sh 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1,24 @@
+#!/bin/bash
+
+HOME=$PWD
+echo "Current test : $HOME"
+
+TESTS_HOME=$(dirname $HOME)
+echo "Tests home : $TESTS_HOME"
+
+ps -u $USER
+echo "Clearing all java instances"
+
+ps -u $USER | grep java
+if [ "$?" == "0" ]
+then
+ killall -u $USER java -9
+fi
+
+echo "Collecting stats"
+for test_case in `ls $TESTS_HOME | grep stage`
+do
+ echo "$test_case"
+ cat $TESTS_HOME/$test_case/*check.stdout
+ echo
+done
\ No newline at end of file
Property changes on: branches/release-0.94/tests/stress/IO/osgc/z_stats.clean.sh
___________________________________________________________________
Added: svn:executable
+ *
Added: branches/release-0.94/tests/stress/IO/osgc/z_stats.swift
===================================================================
--- branches/release-0.94/tests/stress/IO/osgc/z_stats.swift (rev 0)
+++ branches/release-0.94/tests/stress/IO/osgc/z_stats.swift 2014-03-11 20:11:06 UTC (rev 7696)
@@ -0,0 +1 @@
+type file;
\ No newline at end of file
Modified: branches/release-0.94/tests/stress/apps/modis_osgc/title.txt
===================================================================
--- branches/release-0.94/tests/stress/apps/modis_osgc/title.txt 2014-03-11 19:48:33 UTC (rev 7695)
+++ branches/release-0.94/tests/stress/apps/modis_osgc/title.txt 2014-03-11 20:11:06 UTC (rev 7696)
@@ -1 +1 @@
-Modis UC3
+Modis OSGC
More information about the Swift-commit
mailing list