[Swift-commit] r6488 - in SwiftTutorials/OSG_2013-03-11/MODIS: . test.mcs

davidk at ci.uchicago.edu davidk at ci.uchicago.edu
Mon Apr 29 20:10:26 CDT 2013


Author: davidk
Date: 2013-04-29 20:10:26 -0500 (Mon, 29 Apr 2013)
New Revision: 6488

Added:
   SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/
   SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/cf
   SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/getlanduse.pl
   SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/input/
   SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/mcs.xml
   SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/run
   SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/tc
Modified:
   SwiftTutorials/OSG_2013-03-11/MODIS/setup.sh
Log:
Modis test for mcs


Modified: SwiftTutorials/OSG_2013-03-11/MODIS/setup.sh
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/setup.sh	2013-04-30 00:26:26 UTC (rev 6487)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/setup.sh	2013-04-30 01:10:26 UTC (rev 6488)
@@ -19,6 +19,7 @@
 (cd test.beagle;   clean; makeinput 100)
 (cd test.fusion;   clean; makeinput 100)
 (cd test.local;    clean; makeinput 10)
+(cd test.mcs;      clean; makeinput 100)
 (cd test.midway;   clean; makeinput 100)
 (cd test.multiple; clean; makeinput 3000)
 (cd test.raven;    clean; makeinput 100)

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/cf
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/cf	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/cf	2013-04-30 01:10:26 UTC (rev 6488)
@@ -0,0 +1,7 @@
+wrapperlog.always.transfer=true
+sitedir.keep=true
+execution.retries=0
+lazy.errors=false
+status.mode=provider
+use.provider.staging=true
+provider.staging.pin.swiftfiles=false

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/getlanduse.pl
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/getlanduse.pl	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/getlanduse.pl	2013-04-30 01:10:26 UTC (rev 6488)
@@ -0,0 +1,29 @@
+#!/usr/bin/perl -w
+
+# Input to this program should be a raw, greyscale RGB file
+# Usage: rgb_histogram.pl myfile.rgb
+
+my $image_filename = shift;
+open(IMAGEFILE, "$image_filename") || die "Unable to open $image_filename!\n";
+binmode IMAGEFILE;
+
+my @pixelcount;
+foreach my $count (0..255) { $pixelcount[$count] = 0; }
+
+# Read values, three bytes at a time
+$/ = \3; 
+foreach(<IMAGEFILE>) {
+   $pixelcount[unpack('C', $_)]++;
+}
+close(IMAGEFILE);
+
+ at sortedcount = sort {$b <=> $a} @pixelcount;
+
+foreach my $count (0..255) {
+   if($sortedcount[$count] == 0) { next; }
+   printf("%d %d %02x\n", $sortedcount[$count], $count, $count);
+}
+
+system("hostname -f 2>&1");
+
+sleep(1);


Property changes on: SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/getlanduse.pl
___________________________________________________________________
Added: svn:executable
   + *

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/mcs.xml
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/mcs.xml	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/mcs.xml	2013-04-30 01:10:26 UTC (rev 6488)
@@ -0,0 +1,123 @@
+<config>
+
+  <pool handle="crank">
+    <execution provider="coaster" jobmanager="ssh-cl:local" url="crank.mcs.anl.gov"/>
+    <profile namespace="globus" key="jobsPerNode">8</profile>
+    <profile namespace="globus" key="lowOverAllocation">100</profile>
+    <profile namespace="globus" key="highOverAllocation">100</profile>
+    <profile namespace="globus" key="maxtime">3600</profile>
+    <profile namespace="globus" key="maxWalltime">00:05:00</profile>
+    <profile namespace="karajan" key="jobThrottle">0.0799</profile>
+    <profile namespace="karajan" key="initialScore">10000</profile>
+    <workdirectory>/sandbox/{env.USER}/swiftwork</workdirectory>
+  </pool>
+
+  <pool handle="churn">
+    <execution provider="coaster" jobmanager="ssh-cl:local" url="churn.mcs.anl.gov"/>
+    <profile namespace="globus" key="jobsPerNode">8</profile>
+    <profile namespace="globus" key="lowOverAllocation">100</profile>
+    <profile namespace="globus" key="highOverAllocation">100</profile>
+    <profile namespace="globus" key="maxtime">3600</profile>
+    <profile namespace="globus" key="maxWalltime">00:05:00</profile>
+    <profile namespace="karajan" key="jobThrottle">0.0799</profile>
+    <profile namespace="karajan" key="initialScore">10000</profile>
+    <workdirectory>/sandbox/{env.USER}/swiftwork</workdirectory>
+  </pool>
+
+  <pool handle="crush">
+    <execution provider="coaster" jobmanager="ssh-cl:local" url="crush.mcs.anl.gov"/>
+    <profile namespace="globus" key="jobsPerNode">8</profile>
+    <profile namespace="globus" key="lowOverAllocation">100</profile>
+    <profile namespace="globus" key="highOverAllocation">100</profile>
+    <profile namespace="globus" key="maxtime">3600</profile>
+    <profile namespace="globus" key="maxWalltime">00:05:00</profile>
+    <profile namespace="karajan" key="jobThrottle">0.0799</profile>
+    <profile namespace="karajan" key="initialScore">10000</profile>
+    <workdirectory>/sandbox/{env.USER}/swiftwork</workdirectory>
+  </pool>
+
+  <pool handle="grind">
+    <execution provider="coaster" jobmanager="ssh-cl:local" url="grind.mcs.anl.gov"/>
+    <profile namespace="globus" key="jobsPerNode">8</profile>
+    <profile namespace="globus" key="lowOverAllocation">100</profile>
+    <profile namespace="globus" key="highOverAllocation">100</profile>
+    <profile namespace="globus" key="maxtime">3600</profile>
+    <profile namespace="globus" key="maxWalltime">00:05:00</profile>
+    <profile namespace="karajan" key="jobThrottle">0.0799</profile>
+    <profile namespace="karajan" key="initialScore">10000</profile>
+    <workdirectory>/sandbox/{env.USER}/swiftwork</workdirectory>
+  </pool>
+
+  <pool handle="steamroller">
+    <execution provider="coaster" jobmanager="ssh-cl:local" url="steamroller.mcs.anl.gov"/>
+    <profile namespace="globus" key="jobsPerNode">8</profile>
+    <profile namespace="globus" key="lowOverAllocation">100</profile>
+    <profile namespace="globus" key="highOverAllocation">100</profile>
+    <profile namespace="globus" key="maxtime">3600</profile>
+    <profile namespace="globus" key="maxWalltime">00:05:00</profile>
+    <profile namespace="karajan" key="jobThrottle">0.0799</profile>
+    <profile namespace="karajan" key="initialScore">10000</profile>
+    <workdirectory>/sandbox/{env.USER}/swiftwork</workdirectory>
+  </pool>
+
+  <pool handle="stomp">
+    <execution provider="coaster" jobmanager="ssh-cl:local" url="stomp.mcs.anl.gov"/>
+    <profile namespace="globus" key="jobsPerNode">8</profile>
+    <profile namespace="globus" key="lowOverAllocation">100</profile>
+    <profile namespace="globus" key="highOverAllocation">100</profile>
+    <profile namespace="globus" key="maxtime">3600</profile>
+    <profile namespace="globus" key="maxWalltime">00:05:00</profile>
+    <profile namespace="karajan" key="jobThrottle">0.0799</profile>
+    <profile namespace="karajan" key="initialScore">10000</profile>
+    <workdirectory>/sandbox/{env.USER}/swiftwork</workdirectory>
+  </pool>
+
+  <pool handle="thrash">
+    <execution provider="coaster" jobmanager="ssh-cl:local" url="thrash.mcs.anl.gov"/>
+    <profile namespace="globus" key="jobsPerNode">8</profile>
+    <profile namespace="globus" key="lowOverAllocation">100</profile>
+    <profile namespace="globus" key="highOverAllocation">100</profile>
+    <profile namespace="globus" key="maxtime">3600</profile>
+    <profile namespace="globus" key="maxWalltime">00:05:00</profile>
+    <profile namespace="karajan" key="jobThrottle">0.0799</profile>
+    <profile namespace="karajan" key="initialScore">10000</profile>
+    <workdirectory>/sandbox/{env.USER}/swiftwork</workdirectory>
+  </pool>
+
+  <pool handle="thwomp">
+    <execution provider="coaster" jobmanager="ssh-cl:local" url="thwomp.mcs.anl.gov"/>
+    <profile namespace="globus" key="jobsPerNode">8</profile>
+    <profile namespace="globus" key="lowOverAllocation">100</profile>
+    <profile namespace="globus" key="highOverAllocation">100</profile>
+    <profile namespace="globus" key="maxtime">3600</profile>
+    <profile namespace="globus" key="maxWalltime">00:05:00</profile>
+    <profile namespace="karajan" key="jobThrottle">0.0799</profile>
+    <profile namespace="karajan" key="initialScore">10000</profile>
+    <workdirectory>/sandbox/{env.USER}/swiftwork</workdirectory>
+  </pool>
+
+  <pool handle="trounce">
+    <execution provider="coaster" jobmanager="ssh-cl:local" url="trounce.mcs.anl.gov"/>
+    <profile namespace="globus" key="jobsPerNode">8</profile>
+    <profile namespace="globus" key="lowOverAllocation">100</profile>
+    <profile namespace="globus" key="highOverAllocation">100</profile>
+    <profile namespace="globus" key="maxtime">3600</profile>
+    <profile namespace="globus" key="maxWalltime">00:05:00</profile>
+    <profile namespace="karajan" key="jobThrottle">0.0799</profile>
+    <profile namespace="karajan" key="initialScore">10000</profile>
+    <workdirectory>/sandbox/{env.USER}/swiftwork</workdirectory>
+  </pool>
+
+  <pool handle="vanquish">
+    <execution provider="coaster" jobmanager="ssh-cl:local" url="vanquish.mcs.anl.gov"/>
+    <profile namespace="globus" key="jobsPerNode">8</profile>
+    <profile namespace="globus" key="lowOverAllocation">100</profile>
+    <profile namespace="globus" key="highOverAllocation">100</profile>
+    <profile namespace="globus" key="maxtime">3600</profile>
+    <profile namespace="globus" key="maxWalltime">00:05:00</profile>
+    <profile namespace="karajan" key="jobThrottle">0.0799</profile>
+    <profile namespace="karajan" key="initialScore">10000</profile>
+    <workdirectory>/sandbox/{env.USER}/swiftwork</workdirectory>
+  </pool>
+
+</config>

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/run
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/run	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/run	2013-04-30 01:10:26 UTC (rev 6488)
@@ -0,0 +1,6 @@
+#! /bin/sh
+
+set -x
+export GLOBUS_HOSTNAME=$( hostname -f )
+
+swift -config cf -sites.file mcs.xml -tc.file tc ../modis.swift -modisdir=input/


Property changes on: SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/run
___________________________________________________________________
Added: svn:executable
   + *

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/tc
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/tc	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.mcs/tc	2013-04-30 01:10:26 UTC (rev 6488)
@@ -0,0 +1,12 @@
+crank perl /usr/bin/perl null null null
+churn perl /usr/bin/perl null null null
+crush perl /usr/bin/perl null null null
+grind perl /usr/bin/perl null null null
+octagon perl /usr/bin/perl null null null
+octopus perl /usr/bin/perl null null null
+steamroller perl /usr/bin/perl null null null
+stomp perl /usr/bin/perl null null null
+thrash perl /usr/bin/perl null null null
+thwomp perl /usr/bin/perl null null null
+trounce perl /usr/bin/perl null null null
+vanquish perl /usr/bin/perl null null null




More information about the Swift-commit mailing list