[Swift-commit] r6484 - in SwiftTutorials/OSG_2013-03-11/MODIS: . test.fusion

[davidk at ci.uchicago.edu]

Author: davidk
Date: 2013-04-29 15:26:18 -0500 (Mon, 29 Apr 2013)
New Revision: 6484

Added:
   SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/
   SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/cf
   SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/fusion.xml
   SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/getlanduse.pl
   SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/run
   SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/swift.log
   SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/tc
Modified:
   SwiftTutorials/OSG_2013-03-11/MODIS/setup.sh
Log:
Modis tests for fusion


Modified: SwiftTutorials/OSG_2013-03-11/MODIS/setup.sh
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/setup.sh	2013-04-18 21:09:18 UTC (rev 6483)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/setup.sh	2013-04-29 20:26:18 UTC (rev 6484)
@@ -24,6 +24,8 @@
 
 (cd test.uc3;      clean; makeinput 100)
 
+(cd test.fusion;   clean; makeinput 100)
+
 (cd test.multiple; clean; makeinput 3000)
 
 for d in test.*; do

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/cf
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/cf	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/cf	2013-04-29 20:26:18 UTC (rev 6484)
@@ -0,0 +1,8 @@
+
+wrapperlog.always.transfer=true
+sitedir.keep=true
+execution.retries=0
+lazy.errors=false
+status.mode=provider
+use.provider.staging=true
+provider.staging.pin.swiftfiles=false

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/fusion.xml
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/fusion.xml	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/fusion.xml	2013-04-29 20:26:18 UTC (rev 6484)
@@ -0,0 +1,17 @@
+<config>
+   <pool handle="fusion">
+        <execution jobmanager="local:pbs" provider="coaster" url="none"/>
+        <filesystem provider="local" url="none" />
+        <profile namespace="globus" key="maxtime">3600</profile>
+        <profile namespace="globus" key="jobsPerNode">8</profile>
+        <profile namespace="globus" key="queue">shared</profile>
+        <profile namespace="globus" key="nodeGranularity">1</profile>
+        <profile namespace="globus" key="maxNodes">1</profile>
+        <profile namespace="globus" key="slots">1</profile>
+        <profile namespace="karajan" key="jobThrottle">1.0</profile>
+        <profile namespace="karajan" key="initialScore">100</profile>
+        <profile namespace="globus" key="HighOverAllocation">100</profile>
+        <profile namespace="globus" key="LowOverAllocation">100</profile>
+        <workdirectory>/home/{env.USER}/swiftwork</workdirectory>
+    </pool>
+</config>

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/getlanduse.pl
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/getlanduse.pl	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/getlanduse.pl	2013-04-29 20:26:18 UTC (rev 6484)
@@ -0,0 +1,29 @@
+#!/usr/bin/perl -w
+
+# Input to this program should be a raw, greyscale RGB file
+# Usage: rgb_histogram.pl myfile.rgb
+
+my $image_filename = shift;
+open(IMAGEFILE, "$image_filename") || die "Unable to open $image_filename!\n";
+binmode IMAGEFILE;
+
+my @pixelcount;
+foreach my $count (0..255) { $pixelcount[$count] = 0; }
+
+# Read values, three bytes at a time
+$/ = \3; 
+foreach(<IMAGEFILE>) {
+   $pixelcount[unpack('C', $_)]++;
+}
+close(IMAGEFILE);
+
+ at sortedcount = sort {$b <=> $a} @pixelcount;
+
+foreach my $count (0..255) {
+   if($sortedcount[$count] == 0) { next; }
+   printf("%d %d %02x\n", $sortedcount[$count], $count, $count);
+}
+
+system("hostname -f 2>&1");
+
+sleep(1);


Property changes on: SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/getlanduse.pl
___________________________________________________________________
Added: svn:executable
   + *

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/run
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/run	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/run	2013-04-29 20:26:18 UTC (rev 6484)
@@ -0,0 +1,5 @@
+#! /bin/sh
+
+set -x
+
+swift -config cf -sites.file fusion.xml -tc.file tc ../modis.swift -modisdir=input/


Property changes on: SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/run
___________________________________________________________________
Added: svn:executable
   + *

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/swift.log
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/swift.log	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/swift.log	2013-04-29 20:26:18 UTC (rev 6484)
@@ -0,0 +1 @@
+2013-04-29 15:24:16,354-0500 DEBUG Loader Swift started

Added: SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/tc
===================================================================
--- SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/tc	                        (rev 0)
+++ SwiftTutorials/OSG_2013-03-11/MODIS/test.fusion/tc	2013-04-29 20:26:18 UTC (rev 6484)
@@ -0,0 +1 @@
+fusion perl /usr/bin/perl null null null