From ketan at ci.uchicago.edu  Wed Feb 25 10:21:00 2015
From: ketan at ci.uchicago.edu (ketan at ci.uchicago.edu)
Date: Wed, 25 Feb 2015 10:21:00 -0600 (CST)
Subject: [Swift-commit] r8378 - SwiftApps/dsp-swift
Message-ID: <20150225162100.0299F9D586@svn.ci.uchicago.edu>

Author: ketan
Date: 2015-02-25 10:20:58 -0600 (Wed, 25 Feb 2015)
New Revision: 8378

Added:
   SwiftApps/dsp-swift/dsp-inputform.png
   SwiftApps/dsp-swift/dsp-output.png
Modified:
   SwiftApps/dsp-swift/README
Log:
screenshots

Modified: SwiftApps/dsp-swift/README
===================================================================
--- SwiftApps/dsp-swift/README	2015-01-28 19:15:58 UTC (rev 8377)
+++ SwiftApps/dsp-swift/README	2015-02-25 16:20:58 UTC (rev 8378)
@@ -11,6 +11,7 @@
 
 . Swift
 See Swift web Download page to know more about Swift installation.
+
 . Galaxy
 See Galaxy web page to know more about Galaxy installation.
 

Added: SwiftApps/dsp-swift/dsp-inputform.png
===================================================================
(Binary files differ)


Property changes on: SwiftApps/dsp-swift/dsp-inputform.png
___________________________________________________________________
Added: svn:mime-type
   + application/octet-stream

Added: SwiftApps/dsp-swift/dsp-output.png
===================================================================
(Binary files differ)


Property changes on: SwiftApps/dsp-swift/dsp-output.png
___________________________________________________________________
Added: svn:mime-type
   + application/octet-stream



From ketan at ci.uchicago.edu  Fri Feb 27 11:02:34 2015
From: ketan at ci.uchicago.edu (ketan at ci.uchicago.edu)
Date: Fri, 27 Feb 2015 11:02:34 -0600 (CST)
Subject: [Swift-commit] r8379 - SwiftApps/subjobs
Message-ID: <20150227170234.E25F31782B1@svn.ci.uchicago.edu>

Author: ketan
Date: 2015-02-27 11:02:34 -0600 (Fri, 27 Feb 2015)
New Revision: 8379

Removed:
   SwiftApps/subjobs/catsnsleepmpi.swift
   SwiftApps/subjobs/mpicatnap.c
Modified:
   SwiftApps/subjobs/bg.sh
Log:
mpi

Modified: SwiftApps/subjobs/bg.sh
===================================================================
--- SwiftApps/subjobs/bg.sh	2015-02-25 16:20:58 UTC (rev 8378)
+++ SwiftApps/subjobs/bg.sh	2015-02-27 17:02:34 UTC (rev 8379)
@@ -56,7 +56,6 @@
     echo "$0": running runjob --strace none --block "$COBALT_PARTNAME" --corner "$CORNER" --shape "$SHAPE" -p 16 --np "$((16*$SUBBLOCK_SIZE))" : "$@"
     
     #without timeout
-    #strace -o "$HOME/strace.runjob.out" runjob --strace none --block "$COBALT_PARTNAME" --corner "$CORNER" --shape "$SHAPE" -p 16 --np "$((16*$SUBBLOCK_SIZE))" : "$@"
     #runjob --strace none --block "$COBALT_PARTNAME" --corner "$CORNER" --shape "$SHAPE" -p 16 --np "$((16*$SUBBLOCK_SIZE))" : "$@"
     runjob --block "$COBALT_PARTNAME" --corner "$CORNER" --shape "$SHAPE" -p 16 --np 2 : "$@"
     

Deleted: SwiftApps/subjobs/catsnsleepmpi.swift
===================================================================
--- SwiftApps/subjobs/catsnsleepmpi.swift	2015-02-25 16:20:58 UTC (rev 8378)
+++ SwiftApps/subjobs/catsnsleepmpi.swift	2015-02-27 17:02:34 UTC (rev 8379)
@@ -1,15 +0,0 @@
-type file;
-
-app (file o, file sout, file serr) cat (file i)
-{
-  bgsh "/home/ketan/SwiftApps/subjobs/mpicatnap" @i @o arg("s","1") stdout=@sout stderr=@serr;
-}
-
-file out[]<simple_mapper; location="outdir", prefix="f.",suffix=".out">;
-
-foreach j in [1:toInt(arg("n","1"))] {
-  file data<"data.txt">;
-  file sout<single_file_mapper; file=strcat("outdir/f.",j,".stdout")>;
-  file serr<single_file_mapper; file=strcat("outdir/f.",j,".stderr")>;
-  (out[j],sout,serr) = cat(data);
-}

Deleted: SwiftApps/subjobs/mpicatnap.c
===================================================================
--- SwiftApps/subjobs/mpicatnap.c	2015-02-25 16:20:58 UTC (rev 8378)
+++ SwiftApps/subjobs/mpicatnap.c	2015-02-27 17:02:34 UTC (rev 8379)
@@ -1,45 +0,0 @@
-#include <stdio.h>
-#include <mpi.h>
-#include <unistd.h>
-#include <fcntl.h>
-
-int main (argc, argv)
-int argc;
-char *argv[];
-{
-  int rank, size;
-
-  MPI_Init (&argc, &argv);  /* starts MPI */
-
-  char *ifile = argv[1];
-  char *ofile = argv[2];
-  int sleeptime = atoi(argv[3]);
-
-  MPI_Comm_rank (MPI_COMM_WORLD, &rank); /* get current MPI process id (rank) */
-  MPI_Comm_size (MPI_COMM_WORLD, &size); /* get number of MPI processes */
-
-  if (rank==0) {
-    printf("ifile=%s ofile=%s sleeptime=%d\n", ifile, ofile, sleeptime);
-
-    int ifd = open(ifile,O_RDONLY);
-    int ofd = open(ofile,O_WRONLY|O_CREAT,0664);
-    char buf[1024*1024];
-    for(;;) {
-      int rc = read(ifd, buf, sizeof(buf));
-      if (rc <= 0) {
-        close(ifd);
-        close(ofd);
-        break;
-      }
-      write(ofd, buf, rc);
-    }
-  }
-
-  sleep(sleeptime);
-
-  char host[512];
-  gethostname(host, 512);
-  printf( "Hello from process %d of %d on %s\n", rank, size, host);
-  MPI_Finalize();
-  return 0;
-}



From ketan at ci.uchicago.edu  Fri Feb 27 11:10:08 2015
From: ketan at ci.uchicago.edu (ketan at ci.uchicago.edu)
Date: Fri, 27 Feb 2015 11:10:08 -0600 (CST)
Subject: [Swift-commit] r8380 - in SwiftApps/subjobs: . mpicatsnsleep
Message-ID: <20150227171008.AEC7C1782B1@svn.ci.uchicago.edu>

Author: ketan
Date: 2015-02-27 11:10:08 -0600 (Fri, 27 Feb 2015)
New Revision: 8380

Added:
   SwiftApps/subjobs/mpicatsnsleep/
   SwiftApps/subjobs/mpicatsnsleep/apps
   SwiftApps/subjobs/mpicatsnsleep/catsnsleepmpi.swift
   SwiftApps/subjobs/mpicatsnsleep/cf
   SwiftApps/subjobs/mpicatsnsleep/in.data
   SwiftApps/subjobs/mpicatsnsleep/mpicatnap
   SwiftApps/subjobs/mpicatsnsleep/mpicatnap.c
   SwiftApps/subjobs/mpicatsnsleep/runswift.sh
Removed:
   SwiftApps/subjobs/in.data
Log:
adding dir for mpi test

Deleted: SwiftApps/subjobs/in.data
===================================================================
--- SwiftApps/subjobs/in.data	2015-02-27 17:02:34 UTC (rev 8379)
+++ SwiftApps/subjobs/in.data	2015-02-27 17:10:08 UTC (rev 8380)
@@ -1 +0,0 @@
-this is my input

Added: SwiftApps/subjobs/mpicatsnsleep/apps
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/apps	                        (rev 0)
+++ SwiftApps/subjobs/mpicatsnsleep/apps	2015-02-27 17:10:08 UTC (rev 8380)
@@ -0,0 +1,3 @@
+localhost cat /bin/cat null null null
+cluster bgsh /home/ketan/SwiftApps/subjobs/bg.sh null null null
+

Added: SwiftApps/subjobs/mpicatsnsleep/catsnsleepmpi.swift
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/catsnsleepmpi.swift	                        (rev 0)
+++ SwiftApps/subjobs/mpicatsnsleep/catsnsleepmpi.swift	2015-02-27 17:10:08 UTC (rev 8380)
@@ -0,0 +1,15 @@
+type file;
+
+app (file o, file sout, file serr) cat (file i)
+{
+  bgsh "/home/ketan/SwiftApps/subjobs/mpicatnap" @i @o arg("s","1") stdout=@sout stderr=@serr;
+}
+
+file out[]<simple_mapper; location="outdir", prefix="f.",suffix=".out">;
+
+foreach j in [1:toInt(arg("n","1"))] {
+  file data<"data.txt">;
+  file sout<single_file_mapper; file=strcat("outdir/f.",j,".stdout")>;
+  file serr<single_file_mapper; file=strcat("outdir/f.",j,".stderr")>;
+  (out[j],sout,serr) = cat(data);
+}

Added: SwiftApps/subjobs/mpicatsnsleep/cf
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/cf	                        (rev 0)
+++ SwiftApps/subjobs/mpicatsnsleep/cf	2015-02-27 17:10:08 UTC (rev 8380)
@@ -0,0 +1,6 @@
+use.provider.staging=false
+wrapperlog.always.transfer=false
+execution.retries=0
+provider.staging.pin.swiftfiles=false
+sitedir.keep=false
+use.wrapper.staging=false

Added: SwiftApps/subjobs/mpicatsnsleep/in.data
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/in.data	                        (rev 0)
+++ SwiftApps/subjobs/mpicatsnsleep/in.data	2015-02-27 17:10:08 UTC (rev 8380)
@@ -0,0 +1 @@
+this is my input

Added: SwiftApps/subjobs/mpicatsnsleep/mpicatnap
===================================================================
(Binary files differ)


Property changes on: SwiftApps/subjobs/mpicatsnsleep/mpicatnap
___________________________________________________________________
Added: svn:executable
   + *
Added: svn:mime-type
   + application/octet-stream

Added: SwiftApps/subjobs/mpicatsnsleep/mpicatnap.c
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/mpicatnap.c	                        (rev 0)
+++ SwiftApps/subjobs/mpicatsnsleep/mpicatnap.c	2015-02-27 17:10:08 UTC (rev 8380)
@@ -0,0 +1,45 @@
+#include <stdio.h>
+#include <mpi.h>
+#include <unistd.h>
+#include <fcntl.h>
+
+int main (argc, argv)
+int argc;
+char *argv[];
+{
+  int rank, size;
+
+  MPI_Init (&argc, &argv);  /* starts MPI */
+
+  char *ifile = argv[1];
+  char *ofile = argv[2];
+  int sleeptime = atoi(argv[3]);
+
+  MPI_Comm_rank (MPI_COMM_WORLD, &rank); /* get current MPI process id (rank) */
+  MPI_Comm_size (MPI_COMM_WORLD, &size); /* get number of MPI processes */
+
+  if (rank==0) {
+    printf("ifile=%s ofile=%s sleeptime=%d\n", ifile, ofile, sleeptime);
+
+    int ifd = open(ifile,O_RDONLY);
+    int ofd = open(ofile,O_WRONLY|O_CREAT,0664);
+    char buf[1024*1024];
+    for(;;) {
+      int rc = read(ifd, buf, sizeof(buf));
+      if (rc <= 0) {
+        close(ifd);
+        close(ofd);
+        break;
+      }
+      write(ofd, buf, rc);
+    }
+  }
+
+  sleep(sleeptime);
+
+  char host[512];
+  gethostname(host, 512);
+  printf( "Hello from process %d of %d on %s\n", rank, size, host);
+  MPI_Finalize();
+  return 0;
+}

Added: SwiftApps/subjobs/mpicatsnsleep/runswift.sh
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/runswift.sh	                        (rev 0)
+++ SwiftApps/subjobs/mpicatsnsleep/runswift.sh	2015-02-27 17:10:08 UTC (rev 8380)
@@ -0,0 +1,13 @@
+#! /bin/sh
+
+#Old method
+#qsub -A ATPESC2014 -n 512 -t 15 --mode script runswift_script.sh -config cf -tc.file apps -sites.file localcoast.xml "$@"
+
+#build app
+mpixlc mpicatnap.c -o mpicatnap
+
+#New method
+/home/ketan/swift-0.95/cog/modules/swift/dist/swift-svn/bin/swift -sites.file cobalt.xml -config cf -tc.file apps catsnsleepmpi.swift -n=64 -s=2
+
+#A testblock run
+#qsub -A ATPESC2013 -n 32 -t 5 -q low --mode c16 --mode script testblock.sh # --disable_preboot


Property changes on: SwiftApps/subjobs/mpicatsnsleep/runswift.sh
___________________________________________________________________
Added: svn:executable
   + *



From ketan at ci.uchicago.edu  Fri Feb 27 14:02:44 2015
From: ketan at ci.uchicago.edu (ketan at ci.uchicago.edu)
Date: Fri, 27 Feb 2015 14:02:44 -0600 (CST)
Subject: [Swift-commit] r8381 - SwiftApps/subjobs/mpicatsnsleep
Message-ID: <20150227200244.346D51782B1@svn.ci.uchicago.edu>

Author: ketan
Date: 2015-02-27 14:02:44 -0600 (Fri, 27 Feb 2015)
New Revision: 8381

Added:
   SwiftApps/subjobs/mpicatsnsleep/cobalt.cetus.xml
   SwiftApps/subjobs/mpicatsnsleep/data.txt
   SwiftApps/subjobs/mpicatsnsleep/runcetus.sh
Removed:
   SwiftApps/subjobs/mpicatsnsleep/in.data
Modified:
   SwiftApps/subjobs/mpicatsnsleep/catsnsleepmpi.swift
   SwiftApps/subjobs/mpicatsnsleep/runswift.sh
Log:
test on cetus

Modified: SwiftApps/subjobs/mpicatsnsleep/catsnsleepmpi.swift
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/catsnsleepmpi.swift	2015-02-27 17:10:08 UTC (rev 8380)
+++ SwiftApps/subjobs/mpicatsnsleep/catsnsleepmpi.swift	2015-02-27 20:02:44 UTC (rev 8381)
@@ -2,7 +2,7 @@
 
 app (file o, file sout, file serr) cat (file i)
 {
-  bgsh "/home/ketan/SwiftApps/subjobs/mpicatnap" @i @o arg("s","1") stdout=@sout stderr=@serr;
+  bgsh "/home/ketan/SwiftApps/subjobs/mpicatsnsleep/mpicatnap" @i @o arg("s","1") stdout=@sout stderr=@serr;
 }
 
 file out[]<simple_mapper; location="outdir", prefix="f.",suffix=".out">;

Added: SwiftApps/subjobs/mpicatsnsleep/cobalt.cetus.xml
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/cobalt.cetus.xml	                        (rev 0)
+++ SwiftApps/subjobs/mpicatsnsleep/cobalt.cetus.xml	2015-02-27 20:02:44 UTC (rev 8381)
@@ -0,0 +1,32 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<config xmlns="http://www.ci.uchicago.edu/swift/SwiftSites">
+
+<pool handle="cluster">
+<execution provider="coaster" jobmanager="local:cobalt" />
+
+<profile namespace="globus" key="slots">1</profile>
+<profile namespace="globus" key="mode">script</profile>
+
+<profile namespace="karajan" key="jobThrottle">2.99</profile>
+<profile namespace="karajan" key="initialScore">10000</profile>
+<profile namespace="globus" key="maxwalltime">00:04:00</profile>
+<profile namespace="globus" key="walltime">600</profile>
+
+<profile namespace="globus" key="maxnodes">32</profile>
+<profile namespace="globus" key="nodegranularity">32</profile>
+<profile key="SUBBLOCK_SIZE" namespace="env">16</profile>
+<!--
+<profile key="WORKER_LOGGING_LEVEL" namespace="env">DEBUG</profile>
+<profile key="ENABLE_WORKER_LOGGING" namespace="env">TRUE</profile>
+<profile key="ENABLE_WORKER_LOGGING" namespace="env">ON</profile>
+<profile key="WORKER_LOG_DIR" namespace="env">/home/ketan/workerlogs</profile>
+<profile namespace="globus" key="workerLoggingLevel">DEBUG</profile>
+<profile namespace="globus" key="workerLoggingDirectory">/home/ketan/workerlogs</profile>
+-->
+<profile namespace="globus" key="jobsPerNode">2</profile>
+
+<workdirectory>/home/ketan/swiftwork</workdirectory>
+<filesystem provider="local"/>
+
+</pool>
+</config>

Copied: SwiftApps/subjobs/mpicatsnsleep/data.txt (from rev 8380, SwiftApps/subjobs/mpicatsnsleep/in.data)
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/data.txt	                        (rev 0)
+++ SwiftApps/subjobs/mpicatsnsleep/data.txt	2015-02-27 20:02:44 UTC (rev 8381)
@@ -0,0 +1 @@
+this is my input

Deleted: SwiftApps/subjobs/mpicatsnsleep/in.data
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/in.data	2015-02-27 17:10:08 UTC (rev 8380)
+++ SwiftApps/subjobs/mpicatsnsleep/in.data	2015-02-27 20:02:44 UTC (rev 8381)
@@ -1 +0,0 @@
-this is my input

Added: SwiftApps/subjobs/mpicatsnsleep/runcetus.sh
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/runcetus.sh	                        (rev 0)
+++ SwiftApps/subjobs/mpicatsnsleep/runcetus.sh	2015-02-27 20:02:44 UTC (rev 8381)
@@ -0,0 +1,13 @@
+#! /bin/sh
+
+#Old method
+#qsub -A ATPESC2014 -n 512 -t 15 --mode script runswift_script.sh -config cf -tc.file apps -sites.file localcoast.xml "$@"
+
+#build app
+#mpixlc mpicatnap.c -o mpicatnap
+
+#New method
+/home/ketan/swift-0.95/cog/modules/swift/dist/swift-svn/bin/swift -sites.file cobalt.cetus.xml -config cf -tc.file apps catsnsleepmpi.swift -n=16 -s=1
+
+#A testblock run
+#qsub -A ATPESC2013 -n 32 -t 5 -q low --mode c16 --mode script testblock.sh # --disable_preboot


Property changes on: SwiftApps/subjobs/mpicatsnsleep/runcetus.sh
___________________________________________________________________
Added: svn:executable
   + *

Modified: SwiftApps/subjobs/mpicatsnsleep/runswift.sh
===================================================================
--- SwiftApps/subjobs/mpicatsnsleep/runswift.sh	2015-02-27 17:10:08 UTC (rev 8380)
+++ SwiftApps/subjobs/mpicatsnsleep/runswift.sh	2015-02-27 20:02:44 UTC (rev 8381)
@@ -7,7 +7,7 @@
 mpixlc mpicatnap.c -o mpicatnap
 
 #New method
-/home/ketan/swift-0.95/cog/modules/swift/dist/swift-svn/bin/swift -sites.file cobalt.xml -config cf -tc.file apps catsnsleepmpi.swift -n=64 -s=2
+/home/ketan/swift-0.95/cog/modules/swift/dist/swift-svn/bin/swift -sites.file cobalt.xml -config cf -tc.file apps catsnsleepmpi.swift -n=16 -s=1
 
 #A testblock run
 #qsub -A ATPESC2013 -n 32 -t 5 -q low --mode c16 --mode script testblock.sh # --disable_preboot