swift-t -m pbs -n 96 -s settings.sh program.swift
+From ketan at ci.uchicago.edu Mon Nov 3 13:57:35 2014
From: ketan at ci.uchicago.edu (ketan at ci.uchicago.edu)
Date: Mon, 3 Nov 2014 13:57:35 -0600 (CST)
Subject: [Swift-commit] r8296 - SwiftApps/swift-galaxy
Message-ID: <20141103195735.32B549D846@svn.ci.uchicago.edu>
Author: ketan
Date: 2014-11-03 13:57:33 -0600 (Mon, 03 Nov 2014)
New Revision: 8296
Modified:
SwiftApps/swift-galaxy/setup.py
Log:
small change to adjust to latest galaxy versions
Modified: SwiftApps/swift-galaxy/setup.py
===================================================================
--- SwiftApps/swift-galaxy/setup.py 2014-10-31 20:56:50 UTC (rev 8295)
+++ SwiftApps/swift-galaxy/setup.py 2014-11-03 19:57:33 UTC (rev 8296)
@@ -39,13 +39,13 @@
os.symlink ("/tmp/swift-galaxy/swift", galaxyloc+"/tools/swift");
#step 2. update the tool_conf.xml
-tree = ET.parse(galaxyloc+"/tool_conf.xml")
+tree = ET.parse(galaxyloc+"/config/tool_conf.xml.main")
root = tree.getroot()
if 'swift' not in root.attrib:
root.append((ET.fromstring('
Swift/T runs millions of tasks per second on supercomputers.
From wozniak at ci.uchicago.edu Wed Nov 5 11:56:31 2014 From: wozniak at ci.uchicago.edu (wozniak at ci.uchicago.edu) Date: Wed, 5 Nov 2014 11:56:31 -0600 (CST) Subject: [Swift-commit] r8298 - www/main Message-ID: <20141105175631.293229D8B5@svn.ci.uchicago.edu> Author: wozniak Date: 2014-11-05 11:56:31 -0600 (Wed, 05 Nov 2014) New Revision: 8298 Modified: www/main/index.php Log: WIP Modified: www/main/index.php =================================================================== --- www/main/index.php 2014-11-05 17:53:09 UTC (rev 8297) +++ www/main/index.php 2014-11-05 17:56:31 UTC (rev 8298) @@ -175,9 +175,15 @@Swift will be featured at:
-
-
Swift will be featured in many events:
+
+ Regular paper on Swift/T
+ MTAGS
+ HPTCDL
+ ESPT
+Release 0.7.0 [exm-0.7.0.tar.gz] (6.5 MB) +
++11/15/2014 +
+Changes:
+Support for remote execution via Coasters +
+
+New swift-t
tool combines stc
and turbine
+
+New soft targeting feature for data-intensive computing +
+
+Ability to retry app
functions
+
+More features for TURBINE_OUTPUT
+
+Default number of processes is now 2 (not 3) +
+
+Renamed aprun
scheduler to cray
+
+Renamed setup.sh
to bootstrap
+
+STC output is now in a *.tic
file by default
+
@@ -1183,7 +1261,7 @@
<wozniak at mcs.anl.gov>
-turbine-aprun-run.zsh
(PBS with Cray’s aprun
)
+turbine-cray-run.zsh
(PBS with Cray’s aprun
)
A typical invocation is:
swift-t -m pbs -n 96 -s settings.sh program.swift
+or:
stc program.swift
-turbine-pbs-run.zsh -n 96 -s settings.sh program.tcl
+turbine-pbs-run.zsh -n 96 -s settings.sh program.tic
where program.tcl
is the output of STC and settings.sh
contains:
which are equivalent.
program.tic
is the output of STC and settings.sh
contains:
export QUEUE=bigqueue
export PPN=8
which would run program.tcl
in 96 MPI processes on 12 nodes (8
+
which would run program.tic
in 96 MPI processes on 12 nodes (8
processes per node), submitted by PBS to queue bigqueue
.
For scheduled systems, Turbine accepts a common set of environment -variables.
settings.sh
or set by the user in
+any other way.PROCS
@@ -1073,7 +1080,7 @@
Run standalone Turbine executable
(created by mkstatic.tcl) instead of
- program.tcl
.
+ program.tic
.
program.tcl
) is
+(a Java-based program) running. STC output (program.tic
) is
platform-independent. You may run STC to develop and debug your
-script on your local workstation, then simply copy program.tcl
to
+script on your local workstation, then simply copy program.tic
to
the big machine for execution. Just make sure that the STC and
Turbine versions are compatible (the same release number).mpiexec
.turbine -l -n 3 -f hosts.txt program.tcl
+turbine -l -n 3 -f hosts.txt program.tic
echo crush.mcs.anl.gov > hosts.txt
echo crank.mcs.anl.gov >> hosts.txt
-turbine -l -n 3 -f hosts.txt program.tcl
+turbine -l -n 3 -f hosts.txt program.tic
export TURBINE_LAUNCH_OPTS='-f hosts.txt'
-turbine -l -n 4 program.tcl
+turbine -l -n 4 program.tic
To run:
srun ~wozniak/Public/turbine-0.1.1/scripts/submit/slurm/turbine-slurm.sh -n 3 ~/program.tcl
+srun ~wozniak/Public/turbine-0.1.1/scripts/submit/slurm/turbine-slurm.sh -n 3 ~/program.tic
export MODE=cluster
export QUEUE=pubnet
export PROJECT=...
-turbine-cobalt-run.zsh -n 3 program.tcl
+turbine-cobalt-run.zsh -n 3 program.tic
export QUEUE=batch
-~wozniak/Public/turbine/scripts/submit/pbs/turbine-pbs-run.zsh -n 3 program.tcl
+~wozniak/Public/turbine/scripts/submit/pbs/turbine-pbs-run.zsh -n 3 program.tic
See the Turbine scheduler variables and Turbine run script options for additional settings.
To run:
~wozniak/Public/turbine/scripts/submit/cobalt/turbine-cobalt-run.zsh -n 3 ~/program.tcl
+~wozniak/Public/turbine/scripts/submit/cobalt/turbine-cobalt-run.zsh -n 3 ~/program.tic
As of: 0.4.0 - 07/29/2013
As of: 0.7.0 - 11/20/2014
Add to PATH
:
-STC: ~wozniak/Public/stc-bgq/bin/stc
+STC: ~wozniak/Public/ppc64/stc/bin
-Turbine: ~wozniak/Public/turbine-bgq/scrips/submit/cobalt/turbine-cobalt-run.zsh
+Turbine (optional): ~wozniak/Public/ppc64/turbine/scripts/submit/cobalt
export MODE=BGQ
-export QUEUE=<queue_name>
-turbine-cobalt-run.zsh -n 3 program.tcl
+export QUEUE=...
+export PROJECT=...
+swift-t -m cobalt -n 3 program.tic
The normal Turbine environment variables are honored, plus the -Turbine scheduler variables.
As of: 0.5.0 - 4/4/2014
Add to PATH
:
-* STC: wozniak/Public/ppc64/stc/bin
-* Turbine:
-wozniak/Public/ppc64/turbine/scripts/submit/cobalt
As of: 0.7.0 - 11/20/2014
+STC: ~wozniak/Public/sfw/stc/bin
+
+Turbine (optional): ~wozniak/Public/sfw/turbine/scripts/submit/turbine-cobalt-run.zsh
+
Run as:
export MODE=BGQ
-export QUEUE=...
-export PROJECT=...
-turbine-cobalt-run.zsh -n 3 program.tcl
+export QUEUE=default
+swift-t -m cobalt -n 2 program.tic
As of: 0.5.0 - 4/4/2014
The normal Turbine environment variables are honored, plus the +Turbine scheduler variables.
As of: 0.7.0 - 11/20/2014
Tcl:
The GCC installation does not support shared libraries. Thus, you
must compile Tcl with bgxlc
. You must modify the Makefile to use
@@ -1598,22 +1610,32 @@
You may get errors that say wrong digit
. This is apparently a bgxlc
bug when applied to Tcl’s StrToD.c
. Compiling this file with -O3
fixes
the problem.
Put /bgsys/drivers/V1R2M1/ppc64/comm/bin/gcc
in your PATH
.
-Compile c-utils with CC=/usr/bin/gcc
+Compile c-utils with CC=powerpc64-bgq-linux-gcc
-Configure ADLB with CC=mpixlc --enable-mpi-2 --enable-xlc
+Configure ADLB with CC=mpixlc --enable-mpi-2 --enable-xlc --disable-checkpoint
-Configure Turbine with CC=/usr/bin/gcc --disable-static --with-tcl=/home/wozniak/Public/sfw/ppc64/tcl-8.5.12 --with-mpi=/bgsys/drivers/V1R2M1/ppc64/comm --with-mpi-lib-name=mpich-gcc
+Configure Turbine with:
CC=mpixlc
+--disable-static
+--with-tcl=/home/wozniak/Public/sfw/ppc64/bgxlc/dynamic/tcl-8.5.12
+--with-mpi=/bgsys/drivers/V1R2M1/ppc64/comm
+--with-mpi-lib-name=mpich-xl
+--without-zlib
+--without-hdf5
+--disable-static-pkg
+External scripting:
Titan is a Cray XK7 at the Oak Ridge Leadership Computing Facility.
As of: 8/27/2014
/lustre
. Also, your data must be in /lustre
.This installation is for use on the login node.
export TURBINE_LAUNCH_OPTS="-f $HOME/hosts.txt"
-turbine program.tcl
+turbine program.tic
mpiexec tclsh program.tcl
+mpiexec tclsh program.tic
On more complex, scheduled systems, users do not invoke mpiexec
directly. Thus, sample scripts are provided below.