From wilde at mcs.anl.gov  Mon Jun  4 10:10:30 2012
From: wilde at mcs.anl.gov (Michael Wilde)
Date: Mon, 4 Jun 2012 10:10:30 -0500 (CDT)
Subject: [Swift-devel] Suggest we update Swift 0.93 on Beagle for
	SWIFT_USERHOME fix
Message-ID: <80850584.7945.1338822630750.JavaMail.root@zimbra.anl.gov>

Hi David,

Swift 0.93 rev 5285 has the SWIFT_USERHOME fix thats needed on Beagle to enable Swift to use /lustre instead of /home for the $HOME/.globus/scripts directory.

I think Lorenzo and other Beagle users have been forced to use their own modified Swift releases since $HOME became non-writable.

Can you check if its safe to update the swift/0.93 module to at least this rev level, and also if the same fix needs to be applied to trunk in svn?

Might need some discussion - I cant recall if any alternatives to this fix were proposed.

Thanks,

- Mike

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory



From davidk at ci.uchicago.edu  Tue Jun  5 21:19:49 2012
From: davidk at ci.uchicago.edu (David Kelly)
Date: Tue, 5 Jun 2012 21:19:49 -0500 (CDT)
Subject: [Swift-devel] MPI jobs with plain PBS provider
In-Reply-To: <1356665069.96326.1338945211679.JavaMail.root@zimbra-mb2.anl.gov>
Message-ID: <71023753.96455.1338949189518.JavaMail.root@zimbra-mb2.anl.gov>

Hello,

I am trying to run an MPI job with the plain PBS provider (no coasters) on Fusion. I'm following the instructions in the user guide, section 19.3.1 (http://www.ci.uchicago.edu/swift/guides/trunk/userguide/userguide.html#_launching_mpi_jobs_from_swift). It works well with one node. How can I start only one worker, but request multiple nodes? I need something like this in the submit script:

#PBS -l nodes=2:ppn=8

>From looking at the provider, it looks like the value of nodes is determined by the internal 'count' variable, which I believe is always set to 1 for non-coaster jobs. I can control the ppn with the ppn attribute, but as far as I can tell, there is no nodes attribute. Does it make sense to add one for MPI jobs like this?

Here are the files I am testing with:

sites.xml
---------
<config>
<pool handle="fusion">
  <execution jobmanager="local:pbs" provider="pbs" url="none"/>
  <filesystem provider="local" url="none" />
  <profile namespace="globus" key="maxtime">60</profile>
  <profile namespace="globus" key="jobsPerNode">1</profile>
  <profile namespace="globus" key="ppn">8</profile>
  <profile namespace="karajan" key="jobThrottle">5.99</profile>
  <profile namespace="karajan" key="initialScore">10000</profile>
  <workdirectory>/homes/davidk/swiftwork</workdirectory>
</pool>
</config>
---------


testmpi.swift
-------------
type file;

app (file r) mpi ()
{
  mpi;
}

file results <"results.tar">;
results = mpi();
-------------


mpi.sh
------
#!/bin/bash

mpiexec -machinefile $PBS_NODEFILE /home/davidk/testmpi/testmpi
------

David


From wilde at mcs.anl.gov  Wed Jun  6 09:26:09 2012
From: wilde at mcs.anl.gov (Michael Wilde)
Date: Wed, 6 Jun 2012 09:26:09 -0500 (CDT)
Subject: [Swift-devel] MPI jobs with plain PBS provider
In-Reply-To: <71023753.96455.1338949189518.JavaMail.root@zimbra-mb2.anl.gov>
Message-ID: <916537120.11098.1338992769540.JavaMail.root@zimbra.anl.gov>

David, adding jobType and count attributes as follows should do what you want:

    <profile namespace="globus" key="count">2</profile>
    <profile namespace="globus" key="jobType">single</profile>

This was added to trunk on May 22, r3412:
---
Accept jobType value "single" in sites.xml to force a multi-node non-coaster non-JETS PBS job to run a single application.
---

Test on plain PBS (PADS), not yet tested on Cray PBS.

- Mike


----- Original Message -----
> From: "David Kelly" <davidk at ci.uchicago.edu>
> To: "Swift Devel" <swift-devel at ci.uchicago.edu>
> Sent: Tuesday, June 5, 2012 9:19:49 PM
> Subject: [Swift-devel] MPI jobs with plain PBS provider
> Hello,
> 
> I am trying to run an MPI job with the plain PBS provider (no
> coasters) on Fusion. I'm following the instructions in the user guide,
> section 19.3.1
> (http://www.ci.uchicago.edu/swift/guides/trunk/userguide/userguide.html#_launching_mpi_jobs_from_swift).
> It works well with one node. How can I start only one worker, but
> request multiple nodes? I need something like this in the submit
> script:
> 
> #PBS -l nodes=2:ppn=8
> 
> From looking at the provider, it looks like the value of nodes is
> determined by the internal 'count' variable, which I believe is always
> set to 1 for non-coaster jobs. I can control the ppn with the ppn
> attribute, but as far as I can tell, there is no nodes attribute. Does
> it make sense to add one for MPI jobs like this?
> 
> Here are the files I am testing with:
> 
> sites.xml
> ---------
> <config>
> <pool handle="fusion">
> <execution jobmanager="local:pbs" provider="pbs" url="none"/>
> <filesystem provider="local" url="none" />
> <profile namespace="globus" key="maxtime">60</profile>
> <profile namespace="globus" key="jobsPerNode">1</profile>
> <profile namespace="globus" key="ppn">8</profile>
> <profile namespace="karajan" key="jobThrottle">5.99</profile>
> <profile namespace="karajan" key="initialScore">10000</profile>
> <workdirectory>/homes/davidk/swiftwork</workdirectory>
> </pool>
> </config>
> ---------
> 
> 
> testmpi.swift
> -------------
> type file;
> 
> app (file r) mpi ()
> {
> mpi;
> }
> 
> file results <"results.tar">;
> results = mpi();
> -------------
> 
> 
> mpi.sh
> ------
> #!/bin/bash
> 
> mpiexec -machinefile $PBS_NODEFILE /home/davidk/testmpi/testmpi
> ------
> 
> David
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory



From davidk at ci.uchicago.edu  Wed Jun  6 10:10:19 2012
From: davidk at ci.uchicago.edu (David Kelly)
Date: Wed, 6 Jun 2012 10:10:19 -0500 (CDT)
Subject: [Swift-devel] MPI jobs with plain PBS provider
In-Reply-To: <916537120.11098.1338992769540.JavaMail.root@zimbra.anl.gov>
Message-ID: <317981528.98466.1338995419258.JavaMail.root@zimbra-mb2.anl.gov>

Mike,

Thank you - the test MPI application is now working well using multiple nodes on Fusion.

David

----- Original Message -----
> From: "Michael Wilde" <wilde at mcs.anl.gov>
> To: "David Kelly" <davidk at ci.uchicago.edu>
> Cc: "Swift Devel" <swift-devel at ci.uchicago.edu>
> Sent: Wednesday, June 6, 2012 9:26:09 AM
> Subject: Re: [Swift-devel] MPI jobs with plain PBS provider
> David, adding jobType and count attributes as follows should do what
> you want:
> 
> <profile namespace="globus" key="count">2</profile>
> <profile namespace="globus" key="jobType">single</profile>
> 
> This was added to trunk on May 22, r3412:
> ---
> Accept jobType value "single" in sites.xml to force a multi-node
> non-coaster non-JETS PBS job to run a single application.
> ---
> 
> Test on plain PBS (PADS), not yet tested on Cray PBS.
> 
> - Mike
> 
> 
> ----- Original Message -----
> > From: "David Kelly" <davidk at ci.uchicago.edu>
> > To: "Swift Devel" <swift-devel at ci.uchicago.edu>
> > Sent: Tuesday, June 5, 2012 9:19:49 PM
> > Subject: [Swift-devel] MPI jobs with plain PBS provider
> > Hello,
> >
> > I am trying to run an MPI job with the plain PBS provider (no
> > coasters) on Fusion. I'm following the instructions in the user
> > guide,
> > section 19.3.1
> > (http://www.ci.uchicago.edu/swift/guides/trunk/userguide/userguide.html#_launching_mpi_jobs_from_swift).
> > It works well with one node. How can I start only one worker, but
> > request multiple nodes? I need something like this in the submit
> > script:
> >
> > #PBS -l nodes=2:ppn=8
> >
> > From looking at the provider, it looks like the value of nodes is
> > determined by the internal 'count' variable, which I believe is
> > always
> > set to 1 for non-coaster jobs. I can control the ppn with the ppn
> > attribute, but as far as I can tell, there is no nodes attribute.
> > Does
> > it make sense to add one for MPI jobs like this?
> >
> > Here are the files I am testing with:
> >
> > sites.xml
> > ---------
> > <config>
> > <pool handle="fusion">
> > <execution jobmanager="local:pbs" provider="pbs" url="none"/>
> > <filesystem provider="local" url="none" />
> > <profile namespace="globus" key="maxtime">60</profile>
> > <profile namespace="globus" key="jobsPerNode">1</profile>
> > <profile namespace="globus" key="ppn">8</profile>
> > <profile namespace="karajan" key="jobThrottle">5.99</profile>
> > <profile namespace="karajan" key="initialScore">10000</profile>
> > <workdirectory>/homes/davidk/swiftwork</workdirectory>
> > </pool>
> > </config>
> > ---------
> >
> >
> > testmpi.swift
> > -------------
> > type file;
> >
> > app (file r) mpi ()
> > {
> > mpi;
> > }
> >
> > file results <"results.tar">;
> > results = mpi();
> > -------------
> >
> >
> > mpi.sh
> > ------
> > #!/bin/bash
> >
> > mpiexec -machinefile $PBS_NODEFILE /home/davidk/testmpi/testmpi
> > ------
> >
> > David
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> 
> --
> Michael Wilde
> Computation Institute, University of Chicago
> Mathematics and Computer Science Division
> Argonne National Laboratory


From lpesce at uchicago.edu  Fri Jun  8 14:39:19 2012
From: lpesce at uchicago.edu (Lorenzo Pesce)
Date: Fri, 8 Jun 2012 14:39:19 -0500
Subject: [Swift-devel] ram disk with swift
Message-ID: <B976B06A-D7C4-4017-9CD4-B3C3F2493739@uchicago.edu>

Mike,
We were talking about putting the input files for Taka's calculations (the X.mat files), which are rather small ~ 60Kb or so, in ram disk and try to use them for all the apps (that use the same file). giving the size, we could even load up all of them for each node (7*3*60=1.2MB, that is zero) to reduce traffic towards /lustre and thus avoid the meta-data slow downs that Beagle seems to have.

If we copy files in /tmp (as far as I understand it would be ramdisk) on the each node through swift, would it be there for all the apps?

Thanks,

Lorenzo

From wilde at mcs.anl.gov  Fri Jun  8 14:53:25 2012
From: wilde at mcs.anl.gov (Michael Wilde)
Date: Fri, 8 Jun 2012 14:53:25 -0500 (CDT)
Subject: [Swift-devel] ram disk with swift
In-Reply-To: <B976B06A-D7C4-4017-9CD4-B3C3F2493739@uchicago.edu>
Message-ID: <1328245645.3177.1339185205054.JavaMail.root@zimbra.anl.gov>


> We were talking about putting the input files for Taka's calculations
> (the X.mat files), which are rather small ~ 60Kb or so, in ram disk
> and try to use them for all the apps (that use the same file). giving
> the size, we could even load up all of them for each node
> (7*3*60=1.2MB, that is zero) to reduce traffic towards /lustre and
> thus avoid the meta-data slow downs that Beagle seems to have.
> 
> If we copy files in /tmp (as far as I understand it would be ramdisk)
> on the each node through swift, would it be there for all the apps?

One way to do this, which has worked well for us is this:

- in the app wrapper script, create a function that loads the constant input data

- in this function, using directory-based locking logic to:

  -- create a data dir under /tmp
  -- fill the dir from a tarball

- in the app wrapper logic, if the /tmp/data dir is there, use it
  else call the function to create it.

This logic uses the fact that directory creation is atomic, so you can use that to prevent races where two apps running on the same node would each try to create the dir.

David, can you post the logic you developed for the above?

Thanks,

- Mike


From hockyg at gmail.com  Fri Jun  8 15:01:54 2012
From: hockyg at gmail.com (Glen Hocky)
Date: Fri, 8 Jun 2012 16:01:54 -0400
Subject: [Swift-devel] [Swift-user] ram disk with swift
In-Reply-To: <1328245645.3177.1339185205054.JavaMail.root@zimbra.anl.gov>
References: <B976B06A-D7C4-4017-9CD4-B3C3F2493739@uchicago.edu>
	<1328245645.3177.1339185205054.JavaMail.root@zimbra.anl.gov>
Message-ID: <CAGMfakmY=_531AsCrfjE3oncTODW1Fd4qxQ6iE2oXm=Fv8jzxw@mail.gmail.com>

Mike, Lorenzo,
Probably David will have something that will work but in case this helps,
this is the (a) routine you and I developed together for BGP some years ago
(July 08 apparently). Before running a few variables have to be set up so I
also included the setupvars script we had for reference...

function loadfile
{
        cd $rootdir
        local ARCHIVE=$1
        local ARCHIVE_NAME=`basename $ARCHIVE`
        local START_LOCK=$ARCHIVE_NAME-oops-cache-lock-started
        local END_LOCK=$ARCHIVE_NAME-oops-cache-lock-finished
        if [ ! -d ${START_LOCK} ];then
                mkdir ${START_LOCK}
                EXITCODE=$?
                if [ "${EXITCODE}" -ne "0" ];then
                    echo "waiting for data to be copied"
                    while [ ! -d ${END_LOCK} ];do
                        sleep 1
                    done
                else
                        echo "Copying $ARCHIVE to $rootdir"
                        cp -v $ARCHIVE $rootdir
                        tar xzvf $ARCHIVE_NAME
                        rm $ARCHIVE_NAME
                        mkdir ${END_LOCK}
                fi
        else
                while [ ! -d ${END_LOCK} ];do
                        sleep 1
                done
        fi
        return 0
}

function setupvars
{
        export PATH=/fuse/bin:/fuse/usr/bin:$PATH
        rootdir=/dev/shm
        data_location=$1
        protein=$2
        round=$3
        jobid=$4
        killtime=$5

        loadseed=1

        usagestring="$0 DATA_LOCATION PROTEIN ROUND JOBID KILLTIME"
        if [ -z $5 ];then
                echo $usagestring
                echo "Example: $0 /home/hockyg/glOOPS/bgprt 1ubq 1 1 30"
                exit 27
        fi

        oops_pack=$data_location/rt-base.tar.gz
        rtbasedir=$rootdir/rt-base
        input_pack=$data_location/input-$protein.tar.gz
        inputdir=$rootdir/input-$protein
        starttime=`date +%s`
        protid=$protein-$round-$jobid
        protdir=$rootdir/$protid
        timeshift=$(( $jobid % 60 ))

        mkdir -p $protdir/output

        returndir=$data_location/output/$protein/$round
        outdir=$protdir/output
        runoopslog=$protdir/output/$protid.runoopslog
        oopsreturnfile=$rootdir/$protid-done

        if [ ! -e $returndir ];then
                mkdir -p $returndir
        fi

        if [ ! -z $loadseed ];then
                seedfile=$protdir/output/$protid.random
                let seed=`expr $round*10000+$jobid`
                #echo "Writing seed $seed to $seedfile"
                echo $seed > $seedfile
        fi
}



On Fri, Jun 8, 2012 at 3:53 PM, Michael Wilde <wilde at mcs.anl.gov> wrote:

>
> > We were talking about putting the input files for Taka's calculations
> > (the X.mat files), which are rather small ~ 60Kb or so, in ram disk
> > and try to use them for all the apps (that use the same file). giving
> > the size, we could even load up all of them for each node
> > (7*3*60=1.2MB, that is zero) to reduce traffic towards /lustre and
> > thus avoid the meta-data slow downs that Beagle seems to have.
> >
> > If we copy files in /tmp (as far as I understand it would be ramdisk)
> > on the each node through swift, would it be there for all the apps?
>
> One way to do this, which has worked well for us is this:
>
> - in the app wrapper script, create a function that loads the constant
> input data
>
> - in this function, using directory-based locking logic to:
>
>  -- create a data dir under /tmp
>  -- fill the dir from a tarball
>
> - in the app wrapper logic, if the /tmp/data dir is there, use it
>  else call the function to create it.
>
> This logic uses the fact that directory creation is atomic, so you can use
> that to prevent races where two apps running on the same node would each
> try to create the dir.
>
> David, can you post the logic you developed for the above?
>
> Thanks,
>
> - Mike
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120608/d25bc512/attachment.html>

From davidk at ci.uchicago.edu  Fri Jun  8 16:34:43 2012
From: davidk at ci.uchicago.edu (David Kelly)
Date: Fri, 8 Jun 2012 16:34:43 -0500 (CDT)
Subject: [Swift-devel] ram disk with swift
In-Reply-To: <B976B06A-D7C4-4017-9CD4-B3C3F2493739@uchicago.edu>
Message-ID: <1272810551.111958.1339191283314.JavaMail.root@zimbra-mb2.anl.gov>

Here is a portion of a script that that copies some frequently used data to a node's shared memory. I think it is pretty similar to the script that Glen sent earlier.

dssatdir=/dev/shm/dssat
dssattmp=/dev/shm/dssat.tmp

if [ ! -d $dssatdir ]; then
  if mkdir $dssattmp 2>/dev/null; then
    echo $$ copying
    savewd=$PWD
    cd $dssattmp

    mkdir -p refdata
    cp $refdata/* refdata/

    mkdir -p campaign
    cp $campaign/*.MZX campaign/

    mkdir -p binpath
    cp $binpath/*.EXE binpath/

    cd $savewd
    mv $dssattmp $dssatdir
  else
    while [ ! -d $dssatdir ]; do
     # echo $$ sleeping
      sleep 1;
    done
  fi
fi



----- Original Message -----
> From: "Lorenzo Pesce" <lpesce at uchicago.edu>
> To: "Michael Wilde" <wilde at mcs.anl.gov>, "Swift Devel" <swift-devel at ci.uchicago.edu>, swift-user at ci.uchicago.edu
> Cc: "Kazutaka Takahashi" <kazutaka at gmail.com>
> Sent: Friday, June 8, 2012 2:39:19 PM
> Subject: [Swift-devel] ram disk with swift
> Mike,
> We were talking about putting the input files for Taka's calculations
> (the X.mat files), which are rather small ~ 60Kb or so, in ram disk
> and try to use them for all the apps (that use the same file). giving
> the size, we could even load up all of them for each node
> (7*3*60=1.2MB, that is zero) to reduce traffic towards /lustre and
> thus avoid the meta-data slow downs that Beagle seems to have.
> 
> If we copy files in /tmp (as far as I understand it would be ramdisk)
> on the each node through swift, would it be there for all the apps?
> 
> Thanks,
> 
> Lorenzo
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel


From hategan at mcs.anl.gov  Sat Jun  9 15:58:53 2012
From: hategan at mcs.anl.gov (Mihael Hategan)
Date: Sat, 09 Jun 2012 13:58:53 -0700
Subject: [Swift-devel] coaster c client
Message-ID: <1339275533.14910.2.camel@blabla>

Justin,

When you said C instead of C++, did you mean you want the API to be
C-like or was that a restriction on the internals. I'd rather use type
safe lists and hashtables than otherwise.

Mihael



From wozniak at mcs.anl.gov  Sat Jun  9 18:32:12 2012
From: wozniak at mcs.anl.gov (Justin M Wozniak)
Date: Sat, 9 Jun 2012 18:32:12 -0500
Subject: [Swift-devel] coaster c client
In-Reply-To: <1339275533.14910.2.camel@blabla>
References: <1339275533.14910.2.camel@blabla>
Message-ID: <4a2b7574-e167-4b25-9a9c-6f24848c1d03@blur>


C++ internals are fine.

-----Original message-----
From: Mihael Hategan <hategan at mcs.anl.gov>
To: Swift Devel <swift-devel at ci.uchicago.edu>
Sent: Sat, Jun 9, 2012 15:58:57 GMT+00:00
Subject: [Swift-devel] coaster c client

Justin,

When you said C instead of C++, did you mean you want the API to be
C-like or was that a restriction on the internals. I'd rather use type
safe lists and hashtables than otherwise.

Mihael

_______________________________________________
Swift-devel mailing list
Swift-devel at ci.uchicago.edu
https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120609/acef254c/attachment.html>

From hategan at mcs.anl.gov  Sat Jun  9 19:42:16 2012
From: hategan at mcs.anl.gov (Mihael Hategan)
Date: Sat, 09 Jun 2012 17:42:16 -0700
Subject: [Swift-devel] coaster c client
In-Reply-To: <4a2b7574-e167-4b25-9a9c-6f24848c1d03@blur>
References: <1339275533.14910.2.camel@blabla>
	<4a2b7574-e167-4b25-9a9c-6f24848c1d03@blur>
Message-ID: <1339288936.16642.0.camel@blabla>

Ok.

So Tcl is the main client here. Swig is what you use for wrappring C
code?

Mihael

On Sat, 2012-06-09 at 18:32 -0500, Justin M Wozniak wrote:
> 
> C++ internals are fine.
> 
> 
> -----Original message-----
>         From: Mihael Hategan <hategan at mcs.anl.gov>
>         To: Swift Devel <swift-devel at ci.uchicago.edu>
>         Sent: Sat, Jun 9, 2012 15:58:57 GMT+00:00
>         Subject: [Swift-devel] coaster c client
>         
>         
>         Justin,
>         
>         When you said C instead of C++, did you mean you want the API
>         to be
>         C-like or was that a restriction on the internals. I'd rather
>         use type
>         safe lists and hashtables than otherwise.
>         
>         Mihael
>         
>         _______________________________________________
>         Swift-devel mailing list
>         Swift-devel at ci.uchicago.edu
>         https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel




From wozniak at mcs.anl.gov  Sat Jun  9 20:21:33 2012
From: wozniak at mcs.anl.gov (Justin M Wozniak)
Date: Sat, 9 Jun 2012 20:21:33 -0500 (Central Daylight Time)
Subject: [Swift-devel] coaster c client
In-Reply-To: <1339288936.16642.0.camel@blabla>
References: <1339275533.14910.2.camel@blabla>
	<4a2b7574-e167-4b25-9a9c-6f24848c1d03@blur>
	<1339288936.16642.0.camel@blabla>
Message-ID: <alpine.WNT.2.00.1206092020470.5188@JWOZNIAK-DESK>


Yes, but that's not a hard requirement.  We have wrapped things without 
SWIG as well.

On Sat, 9 Jun 2012, Mihael Hategan wrote:

> Ok.
>
> So Tcl is the main client here. Swig is what you use for wrappring C
> code?
>
> Mihael
>
> On Sat, 2012-06-09 at 18:32 -0500, Justin M Wozniak wrote:
>>
>> C++ internals are fine.
>>
>>
>> -----Original message-----
>>         From: Mihael Hategan <hategan at mcs.anl.gov>
>>         To: Swift Devel <swift-devel at ci.uchicago.edu>
>>         Sent: Sat, Jun 9, 2012 15:58:57 GMT+00:00
>>         Subject: [Swift-devel] coaster c client
>>
>>
>>         Justin,
>>
>>         When you said C instead of C++, did you mean you want the API
>>         to be
>>         C-like or was that a restriction on the internals. I'd rather
>>         use type
>>         safe lists and hashtables than otherwise.
>>
>>         Mihael
>>
>>         _______________________________________________
>>         Swift-devel mailing list
>>         Swift-devel at ci.uchicago.edu
>>         https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>
>

-- 
Justin M Wozniak


From dsk at ci.uchicago.edu  Mon Jun 11 10:23:10 2012
From: dsk at ci.uchicago.edu (Daniel S. Katz)
Date: Mon, 11 Jun 2012 11:23:10 -0400
Subject: [Swift-devel] swift user map
Message-ID: <4F1BEFE5-4AE5-433B-A3D5-6B37F00702C9@ci.uchicago.edu>

Hi,

I have this diagram, perhaps from an old proposal.



Is there something newer?  Perhaps that shows some users in Europe, since I will be talking in Europe next week?

Thanks,
Dan

-- 
Daniel S. Katz
University of Chicago
(773) 834-7186 (voice)
(773) 834-6818 (fax)
d.katz at ieee.org or dsk at ci.uchicago.edu
http://www.ci.uchicago.edu/~dsk/




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120611/df8d148d/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: PastedGraphic-1.pdf
Type: application/pdf
Size: 1675227 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120611/df8d148d/attachment.pdf>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120611/df8d148d/attachment-0001.html>

From wilde at mcs.anl.gov  Mon Jun 11 19:56:40 2012
From: wilde at mcs.anl.gov (Michael Wilde)
Date: Mon, 11 Jun 2012 19:56:40 -0500 (CDT)
Subject: [Swift-devel] swift user map
In-Reply-To: <4F1BEFE5-4AE5-433B-A3D5-6B37F00702C9@ci.uchicago.edu>
Message-ID: <955761141.1880.1339462600103.JavaMail.root@zimbra.anl.gov>

Dan, the live usage map is at:

  http://www.ci.uchicago.edu/swift/usage/locations.php

...which shows users in Europe.

Also stats are at:

   http://www.ci.uchicago.edu/swift/usage/usage.php

David Kelly maintains this and can help if you need related info.

- Mike

----- Original Message -----
> From: "Daniel S. Katz" <dsk at ci.uchicago.edu>
> To: "swift-devel Devel" <swift-devel at ci.uchicago.edu>
> Sent: Monday, June 11, 2012 10:23:10 AM
> Subject: [Swift-devel] swift user map
> Hi,
> 
> 
> I have this diagram, perhaps from an old proposal.
> 
> 
> 
> 
> 
> 
> 
> 
> Is there something newer? Perhaps that shows some users in Europe,
> since I will be talking in Europe next week?
> 
> 
> Thanks,
> Dan
> 
> 
> 
> 
> 
> --
> 
> 
> 
> 
> 
> 
> 
> 
> Daniel S. Katz
> University of Chicago
> (773) 834-7186 (voice)
> (773) 834-6818 (fax)
> d.katz at ieee.org or dsk at ci.uchicago.edu
> http://www.ci.uchicago.edu/~dsk/
> 
> 
> 
> 
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory



From dsk at ci.uchicago.edu  Mon Jun 11 20:03:09 2012
From: dsk at ci.uchicago.edu (Daniel S. Katz)
Date: Mon, 11 Jun 2012 21:03:09 -0400
Subject: [Swift-devel] swift user map
In-Reply-To: <955761141.1880.1339462600103.JavaMail.root@zimbra.anl.gov>
References: <955761141.1880.1339462600103.JavaMail.root@zimbra.anl.gov>
Message-ID: <37316274-1EF5-4180-AAAC-251B5D43F4D4@ci.uchicago.edu>

Great, thanks.

Dan


On Jun 11, 2012, at 8:56 PM, Michael Wilde wrote:

> Dan, the live usage map is at:
> 
>  http://www.ci.uchicago.edu/swift/usage/locations.php
> 
> ...which shows users in Europe.
> 
> Also stats are at:
> 
>   http://www.ci.uchicago.edu/swift/usage/usage.php
> 
> David Kelly maintains this and can help if you need related info.
> 
> - Mike
> 
> ----- Original Message -----
>> From: "Daniel S. Katz" <dsk at ci.uchicago.edu>
>> To: "swift-devel Devel" <swift-devel at ci.uchicago.edu>
>> Sent: Monday, June 11, 2012 10:23:10 AM
>> Subject: [Swift-devel] swift user map
>> Hi,
>> 
>> 
>> I have this diagram, perhaps from an old proposal.
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> Is there something newer? Perhaps that shows some users in Europe,
>> since I will be talking in Europe next week?
>> 
>> 
>> Thanks,
>> Dan
>> 
>> 
>> 
>> 
>> 
>> --
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> Daniel S. Katz
>> University of Chicago
>> (773) 834-7186 (voice)
>> (773) 834-6818 (fax)
>> d.katz at ieee.org or dsk at ci.uchicago.edu
>> http://www.ci.uchicago.edu/~dsk/
>> 
>> 
>> 
>> 
>> 
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> 
> -- 
> Michael Wilde
> Computation Institute, University of Chicago
> Mathematics and Computer Science Division
> Argonne National Laboratory
> 

-- 
Daniel S. Katz
University of Chicago
(773) 834-7186 (voice)
(773) 834-6818 (fax)
d.katz at ieee.org or dsk at ci.uchicago.edu
http://www.ci.uchicago.edu/~dsk/






From foster at anl.gov  Tue Jun 12 04:24:42 2012
From: foster at anl.gov (Ian Foster)
Date: Tue, 12 Jun 2012 04:24:42 -0500
Subject: [Swift-devel] swift user map
In-Reply-To: <955761141.1880.1339462600103.JavaMail.root@zimbra.anl.gov>
References: <955761141.1880.1339462600103.JavaMail.root@zimbra.anl.gov>
Message-ID: <83723FAB-099F-4873-B0FB-F2D428596A16@anl.gov>

Very nice! We just need someone in Antarctica ...

On Jun 11, 2012, at 7:56 PM, Michael Wilde wrote:

> Dan, the live usage map is at:
> 
>  http://www.ci.uchicago.edu/swift/usage/locations.php
> 
> ...which shows users in Europe.
> 
> Also stats are at:
> 
>   http://www.ci.uchicago.edu/swift/usage/usage.php
> 
> David Kelly maintains this and can help if you need related info.
> 
> - Mike
> 
> ----- Original Message -----
>> From: "Daniel S. Katz" <dsk at ci.uchicago.edu>
>> To: "swift-devel Devel" <swift-devel at ci.uchicago.edu>
>> Sent: Monday, June 11, 2012 10:23:10 AM
>> Subject: [Swift-devel] swift user map
>> Hi,
>> 
>> 
>> I have this diagram, perhaps from an old proposal.
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> Is there something newer? Perhaps that shows some users in Europe,
>> since I will be talking in Europe next week?
>> 
>> 
>> Thanks,
>> Dan
>> 
>> 
>> 
>> 
>> 
>> --
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> Daniel S. Katz
>> University of Chicago
>> (773) 834-7186 (voice)
>> (773) 834-6818 (fax)
>> d.katz at ieee.org or dsk at ci.uchicago.edu
>> http://www.ci.uchicago.edu/~dsk/
>> 
>> 
>> 
>> 
>> 
>> _______________________________________________
>> Swift-devel mailing list
>> Swift-devel at ci.uchicago.edu
>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> 
> -- 
> Michael Wilde
> Computation Institute, University of Chicago
> Mathematics and Computer Science Division
> Argonne National Laboratory
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel



From benc at hawaga.org.uk  Tue Jun 12 04:44:11 2012
From: benc at hawaga.org.uk (Ben Clifford)
Date: Tue, 12 Jun 2012 10:44:11 +0100
Subject: [Swift-devel] swift user map
In-Reply-To: <955761141.1880.1339462600103.JavaMail.root@zimbra.anl.gov>
References: <955761141.1880.1339462600103.JavaMail.root@zimbra.anl.gov>
Message-ID: <86D6FB24-AA5B-45AE-B2A0-778FB19E888D@hawaga.org.uk>


On Jun 12, 2012, at 1:56 AM, Michael Wilde wrote:

> Dan, the live usage map is at:
> 
>  http://www.ci.uchicago.edu/swift/usage/locations.php

How accurate geographically is that / how does it work? I see a beacon in South Africa, which doesn't surprise me because the University of Johannesburg people play with Swift, but it appears to be no where near there... out in the countryside somewhere.

-- 



From davidk at ci.uchicago.edu  Tue Jun 12 07:27:21 2012
From: davidk at ci.uchicago.edu (David Kelly)
Date: Tue, 12 Jun 2012 07:27:21 -0500 (CDT)
Subject: [Swift-devel] swift user map
In-Reply-To: <86D6FB24-AA5B-45AE-B2A0-778FB19E888D@hawaga.org.uk>
Message-ID: <1004236621.8115.1339504041055.JavaMail.root@zimbra-mb2.anl.gov>

In 0.93 and later, IP address is recorded as a part of the usage statistics. This is modeled pretty closely after the way that Globus does their usage tracking. More information about this is at http://www.ci.uchicago.edu/swift/docs/tracking_policy.php

Every night from cron a script extracts a list of IP addresses from the usage database and runs them through a geolocation database called MaxMind GeoLite City. From there I extract latitudes and longitudes and use those as plot points on Google Maps.

Some information about the accuracy of the GeoLite database is at https://www.maxmind.com/app/geolite_city_accuracy. 

David

----- Original Message -----
> From: "Ben Clifford" <benc at hawaga.org.uk>
> To: "Michael Wilde" <wilde at mcs.anl.gov>
> Cc: "swift-devel Devel" <swift-devel at ci.uchicago.edu>
> Sent: Tuesday, June 12, 2012 4:44:11 AM
> Subject: Re: [Swift-devel] swift user map
> On Jun 12, 2012, at 1:56 AM, Michael Wilde wrote:
> 
> > Dan, the live usage map is at:
> >
> >  http://www.ci.uchicago.edu/swift/usage/locations.php
> 
> How accurate geographically is that / how does it work? I see a beacon
> in South Africa, which doesn't surprise me because the University of
> Johannesburg people play with Swift, but it appears to be no where
> near there... out in the countryside somewhere.
> 
> --
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel


From dsk at ci.uchicago.edu  Tue Jun 12 11:47:01 2012
From: dsk at ci.uchicago.edu (Daniel S. Katz)
Date: Tue, 12 Jun 2012 12:47:01 -0400
Subject: [Swift-devel] Fwd: Swift
References: <CBFCB21D.FA3D%hook.hua@jpl.nasa.gov>
Message-ID: <B36C6A14-DCEF-46A0-A7E6-948E3587FEE5@ci.uchicago.edu>

FYI...

Dan

p.s.  Hook was in the same group with me at JPL, a long time ago, and he's currently here in DC at the EarthCube meeting, where I (re)met him in the workflow breakout group.

Begin forwarded message:

> From: "Hua, Hook (388C)" <hook.hua at jpl.nasa.gov>
> Subject: Re: Swift
> Date: June 12, 2012 11:51:41 AM EDT
> To: "Daniel S. Katz" <d.katz at ieee.org>
> 
> Hi Dan,
> 
> Interesting. Will take a look.
> 
> Have you seen PiCloud [1]?  It enables python scripting to control cloud VM for processing. Lowers the entry of barrier even for scripting-based cloud-enabled map-reduce. 
> 
> --Hook
> 
> [1] http://www.picloud.com/
> 
> 
> From: "Daniel S. Katz" <d.katz at ieee.org>
> Date: Tue, 12 Jun 2012 11:41:40 -0400
> To: Hook Hua <Hook.Hua at jpl.nasa.gov>
> Subject: Swift
> 
> Hi,
> 
> You might be interested in Swift - http://www.ci.uchicago.edu/swift/
> 
> I work on this in my university time.
> 
> Dan
> 
> -- 
> Daniel S. Katz
> University of Chicago
> (773) 834-7186 (voice)
> (773) 834-6818 (fax)
> d.katz at ieee.org or dsk at ci.uchicago.edu
> http://www.ci.uchicago.edu/~dsk/
> 
> 
> 
> 



-- 
Daniel S. Katz
University of Chicago
(773) 834-7186 (voice)
(773) 834-6818 (fax)
d.katz at ieee.org or dsk at ci.uchicago.edu
http://www.ci.uchicago.edu/~dsk/




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120612/652ba8eb/attachment.html>

From lpesce at uchicago.edu  Wed Jun 13 14:08:15 2012
From: lpesce at uchicago.edu (Lorenzo Pesce)
Date: Wed, 13 Jun 2012 14:08:15 -0500
Subject: [Swift-devel] Suggest we update Swift 0.93 on Beagle for
	SWIFT_USERHOME fix
In-Reply-To: <80850584.7945.1338822630750.JavaMail.root@zimbra.anl.gov>
References: <80850584.7945.1338822630750.JavaMail.root@zimbra.anl.gov>
Message-ID: <FF3E8A73-957D-47A3-9181-A8E2E182A94B@uchicago.edu>

Any news about this?

I am just asking because we are cleaning up our swift files.

On Jun 4, 2012, at 10:10 AM, Michael Wilde wrote:

> Hi David,
> 
> Swift 0.93 rev 5285 has the SWIFT_USERHOME fix thats needed on Beagle to enable Swift to use /lustre instead of /home for the $HOME/.globus/scripts directory.
> 
> I think Lorenzo and other Beagle users have been forced to use their own modified Swift releases since $HOME became non-writable.
> 
> Can you check if its safe to update the swift/0.93 module to at least this rev level, and also if the same fix needs to be applied to trunk in svn?
> 
> Might need some discussion - I cant recall if any alternatives to this fix were proposed.
> 
> Thanks,
> 
> - Mike
> 
> -- 
> Michael Wilde
> Computation Institute, University of Chicago
> Mathematics and Computer Science Division
> Argonne National Laboratory
> 



From iraicu at cs.iit.edu  Sat Jun 16 08:31:07 2012
From: iraicu at cs.iit.edu (Ioan Raicu)
Date: Sat, 16 Jun 2012 08:31:07 -0500
Subject: [Swift-devel] CFP: The 13th IEEE/ACM Int. Symp. on Cluster,
 Cloud and Grid Computing (CCGrid) 2013
Message-ID: <4FDC8A9B.1000902@cs.iit.edu>

                       **** CALL FOR PAPERS ****

                 The 13th IEEE/ACM International Symposium on
                      Cluster, Cloud and Grid Computing
                             (CCGrid 2013)

           Delft University of Technology, Delft, the Netherlands

                            May 13-16, 2013

                http://www.pds.ewi.tudelft.nl/ccgrid2013



Rapid advances in architectures, networks, and systems and middleware technologies
are leading to new concepts in and platforms for computing, ranging from Clusters and
Grids to Clouds and Datacenters. CCGrid is a series of very successful conferences,
sponsored by the IEEE Computer Society Technical Committee on Scalable Computing (TCSC)
and the ACM, with the overarching goal of bringing together international researchers,
developers, and users to provide an international forum to present leading research
activities and results on a broad range of topics related to these concepts and platforms,
and their applications. The conference features keynotes, technical presentations,
workshops, tutorials, and posters, as well as the SCALE challenge featuring live demonstrations.

In 2013, CCGrid will come to the Netherlands for the first time, and will be held in Delft,
a historical, picturesque city that is less than one hour away from Amsterdam-Schiphol airport.
The main conference will be held on May 14-16 (Tuesday to Thursday), with tutorials and
affiliated workshops taking place on May 13 (Monday).


**** IMPORTANT DATES ****
Papers Due:                             12 November 2012
Author Notifications:                   24 January 2013
Final Papers Due:                       22 February 2013
  

**** TOPICS OF INTEREST ****
CCGrid 2013 will have a focus on important and immediate issues that are significantly
influencing all aspects of cluster, cloud and grid computing. Topics of interest include,
but are not limited to:

* Applications and Experiences: Applications to real and complex problems in science,
   engineering, business, and society; User studies; Experiences with large-scale deployments,
   systems, or applications
* Architecture: System architectures, design and deployment; Power and cooling; Security
   and reliability; High availability solutions
* Autonomic Computing and Cyberinfrastructure: Self-managed behavior, models and technologies;
   Autonomic paradigms and systems (control-based, bio-inspired, emergent, etc.); Bio-inspired
   optimizations and computing
* Cloud Computing: Cloud architectures; Software tools and techniques for clouds
* Multicore and Accelerator-based Computing: Software and application techniques to utilize
   multicore architectures and accelerators in clusters, grids, and clouds
* Performance Modeling and Evaluation: Performance prediction and modeling; Monitoring and
   evaluation tools; Analysis of system and application performance; Benchmarks and testbeds
* Programming Models, Systems, and Fault-Tolerant Computing: Programming models and
   environments for cluster, cloud, and grid computing; Fault-tolerant systems, programs and
   algorithms; Systems software to support efficient computing
* Scheduling and Resource Management: Techniques to schedule jobs and resources on cluster,
   cloud, and grid computing platforms; SLA definition and enforcement


**** PAPER SUBMISSION GUIDELINES ****
Authors are invited to submit papers electronically in PDF format. Submitted manuscripts
should be structured as technical papers and may not exceed 8 letter-size (8.5 x 11) pages
including figures, tables and references using the IEEE format for conference proceedings.
Submissions not conforming to these guidelines may be returned without review. Authors
should make sure that their file will print on a printer that uses letter-size (8.5 x 11)
paper. The official language of the conference is English. All manuscripts will be reviewed
and will be judged on correctness, originality, technical strength, significance, quality of
presentation, and interest and relevance to the conference attendees.

Submitted papers must represent original unpublished research that is not currently under
review for any other conference or journal. Papers not following these guidelines will be
rejected without review and further action may be taken, including (but not limited to)
notifications sent to the heads of the institutions of the authors and sponsors of the
conference. Submissions received after the due date, exceeding the page limit, or not
appropriately structured may not be considered. Authors may contact the conference chairs
for more information. The proceedings will be published through the IEEE Computer Society
Press, USA, and will be made available online through the IEEE Digital Library.


**** CALL FOR TUTORIAL AND WORKSHOP PROPOSALS ****
Tutorials and workshops affiliated with CCGrid 2013 will be held on May 13 (Monday). For
more information on the tutorials and workshops and for the complete Call for Tutorial and
Workshop Proposals, please see the conference website.


**** GENERAL CHAIR ****
Dick Epema, Delft University of Technology, the Netherlands


**** PROGRAM CHAIR ****
Thomas Fahringer, University of Innsbruck, Austria


**** PROGRAM VICE-CHAIRS ****
Rosa Badia, Barcelona Supercomputing Center, Spain
Henri Bal, Vrije Universiteit, the Netherlands
Marios Dikaiakos, University of Cyprus, Cyprus
Kirk Cameron, VirginiaTech, USA
Daniel Katz, University of Chicago & Argonne Nat Lab, USA
Kate Keahey, Argonne National Laboratory, USA
Martin Schulz, Lawrence Livermore National Laboratory, USA
Douglas Thain, University of Notre Dame, USA
Cheng-Zhong Xu, Shenzhen Inst. of Advanced Techn, China


**** WORKSHOPS CHAIR ****
Shantenu Jha, Rutgers and Louisana State University, USA


**** DOCTORAL SYMPOSIUM CHAIRS ****
Yogesh Simmhan, University of Southern California, USA
Ana Varbanescu, Delft Univ of Technology, the Netherlands


**** SUBMISSIONS AND PROCEEDINGS CHAIR ****
Pavan Balaji, Argonne National Laboratory, USA


**** FINANCE AND REGISTRATION CHAIR ****
Alexandru Iosup, Delft Univ of Technology, the Netherlands


**** PUBLICITY CHAIRS ****
Nazareno Andrade, University Federal de Campina Grance, Brazil
Gabriel Antoniu, INRIA, France
Bahman Javadi, University of Western Sysney, Australia
Ioan Raicu, Illinois Institute of Technology and Argonne National Laboratory, USA


**** CYBER CHAIR ****
Stephen van der Laan, Delft University of Technology, the Netherlands

-- 
=================================================================
Ioan Raicu, Ph.D.
Assistant Professor, Illinois Institute of Technology (IIT)
Guest Research Faculty, Argonne National Laboratory (ANL)
=================================================================
Data-Intensive Distributed Systems Laboratory, CS/IIT
Distributed Systems Laboratory, MCS/ANL
=================================================================
Cel:    1-847-722-0876
Office: 1-312-567-5704
Email:  iraicu at cs.iit.edu
Web:    http://www.cs.iit.edu/~iraicu/
Web:    http://datasys.cs.iit.edu/
=================================================================
=================================================================

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120616/1f1d6a87/attachment.html>

From iraicu at cs.iit.edu  Thu Jun 28 13:52:23 2012
From: iraicu at cs.iit.edu (Ioan Raicu)
Date: Thu, 28 Jun 2012 13:52:23 -0500
Subject: [Swift-devel] eScience Conference submission extension - 18 July
Message-ID: <4FECA7E7.9050805@cs.iit.edu>

Due to numerous requests, we are extended the paper deadline, and 
dropping the abstract deadline completely:


CALL FOR PAPERS

8th IEEE International Conference on eScience
http://www.ci.uchicago.edu/escience2012/
October 8-12, 2012
Chicago, IL, USA

Researchers in all disciplines are increasingly adopting digital tools, 
techniques and practices, often in communities and projects that span 
disciplines, laboratories, organizations, and national boundaries. The 
eScience 2012 conference is designed to bring together leading 
international and interdisciplinary research communities, developers, 
and users of eScience applications and enabling IT technologies. The 
conference serves as a forum to present the results of the latest 
applications research and product/tool developments and to highlight 
related activities from around the world. Also, we are now entering the 
second decade of eScience and the 2012 conference gives an opportunity 
to take stock of what has been achieved so far and look forward to the 
challenges and opportunities the next decade will bring.

A special emphasis of the 2012 conference is on advances in the 
application of technology in a particular discipline. Accordingly, 
significant advances in applications science and technology will be 
considered as important as the development of new technologies 
themselves. Further, we welcome contributions in educational activities 
under any of these disciplines.

As a result, the conference will be structured around two e-Science tracks:

. eScience Algorithms and Applications
. eScience application areas, including:
. Physical sciences
. Biomedical sciences
. Social sciences and humanities
. Data-oriented approaches and applications
. Compute-oriented approaches and applications
. Extreme scale approaches and applications
. Cyberinfrastructure to support eScience
. Novel hardware
. Novel uses of production infrastructure
. Software and services
. Tools

The conference proceedings will be published by the IEEE Computer 
Society Press, USA and will be made available online through the IEEE 
Digital Library. Selected papers will be invited to submit extended 
versions to a special issue of the Future Generation Computer Systems 
(FGCS)journal.

SUBMISSION PROCESS
Authors are invited to submit papers with unpublished, original work of 
not more than 8 pages of double column text using single spaced 10 point 
size on 8.5 x 11 inch pages, as per IEEE 8.5 x 11 manuscript guidelines. 
(Up to 2 additional pages may be purchased for US$150/page)

Templates are available from 
http://www.ieee.org/conferences_events/conferences/publishing/templates.html.

Authors should submit a PDF file that will print on a PostScript printer 
tohttps://www.easychair.org/conferences/?conf=escience2012

(Note that paper submitters also must submit an abstract in advance of 
the paper deadline. This should be done through the same site where 
papers are submitted.)

It is a requirement that at least one author of each accepted paper 
attend the conference.

IMPORTANT DATES

Abstract submission no longer required
Paper submission: extended to 18 July 2012 (firm)
Paper author notification: 22 August 2012
Camera-ready papers due: 10 September 2012
Conference: 8-12 October 2012




In addition to the eScience conference itself, there are six associated 
workshops and one tutorial 
(http://www.ci.uchicago.edu/escience2012/workshops.php)

  * Extending High-Performance Computing Beyond its Traditional User
    Communities, http://www.psc.edu/events/escience-2012-workshop/
  * 2nd International Workshop on Analyzing and Improving Collaborative
    eScience with Social Networks (eSoN 12),
    http://www.ci.uchicago.edu/eson2012/
  * Advances in eHealth,
    http://www.scalalife.eu/content/advances-ehealth-2012-workshop
  * Maintainable Software Practices in e-Science,
    http://software.ac.uk/maintainable-software-practice-workshop
  * eScience Meets the Instrument,
    https://confluence-vre.its.monash.edu.au/display/escience2012/eScience+Meets+the+Instrument
  * Collaborative research using eScience infrastructure and high speed
    networks,
    http://www.surfnet.nl/en/Hybride_netwerk/SURFlichtpaden/Pages/CollaborativeresearchusingeScienceinfrastructureandhighspeednetworks.aspx


  * Tutorial: Big Data Processing: Lessons from Industry and
    Applications in Science,
    http://www.ci.uchicago.edu/escience2012/tutorial.php






CONFERENCE ORGANIZATION

General Chair
. Ian Foster, University of Chicago & Argonne National Laboratory, USA
Program Co-Chairs
. Daniel S. Katz, University of Chicago & Argonne National Laboratory, USA
. Heinz Stockinger, SIB Swiss Institute of Bioinformatics, Switzerland
Program Vice Co-Chairs
. eScience Algorithms and Applications Track
. David Abramson, Monash University, Australia
. Gabrielle Allen, Louisiana State University, USA
. Cyberinfrastructure to support eScience Track
. Rosa M. Badia, Barcelona Supercomputing Center / CSIC, Spain
. Geoffrey Fox, Indiana University, USA
Early Results and Works-in-Progress Posters Chair
. Roger Barga, Microsoft, USA
Workshops Chair
. Ruth Pordes, FNAL, USA
Sponsorship Chair
. Charlie Catlett, Argonne National Laboratory, USA
Conference Manager and Finance Chair
. Julie Wulf-Knoerzer, University of Chicago & Argonne National 
Laboratory, USA
Publicity Chairs
. Kento Aida, National Institute of Informatics, Japan
. Ioan Raicu, Illinois Institute of Technology, USA
. David Wallom, Oxford e-Research Centre, UK
Local Organizing Committee
. Ninfa Mayorga, University of Chicago, USA
. Evelyn Rayburn, University of Chicago, USA
. Lynn Valentini, Argonne National Laboratory, USA
Program Committee
. eScience Algorithms and Applications Track
. Srinivas Aluru, Iowa State University, USA
. Ashiq Anjum, University of Derby, UK
. David A. Bader, Georgia Institute of Technology, USA
. Jon Blower, University of Reading, UK
. Paul Bonnington, Monash University, Australia
. Simon Cox, University of Southampton, UK
. David De Roure, Oxford e-Research Centre, UK
. George Djorgovski, California Institute of Technology, USA
. Anshu Dubey, University of Chicago & Argonne National Laboratory, USA
. Yuri Estrin, Monash University, Australia
. Dan Fay, Microsoft, USA
. Jeremy Frey, University of Southampton, UK
. Wolfgang Gentzsch, HPC Consultant, Germany
. Lutz Gross, The University of Queensland, Austrialia
. Sverker Holmgren, Uppsala University, Sweden
. Bill Howe, University of Washington, USA
. Marina Jirotka, University of Oxford, UK
. Timoleon Kipouros, University of Cambridge, UK
. Kerstin Kleese van Dam, Pacific Northwest National Laboratory, USA
. Arun S. Konagurthu, Monash University, Australia
. Peter Kunszt, SystemsX.ch <http://SystemsX.ch/>, Switzerland
. Alexey Lastovetsky, University College Dublin, Ireland
. Andrew Lewis, Griffith University, Australia
. Sergio Maffioletti, University of Zurich, Switzerland
. Amitava Majumdar, San Diego Supercomputer Center, University of 
California at San Diego, USA
. Rui Mao, Shenzhen University, China
. Madhav V. Marathe, Virginia Tech, USA
. Maryann Martone, University of California at San Diego, USA
. Louis Moresi, Monash University, Australia
. Riccardo Murri, University of Zurich, Switzerland
. Silvia D. Olabarriaga, Academic Medical Center of the University of 
Amsterdam, Netherlands
. Enrique S. Quintana-Ort?, Universidad Jaume I, Spain
. Abani Patra, University at Buffalo, USA
. Rob Pennington, NSF, USA
. Andrew Perry, Monash University, Australia
. Beth Plale, Indiana University, USA
. Michael Resch, University of Stuttgart, Germany
. Adrian Sandu, Virginia Tech, USA
. Mark Savill, Cranfield University, UK
. Erik Schnetter, Perimeter Institute for Theoretical Physics, Canada
. Edward Seidel, Louisiana State University, USA
. Suzanne M. Shontz, The Pennsylvania State University, USA
. David Skinner, Lawrence Berkeley National Laboratory, USA
. Alan Sussman, University of Maryland, USA
. Alex Szalay, Johns Hopkins University, USA
. Domenico Talia, ICAR-CNR & University of Calabria, Italy
. Jian Tao, Louisiana State University, USA
. David Wallom, Oxford e-Research Centre, UK
. Shaowen Wang, University of Illinois at Urbana-Champaign, USA
. Michael Wilde, Argonne National Laboratory & University of Chicago, USA
. Nancy Wilkins-Diehr, San Diego Supercomputer Center, University of 
California at San Diego, USA
. Wu Zhang, Shanghai University, China
. Yunquan Zhang, Chinese Academy of Sciences, China
. Cyberinfrastructure to support eScience Track
. Deb Agarwal, Lawrence Berkeley National Laboratory, USA
. Ilkay Altintas, San Diego Supercomputer Center, University of 
California at San Diego, USA
. Henri Bal, Vrije Universiteit, Netherlands
. Roger Barga, Microsoft, USA
. Martin Berzins, University of Utah, USA
. John Brooke, University of Manchester, UK
. Thomas Fahringer, University of Innsbruck, Austria
. Gilles Fedak, INRIA, France
. Jos? A. B. Fortes, University of Florida, USA
. Yolanda Gil, ISI/USC, USA
. Madhusudhan Govindaraju, SUNY Binghamton, USA
. Thomas Hacker, Purdue University, USA
. Ken Hawick, Massey University, New Zealand
. Marty Humphrey, University of Virginia, USA
. Hai Jin, Huazhong University of Science and Technology, China
. Thilo Kielmann, Vrije Universiteit, Netherlands
. Scott Klasky, Oak Ridge National Laboratory, USA
. Isao Kojima, AIST, Japan
. Tevfik Kosar, University at Buffalo, USA
. Dieter Kranzlmueller, LMU & LRZ Munich, Germany
. Erwin Laure, KTH, Sweden
. Jysoo Lee, KISTI, Korea
. Li Xiaoming, Peking University, China
. Bertram Lud?scher, University of California, Davis, USA
. Andrew Lumsdaine, Indiana University, USA
. Tanu Malik, University of Chicago, USA
. Satoshi Matsuoka, Tokyo Institute of Technology, Japan
. Reagan Moore, University of North Carolina at Chapel Hill, USA
. Shirley Moore, University of Kentucky, USA
. Steven Newhouse, EGI, Netherlands
. Dhabaleswar K. (DK) Panda, The Ohio State University, USA
. Manish Parashar, Rutgers University, USA
. Ron Perrott, University of Oxford, UK
. Depei Qian, Beihang University, China
. Judy Qui, Indiana University, USA
. Ioan Raicu, Illinois Institute of Technology, USA
. Lavanya Ramakrishnan, Lawrence Berkeley National Laboratory, USA
. Omer Rana, Cardiff University, UK
. Paul Roe, Queensland University of Technology, Australia
. Bruno Schulze, LNCC, Brazil
. Marc Snir, Argonne National Laboratory & University of Illinois at 
Urbana-Champaign, USA
. Xian-He Sun, Illinois Institute of Technology, USA
. Yoshio Tanaka, AIST, Japan
. Michela Taufer, University of Delaware, USA
. Kerry Taylor, CSIRO, Australia
. Douglas Thain, University of Notre Dame, USA
. Paul Watson, Newcastle University, UK
. Jian Zhang, Northern Illinois University, USA
. Jun Zhao, University of Oxford, UK

Sponsors:
. University of Chicago
. Argonne National Laboratory
. IEEE
. CSIRO
. Indiana University
. additional sponsorship opportunities are available

-- 
=================================================================
Ioan Raicu, Ph.D.
Assistant Professor, Illinois Institute of Technology (IIT)
Guest Research Faculty, Argonne National Laboratory (ANL)
=================================================================
Data-Intensive Distributed Systems Laboratory, CS/IIT
Distributed Systems Laboratory, MCS/ANL
=================================================================
Cel:    1-847-722-0876
Office: 1-312-567-5704
Email:  iraicu at cs.iit.edu
Web:    http://www.cs.iit.edu/~iraicu/
Web:    http://datasys.cs.iit.edu/
=================================================================
=================================================================

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120628/fd6a47c9/attachment.html>

From hockyg at uchicago.edu  Thu Jun 28 14:16:09 2012
From: hockyg at uchicago.edu (Glen Hocky)
Date: Thu, 28 Jun 2012 15:16:09 -0400
Subject: [Swift-devel] patch for condor provider
Message-ID: <CAGMfakmEebWS4SuSuq9b1oCJT7OK1R0SFO2RPkaF5jo0d196sg@mail.gmail.com>

Hey everyone. I have a small patch to suggest for the condor provider.

For accounting group parameter, which I have added, the accounting group
apparently must be specified in quotes, i.e.

+AccountingGroup = "group_friends.hockyg"

so in my sites file I have

        <profile namespace="globus"
key="AccountingGroup">"group_friends.hockyg"</profile>

but perhaps you would rather modify my patch such that this is specified
sans quotes

Best,
Glen


svn diff
modules/provider-localscheduler/src/org/globus/cog/abstraction/impl/scheduler/condor/CondorExecutor.java
Index:
modules/provider-localscheduler/src/org/globus/cog/abstraction/impl/scheduler/condor/CondorExecutor.java
===================================================================
---
modules/provider-localscheduler/src/org/globus/cog/abstraction/impl/scheduler/condor/CondorExecutor.java
(revision
3420)
+++
modules/provider-localscheduler/src/org/globus/cog/abstraction/impl/scheduler/condor/CondorExecutor.java
(working
copy)
@@ -52,6 +52,9 @@
  if ("MPI".equals(type)) {
  wr.write("universe = MPI\n");
  }
+ else if ("parallel".equals(type)) {
+ wr.write("universe = parallel\n");
+ }
  else if("grid".equals(type)) {
  grid = true;
  String gridResource = (String) spec.getAttribute("gridResource");
@@ -68,10 +71,15 @@
  else {
  wr.write("universe = vanilla\n");
  }
+
+                //set account group if specified
+ writeAttr("AccountingGroup", "+AccountingGroup = ", wr);
+
  if ("true".equals(spec.getAttribute("holdIsFailure"))) {
  wr.write("periodic_remove = JobStatus == 5\n");
  }
  writeAttr("count", "machine_count = ", wr);
+ writeAttr("count", "request_cpus = ", wr);
  if (spec.getStdInput() != null) {
  wr.write("input = " + quote(spec.getStdInput()) + "\n");
  }
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20120628/10ca8ba7/attachment.html>

From wilde at mcs.anl.gov  Thu Jun 28 14:33:29 2012
From: wilde at mcs.anl.gov (Michael Wilde)
Date: Thu, 28 Jun 2012 14:33:29 -0500 (CDT)
Subject: [Swift-devel] patch for condor provider
In-Reply-To: <CAGMfakmEebWS4SuSuq9b1oCJT7OK1R0SFO2RPkaF5jo0d196sg@mail.gmail.com>
Message-ID: <1291083250.34.1340912009249.JavaMail.root@zimbra.anl.gov>

One clarification here: Glen did this mod because the UC3 team requested that he add AccountingGroup to his submit files.

- Mike

----- Original Message -----
> From: "Glen Hocky" <hockyg at uchicago.edu>
> To: "swift-devel" <swift-devel at ci.uchicago.edu>
> Sent: Thursday, June 28, 2012 2:16:09 PM
> Subject: [Swift-devel] patch for condor provider
> Hey everyone. I have a small patch to suggest for the condor provider.
> 
> 
> 
> For accounting group parameter, which I have added, the accounting
> group apparently must be specified in quotes, i.e.
> 
> 
> +AccountingGroup = "group_friends.hockyg"
> 
> 
> so in my sites file I have
> 
> 
> <profile namespace="globus"
> key="AccountingGroup">"group_friends.hockyg"</profile>
> 
> 
> but perhaps you would rather modify my patch such that this is
> specified sans quotes
> 
> 
> Best,
> Glen
> 
> 
> 
> 
> 
> 
> svn diff
> modules/provider-localscheduler/src/org/globus/cog/abstraction/impl/scheduler/condor/CondorExecutor.java
> Index:
> modules/provider-localscheduler/src/org/globus/cog/abstraction/impl/scheduler/condor/CondorExecutor.java
> ===================================================================
> ---
> modules/provider-localscheduler/src/org/globus/cog/abstraction/impl/scheduler/condor/CondorExecutor.java
> (revision 3420)
> +++
> modules/provider-localscheduler/src/org/globus/cog/abstraction/impl/scheduler/condor/CondorExecutor.java
> (working copy)
> @@ -52,6 +52,9 @@
> if ("MPI".equals(type)) {
> wr.write("universe = MPI\n");
> }
> + else if ("parallel".equals(type)) {
> + wr.write("universe = parallel\n");
> + }
> else if("grid".equals(type)) {
> grid = true;
> String gridResource = (String) spec.getAttribute("gridResource");
> @@ -68,10 +71,15 @@
> else {
> wr.write("universe = vanilla\n");
> }
> +
> + //set account group if specified
> + writeAttr("AccountingGroup", "+AccountingGroup = ", wr);
> +
> if ("true".equals(spec.getAttribute("holdIsFailure"))) {
> wr.write("periodic_remove = JobStatus == 5\n");
> }
> writeAttr("count", "machine_count = ", wr);
> + writeAttr("count", "request_cpus = ", wr);
> if (spec.getStdInput() != null) {
> wr.write("input = " + quote(spec.getStdInput()) + "\n");
> }
> 
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory