From ketancmaheshwari at gmail.com  Tue Oct  1 14:35:44 2013
From: ketancmaheshwari at gmail.com (Ketan Maheshwari)
Date: Tue, 1 Oct 2013 14:35:44 -0500
Subject: [Swift-devel] local:slurm ppn and jobs per node not honored
Message-ID: <CAMUuvirresfu3h=YiT1c318ap5ySVRMf4GE3v_NQrzV1VzPCig@mail.gmail.com>

Hi,

On stampede, I am observing that the sites parameters such as ppn and
jobspernode are being overridden by the throttle value. I intended to run 1
job per node on a single node run. However, it seems more jobs are running.
My sites parameters are as follows:

   <profile namespace="globus"  key="jobsPerNode">1</profile>
   <profile namespace="globus"  key="ppn">1</profile>
   <profile namespace="globus"  key="maxTime">7500</profile>
   <profile namespace="globus"  key="maxwalltime">00:10:00</profile>
   <profile namespace="globus"  key="lowOverallocation">100</profile>
   <profile namespace="globus"  key="highOverallocation">100</profile>
   <profile namespace="globus"  key="queue">normal</profile>
   <profile namespace="globus"  key="nodeGranularity">1</profile>
   <profile namespace="globus"  key="maxNodes">1</profile>
   <profile namespace="karajan" key="jobThrottle">.3199</profile>

To reproduce, I run a catsnsleep example with 100 tasks and sleep value 10
seconds. From the standard out and completion time, it seems Swift is
running more jobs in parallel despite jobsPerNode and ppn set to be 1.

Attached is the stdout and log for this run. I am setting throttle high
since otherwise coasters will leave resources and try to reacquire on each
job burst.

Thanks,
-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131001/fc390b68/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: stampederun.out
Type: application/octet-stream
Size: 8616 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131001/fc390b68/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: catsnsleep-20131001-1423-2q35a3ed.log
Type: application/octet-stream
Size: 915515 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131001/fc390b68/attachment-0001.obj>

From hategan at mcs.anl.gov  Tue Oct  1 14:42:19 2013
From: hategan at mcs.anl.gov (Mihael Hategan)
Date: Tue, 01 Oct 2013 12:42:19 -0700
Subject: [Swift-devel] local:slurm ppn and jobs per node not honored
In-Reply-To: <CAMUuvirresfu3h=YiT1c318ap5ySVRMf4GE3v_NQrzV1VzPCig@mail.gmail.com>
References: <CAMUuvirresfu3h=YiT1c318ap5ySVRMf4GE3v_NQrzV1VzPCig@mail.gmail.com>
Message-ID: <1380656539.29307.0.camel@echo>

slots = 1?

On Tue, 2013-10-01 at 14:35 -0500, Ketan Maheshwari wrote:
> Hi,
> 
> On stampede, I am observing that the sites parameters such as ppn and
> jobspernode are being overridden by the throttle value. I intended to run 1
> job per node on a single node run. However, it seems more jobs are running.
> My sites parameters are as follows:
> 
>    <profile namespace="globus"  key="jobsPerNode">1</profile>
>    <profile namespace="globus"  key="ppn">1</profile>
>    <profile namespace="globus"  key="maxTime">7500</profile>
>    <profile namespace="globus"  key="maxwalltime">00:10:00</profile>
>    <profile namespace="globus"  key="lowOverallocation">100</profile>
>    <profile namespace="globus"  key="highOverallocation">100</profile>
>    <profile namespace="globus"  key="queue">normal</profile>
>    <profile namespace="globus"  key="nodeGranularity">1</profile>
>    <profile namespace="globus"  key="maxNodes">1</profile>
>    <profile namespace="karajan" key="jobThrottle">.3199</profile>
> 
> To reproduce, I run a catsnsleep example with 100 tasks and sleep value 10
> seconds. From the standard out and completion time, it seems Swift is
> running more jobs in parallel despite jobsPerNode and ppn set to be 1.
> 
> Attached is the stdout and log for this run. I am setting throttle high
> since otherwise coasters will leave resources and try to reacquire on each
> job burst.
> 
> Thanks,
> Hi,
> 
> 
> On stampede, I am observing that the sites parameters such as ppn and
> jobspernode are being overridden by the throttle value. I intended to
> run 1 job per node on a single node run. However, it seems more jobs
> are running. My sites parameters are as follows:
> 
> 
>    <profile namespace="globus"  key="jobsPerNode">1</profile>
>    <profile namespace="globus"  key="ppn">1</profile>
>    <profile namespace="globus"  key="maxTime">7500</profile>
>    <profile namespace="globus"  key="maxwalltime">00:10:00</profile>
>    <profile namespace="globus"  key="lowOverallocation">100</profile>
>    <profile namespace="globus"  key="highOverallocation">100</profile>
>    <profile namespace="globus"  key="queue">normal</profile>
>    <profile namespace="globus"  key="nodeGranularity">1</profile>
>    <profile namespace="globus"  key="maxNodes">1</profile>
>    <profile namespace="karajan" key="jobThrottle">.3199</profile>
> 
> 
> To reproduce, I run a catsnsleep example with 100 tasks and sleep
> value 10 seconds. From the standard out and completion time, it seems
> Swift is running more jobs in parallel despite jobsPerNode and ppn set
> to be 1.
> 
> 
> Attached is the stdout and log for this run. I am setting throttle
> high since otherwise coasters will leave resources and try to
> reacquire on each job burst.
> 
> 
> Thanks,
> -- 
> Ketan
> 
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel




From ketancmaheshwari at gmail.com  Tue Oct  1 15:10:48 2013
From: ketancmaheshwari at gmail.com (Ketan Maheshwari)
Date: Tue, 1 Oct 2013 15:10:48 -0500
Subject: [Swift-devel] local:slurm ppn and jobs per node not honored
In-Reply-To: <1380656539.29307.0.camel@echo>
References: <CAMUuvirresfu3h=YiT1c318ap5ySVRMf4GE3v_NQrzV1VzPCig@mail.gmail.com>
	<1380656539.29307.0.camel@echo>
Message-ID: <CAMUuvip_ZzfREO=B1dt0xymRuf0ZZrjrM4bJSAHGHfhwZWgskQ@mail.gmail.com>

Ahh sorry, my sites file was missing slots value. Swift was using the
default slots value of 20. Rerunning with slots=1 gives the desired task
rate.

Thanks,
Ketan


On Tue, Oct 1, 2013 at 2:42 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:

> slots = 1?
>
> On Tue, 2013-10-01 at 14:35 -0500, Ketan Maheshwari wrote:
> > Hi,
> >
> > On stampede, I am observing that the sites parameters such as ppn and
> > jobspernode are being overridden by the throttle value. I intended to
> run 1
> > job per node on a single node run. However, it seems more jobs are
> running.
> > My sites parameters are as follows:
> >
> >    <profile namespace="globus"  key="jobsPerNode">1</profile>
> >    <profile namespace="globus"  key="ppn">1</profile>
> >    <profile namespace="globus"  key="maxTime">7500</profile>
> >    <profile namespace="globus"  key="maxwalltime">00:10:00</profile>
> >    <profile namespace="globus"  key="lowOverallocation">100</profile>
> >    <profile namespace="globus"  key="highOverallocation">100</profile>
> >    <profile namespace="globus"  key="queue">normal</profile>
> >    <profile namespace="globus"  key="nodeGranularity">1</profile>
> >    <profile namespace="globus"  key="maxNodes">1</profile>
> >    <profile namespace="karajan" key="jobThrottle">.3199</profile>
> >
> > To reproduce, I run a catsnsleep example with 100 tasks and sleep value
> 10
> > seconds. From the standard out and completion time, it seems Swift is
> > running more jobs in parallel despite jobsPerNode and ppn set to be 1.
> >
> > Attached is the stdout and log for this run. I am setting throttle high
> > since otherwise coasters will leave resources and try to reacquire on
> each
> > job burst.
> >
> > Thanks,
> > Hi,
> >
> >
> > On stampede, I am observing that the sites parameters such as ppn and
> > jobspernode are being overridden by the throttle value. I intended to
> > run 1 job per node on a single node run. However, it seems more jobs
> > are running. My sites parameters are as follows:
> >
> >
> >    <profile namespace="globus"  key="jobsPerNode">1</profile>
> >    <profile namespace="globus"  key="ppn">1</profile>
> >    <profile namespace="globus"  key="maxTime">7500</profile>
> >    <profile namespace="globus"  key="maxwalltime">00:10:00</profile>
> >    <profile namespace="globus"  key="lowOverallocation">100</profile>
> >    <profile namespace="globus"  key="highOverallocation">100</profile>
> >    <profile namespace="globus"  key="queue">normal</profile>
> >    <profile namespace="globus"  key="nodeGranularity">1</profile>
> >    <profile namespace="globus"  key="maxNodes">1</profile>
> >    <profile namespace="karajan" key="jobThrottle">.3199</profile>
> >
> >
> > To reproduce, I run a catsnsleep example with 100 tasks and sleep
> > value 10 seconds. From the standard out and completion time, it seems
> > Swift is running more jobs in parallel despite jobsPerNode and ppn set
> > to be 1.
> >
> >
> > Attached is the stdout and log for this run. I am setting throttle
> > high since otherwise coasters will leave resources and try to
> > reacquire on each job burst.
> >
> >
> > Thanks,
> > --
> > Ketan
> >
> >
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>
>


-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131001/2b15bbbe/attachment.html>

From ketancmaheshwari at gmail.com  Thu Oct  3 20:45:33 2013
From: ketancmaheshwari at gmail.com (Ketan Maheshwari)
Date: Thu, 3 Oct 2013 20:45:33 -0500
Subject: [Swift-devel] resume feature in trunk
Message-ID: <CAMUuvirXterzEHhpNxdNdcZEUxYijwz_xwS9E4f8u_vzWH6x-w@mail.gmail.com>

Hi,

It seems that the resume feature in trunk has some problems.

When I try to resume a workflow I am running, I get the following error:

$ swift -sites.file sites.gordon.xml -tc.file apps -config cf
workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
Swift trunk swift-r7089 cog-r3775 (cog modified locally)
RunID: 20131004-0142-7l1ym0y9
Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000

Execution failed:
java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
swift:stageIn @ workflow, line: 347
Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14] for
mA_file
at
org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
at
org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
at org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
at
org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
at
org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
at
org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
at
org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
at org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
at
org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
at
org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
at
org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
at
org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
at org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
at
org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
at org.globus.cog.karajan.compiled.nodes.UParallel$1.run(UParallel.java:68)
at k.thr.LWThread.run(LWThread.java:228)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)

I am trying to reproduce with a simpler example.

Thanks,
-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131003/aa4829a4/attachment.html>

From hategan at mcs.anl.gov  Thu Oct  3 21:52:43 2013
From: hategan at mcs.anl.gov (Mihael Hategan)
Date: Thu, 03 Oct 2013 19:52:43 -0700
Subject: [Swift-devel] resume feature in trunk
In-Reply-To: <CAMUuvirXterzEHhpNxdNdcZEUxYijwz_xwS9E4f8u_vzWH6x-w@mail.gmail.com>
References: <CAMUuvirXterzEHhpNxdNdcZEUxYijwz_xwS9E4f8u_vzWH6x-w@mail.gmail.com>
Message-ID: <1380855163.27712.1.camel@echo>

Yeah, please send me the script or a simplified one. I have been using
resume for a while, so it's not a general resume issue.

Mihael

On Thu, 2013-10-03 at 20:45 -0500, Ketan Maheshwari wrote:
> Hi,
> 
> It seems that the resume feature in trunk has some problems.
> 
> When I try to resume a workflow I am running, I get the following error:
> 
> $ swift -sites.file sites.gordon.xml -tc.file apps -config cf
> workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
> Swift trunk swift-r7089 cog-r3775 (cog modified locally)
> RunID: 20131004-0142-7l1ym0y9
> Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
> 
> Execution failed:
> java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
> swift:stageIn @ workflow, line: 347
> Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14] for
> mA_file
> at
> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> at
> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
> at org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> at
> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> at
> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
> at
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
> at
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at org.globus.cog.karajan.compiled.nodes.UParallel$1.run(UParallel.java:68)
> at k.thr.LWThread.run(LWThread.java:228)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
> 
> I am trying to reproduce with a simpler example.
> 
> Thanks,
> Hi,
> 
> 
> It seems that the resume feature in trunk has some problems.
> 
> 
> When I try to resume a workflow I am running, I get the following
> error:
> 
> 
> $ swift -sites.file sites.gordon.xml -tc.file apps -config cf
> workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
> Swift trunk swift-r7089 cog-r3775 (cog modified locally)
> RunID: 20131004-0142-7l1ym0y9
> Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
> 
> 
> Execution failed:
> java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
> swift:stageIn @ workflow, line: 347
> Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14] for
> mA_file
> at
> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> at
> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
> at
> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> at
> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> at
> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
> at
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
> at
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at org.globus.cog.karajan.compiled.nodes.UParallel
> $1.run(UParallel.java:68)
> at k.thr.LWThread.run(LWThread.java:228)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor
> $Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
> 
> 
> I am trying to reproduce with a simpler example.
> 
> 
> Thanks,
> -- 
> Ketan
> 
> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel




From ketancmaheshwari at gmail.com  Sat Oct  5 18:40:28 2013
From: ketancmaheshwari at gmail.com (Ketan Maheshwari)
Date: Sat, 5 Oct 2013 18:40:28 -0500
Subject: [Swift-devel] resume feature in trunk
In-Reply-To: <1380855163.27712.1.camel@echo>
References: <CAMUuvirXterzEHhpNxdNdcZEUxYijwz_xwS9E4f8u_vzWH6x-w@mail.gmail.com>
	<1380855163.27712.1.camel@echo>
Message-ID: <CAMUuvipO7Waqy-4WsStVAcBBEuSTNTHVTbT6F6ZnerJDckXV9w@mail.gmail.com>

Hi Mihael,

Attached is the simplified version of my script and apps which has the same
resume behavior I reported.

Thanks,
Ketan


On Thu, Oct 3, 2013 at 9:52 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:

> Yeah, please send me the script or a simplified one. I have been using
> resume for a while, so it's not a general resume issue.
>
> Mihael
>
> On Thu, 2013-10-03 at 20:45 -0500, Ketan Maheshwari wrote:
> > Hi,
> >
> > It seems that the resume feature in trunk has some problems.
> >
> > When I try to resume a workflow I am running, I get the following error:
> >
> > $ swift -sites.file sites.gordon.xml -tc.file apps -config cf
> > workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
> > Swift trunk swift-r7089 cog-r3775 (cog modified locally)
> > RunID: 20131004-0142-7l1ym0y9
> > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
> >
> > Execution failed:
> > java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
> > swift:stageIn @ workflow, line: 347
> > Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14] for
> > mA_file
> > at
> >
> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> > at
> >
> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> > at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
> > at
> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > at
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > at
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > at
> org.globus.cog.karajan.compiled.nodes.UParallel$1.run(UParallel.java:68)
> > at k.thr.LWThread.run(LWThread.java:228)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:724)
> >
> > I am trying to reproduce with a simpler example.
> >
> > Thanks,
> > Hi,
> >
> >
> > It seems that the resume feature in trunk has some problems.
> >
> >
> > When I try to resume a workflow I am running, I get the following
> > error:
> >
> >
> > $ swift -sites.file sites.gordon.xml -tc.file apps -config cf
> > workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
> > Swift trunk swift-r7089 cog-r3775 (cog modified locally)
> > RunID: 20131004-0142-7l1ym0y9
> > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
> >
> >
> > Execution failed:
> > java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
> > swift:stageIn @ workflow, line: 347
> > Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14] for
> > mA_file
> > at
> >
> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> > at
> >
> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> > at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
> > at
> > org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > at
> > org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > at
> > org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> > at
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > at org.globus.cog.karajan.compiled.nodes.UParallel
> > $1.run(UParallel.java:68)
> > at k.thr.LWThread.run(LWThread.java:228)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:724)
> >
> >
> > I am trying to reproduce with a simpler example.
> >
> >
> > Thanks,
> > --
> > Ketan
> >
> >
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>
>


-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131005/f426fd1c/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: resumetest.swift
Type: application/octet-stream
Size: 1508 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131005/f426fd1c/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sites.xml
Type: text/xml
Size: 475 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131005/f426fd1c/attachment.xml>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: cf
Type: application/octet-stream
Size: 220 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131005/f426fd1c/attachment-0001.obj>

From ketancmaheshwari at gmail.com  Sat Oct  5 18:41:18 2013
From: ketancmaheshwari at gmail.com (Ketan Maheshwari)
Date: Sat, 5 Oct 2013 18:41:18 -0500
Subject: [Swift-devel] resume feature in trunk
In-Reply-To: <CAMUuvipO7Waqy-4WsStVAcBBEuSTNTHVTbT6F6ZnerJDckXV9w@mail.gmail.com>
References: <CAMUuvirXterzEHhpNxdNdcZEUxYijwz_xwS9E4f8u_vzWH6x-w@mail.gmail.com>
	<1380855163.27712.1.camel@echo>
	<CAMUuvipO7Waqy-4WsStVAcBBEuSTNTHVTbT6F6ZnerJDckXV9w@mail.gmail.com>
Message-ID: <CAMUuviob3zTdcpXmZ3rgEPRWkA8P+c3_2Hbe11Bs_byA+X=q3Q@mail.gmail.com>

Attached the dummy apps now.


On Sat, Oct 5, 2013 at 6:40 PM, Ketan Maheshwari <ketancmaheshwari at gmail.com
> wrote:

> Hi Mihael,
>
> Attached is the simplified version of my script and apps which has the
> same resume behavior I reported.
>
> Thanks,
> Ketan
>
>
> On Thu, Oct 3, 2013 at 9:52 PM, Mihael Hategan <hategan at mcs.anl.gov>wrote:
>
>> Yeah, please send me the script or a simplified one. I have been using
>> resume for a while, so it's not a general resume issue.
>>
>> Mihael
>>
>> On Thu, 2013-10-03 at 20:45 -0500, Ketan Maheshwari wrote:
>> > Hi,
>> >
>> > It seems that the resume feature in trunk has some problems.
>> >
>> > When I try to resume a workflow I am running, I get the following error:
>> >
>> > $ swift -sites.file sites.gordon.xml -tc.file apps -config cf
>> > workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
>> > Swift trunk swift-r7089 cog-r3775 (cog modified locally)
>> > RunID: 20131004-0142-7l1ym0y9
>> > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
>> >
>> > Execution failed:
>> > java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
>> > swift:stageIn @ workflow, line: 347
>> > Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14] for
>> > mA_file
>> > at
>> >
>> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
>> > at
>> >
>> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
>> > at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
>> > at
>> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>> > at
>> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>> > at
>> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>> > at
>> org.globus.cog.karajan.compiled.nodes.UParallel$1.run(UParallel.java:68)
>> > at k.thr.LWThread.run(LWThread.java:228)
>> > at
>> >
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> > at
>> >
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> > at java.lang.Thread.run(Thread.java:724)
>> >
>> > I am trying to reproduce with a simpler example.
>> >
>> > Thanks,
>> > Hi,
>> >
>> >
>> > It seems that the resume feature in trunk has some problems.
>> >
>> >
>> > When I try to resume a workflow I am running, I get the following
>> > error:
>> >
>> >
>> > $ swift -sites.file sites.gordon.xml -tc.file apps -config cf
>> > workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
>> > Swift trunk swift-r7089 cog-r3775 (cog modified locally)
>> > RunID: 20131004-0142-7l1ym0y9
>> > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
>> >
>> >
>> > Execution failed:
>> > java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
>> > swift:stageIn @ workflow, line: 347
>> > Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14] for
>> > mA_file
>> > at
>> >
>> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
>> > at
>> >
>> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
>> > at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
>> > at
>> >
>> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>> > at
>> > org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>> > at
>> > org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
>> > at
>> >
>> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>> > at org.globus.cog.karajan.compiled.nodes.UParallel
>> > $1.run(UParallel.java:68)
>> > at k.thr.LWThread.run(LWThread.java:228)
>> > at
>> >
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> > at java.util.concurrent.ThreadPoolExecutor
>> > $Worker.run(ThreadPoolExecutor.java:615)
>> > at java.lang.Thread.run(Thread.java:724)
>> >
>> >
>> > I am trying to reproduce with a simpler example.
>> >
>> >
>> > Thanks,
>> > --
>> > Ketan
>> >
>> >
>> > _______________________________________________
>> > Swift-devel mailing list
>> > Swift-devel at ci.uchicago.edu
>> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>>
>>
>>
>
>
> --
> Ketan
>
>


-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131005/05a6b7f4/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: gendata.sh
Type: application/x-sh
Size: 37 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131005/05a6b7f4/attachment.sh>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: matmul.sh
Type: application/x-sh
Size: 54 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131005/05a6b7f4/attachment-0001.sh>

From davidk at ci.uchicago.edu  Tue Oct  8 15:59:13 2013
From: davidk at ci.uchicago.edu (David Kelly)
Date: Tue, 8 Oct 2013 15:59:13 -0500 (CDT)
Subject: [Swift-devel] Filesys mapper with multiple patterns?
In-Reply-To: <967617468.3030450.1381265231031.JavaMail.root@ci.uchicago.edu>
Message-ID: <818145368.3033483.1381265953614.JavaMail.root@ci.uchicago.edu>



Is it possible to use a filesys mapper with multiple patterns? I would like "dir1/*.txt" and "dir2/*" to go in the same (one-dimensional) file array. I can do this with an ext mapper, just wondering if there is a better way. 


Thanks, 
David 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131008/a15a4e63/attachment.html>

From wilde at mcs.anl.gov  Tue Oct  8 16:06:35 2013
From: wilde at mcs.anl.gov (Michael Wilde)
Date: Tue, 8 Oct 2013 16:06:35 -0500 (CDT)
Subject: [Swift-devel] Filesys mapper with multiple patterns?
In-Reply-To: <818145368.3033483.1381265953614.JavaMail.root@ci.uchicago.edu>
Message-ID: <1229435952.4021171.1381266395514.JavaMail.root@mcs.anl.gov>

Perhaps do:

  file f[] <simple_mapper; file=readData(sh("ls -1 dir1/*.txt dir2/*"))>;

...or something similar?

- Mike

----- Original Message -----
> From: "David Kelly" <davidk at ci.uchicago.edu>
> To: "Swift Devel" <swift-devel at ci.uchicago.edu>
> Sent: Tuesday, October 8, 2013 3:59:13 PM
> Subject: [Swift-devel] Filesys mapper with multiple patterns?
> 
> 
> 
> 
> 
> Is it possible to use a filesys mapper with multiple patterns? I
> would like "dir1/*.txt" and "dir2/*" to go in the same
> (one-dimensional) file array. I can do this with an ext mapper, just
> wondering if there is a better way.
> 
> 
> Thanks,
> David
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> 


From marialemos72 at gmail.com  Sun Oct 13 08:15:17 2013
From: marialemos72 at gmail.com (Maria Lemos)
Date: Sun, 13 Oct 2013 14:15:17 +0100
Subject: [Swift-devel] [CISTI'2014]: Call for Workshops
Message-ID: <20131013131538.E33F77CC4C0@mailrelay.anl.gov>

******************************* CALL for WORKSHOPS **********************************
CISTI'2014 - 9th Iberian Conference on Information Systems and Technologies
                    June 18-21, 2014, Barcelona, Spain
                http://www.aisti.eu/cisti2014/index.php/en
*************************************************************************************


WORKSHOP FORMAT

The Iberian Information Systems and Technologies research and industrial community is invited to submit proposals of Workshops for CISTI 2014 ? 9th Iberian Conference on Information Systems and Technologies to be held at Barcelona, Spain, June 18?21, 2014. Two types of Workshops may be proposed: Regular Workshops and Project Workshops.

Regular Workshops should focus on a specific scientific subject on the scope of CISTI 2014 but not directly included on the main conference areas. Each regular workshop will be coordinated by an Organizing Committee composed of, at least, two researchers in the field, preferably from different institutions and different countries. The organizers should create an international Program Committee for the Workshop, with recognized researchers within the specific Workshop scientific area. Each workshop should have at least 10 submissions and 5 accepted papers in order to be conducted at CISTI.

Project Workshops are intended to promote the dissemination and facilitate the future exploitation of EU Latin-American and national project results such as EU/FP7, CSIC, FCT, QREN, Fund.Gulbenkian, CYTED, CAPES, CNPq, FINEP and other Projects/funding sources. The results to be disseminated may be preliminary project results (for unfinished projects) or the project final results (for already finished projects). Each project workshop should be directly related to a Project funded in a competitive manner by a National/International Science Organization. The Workshop should be coordinated by an Organizing Committee composed by at least two researchers including the Principal Investigator of the project. Each project Workshop will be entitled to at least a paper on the Conference main proceedings (specific details and distinct configurations for the project workshop should be discussed with the conference Workshop chair).

The selection of Workshops will be performed by CISTI 2014 Conference Chairs. Workshops full papers will be published in the conference main proceedings in specific Workshop chapters. Proceedings will be submitted for indexation by ISI Thomson, SCOPUS, INSPEC and EBSCO. Detailed and up-to-date information may be found at CISTI 2014 website http://www.aisti.eu/cisti2014.


WORKSHOP ORGANIZATION

The Organizing Committee of each Workshop will be responsible for:

?    Producing and distributing the Workshop Call for Papers (CFP);
?    Coordinating the review and selection process for the papers submitted to the Workshop, as Workshop chairs (on the paper submission system installed for all the Workshops);
?    Delivering the final versions of the papers accepted for the Workshop in accordance with the guidelines and deadlines defined by CISTI 2014 organizers;
?    Coordinating and chairing the Workshop sessions at the conference.

CISTI 2014 organizers reserve the right to cancel any Workshop if deadlines are missed or if the number of registered attendees is too low to support the costs associated with the Workshop.


PROPOSAL CONTENT

Regular Workshop proposals should contain the following information:

?    Workshop title;
?    Brief description of the specific scientific scope of the Workshop;
?    List of topics of interest (max 15 topics);
?    Reasons the Workshop should be held within CISTI?2014;
?    Name, postal address, phone and email of all the members of the Workshop Organizing Committee;
?    Proposal for the Workshop Program Committee (Names and affiliations).

Project Workshop proposals should contain the following information:

?    Workshop title;
?    Project Title, Reference, Principal Investigator, Funding Organization, Total Funding, Consortium, Abstract and Objectives;
?    Reasons the Workshop should be held within CISTI?2014;
?    Name, postal address, phone and email of all the members of the Workshop Organizing Committee.

Proposals should be submitted electronically by email to cistimail at gmail.com (cc: lpreis at dsi.uminho.pt), in PDF, (in English, Portuguese and Spanish), by November 2, 2013.


IMPORTANT DATES

?    Deadline for Workshop proposals: November 2, 2013
?    Notification of Workshop acceptance: November 9, 2013
?    Deadline for paper submission: February 22, 2014
?    Notification of paper acceptance: March 29, 2014
?    Deadline for final versions and conference registration: April 12, 2014
?    Deadline for Workshop final papers delivery to CISTI organizers: April 19, 2014
?    Conference dates: June 18-21, 2014


CHAIR

Luis Paulo Reis, University of Minho


Regards,

CISTI'2014 Team
http://www.aisti.eu/cisti2014/index.php/en




From benc at hawaga.org.uk  Sun Oct 13 10:16:10 2013
From: benc at hawaga.org.uk (Ben Clifford)
Date: Sun, 13 Oct 2013 15:16:10 +0000 (UTC)
Subject: [Swift-devel] LVars: monotonic update for deterministic parallel
	programming
Message-ID: <alpine.DEB.2.00.1310131514100.23819@dildano.hawaga.org.uk>


>From the abstracts in the URL, this looks very similar to how I did (/do) 
regard the way that swift's single-write variables working when used for 
more than simple base types.

http://lambda-the-ultimate.org/node/4823

Looks like someone got round to getting their PhD doing it before I 
attempted it...

-- 


From tim.g.armstrong at gmail.com  Sun Oct 13 15:21:55 2013
From: tim.g.armstrong at gmail.com (Tim Armstrong)
Date: Sun, 13 Oct 2013 15:21:55 -0500
Subject: [Swift-devel] LVars: monotonic update for deterministic
	parallel programming
In-Reply-To: <alpine.DEB.2.00.1310131514100.23819@dildano.hawaga.org.uk>
References: <alpine.DEB.2.00.1310131514100.23819@dildano.hawaga.org.uk>
Message-ID: <CAC0jiV5QbXdTdzfGUuknQQj1OcN=8_tJB_9X2jqjffpjzgdcSA@mail.gmail.com>

I've been aware of her work for a little while - looks like a nice way of
formalizing some of these ideas.

- Tim


On Sun, Oct 13, 2013 at 10:16 AM, Ben Clifford <benc at hawaga.org.uk> wrote:

>
> From the abstracts in the URL, this looks very similar to how I did (/do)
> regard the way that swift's single-write variables working when used for
> more than simple base types.
>
> http://lambda-the-ultimate.org/node/4823
>
> Looks like someone got round to getting their PhD doing it before I
> attempted it...
>
> --
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131013/40542cd9/attachment.html>

From hategan at mcs.anl.gov  Thu Oct 17 18:02:13 2013
From: hategan at mcs.anl.gov (Mihael Hategan)
Date: Thu, 17 Oct 2013 16:02:13 -0700
Subject: [Swift-devel] resume feature in trunk
In-Reply-To: <CAMUuviob3zTdcpXmZ3rgEPRWkA8P+c3_2Hbe11Bs_byA+X=q3Q@mail.gmail.com>
References: <CAMUuvirXterzEHhpNxdNdcZEUxYijwz_xwS9E4f8u_vzWH6x-w@mail.gmail.com>
	<1380855163.27712.1.camel@echo>
	<CAMUuvipO7Waqy-4WsStVAcBBEuSTNTHVTbT6F6ZnerJDckXV9w@mail.gmail.com>
	<CAMUuviob3zTdcpXmZ3rgEPRWkA8P+c3_2Hbe11Bs_byA+X=q3Q@mail.gmail.com>
Message-ID: <1382050933.24636.1.camel@echo>

Fixed in r7175.

Mihael

On Sat, 2013-10-05 at 18:41 -0500, Ketan Maheshwari wrote:
> Attached the dummy apps now.
> 
> 
> On Sat, Oct 5, 2013 at 6:40 PM, Ketan Maheshwari <ketancmaheshwari at gmail.com
> > wrote:
> 
> > Hi Mihael,
> >
> > Attached is the simplified version of my script and apps which has the
> > same resume behavior I reported.
> >
> > Thanks,
> > Ketan
> >
> >
> > On Thu, Oct 3, 2013 at 9:52 PM, Mihael Hategan <hategan at mcs.anl.gov>wrote:
> >
> >> Yeah, please send me the script or a simplified one. I have been using
> >> resume for a while, so it's not a general resume issue.
> >>
> >> Mihael
> >>
> >> On Thu, 2013-10-03 at 20:45 -0500, Ketan Maheshwari wrote:
> >> > Hi,
> >> >
> >> > It seems that the resume feature in trunk has some problems.
> >> >
> >> > When I try to resume a workflow I am running, I get the following error:
> >> >
> >> > $ swift -sites.file sites.gordon.xml -tc.file apps -config cf
> >> > workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
> >> > Swift trunk swift-r7089 cog-r3775 (cog modified locally)
> >> > RunID: 20131004-0142-7l1ym0y9
> >> > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
> >> >
> >> > Execution failed:
> >> > java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
> >> > swift:stageIn @ workflow, line: 347
> >> > Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14] for
> >> > mA_file
> >> > at
> >> >
> >> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> >> > at
> >> >
> >> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> >> > at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
> >> > at
> >> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >> > at
> >> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >> > at
> >> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >> > at
> >> org.globus.cog.karajan.compiled.nodes.UParallel$1.run(UParallel.java:68)
> >> > at k.thr.LWThread.run(LWThread.java:228)
> >> > at
> >> >
> >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >> > at
> >> >
> >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >> > at java.lang.Thread.run(Thread.java:724)
> >> >
> >> > I am trying to reproduce with a simpler example.
> >> >
> >> > Thanks,
> >> > Hi,
> >> >
> >> >
> >> > It seems that the resume feature in trunk has some problems.
> >> >
> >> >
> >> > When I try to resume a workflow I am running, I get the following
> >> > error:
> >> >
> >> >
> >> > $ swift -sites.file sites.gordon.xml -tc.file apps -config cf
> >> > workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
> >> > Swift trunk swift-r7089 cog-r3775 (cog modified locally)
> >> > RunID: 20131004-0142-7l1ym0y9
> >> > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
> >> >
> >> >
> >> > Execution failed:
> >> > java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
> >> > swift:stageIn @ workflow, line: 347
> >> > Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14] for
> >> > mA_file
> >> > at
> >> >
> >> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> >> > at
> >> >
> >> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> >> > at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
> >> > at
> >> >
> >> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >> > at
> >> > org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >> > at
> >> > org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> >> > at
> >> >
> >> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >> > at org.globus.cog.karajan.compiled.nodes.UParallel
> >> > $1.run(UParallel.java:68)
> >> > at k.thr.LWThread.run(LWThread.java:228)
> >> > at
> >> >
> >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >> > at java.util.concurrent.ThreadPoolExecutor
> >> > $Worker.run(ThreadPoolExecutor.java:615)
> >> > at java.lang.Thread.run(Thread.java:724)
> >> >
> >> >
> >> > I am trying to reproduce with a simpler example.
> >> >
> >> >
> >> > Thanks,
> >> > --
> >> > Ketan
> >> >
> >> >
> >> > _______________________________________________
> >> > Swift-devel mailing list
> >> > Swift-devel at ci.uchicago.edu
> >> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> >>
> >>
> >>
> >
> >
> > --
> > Ketan
> >
> >
> 
> 
> Attached the dummy apps now.
> 
> 
> On Sat, Oct 5, 2013 at 6:40 PM, Ketan Maheshwari
> <ketancmaheshwari at gmail.com> wrote:
>         Hi Mihael,
>         
>         
>         Attached is the simplified version of my script and apps which
>         has the same resume behavior I reported.
>         
>         
>         Thanks,
>         Ketan
>         
>         
>         On Thu, Oct 3, 2013 at 9:52 PM, Mihael Hategan
>         <hategan at mcs.anl.gov> wrote:
>                 Yeah, please send me the script or a simplified one. I
>                 have been using
>                 resume for a while, so it's not a general resume
>                 issue.
>                 
>                 Mihael
>                 
>                 On Thu, 2013-10-03 at 20:45 -0500, Ketan Maheshwari
>                 wrote:
>                 > Hi,
>                 >
>                 > It seems that the resume feature in trunk has some
>                 problems.
>                 >
>                 > When I try to resume a workflow I am running, I get
>                 the following error:
>                 >
>                 > $ swift -sites.file sites.gordon.xml -tc.file apps
>                 -config cf
>                 > workflow.swift -resume
>                 workflow-20131004-0107-09cxqmd5.0.rlog
>                 > Swift trunk swift-r7089 cog-r3775 (cog modified
>                 locally)
>                 > RunID: 20131004-0142-7l1ym0y9
>                 > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
>                 >
>                 > Execution failed:
>                 > java.lang.IndexOutOfBoundsException: Invalid index
>                 [14] for mA_file
>                 > swift:stageIn @ workflow, line: 347
>                 > Caused by: java.lang.IndexOutOfBoundsException:
>                 Invalid index [14] for
>                 > mA_file
>                 > at
>                 >
>                 org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
>                 > at
>                 >
>                 org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
>                 > at
>                 org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
>                 > at
>                 org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>                 > at
>                 org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>                 > at
>                 org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>                 > at org.globus.cog.karajan.compiled.nodes.UParallel
>                 $1.run(UParallel.java:68)
>                 > at k.thr.LWThread.run(LWThread.java:228)
>                 > at
>                 >
>                 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>                 > at
>                 > java.util.concurrent.ThreadPoolExecutor
>                 $Worker.run(ThreadPoolExecutor.java:615)
>                 > at java.lang.Thread.run(Thread.java:724)
>                 >
>                 > I am trying to reproduce with a simpler example.
>                 >
>                 > Thanks,
>                 > Hi,
>                 >
>                 >
>                 > It seems that the resume feature in trunk has some
>                 problems.
>                 >
>                 >
>                 > When I try to resume a workflow I am running, I get
>                 the following
>                 > error:
>                 >
>                 >
>                 > $ swift -sites.file sites.gordon.xml -tc.file apps
>                 -config cf
>                 > workflow.swift -resume
>                 workflow-20131004-0107-09cxqmd5.0.rlog
>                 > Swift trunk swift-r7089 cog-r3775 (cog modified
>                 locally)
>                 > RunID: 20131004-0142-7l1ym0y9
>                 > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
>                 >
>                 >
>                 > Execution failed:
>                 > java.lang.IndexOutOfBoundsException: Invalid index
>                 [14] for mA_file
>                 > swift:stageIn @ workflow, line: 347
>                 > Caused by: java.lang.IndexOutOfBoundsException:
>                 Invalid index [14] for
>                 > mA_file
>                 > at
>                 >
>                 org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
>                 > at
>                 >
>                 org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
>                 > at
>                 org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
>                 > at
>                 >
>                 org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
>                 > at
>                 >
>                 org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
>                 > at org.globus.cog.karajan.compiled.nodes.UParallel
>                 > $1.run(UParallel.java:68)
>                 > at k.thr.LWThread.run(LWThread.java:228)
>                 > at
>                 >
>                 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>                 > at java.util.concurrent.ThreadPoolExecutor
>                 > $Worker.run(ThreadPoolExecutor.java:615)
>                 > at java.lang.Thread.run(Thread.java:724)
>                 >
>                 >
>                 > I am trying to reproduce with a simpler example.
>                 >
>                 >
>                 > Thanks,
>                 > --
>                 > Ketan
>                 >
>                 >
>                 
>                 > _______________________________________________
>                 > Swift-devel mailing list
>                 > Swift-devel at ci.uchicago.edu
>                 >
>                 https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>                 
>                 
>         
>         
>         
>         
>         -- 
>         Ketan
>         
>         
> 
> 
> 
> 
> -- 
> Ketan
> 
> 




From ketancmaheshwari at gmail.com  Fri Oct 18 10:24:20 2013
From: ketancmaheshwari at gmail.com (Ketan Maheshwari)
Date: Fri, 18 Oct 2013 10:24:20 -0500
Subject: [Swift-devel] resume feature in trunk
In-Reply-To: <1382050933.24636.1.camel@echo>
References: <CAMUuvirXterzEHhpNxdNdcZEUxYijwz_xwS9E4f8u_vzWH6x-w@mail.gmail.com>
	<1380855163.27712.1.camel@echo>
	<CAMUuvipO7Waqy-4WsStVAcBBEuSTNTHVTbT6F6ZnerJDckXV9w@mail.gmail.com>
	<CAMUuviob3zTdcpXmZ3rgEPRWkA8P+c3_2Hbe11Bs_byA+X=q3Q@mail.gmail.com>
	<1382050933.24636.1.camel@echo>
Message-ID: <CAMUuviq=mE4EQnN23eNDsbJXctY1b1aLnQyQ9ktk-XXqL2FMpQ@mail.gmail.com>

Works, thanks!


On Thu, Oct 17, 2013 at 6:02 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:

> Fixed in r7175.
>
> Mihael
>
> On Sat, 2013-10-05 at 18:41 -0500, Ketan Maheshwari wrote:
> > Attached the dummy apps now.
> >
> >
> > On Sat, Oct 5, 2013 at 6:40 PM, Ketan Maheshwari <
> ketancmaheshwari at gmail.com
> > > wrote:
> >
> > > Hi Mihael,
> > >
> > > Attached is the simplified version of my script and apps which has the
> > > same resume behavior I reported.
> > >
> > > Thanks,
> > > Ketan
> > >
> > >
> > > On Thu, Oct 3, 2013 at 9:52 PM, Mihael Hategan <hategan at mcs.anl.gov
> >wrote:
> > >
> > >> Yeah, please send me the script or a simplified one. I have been using
> > >> resume for a while, so it's not a general resume issue.
> > >>
> > >> Mihael
> > >>
> > >> On Thu, 2013-10-03 at 20:45 -0500, Ketan Maheshwari wrote:
> > >> > Hi,
> > >> >
> > >> > It seems that the resume feature in trunk has some problems.
> > >> >
> > >> > When I try to resume a workflow I am running, I get the following
> error:
> > >> >
> > >> > $ swift -sites.file sites.gordon.xml -tc.file apps -config cf
> > >> > workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
> > >> > Swift trunk swift-r7089 cog-r3775 (cog modified locally)
> > >> > RunID: 20131004-0142-7l1ym0y9
> > >> > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
> > >> >
> > >> > Execution failed:
> > >> > java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
> > >> > swift:stageIn @ workflow, line: 347
> > >> > Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14]
> for
> > >> > mA_file
> > >> > at
> > >> >
> > >>
> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> > >> > at
> > >> >
> > >>
> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> > >> > at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
> > >> > at
> > >>
> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > >> > at
> > >>
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > >> > at
> > >>
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > >> > at
> > >>
> org.globus.cog.karajan.compiled.nodes.UParallel$1.run(UParallel.java:68)
> > >> > at k.thr.LWThread.run(LWThread.java:228)
> > >> > at
> > >> >
> > >>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > >> > at
> > >> >
> > >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > >> > at java.lang.Thread.run(Thread.java:724)
> > >> >
> > >> > I am trying to reproduce with a simpler example.
> > >> >
> > >> > Thanks,
> > >> > Hi,
> > >> >
> > >> >
> > >> > It seems that the resume feature in trunk has some problems.
> > >> >
> > >> >
> > >> > When I try to resume a workflow I am running, I get the following
> > >> > error:
> > >> >
> > >> >
> > >> > $ swift -sites.file sites.gordon.xml -tc.file apps -config cf
> > >> > workflow.swift -resume workflow-20131004-0107-09cxqmd5.0.rlog
> > >> > Swift trunk swift-r7089 cog-r3775 (cog modified locally)
> > >> > RunID: 20131004-0142-7l1ym0y9
> > >> > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
> > >> >
> > >> >
> > >> > Execution failed:
> > >> > java.lang.IndexOutOfBoundsException: Invalid index [14] for mA_file
> > >> > swift:stageIn @ workflow, line: 347
> > >> > Caused by: java.lang.IndexOutOfBoundsException: Invalid index [14]
> for
> > >> > mA_file
> > >> > at
> > >> >
> > >>
> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> > >> > at
> > >> >
> > >>
> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> > >> > at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
> > >> > at
> > >> >
> > >>
> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > >> > at
> > >> >
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > >> > at
> > >> >
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> > >> > at
> > >> >
> > >>
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> > >> > at org.globus.cog.karajan.compiled.nodes.UParallel
> > >> > $1.run(UParallel.java:68)
> > >> > at k.thr.LWThread.run(LWThread.java:228)
> > >> > at
> > >> >
> > >>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > >> > at java.util.concurrent.ThreadPoolExecutor
> > >> > $Worker.run(ThreadPoolExecutor.java:615)
> > >> > at java.lang.Thread.run(Thread.java:724)
> > >> >
> > >> >
> > >> > I am trying to reproduce with a simpler example.
> > >> >
> > >> >
> > >> > Thanks,
> > >> > --
> > >> > Ketan
> > >> >
> > >> >
> > >> > _______________________________________________
> > >> > Swift-devel mailing list
> > >> > Swift-devel at ci.uchicago.edu
> > >> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > >>
> > >>
> > >>
> > >
> > >
> > > --
> > > Ketan
> > >
> > >
> >
> >
> > Attached the dummy apps now.
> >
> >
> > On Sat, Oct 5, 2013 at 6:40 PM, Ketan Maheshwari
> > <ketancmaheshwari at gmail.com> wrote:
> >         Hi Mihael,
> >
> >
> >         Attached is the simplified version of my script and apps which
> >         has the same resume behavior I reported.
> >
> >
> >         Thanks,
> >         Ketan
> >
> >
> >         On Thu, Oct 3, 2013 at 9:52 PM, Mihael Hategan
> >         <hategan at mcs.anl.gov> wrote:
> >                 Yeah, please send me the script or a simplified one. I
> >                 have been using
> >                 resume for a while, so it's not a general resume
> >                 issue.
> >
> >                 Mihael
> >
> >                 On Thu, 2013-10-03 at 20:45 -0500, Ketan Maheshwari
> >                 wrote:
> >                 > Hi,
> >                 >
> >                 > It seems that the resume feature in trunk has some
> >                 problems.
> >                 >
> >                 > When I try to resume a workflow I am running, I get
> >                 the following error:
> >                 >
> >                 > $ swift -sites.file sites.gordon.xml -tc.file apps
> >                 -config cf
> >                 > workflow.swift -resume
> >                 workflow-20131004-0107-09cxqmd5.0.rlog
> >                 > Swift trunk swift-r7089 cog-r3775 (cog modified
> >                 locally)
> >                 > RunID: 20131004-0142-7l1ym0y9
> >                 > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
> >                 >
> >                 > Execution failed:
> >                 > java.lang.IndexOutOfBoundsException: Invalid index
> >                 [14] for mA_file
> >                 > swift:stageIn @ workflow, line: 347
> >                 > Caused by: java.lang.IndexOutOfBoundsException:
> >                 Invalid index [14] for
> >                 > mA_file
> >                 > at
> >                 >
> >
> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> >                 > at
> >                 >
> >
> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> >                 > at
> >
> org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
> >                 > at
> >
> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >                 > at
> >
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >                 > at
> >
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >                 > at org.globus.cog.karajan.compiled.nodes.UParallel
> >                 $1.run(UParallel.java:68)
> >                 > at k.thr.LWThread.run(LWThread.java:228)
> >                 > at
> >                 >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >                 > at
> >                 > java.util.concurrent.ThreadPoolExecutor
> >                 $Worker.run(ThreadPoolExecutor.java:615)
> >                 > at java.lang.Thread.run(Thread.java:724)
> >                 >
> >                 > I am trying to reproduce with a simpler example.
> >                 >
> >                 > Thanks,
> >                 > Hi,
> >                 >
> >                 >
> >                 > It seems that the resume feature in trunk has some
> >                 problems.
> >                 >
> >                 >
> >                 > When I try to resume a workflow I am running, I get
> >                 the following
> >                 > error:
> >                 >
> >                 >
> >                 > $ swift -sites.file sites.gordon.xml -tc.file apps
> >                 -config cf
> >                 > workflow.swift -resume
> >                 workflow-20131004-0107-09cxqmd5.0.rlog
> >                 > Swift trunk swift-r7089 cog-r3775 (cog modified
> >                 locally)
> >                 > RunID: 20131004-0142-7l1ym0y9
> >                 > Progress:  time: Fri, 04 Oct 2013 01:42:37 +0000
> >                 >
> >                 >
> >                 > Execution failed:
> >                 > java.lang.IndexOutOfBoundsException: Invalid index
> >                 [14] for mA_file
> >                 > swift:stageIn @ workflow, line: 347
> >                 > Caused by: java.lang.IndexOutOfBoundsException:
> >                 Invalid index [14] for
> >                 > mA_file
> >                 > at
> >                 >
> >
> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> >                 > at
> >                 >
> >
> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> >                 > at
> >
> org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:81)
> >                 > at
> >                 >
> >
> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:155)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:66)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.user.Function.runBody(Function.java:99)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.runBody(InvocationWrapper.java:245)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.user.InvocationWrapper.run(InvocationWrapper.java:69)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> >                 > at
> >                 >
> >
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> >                 > at org.globus.cog.karajan.compiled.nodes.UParallel
> >                 > $1.run(UParallel.java:68)
> >                 > at k.thr.LWThread.run(LWThread.java:228)
> >                 > at
> >                 >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >                 > at java.util.concurrent.ThreadPoolExecutor
> >                 > $Worker.run(ThreadPoolExecutor.java:615)
> >                 > at java.lang.Thread.run(Thread.java:724)
> >                 >
> >                 >
> >                 > I am trying to reproduce with a simpler example.
> >                 >
> >                 >
> >                 > Thanks,
> >                 > --
> >                 > Ketan
> >                 >
> >                 >
> >
> >                 > _______________________________________________
> >                 > Swift-devel mailing list
> >                 > Swift-devel at ci.uchicago.edu
> >                 >
> >
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> >
> >
> >
> >
> >
> >
> >         --
> >         Ketan
> >
> >
> >
> >
> >
> >
> > --
> > Ketan
> >
> >
>
>
>


-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131018/bb0f2d8e/attachment.html>

From iraicu at cs.iit.edu  Sat Oct 19 04:36:16 2013
From: iraicu at cs.iit.edu (Ioan Raicu)
Date: Sat, 19 Oct 2013 04:36:16 -0500
Subject: [Swift-devel] CFP: IEEE/ACM CCGrid 2014 -- papers due 11-11-2013
Message-ID: <52625290.5070107@cs.iit.edu>

------------------------- IEEE/ACM CCGrid 2014 -------------------------
14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

May 26-29, 2014
Chicago, IL, USA

http://datasys.cs.iit.edu/events/CCGrid2014/

Rapid advances in architectures, networks, and systems and middleware
technologies are leading to new concepts and platforms for computing,
ranging from Clusters and Grids to Clouds and Datacenters. The 14th
Annual IEEE/ACM International Symposium in Cluster, Cloud, and Grid
Computing (CCGrid 2014) is a forum bringing together international
researchers, developers, and practitioners to present leading research
activities and results on a broad range of topics related to these
concepts and platforms, and their applications. The conference features
keynotes, technical presentations, workshops, tutorials, and posters, as
well as the SCALE challenge featuring live demonstrations.

In 2014, CCGrid will return to the USA and be held in Chicago, the third
largest city in the United States. The main conference will be held on
May 27-29, 2014, with tutorials and affiliated workshops taking place on
May 26, 2014.

IMPORTANT DATES (Anywhere on Earth)
Workshop Proposals Due: November 3rd, 2013
Papers Due: November 11th, 2013
Author Notifications: January 24th, 2014
Camera Ready Papers Due: February 17th, 2014
Posters Due: February 24th, 2014
Tutorials Due: March 4th, 2014

TOPICS OF INTEREST
CCGrid 2014 will have a focus on important and immediate issues that are
significantly influencing all aspects of cluster, cloud and grid
computing. Topics of interest include, but are not limited to:
* Applications and Experiences: Applications to real and complex problems
in science, engineering, business, and society; User studies; Experiences
with large-scale deployments, systems, or applications
* Architecture and Accelerators: Design and use of emergent system
architectures including but not limited to accelerators; Multicores;
Power and cooling; Security and reliability; High availability solutions
* Autonomic Computing and Cyberinfrastructure: Self-managed behavior,
models and technologies; Autonomic paradigms and systems (control-based,
bio-inspired, emergent, etc.); Bio-inspired optimizations and computing
* Cloud Computing: Development, evaluation, and optimization of cloud
architectures; Software tools and techniques for clouds
* Modeling and Evaluation of Performance and Energy: Prediction,
modeling and analysis; Monitoring and evaluation tools; Benchmarks and
testbeds
* Programming Models, Systems, and Fault-Tolerant Computing: Programming
models, systems software and environments for cluster, cloud, and grid
computing; Fault-tolerant systems, programs and algorithms
* Scheduling and Resource Management: Techniques to schedule jobs and
resources on cluster, cloud, and grid computing platforms; SLA definition
and enforcement
* Storage and I/O Systems: System design and optimization for big data
processing in cluster and cloud environment


PAPER SUBMISSION GUIDELINES
Authors are invited to submit papers electronically in PDF format.
Submitted manuscripts should be structured as technical papers and may
not exceed 10 letter-size (8.5 x 11) pages including figures, tables and
references using the IEEE format for conference proceedings. Submissions
not conforming to these guidelines may be returned without review. The
official language of the conference is English. All manuscripts will be
reviewed and judged on correctness, originality, technical strength,
significance, quality of presentation, and interest and relevance to the
conference attendees.

Paper submissions are limited to 10 pages in 2-column IEEE format
including all figures and references. Submitted manuscripts exceeding
this limit will be returned without review. For the final camera-ready
version, authors with accepted papers may purchase additional pages at
the following rates: 100 USD for each of the first two additional pages;
200 USD for each of the third and fourth additional pages.

Submitted papers must represent original unpublished research that is not
currently under review for any other conference or journal. Papers not
following these guidelines will be rejected without review and further
action may be taken, including (but not limited to) notifications sent to
the heads of the institutions of the authors and sponsors of the
conference. Submissions received after the due date, exceeding the page
limit, or not appropriately structured may not be considered. Authors may
contact the conference chairs for more information. The proceedings will
be published through the IEEE Computer Society Press, USA, and will be
made available online through the IEEE Digital Library. The paper
submission online system will be available in late September 2013.

JOURNAL SPECIAL ISSUE
IEEE Transactions on Cloud Computing (TCC: http://computer.org/TCC) is
organizing a Special Issue which encourages submission of revised and
extended versions of 2-3 best/top rated papers in the area of Cloud
Computing from our conference. The special issue also seeks direct
submission of papers that present 'new' ideas for the first time in TCC.
All papers will be peer-reviewed and selected competitively based on
their originality and merit as per requirement of TCC. All queries on
this special issue should be directed to its guest editors. Details on
this special issue will be informed about in a separate Call for Papers at
http://www.computer.org/cms/Computer.org/transactions/cfps/cfp_tccsi_apbdac.pdf. 


CALL FOR TUTORIAL, WORKSHOP PROPOSALS, AND POSTERS
Tutorials and workshops affiliated with CCGrid 2014 will be held on May
26, 2014. Poster presentations will be done during the main conference
dates between May 27th and May 29th 2014. For more information on the
tutorials, workshops, posters, and doctoral symposium, see the following
links:
- Tutorials: 
http://datasys.cs.iit.edu/events/CCGrid2014/call-tutorials.html
- Workshops: 
http://datasys.cs.iit.edu/events/CCGrid2014/call-workshops.html
- Posters: http://datasys.cs.iit.edu/events/CCGrid2014/call-posters.html
- Doctoral Symposium: 
http://datasys.cs.iit.edu/events/CCGrid2014/call-doctoral.html

ORGANIZATION

Honorary General Chair
Daniel A. Reed, University of Iowa, USA

General Chairs
Xian-He Sun, Illinois Institute of Technology, USA
Ian T. Foster, University of Chicago & Argonne National Laboratory, USA

Program Committee Chair
Kirk W. Cameron, Virginia Tech, USA
Dimitris S. Nikolopoulos, Queen's University of Belfast, UK

APPLICATIONS
Esmond G. Ng, Lawrence Berkeley National Laboratory, USA
ARCHITECTURE & ACCELERATORS
Suren Byna, Lawrence Berkeley National Laboratory, USA
AUTONOMIC COMPUTING AND CYBERINFRASTUCTURE
Vladimir Getov, University of Westminster, UK
Xiaobo Zhou, University of Colorado, USA
CLOUD COMPUTING
Ali Butt, Virginia Tech, USA
Xiaosong Ma, North Carolina State University, USA
MODELING AND EVALUATION OF PERFORMANCE AND ENERGY
David Lowenthal, University of Arizona, USA
PROGRAMMING MODELS, SYSTEMS, AND FAULT-TOLERANT COMPUTING
Kasidit Chanchio, Thammasat University, Thailand
Christian Engelmann, Oak Ridge National Laboratory, USA
SCHEDULING AND RESOURCE MANAGEMENT
Matthew Grove, Rackspace, USA
Rizos Sakellariou, University of Manchester, UK
STORAGE AND I/O SYSTEMS
Dan Feng, Huazhong University of Science and Technology, China

Workshops Co-Chairs
Zhiling Lan, Illinois Institute of Technology, USA
Matei Ripeanu, University of British Columbia, Canada

Tutorials Co-Chairs
Kate Keahey, University of Chicago & Argonne National Laboratory, USA
Radu Prodan, University of Innsbruck, Austria

Doctoral Symposium Co-Chairs
Judy Qiu, Indiana University, USA

Poster and Research Demo Chair
Borja Sotomayor, University of Chicago, USA
Hui Jin, Oracle, USA

SCALE Challenge Coordinator
Doug Thain, Notre Dame, USA

Student Award Chair
Yong Chen, Texas Tech University, USA

Publicity Chair
Bruno Schulze, LNCC, Brazil
Cho-Li Wang, The University of Hong Kong, China
Darren J. Kerbyson, Pacific Northwest National Laboratory, USA
Toni Cortes UPC/BSC, Spain

Cyber Co-Chairs
Rong Ge, Marquette University, USA
Wei Tang, Argonne National Laboratory, USA

Proceedings Chair
Pavan Balaji, Argonne National Laboratory, USA

Local Organizing Committee
Ioan Raicu, Illinois Institute of Technology, USA
Kyle Chard, University of Chicago, USA

Finance Chairs
Dawn DeBartolo, Illinois Institute of Technology, USA

Steering Committee
Rajkumar Buyya, University of Melbourne, Australia (Chair)
Craig Lee, The Aerospace Corporation, USA (Co-Chair)
Henri Bal, Vrije University, The Netherlands
Pavan Balaji, Argonne National Laboratory, USA
Franck Capello, University of Paris-Sud, France
Jack Dongarra, University of Tennessee & ORNL, USA
Dick Epema, Technical University of Delft, The Netherlands
Thomas Fahringer, University of Innsbruck, Austria
Ian Foster, University of Chicago, USA
Wolfgang Gentzsch, DEISA, Germany
Hai Jin, Huazhong University of Science & Technology, China
Laurent Lefevre, INRIA, France
Geng Lin, Dell Inc., USA
Manish Parashar, Rutgers: The State University of New Jersey, USA
Shikharesh Majumdar, Carleton University, Canada
Satoshi Matsuoaka, Tokyo Institute of Technology, Japan
Omer Rana, Cardiff University, UK
Paul Roe, Queensland University of Technology, Australia
Bruno Schulze, LNCC, Brazil
Nalini Venkatasubramanian, University of California, USA
Carlos Varela, Rensselaer Polytechnic Institute, USA

Technical Program Committee

Applications:
Bill Barth, University of Texas at Austin
Costas Bekas, IBM Research - Zurich
Sanjukta Bhowmick, University of Nebraska
Yifeng Chen, Peking University
Olivier Coulaud, INRIA
Frederic Desprez, INRIA
Daniel Martin, Lawrence Berkeley National Laboratory
Kengo Nakajima, University of Tokyo
Hai Ah Nam, Oak Ridge National Laboratory
Esmond Ng, Lawrence Berkeley National Laboratory
Dana Petcu, West University of Timisoara
Judy Qiu, Indiana University
Ashok Srinivasan, Florida State University
Gerhard Wellein, Erlangen Regional Computing Center
Rio Yokota, KAUST
Yunquan Zhang, Institute of Software - Chinese Academy of Sciences

ARCHITECTURE & ACCELERATORS
Michela Becchi, University of Missouri
Suren Byna, Lawrence Berkeley National Laboratory
Srihari Cadambi, NEC Labs America Inc.
Wenguang Chen, Tsinghua University
Cong Du, Arista Networks
Natalie Enright Jerger, University of Toronto
Michael Ferdman, Stony Brook University
Dong Li, Oak Rdige National Lab
Sonia Lopez, Rochester Institute of Technology
Kamesh Madduri, Pennsylvania State University
Jiayuan Meng, Argonne National Lab
Ahmad Samih, Intel Corporation
Vinod Tipparaju, AMD
Didem Unat, Lawrence Berkeley National Laboratory
Sathish Vadhiyar, Indian Institute of Science -- Bangalore
Abhinav Vishnu, Pacific Northwest National Laboratory
Yili Zheng, LBNL

AUTONOMIC COMPUTING AND CYBERINFRASTUCTURE
Marco Aldinucci, University of Torino
Francoise Baude, Universite de Nice Sophia-Antipolis
Alexander Bolotov, University of Westminster
Marian Bubak, AGH Krakow PL and University of Amsterdam
Abhishek Chandra, University of Minnesota
Yong Chen, Texas Tech University
Yuan Chen, HP Labs
Marco Danelutto, University of Pisa
Xiaoning Ding, New Jersey Institute of Technology
Jose Fortes, University of Florida
Paraskevi Fragopoulou, FORTH-ICS
Vladimir Getov, University of Westminster
Sergei Gorlatch, University of Muenster
Palden Lama, University of Texas at San Antonio
Zhiqiang Lin, University of Texas at Dallas
Cristian Lumezanu, NEC Laboratories
Ningfang Mi, Northeastern University
Christine Morin, INRIA
Jia Rao, University of Colorado, Colorado Springs
Ian Taylor, Cardiff University and Louisiana State University
Thomas Weigold, IBM Research
Timothy Wood, George Washington University
Weikuan Yu, Auburn University
Ming Zhao, Florida International University
Xiaobo Zhou, University of Colorado

CLOUD COMPUTING
Gagan Agrawal, Ohio State University
Raouf Boutaba, University of Waterloo
Ali Butt, Virginia Tech
Zhihui Du, Tsinghua University
Dick Epema, Delft University of Technology
Renato Figueiredo, University of Florida
Geoffrey C. Fox, Indiana University
Chuntao Hong, Microsoft Research
Peter Kilpatrick, Queen's University Belfast
Jong Kim, HPC Lab
Youngjae Kim, Oak Ridge National Laboratory
Shan Lu, University of Wisconsin at Madison
Xiaosong Ma, North Carolina State University
Kostas Magoutis, ICS-FORTH
Gaurav Makkar, NetApp
M. Mustafa Rafique, IBM Research
Ioan Raicu, Illinois Institute of Technology
Lavanya Ramakrishnan, Lawrence Berkeley National Lab
Kai Sachs, SAP AG
Prasenjit Sarkar, IBM
Radu Sion, Stony Brook University
Yang Song, IBM
Osamu Tatebe, University of Tsukuba
Douglas Thain, University of Notre Dame
Devesh Tiwari, Oak Ridge National Laboratory
Dimitrios Tsoumakos, Ionian University
Guanying Wang, Google
Jon Weissman, University of Minnesota
Gianluigi Zanetti, CRS4
Jianfeng Zhan, Institute of Computing Technology - Chinese Academy of 
Sciences

MODELING AND EVALUATION OF PERFORMANCE AND ENERGY
Sadaf Alam, Swiss National Supercomputing Centre
Dorian Arnold, University of New Mexico
Frank Bellosa, University of Karlsruhe
Peter Dinda, Northwestern University
Todd Gamblin, Lawrence Livermore National Laboratory
Lizy John, University of Texas at Austin
Karen L. Karavanic, Portland State University
Darren Kerbyson, Pacific Northwest National Lab
James Laros, Sandia National Labs
David Lowenthal, University of Arizona
Naoya Maruyama, RIKEN AICS
Barry Rountree, Lawrence Livermore National Laboratory
Valerie Taylor, Texas A&M University
Hans Vandierendonck, Queen's University Belfast
Ana Varbanescu, University of Amsterdam
Xin Yuan, Flroida State University

PROGRAMMING MODELS, SYSTEMS, AND FAULT-TOLERANT COMPUTING
Vassil Alexandrov, BSC
Christos Antonopoulos, University of Thessaly
Pavan Balaji, Argonne National Laboratory
David E. Bernholdt, Oak Ridge National Laboratory
Filip Blagojevic, Hitachi Research
George Bosilca, University of Tennessee
Patrick Bridges, University of New Mexico
Greg Bronevetsky, Lawrence Livermore National Laboratory
Franck Cappello, INRIA and University of Illinois at Urbana Champaign
Kasidit Chanchio, Thammasat University
Zizhong Chen, University of California at Riverside
Andrew Chien, University of Chicago
Nathan Debardeleben, Los Alamos National Laboratory
Christian Engelmann, Oak Ridge National Laboratory
Kurt Ferreira, Sandia National Laboratories
Ada Gavrilovska, Georgia Institute of Technology
Cecile Germain, LRI
Michael Gerndt, Technische Universit?t M?nchen
William Gropp, University of Illinois at Urbana-Champaign
Thilo Kielmann, Vrije Universiteit
Bettina Krammer, Universit? de Versailles St-Quentin-en-Yvelines (UVSQ)
Dieter Kranzlm?ller, Ludwig-Maximilians-Universitaet Muenchen
Sriram Krishnamoorthy, Pacific Northwest National Lab
Hatem Ltaief, KAUST
Satoshi Matsuoka, Tokyo Institute of Technology
Celso Mendes, University of Illinois
Kathryn Mohror, LLNL
Frank Mueller, NCSU
Wolfgang E. Nagel, ZIH, TU Dresden
Bogdan Nicolae, IBM Research (Ireland)
Dhabaleswar Panda, Ohio State University
Prapaporn Rattanatamrong, Thammasat University
Alexander Reinefeld, Zuse Institute Berlin
Rolf Riesen, IBM Research
Scott Schneider, IBM Research
Martin Schulz, Lawrence Livermore National Laboratory
Stephen Scott, Oak Ridge National Laboratory
Shuaiwen Song, Pacific Northwest National Lab
Wei Tang, Argonne National Laboratory
Michela Taufer, University of Delaware
Putchong Uthayopas, Kasetsart University
Felix Wolf, German Research School for Simulation Sciences

SCHEDULING AND RESOURCE MANAGEMENT
Carl Albing, Cray Inc. and University of Reading
Henri Bal, Vrije Universiteit
Anne Benoit, ENS Lyon - LIP
Luiz F. Bittencourt, University of Campinas
Richard Boakes, University of Portsmouth
Ivona Brandic, TU Wien
Julita Corbalan, Barcelona Supercomputing Center
Ewa Deelman, USC Information Sciences Institute
Erik Elmroth, Ume? University
Thomas Fahringer, University of Innsbruck
Matthew Grove, Rackspace
Emmanuel Jeannot, Inria
Gideon Juve, USC Information Sciences Institute
Helen Karatza, Aristotle University of Thessaloniki
Alexey Lastovetsky, University College Dublin
Charles Lively, DeVry University
Maciej Malawski, AGH
Nandini Mukherjee, Jadavpur University
Jarek Nabrzyski, University of Notre Dame
Thomas Naughton, ORNL
George Pallis, University of Cyprus
Rizos Sakellariou, University of Manchester
Uwe Schwiegelshohn, TU Dortmund University
Domenico Talia, University of Calabria
Matthew E. Tolentino, Intel Corporation
Denis Trystram, Grenoble university
Kurt Vanmechelen, University of Antwerp
Carlos A. Varela, Rensselaer Polytechnic Institute
Vladimir Vlassov, Royal Institute of Technology (KTH)
Ramin Yahyapour, University of G?ttingen
Wolfgang Ziegler, Fraunhofer Institute SCAI

STORAGE AND I/O SYSTEMS
Andre Brinkmann, Johannes Gutenberg-Universit?t Mainz
Toni Cortes, Barcelona Supercomputing Center
Yafei Dai, Peking University
Dan Feng, Huazhong University of Science and Technology
Xubin He, Virginia Commonwealth University
Hong Jiang, University of Nebraska Lincoln
Xiao Qin, Auburn University
Fang Wang, Huazhong University of Science and Technology
Chunxiao Xing, Tsinghua University
Zhenquan Xu, Wuhan University
Lu Xu, Institute of Computing Technology - Chinese Academy of Sciences
Zhao Zhang, Iowa State University
Yifeng Zhu, University of Maine
Zhichun Zhu, University of Illinois at Chicago




-- 
=================================================================
Ioan Raicu, Ph.D.
Assistant Professor, Illinois Institute of Technology (IIT)
Guest Research Faculty, Argonne National Laboratory (ANL)
=================================================================
Data-Intensive Distributed Systems Laboratory, CS/IIT
Distributed Systems Laboratory, MCS/ANL
=================================================================
Editor: IEEE TCC, Springer JoCCASA
Chair:  IEEE/ACM MTAGS, ACM ScienceCloud, IEEE/ACM DataCloud
=================================================================
Cel:      1-847-722-0876
Office:   1-312-567-5704
Email: iraicu at cs.iit.edu
Web: http://www.cs.iit.edu/~iraicu/
Web: http://datasys.cs.iit.edu/
LinkedIn: http://www.linkedin.com/in/ioanraicu
Google: http://scholar.google.com/citations?user=jE73HYAAAAAJ
=================================================================
=================================================================



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131019/7b0900da/attachment.html>

From marialemos72 at gmail.com  Thu Oct 24 06:34:05 2013
From: marialemos72 at gmail.com (Maria Lemos)
Date: Thu, 24 Oct 2013 12:34:05 +0100
Subject: [Swift-devel] [WorldCIST'14]: World Conference on IST;
	Proceedings by Springer
Message-ID: <20131024113407.559C47CC0BD@mailrelay.anl.gov>

Apologies if you are receiving this mail more than once...


**********************************************************************************
                             WorldCIST'14
The 2014 World Conference on Information Systems and Technologies
                April 15 - 18, Madeira Island, Portugal
                   http://www.aisti.eu/worldcist14/
**********************************************************************************

The 2014 World Conference on Information Systems and Technologies (WorldCIST'14: http://www.aisti.eu/worldcist14) is a global forum for researchers and practitioners to present and discuss the most recent innovations, trends, results, experiences and concerns in the several perspectives of Information Systems and Technologies.

We are pleased to invite you to submit your papers to WorldCISTI'14. All submissions will be reviewed on the basis of relevance, originality, importance and clarity.

 
THEMES

Submitted papers should be related with one or more of the main themes proposed for the Conference:

A) Information and Knowledge Management (IKM);

B) Organizational Models and Information Systems (OMIS);

C) Intelligent and Decision Support Systems (IDSS);

D) Software Systems, Architectures, Applications and Tools (SSAAT);

E) Computer Networks, Mobility and Pervasive Systems (CNMPS);

F) Human-Computer Interaction (HCI);

G) Health Informatics (HIS);

H) Information Technologies in Education (ITE).


TYPES OF SUBMISSIONS AND DECISIONS

Four types of papers can be submitted:

Full paper: Finished or consolidated R&D works, to be included in one of the Conference themes. These papers are assigned a 10-page limit.

Short paper: Ongoing works with relevant preliminary results, open to discussion. These papers are assigned a 7-page limit.

Poster paper: Initial work with relevant ideas, open to discussion. These papers are assigned to a 4-page limit.

Company paper: Companies' papers that show practical experience, R & D, tools, etc., focused on some topics of the conference. These papers are assigned to a 4-page limit.

Submitted papers must comply with the format of Advances in Intelligent Systems and Computing Series (see Instructions for Authors at Springer Website or download a DOC example) be written in English, must not have been published before, not be under review for any other conference or publication and not include any information leading to the authors? identification. Therefore, the authors? names, affiliations and bibliographic references should not be included in the version for evaluation by the Program Committee. This information should only be included in the camera-ready version, saved in Word or Latex format and also in PDF format. These files must be accompanied by the Consent to Publication form filled out, in a ZIP file, and uploaded at the conference management system.

All papers will be subjected to a ?double-blind review? by at least two members of the Program Committee.

Based on Program Committee evaluation, a paper can be rejected or accepted by the Conference Chairs. In the later case, it can be accepted as the type originally submitted or as another type. Thus, full papers can be accepted as short papers or poster papers only. Similarly, short papers can be accepted as poster papers only. In these cases, the authors will be allowed to maintain the original number of pages in the camera-ready version.

The authors of accepted poster papers must also build and print a poster to be exhibited during the Conference. This poster must follow an A1 or A2 vertical format. The Conference includes Work Sessions where these posters are presented and orally discussed, with a 5 minute limit per poster.

The authors of accepted full papers will have 15 minutes to present their work in a Conference Work Session; approximately 5 minutes of discussion will follow each presentation. The authors of accepted short papers and company papers will have 11 minutes to present their work in a Conference Work Session; approximately 4 minutes of discussion will follow each presentation.


PUBLICATION AND INDEXING

To ensure that a full paper, short paper, poster paper or company paper is published in the Proceedings, at least one of the authors must be fully registered by the 24th of January 2014, and the paper must comply with the suggested layout and page-limit. Additionally, all recommended changes must be addressed by the authors before they submit the camera-ready version.

No more than one paper per registration will be published in the Conference Proceedings. An extra fee must be paid for publication of additional papers, with a maximum of one additional paper per registration.

Full and short papers will be published in Proceedings by Springer, in Advances in Intelligent Systems and Computing Series. Poster and company papers will be published in Proceedings by AISTI.

Published full and short papers will be submitted for indexation by ISI, EI-Compendex, SCOPUS and DBLP, among others, and will be available in the SpringerLink Digital Library. Published poster and company papers will be submitted for indexation by EI-Compendex and EBSCO.

The authors of the best selected papers will be invited to extend them for publication in international journals indexed by ISI, SCOPUS and DBLP, among others, such as:

Journal of Information Technology (JIT)

Social Science Computer Review (SSCR)

Information Processing & Management (IPM)

Information Technology & People (ITP)

Computer Science and Information Systems (ComSIS)

Information Development (IDV)

IEEE IT Professional (ITPro)

Methods of Information in Medicine (MIM)

Computer Methods in Biomechanics and Biomedical Engineering - Imaging & Visualization (CMBBE-IV)

Journal of Medical Internet Research (JMIR)

International Journal of Interactive Multimedia and Artificial Intelligence (IJIMAI)

International Journal of Health Information Systems & Informatics (IJHISI)

International Journal of Web Based Communities (IJWBC)

EAI Transactions on e-Education and e-Learning (EAI-TEL)


INPORTANT DATES

Paper Submission: November 15, 2013

Notification of Acceptance: January 10, 2014

Camera-ready Submission: January 19, 2014

Payment of Registration, to ensure the inclusion of an accepted paper in the conference proceedings: January 24, 2014.



Regards, 

WorldCIST'14 Team
http://www.aisti.eu/worldcist14/









From wilde at mcs.anl.gov  Thu Oct 31 18:53:38 2013
From: wilde at mcs.anl.gov (Michael Wilde)
Date: Thu, 31 Oct 2013 18:53:38 -0500 (CDT)
Subject: [Swift-devel] Web page issue
In-Reply-To: <84043060.17951864.1383263439865.JavaMail.root@mcs.anl.gov>
Message-ID: <479612997.17956421.1383263618100.JavaMail.root@mcs.anl.gov>

David, the mainpage still points to the old quickstart guide.

Can you change the Get Started button to say:

  Try the tutorial and start using Swift today!

and have the button take you to the documentation page?

Thanks,

- Mike


From davidk at ci.uchicago.edu  Thu Oct 31 19:17:57 2013
From: davidk at ci.uchicago.edu (David Kelly)
Date: Thu, 31 Oct 2013 19:17:57 -0500 (CDT)
Subject: [Swift-devel] Web page issue
In-Reply-To: <479612997.17956421.1383263618100.JavaMail.root@mcs.anl.gov>
Message-ID: <1488482218.7599534.1383265077168.JavaMail.root@ci.uchicago.edu>

Sure, the Get Started button points to the documentation page now. 

----- Original Message -----

> From: "Michael Wilde" <wilde at mcs.anl.gov>
> To: "David Kelly" <davidk at ci.uchicago.edu>
> Cc: "Swift Devel" <swift-devel at ci.uchicago.edu>
> Sent: Thursday, October 31, 2013 6:53:38 PM
> Subject: Web page issue

> David, the mainpage still points to the old quickstart guide.

> Can you change the Get Started button to say:

> Try the tutorial and start using Swift today!

> and have the button take you to the documentation page?

> Thanks,

> - Mike
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131031/df708fa3/attachment.html>

From wilde at mcs.anl.gov  Thu Oct 31 22:40:02 2013
From: wilde at mcs.anl.gov (Michael Wilde)
Date: Thu, 31 Oct 2013 22:40:02 -0500 (CDT)
Subject: [Swift-devel] Web page issue
In-Reply-To: <1488482218.7599534.1383265077168.JavaMail.root@ci.uchicago.edu>
Message-ID: <430942396.18000765.1383277202465.JavaMail.root@mcs.anl.gov>

Thanks, David - that looks much better.  Can you also change the order of:

Swift on Crays
Swift on OSG Connect
Swift on Clouds and Ad Hoc collections of workstations

to 

Swift on Clouds and Ad Hoc collections of workstations
Swift on Open Science Grid (OSG Connect)
Swift on Cray Systems

Thanks,

- Mike


----- Original Message -----
> From: "David Kelly" <davidk at ci.uchicago.edu>
> To: "Michael Wilde" <wilde at mcs.anl.gov>
> Cc: "Swift Devel" <swift-devel at ci.uchicago.edu>
> Sent: Thursday, October 31, 2013 7:17:57 PM
> Subject: Re: Web page issue
> 
> 
> Sure, the Get Started button points to the documentation page now.
> 
> ----- Original Message -----
> 
> 
> From: "Michael Wilde" <wilde at mcs.anl.gov>
> To: "David Kelly" <davidk at ci.uchicago.edu>
> Cc: "Swift Devel" <swift-devel at ci.uchicago.edu>
> Sent: Thursday, October 31, 2013 6:53:38 PM
> Subject: Web page issue
> 
> David, the mainpage still points to the old quickstart guide.
> 
> Can you change the Get Started button to say:
> 
> Try the tutorial and start using Swift today!
> 
> and have the button take you to the documentation page?
> 
> Thanks,
> 
> - Mike
> 
> 


From yadunandb at ci.uchicago.edu  Mon Oct  7 11:30:50 2013
From: yadunandb at ci.uchicago.edu (Yadu Nand B)
Date: Mon, 07 Oct 2013 16:30:50 -0000
Subject: [Swift-devel] Bootstrap.sh got mangled with the patch
In-Reply-To: <999150101.2616874.1381163364231.JavaMail.root@ci.uchicago.edu>
Message-ID: <1647143871.2617606.1381163450090.JavaMail.root@ci.uchicago.edu>

Hi Mihael,

It looks like my patch (probably) mangled the bootstrap.sh script,
and as a result remote tests are failing. 

Here's a snippet of code from Rev:3806 
/cog/provider-coaster/resources/bootstrap.sh 

WGET=`$WR which wget`
if [ "X$WGET" == "X" ]; then
    WGET=`$WR which curl`
    UNAME=`uname`
    if [ "X$WGET" == "X" ]; then
	error "No wget or curl available"
    elif [ "$UNAME" == "Darwin" ]; then
        WGET="$WGET -o $DJ $BS/$B.jar >>$L 2>&1"
    else
        WGET="$WGET -O $DJ $BS/$B.jar >>$L 2>&1"  
    elif [ "$UNAME" == "Darwin" ]; then
        WGET="$WGET -o $DJ $BS/$B.jar >>$L 2>&1"
    else
        WGET="$WGET -O $DJ $BS/$B.jar >>$L 2>&1"
    fi
else
    WGET="$WGET -c -q $BS/$B.jar -O $DJ >>$L 2>&1"
fi

And here's how it is supposed to be:

WGET=`$WR which wget`
if [ "X$WGET" == "X" ]; then
    WGET=`$WR which curl`
    if [ "X$WGET" == "X" ]; then
        error "No wget or curl available"
    elif [ "$UNAME" == "Darwin" ]; then
        WGET="$WGET -o $DJ $BS/$B.jar >>$L 2>&1"
    else
        WGET="$WGET -O $DJ $BS/$B.jar >>$L 2>&1"  
    fi
else
    WGET="$WGET -c -q $BS/$B.jar -O $DJ >>$L 2>&1"
fi


Could you please review this?

Thanks,
Yadu


From BBecker at csir.co.za  Thu Oct 31 05:56:03 2013
From: BBecker at csir.co.za (Bruce Becker)
Date: Thu, 31 Oct 2013 10:56:03 -0000
Subject: [Swift-devel] CREAM-CE support
Message-ID: <CAPkbFJ9mXeGgCZT7P3GtkZV3MFsx397mtWgsSsLaLzZ8J3bTfw@mail.gmail.com>

Hi Swift-devel

I've got some users in Johannesburg who are very keen on swift, and have
been using it for a while. However, they cannot use the national grid
infrastructure in South Africa, which is EMI-3 based. All of our clusters
expose CREAM Computing Elements. I would like to hack something together to
1) allow swift to use VO SAGrid proxies for authentication and
authorisation on our sites
2) create a CREAM provider so that swift can understand how to submit to
CREAM CE's. Either via the command line or via the API.

Where should I start ?
Thanks !
Bruce

-- 
Dr. Bruce Becker,
Coordinator, South African National Grid
Meraka Institute, CSIR
Meiring Naude Road
Pretoria 0001 South Africa
+27 12 841 3746 (w) | +27 12 841-4829 (f) |
+27 84 989 6169 (m)  | + 39 392 622 9279
AIM/GTalk/Skype/MSN/Jabber : brucellino
http://www.sagrid.ac.za
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20131031/a042f1bc/attachment.html>