[Swift-devel] iterate fails
Mihael Hategan
hategan at mcs.anl.gov
Mon Sep 16 15:04:21 CDT 2013
Not the same. The link points to a compilation issue, while this is a
run-time issue.
Mihael
On Mon, 2013-09-16 at 14:39 -0500, Yadu Nand wrote:
> Hi Mihael,
>
> Is this the same issue that was discussed in this mail ->
> http://lists.ci.uchicago.edu/pipermail/swift-devel/2013-March/010109.html
>
> I am seeing this script failing on trunk (but not on 0.94). The internals
> stress test
> runs this script which does an assignment to an array within an iterate
> loop ->
> https://github.com/yadudoc/swift-basics/blob/master/stress/x_iterate.swift
> The test-suite has some pending issues on trunk, which I haven't cleaned up
> yet,
> and which is why this went under the radar.
>
> Here's the error I get when running stress/x_iterate.swift:
> [yadunand at midway001 x_iterate-142712]$ swift x_iterate.swift -loops=5
> Swift trunk swift-r7071 (swift modified locally) cog-r3787 (cog modified
> locally)
> RunID: 20130916-1936-i6mqe9qa
> [Error] sites.xml, line 1, col 9: cvc-elt.1: Cannot find the declaration of
> element 'config'.
> Progress: time: Mon, 16 Sep 2013 19:36:50 +0000
> Result[0] = 0
>
> Execution failed:
> java.lang.IndexOutOfBoundsException: Invalid index [4] for result
> tracef @ x_iterate, line: 56
> Caused by: java.lang.IndexOutOfBoundsException: Invalid index [4] for result
> at
> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> at
> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> at
> org.griphyn.vdl.karajan.lib.SwiftFunction.waitForAll(SwiftFunction.java:343)
> at org.griphyn.vdl.karajan.lib.swiftscript.Tracef.function(Tracef.java:57)
> at
> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> at
> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:154)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at org.globus.cog.karajan.compiled.nodes.UParallel$1.run(UParallel.java:68)
> at k.thr.LWThread.run(LWThread.java:228)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:722)
>
> Here's the error I'm getting when running Ketan's code :
> Execution failed:
> org.griphyn.vdl.mapping.InvalidPathException: Array index '[2]' not found
> for out of size 2
> swift:getFieldSubscript @ iterate, line: 93
> Caused by: org.griphyn.vdl.mapping.InvalidPathException: Array index '[2]'
> not found for out of size 2
>
> Are these coming from the same bug ?
>
> Thanks,
> -Yadu
>
>
>
> On Mon, Sep 16, 2013 at 1:52 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:
>
> > I can confirm that this is an issue with write reference counting in
> > trunk. I'm working on it.
> >
> > On Mon, 2013-09-16 at 11:29 -0500, Michael Wilde wrote:
> > > If this is indeed failing on trunk, hopefully the test suite will see
> > the same thing.
> > > Yadu, can you look into this and file a ticket if its indeed a trunk bug?
> > >
> > > Thanks,
> > >
> > > - Mike
> > >
> > > ----- Original Message -----
> > > > From: "Ketan Maheshwari" <ketancmaheshwari at gmail.com>
> > > > To: "Michael Wilde" <wilde at mcs.anl.gov>
> > > > Cc: "Swift Devel" <swift-devel at ci.uchicago.edu>
> > > > Sent: Monday, September 16, 2013 11:23:54 AM
> > > > Subject: Re: [Swift-devel] iterate fails
> > > >
> > > >
> > > >
> > > > Mike,
> > > >
> > > > I am using the latest trunk:
> > > > Swift trunk swift-r7065 (swift modified locally) cog-r3782
> > > >
> > > >
> > > >
> > > >
> > > > On Mon, Sep 16, 2013 at 11:20 AM, Michael Wilde < wilde at mcs.anl.gov >
> > > > wrote:
> > > >
> > > >
> > > > Ketan, this worked for me (see below). What version of swift did you
> > > > run where?
> > > >
> > > > I ran on swift.rcc, on localhost.
> > > >
> > > > - Mike
> > > >
> > > > swift$ swift km2.swift -data=data.txt
> > > > Swift 0.94.1 RC2 swift-r6895 cog-r3765
> > > >
> > > > RunID: 20130916-1617-i570fay7
> > > > Progress: time: Mon, 16 Sep 2013 16:17:32 +0000
> > > > Final status: Mon, 16 Sep 2013 16:17:33 +0000 Finished successfully:3
> > > >
> > > > swift$ ls -lt outdir | head
> > > > total 16032
> > > > -rw-r--r-- 1 wilde wilde 9 Sep 16 11:17 f.0002.out
> > > > -rw-r--r-- 1 wilde wilde 9 Sep 16 11:17 f.0001.out
> > > > -rw-rw-r-- 1 wilde wilde 9 Sep 16 11:17 f.0000.out
> > > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0483.out
> > > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0490.out
> > > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0488.out
> > > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0500.out
> > > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0498.out
> > > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0491.out
> > > > swift$ swift -version
> > > > Swift 0.94.1 RC2 swift-r6895 cog-r3765
> > > >
> > > > swift$
> > > >
> > > >
> > > >
> > > >
> > > > ----- Original Message -----
> > > > > From: "Ketan Maheshwari" < ketancmaheshwari at gmail.com >
> > > > > To: "Swift Devel" < swift-devel at ci.uchicago.edu >
> > > > > Sent: Monday, September 16, 2013 10:49:07 AM
> > > > > Subject: [Swift-devel] iterate fails
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > Hi,
> > > > >
> > > > > I am trying a catsn example with foreach replaced by iterate as
> > > > > follows:
> > > > >
> > > > > ===
> > > > > type file;
> > > > >
> > > > > app (file o) cat (file i) {
> > > > > cat @i stdout=@o;
> > > > > }
> > > > > file out[]<simple_mapper; location="outdir",
> > > > > prefix="f.",suffix=".out">;
> > > > >
> > > > > string d=@arg("data");
> > > > >
> > > > > #foreach j in [1:1000] {
> > > > > iterate j {
> > > > > file data<single_file_mapper; file=d>;
> > > > > out[j] = cat(data);
> > > > > } until (j==3);
> > > > >
> > > > >
> > > > > ===
> > > > >
> > > > >
> > > > > The run fails with error message as follows:
> > > > > $ swift -tc.file tc -config cf -sites.file sites.xml catsn.swift
> > > > > -data=data.txt
> > > > > Swift trunk swift-r7065 (swift modified locally) cog-r3782
> > > > > RunID: 20130916-1045-tldyyexe
> > > > > Progress: time: Mon, 16 Sep 2013 10:45:41 -0500
> > > > >
> > > > > Execution failed:
> > > > > org.griphyn.vdl.mapping.InvalidPathException: Array index '[2]' not
> > > > > found for out of size 2
> > > > > swift:getFieldSubscript @ catsn, line: 93
> > > > > Caused by: org.griphyn.vdl.mapping.InvalidPathException: Array
> > > > > index
> > > > > '[2]' not found for out of size 2
> > > > >
> > > > >
> > > > >
> > > > > Any suggestions?
> > > > >
> > > > >
> > > > > Thanks,
> > > > >
> > > > > --
> > > > > Ketan
> > > > >
> > > > >
> > > > > _______________________________________________
> > > > > Swift-devel mailing list
> > > > > Swift-devel at ci.uchicago.edu
> > > > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Ketan
> > > >
> > > >
> > > _______________________________________________
> > > Swift-devel mailing list
> > > Swift-devel at ci.uchicago.edu
> > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> >
> >
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> >
>
>
>
> Hi Mihael,
>
>
> Is this the same issue that was discussed in this mail ->
> http://lists.ci.uchicago.edu/pipermail/swift-devel/2013-March/010109.html
>
>
> I am seeing this script failing on trunk (but not on 0.94). The
> internals stress test
> runs this script which does an assignment to an array within an
> iterate loop ->
> https://github.com/yadudoc/swift-basics/blob/master/stress/x_iterate.swift
> The test-suite has some pending issues on trunk, which I haven't
> cleaned up yet,
> and which is why this went under the radar.
>
>
> Here's the error I get when running stress/x_iterate.swift:
> [yadunand at midway001 x_iterate-142712]$ swift x_iterate.swift -loops=5
> Swift trunk swift-r7071 (swift modified locally) cog-r3787 (cog
> modified locally)
> RunID: 20130916-1936-i6mqe9qa
> [Error] sites.xml, line 1, col 9: cvc-elt.1: Cannot find the
> declaration of element 'config'.
> Progress: time: Mon, 16 Sep 2013 19:36:50 +0000
> Result[0] = 0
>
>
> Execution failed:
> java.lang.IndexOutOfBoundsException: Invalid index [4] for result
> tracef @ x_iterate, line: 56
> Caused by: java.lang.IndexOutOfBoundsException: Invalid index [4] for
> result
> at
> org.griphyn.vdl.mapping.AbstractDataNode.checkNoValue(AbstractDataNode.java:716)
> at
> org.griphyn.vdl.mapping.AbstractDataNode.waitFor(AbstractDataNode.java:682)
> at
> org.griphyn.vdl.karajan.lib.SwiftFunction.waitForAll(SwiftFunction.java:343)
> at
> org.griphyn.vdl.karajan.lib.swiftscript.Tracef.function(Tracef.java:57)
> at
> org.griphyn.vdl.karajan.lib.SwiftFunction.runBody(SwiftFunction.java:108)
> at
> org.globus.cog.karajan.compiled.nodes.InternalFunction.run(InternalFunction.java:154)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at
> org.globus.cog.karajan.compiled.nodes.Sequential.run(Sequential.java:22)
> at
> org.globus.cog.karajan.compiled.nodes.CompoundNode.runChild(CompoundNode.java:87)
> at org.globus.cog.karajan.compiled.nodes.UParallel
> $1.run(UParallel.java:68)
> at k.thr.LWThread.run(LWThread.java:228)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor
> $Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:722)
>
>
> Here's the error I'm getting when running Ketan's code :
> Execution failed:
> org.griphyn.vdl.mapping.InvalidPathException: Array index '[2]' not
> found for out of size 2
> swift:getFieldSubscript @ iterate, line: 93
> Caused by: org.griphyn.vdl.mapping.InvalidPathException: Array index
> '[2]' not found for out of size 2
>
>
> Are these coming from the same bug ?
>
>
> Thanks,
> -Yadu
>
>
>
>
>
> On Mon, Sep 16, 2013 at 1:52 PM, Mihael Hategan <hategan at mcs.anl.gov>
> wrote:
> I can confirm that this is an issue with write reference
> counting in
> trunk. I'm working on it.
>
> On Mon, 2013-09-16 at 11:29 -0500, Michael Wilde wrote:
> > If this is indeed failing on trunk, hopefully the test suite
> will see the same thing.
> > Yadu, can you look into this and file a ticket if its indeed
> a trunk bug?
> >
> > Thanks,
> >
> > - Mike
> >
> > ----- Original Message -----
> > > From: "Ketan Maheshwari" <ketancmaheshwari at gmail.com>
> > > To: "Michael Wilde" <wilde at mcs.anl.gov>
> > > Cc: "Swift Devel" <swift-devel at ci.uchicago.edu>
> > > Sent: Monday, September 16, 2013 11:23:54 AM
> > > Subject: Re: [Swift-devel] iterate fails
> > >
> > >
> > >
> > > Mike,
> > >
> > > I am using the latest trunk:
> > > Swift trunk swift-r7065 (swift modified locally) cog-r3782
> > >
> > >
> > >
> > >
> > > On Mon, Sep 16, 2013 at 11:20 AM, Michael Wilde <
> wilde at mcs.anl.gov >
> > > wrote:
> > >
> > >
> > > Ketan, this worked for me (see below). What version of
> swift did you
> > > run where?
> > >
> > > I ran on swift.rcc, on localhost.
> > >
> > > - Mike
> > >
> > > swift$ swift km2.swift -data=data.txt
> > > Swift 0.94.1 RC2 swift-r6895 cog-r3765
> > >
> > > RunID: 20130916-1617-i570fay7
> > > Progress: time: Mon, 16 Sep 2013 16:17:32 +0000
> > > Final status: Mon, 16 Sep 2013 16:17:33 +0000 Finished
> successfully:3
> > >
> > > swift$ ls -lt outdir | head
> > > total 16032
> > > -rw-r--r-- 1 wilde wilde 9 Sep 16 11:17 f.0002.out
> > > -rw-r--r-- 1 wilde wilde 9 Sep 16 11:17 f.0001.out
> > > -rw-rw-r-- 1 wilde wilde 9 Sep 16 11:17 f.0000.out
> > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0483.out
> > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0490.out
> > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0488.out
> > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0500.out
> > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0498.out
> > > -rw-rw-r-- 1 wilde wilde 9 Jul 27 17:05 f.0491.out
> > > swift$ swift -version
> > > Swift 0.94.1 RC2 swift-r6895 cog-r3765
> > >
> > > swift$
> > >
> > >
> > >
> > >
> > > ----- Original Message -----
> > > > From: "Ketan Maheshwari" < ketancmaheshwari at gmail.com >
> > > > To: "Swift Devel" < swift-devel at ci.uchicago.edu >
> > > > Sent: Monday, September 16, 2013 10:49:07 AM
> > > > Subject: [Swift-devel] iterate fails
> > > >
> > > >
> > > >
> > > >
> > > > Hi,
> > > >
> > > > I am trying a catsn example with foreach replaced by
> iterate as
> > > > follows:
> > > >
> > > > ===
> > > > type file;
> > > >
> > > > app (file o) cat (file i) {
> > > > cat @i stdout=@o;
> > > > }
> > > > file out[]<simple_mapper; location="outdir",
> > > > prefix="f.",suffix=".out">;
> > > >
> > > > string d=@arg("data");
> > > >
> > > > #foreach j in [1:1000] {
> > > > iterate j {
> > > > file data<single_file_mapper; file=d>;
> > > > out[j] = cat(data);
> > > > } until (j==3);
> > > >
> > > >
> > > > ===
> > > >
> > > >
> > > > The run fails with error message as follows:
> > > > $ swift -tc.file tc -config cf -sites.file sites.xml
> catsn.swift
> > > > -data=data.txt
> > > > Swift trunk swift-r7065 (swift modified locally)
> cog-r3782
> > > > RunID: 20130916-1045-tldyyexe
> > > > Progress: time: Mon, 16 Sep 2013 10:45:41 -0500
> > > >
> > > > Execution failed:
> > > > org.griphyn.vdl.mapping.InvalidPathException: Array
> index '[2]' not
> > > > found for out of size 2
> > > > swift:getFieldSubscript @ catsn, line: 93
> > > > Caused by: org.griphyn.vdl.mapping.InvalidPathException:
> Array
> > > > index
> > > > '[2]' not found for out of size 2
> > > >
> > > >
> > > >
> > > > Any suggestions?
> > > >
> > > >
> > > > Thanks,
> > > >
> > > > --
> > > > Ketan
> > > >
> > > >
> > > > _______________________________________________
> > > > Swift-devel mailing list
> > > > Swift-devel at ci.uchicago.edu
> > > >
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> > > >
> > >
> > >
> > >
> > > --
> > > Ketan
> > >
> > >
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> >
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>
>
>
>
> --
> Yadu Nand B
>
>
More information about the Swift-devel
mailing list