[Swift-devel] STOMP script problems - Re: stripped down script still has some confusing issues

[Michael Wilde]

This is looking good. Thanks everyone for pushing forward to resolve the problems.

Mihael, the improved error messages are looking great.

I'm cc'ing swift-devel here so that David can pick up the fixes for 0.94. Im thinking at this point its best to create a new 0.94 release candidate from trunk. Is that the way to go?

We should keep swift-support copied on future discussion.

- Mike

----- Original Message -----
> From: "Mihael Hategan" <hategan at mcs.anl.gov>
> To: "Karen L Schuchardt" <Karen.Schuchardt at pnnl.gov>
> Cc: "Michael Wilde" <wilde at mcs.anl.gov>, "Jared M Chase" <jared.chase at pnnl.gov>, "Khushbu Agarwal"
> <Khushbu.Agarwal at pnnl.gov>
> Sent: Tuesday, November 20, 2012 5:20:05 AM
> Subject: RE: Fwd: stripped down script still has some confusing issues
> On Mon, 2012-11-19 at 20:09 -0800, Mihael Hategan wrote:
> > On Mon, 2012-11-19 at 19:56 -0800, Schuchardt, Karen L wrote:
> > > Mihael,
> > >
> > > [...]
> >
> > >   And yet the script still dies in the same place. For me
> > >   iteration 32
> > > always and on either stomp.out or the stomp restart file. So
> > > something else is going on here.
> >
> > I'll give it a shot and see what's happening.
> 
> Runs fine with trunk.
> 
> Fails with 0.93, at iteration 40 for me, due to the deep linking
> issue.
> The symptom is "<some app> failed with an exit code of 1". A
> workaround
> is to specify a scratch tag in sites.xml (it forces swift to copy file
> to scratch instead of linking):
> <config>
> <pool handle="localhost">
> <filesystem provider="local"/>
> <execution provider="local" />
> <workdirectory >/home/mike/tmp/swift</workdirectory>
> <scratch>/home/mike/tmp/swift-scratch</scratch>
> </pool>
> </config>
> 
> Runs fine after that.
> 
> If the above fix doesn't work for you, you might be running into a
> different problem. Please send me the logs in that case.
> 
> [...]
> 
> > >
> > > Also Jared had trouble compiling the trunk. Can you send us a
> > > revised distribution?
> >
> > Sure, I can do that. The improved error messages might help.
> 
> www.mcs.anl.gov/~hategan/swift-trunk-r6065-cog-r3515.tar.gz
> 
> As usual, it's trunk, so it might break in various places.
> However, I added some improved error reporting, including a detector
> of
> mapping badness (it only issues warnings, but they will most likely
> result in errors later). Here's a sample output:
> 
> RunID: 20121120-0311-6sbzpc39
> Progress: time: Tue, 20 Nov 2012 03:12:03 -0800
> SwiftScript trace: 0, 500
> SwiftScript trace: Starting iteration, 0
> 
> Duplicate mapping found:
> h5part_files (line 272) is used to read from
> file://localhost/run-0/sph-0/sph.output.h5part
> sphOut (line 234) is used to write to
> file://localhost/run-0/sph-0/sph.output.h5part
> Execution failed:
> Exception in gpg:
> Arguments: [-m, run-0/writeData.out, -r, 0, -p, run-0/stomp.plot, -f,
> run-0/sph-0/sph.output.h5part]
> Host: localhost
> Directory: kls1-20121120-0311-6sbzpc39/jobs/v/gpg-vs5hh81l
> Caused by:
> File not found:
> /home/mike/tmp/swift-bugs/pnnl/subsurface/./run-0/sph-0/sph.output.h5part
> gpg, kls1.swift, line 276
> hybridModel, kls1.swift, line 303
> iterate, kls1.swift, line 297
> 
> Mihael

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory