[Swift-user] output file array

[Ketan Maheshwari]

Trying trunk for this pattern.

A toy application invoked over a foreach loop that creates an output file,
an stdout and an stderr files.

The files are mapped into an output directory named with the loop index as
suffix so that the files do not get overwritten:

foreach i in [0:9]{

  file out<single_file_mapper; file=strcat("outdir", i, "/std.out")>;
  file err<single_file_mapper; file=strcat("outdir", i, "/std.err")>;
  file appout<single_file_mapper; file=strcat("outdir", i, "/afile.txt")>;

  (out, err, appout) = touch_app("Hello");
}


The stdout and stderr files correctly ends up in their respective
directories but the app generated file does not.

I see following error message:

Execution failed:
Exception in t:
    Arguments: [Hello]
    Host: edison1
    Directory: touchafile-run001/jobs/t/t-ffv33r2m
exception @ swift-int-staging.k, line: 165
Caused by: The following output files were not created by the application:
outdir4/afile.txt

Any suggestions for fixing this?

Attached is the test directory with sources and executable with rundir.

Thanks,
Ketan


On Mon, Dec 22, 2014 at 5:14 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:

> Hi,
>
> I don't think 0.95 supports dynamic arrays output from apps. You will
> need trunk/0.96 for that.
>
> Mihael
>
> On Mon, 2014-12-22 at 15:37 -0600, Ketan Maheshwari wrote:
> > Hi Mihael,
> >
> > This is with Swift 0.95.
> >
> > Thanks,
> > Ketan
> >
> > On Sun, Dec 21, 2014 at 2:40 PM, Hategan-Marandiuc, Philip M. <
> > hategan at mcs.anl.gov> wrote:
> >
> > > Hi Ketan,
> > >
> > > Sorry for the delay. Is this trunk or 0.95?
> > >
> > > Mihael
> > >
> > > On Wed, 2014-12-17 at 14:26 -0600, Ketan Maheshwari wrote:
> > > > Hi,
> > > >
> > > > I am dealing with a workflow pattern where an app expects multiple
> output
> > > > files with a pattern.
> > > >
> > > > The app signature is:
> > > >
> > > > app (file[] _wrfout, file _out, file _err) wrf_app (file _wrf_in,
> file[]
> > > > _tbl, file[] _ozone, ...)
> > > > {
> > > >    wrf stdout=@_out stderr=@_err;
> > > > }
> > > >
> > > > The _wrfout files are the app result files which follows a pattern:
> > > wrfout_*
> > > >
> > > > So, I am invoking the application in a foreach loop as:
> > > >
> > > > foreach i in [0:2]{
> > > >   file[] wrfout<simple_mapper; location=strcat("outdir",i),
> > > > pattern="wrfout_*">;
> > > >   file wrfstdout<single_file_mapper; file=strcat("outdir", i,
> > > "/std.out")>;
> > > >   file wrfstderr<single_file_mapper; file=strcat("outdir", i,
> > > "/std.err")>;
> > > >
> > > >    (wrfout, wrfstdout, wrfstderr) = wrf_app (wrfin, tbl, ozone, tr,
> data,
> > > > gribmap, namelist, co2_trans, input_sounding);
> > > > }
> > > >
> > > > The script hangs at runtime with the following messages:
> > > >
> > > > No events in 1s.
> > > > Finding dependency loops...
> > > >
> > > > Waiting threads:
> > > > Thread: R-6-0-4, waiting on wrfout (declared on line 50)
> > > > swift:stageOut, wf.edison, line 134
> > > > swift:execute, wf.edison, line 123
> > > > wrf_app, wf.edison, line 242
> > > >
> > > > Thread: R-6-2-4, waiting on wrfout (declared on line 50)
> > > > swift:stageOut, wf.edison, line 134
> > > > swift:execute, wf.edison, line 123
> > > > wrf_app, wf.edison, line 242
> > > >
> > > > Thread: R-6-1-4, waiting on wrfout (declared on line 50)
> > > > swift:stageOut, wf.edison, line 134
> > > > swift:execute, wf.edison, line 123
> > > > wrf_app, wf.edison, line 242
> > > >
> > > > Any suggestions?
> > > >
> > > > Thanks,
> > > > Ketan
> > > > _______________________________________________
> > > > Swift-user mailing list
> > > > Swift-user at ci.uchicago.edu
> > > > https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
> > >
> > >
> > >
>
>
> _______________________________________________
> Swift-user mailing list
> Swift-user at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20150106/0dd21c74/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: touchafile.tgz
Type: application/x-gzip
Size: 112033 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-user/attachments/20150106/0dd21c74/attachment.bin>