[Swift-devel] Fwd: trunk FileNotFoundException
Mihael Hategan
hategan at mcs.anl.gov
Tue Jul 12 20:43:38 CDT 2011
The NPE seems legit, and in quite the right spot considering the recent
commits. But I was trying to figure out the thing with the workdir
creation.
In any event, does any of you have a simple test case for the NPE?
On Tue, 2011-07-12 at 21:29 -0400, Glen Hocky wrote:
> By the way, I also see this error, w/ pbs+coasters and on osg w/
> condor, no provider staging
>
> On Tue, Jul 12, 2011 at 9:26 PM, Ketan Maheshwari
> <ketancmaheshwari at gmail.com> wrote:
> No, provider staging is not on.
>
> I am using local execution provider:
>
> <pool handle="localhost">
> <filesystem provider="local" />
> <execution provider="local" />
> <workdirectory>/var/tmp/swift.workdir</workdirectory>
> <profile namespace="karajan"
> key="jobThrottle">0.20</profile>
> </pool>
>
>
>
>
>
> On Tue, Jul 12, 2011 at 8:15 PM, Mihael Hategan
> <hategan at mcs.anl.gov> wrote:
> Is provider staging on?
>
>
> On Tue, 2011-07-12 at 14:16 -0500, Ketan Maheshwari
> wrote:
> > Mihael,
> >
> > I tried to further investigate the issue and from
> the logs it seems
> > that Swift is trying to execute the mkoffset app
> before creating a
> > jobs/ directory in workdir. Could it be that this is
> an ordering
> > issue. For instance, I see the following line:
> >
> > 2011-07-12 13:50:49,559-0500 DEBUG vdl:execute2
> JOB_START
> > jobid=mkoffset-mex8fvck tr=mkoffset
> arguments=[200.0, 60.0]
> >
> tmpdir=postproc-20110712-1343-eczky6ob/jobs/m/mkoffset-mex8fvck
> > host=localhost
> >
> > but do not see a createdir corresponding to above.
> >
> > I have ran this workflow successfully with 0.92.1
> so, I am pretty sure
> > that it works correctly as far as order of execution
> is concerned.
> >
> > Thanks for any more insights into this.
> >
> > Regards,
> > Ketan
> >
> > ---------- Forwarded message ----------
> > From: Ketan Maheshwari <ketancmaheshwari at gmail.com>
> > Date: Mon, Jul 11, 2011 at 10:31 PM
> > Subject: trunk FileNotFoundException
> > To: swift-user at ci.uchicago.edu
> >
> >
> > Hello,
> >
> > Using Swift trunk, I am running the SCEC workflow
> from Communicado
> > using ranger, localhost and OSG resources.
> >
> > One particular app 'mkoffset' which is destined to
> run on localhost is
> > faulting with FileNotFoundException.
> >
> > The log does give information on its mapping and
> when it gets
> > 'cleared'.
> >
> > The config, tc, sites and log files for the run
> could be found here:
> > http://www.mcs.anl.gov/~ketan/files/bundle.tgz (log
> is 90M, upload
> > size exceeded!)
> >
> > The error stack that I am getting on stdout is:
> >
> > Progress: time: Mon, 11 Jul 2011 22:16:38 -0500
> Selecting site:390
> > Stage in:16 Active:9 Checking status:1 Finished
> successfully:36
> > Failed but can retry:3
> >
> org.globus.cog.abstraction.impl.file.FileNotFoundException: File not
> >
> found: /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/stderr.txt
> > at
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)
> > at
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)
> > at
> >
> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)
> > at
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)
> > at
> >
> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)
> > at
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)
> > at java.lang.Thread.run(Thread.java:619)
> >
> org.globus.cog.abstraction.impl.file.FileNotFoundException: File not
> >
> found: /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/LGU/offset-128
> > at
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)
> > at
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)
> > at
> >
> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)
> > at
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)
> > at
> >
> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)
> > at
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)
> > at java.lang.Thread.run(Thread.java:619)
> > Progress: time: Mon, 11 Jul 2011 22:16:39 -0500
> Selecting site:389
> > Stage in:16 Active:9 Checking status:1 Finished
> successfully:38
> > Failed but can retry:4
> > Execution failed:
> > java.lang.NullPointerException
> > at
> >
> org.griphyn.vdl.mapping.AbstractDataNode.getValue(AbstractDataNode.java:333)
> > at
> >
> org.griphyn.vdl.karajan.lib.SetFieldValue.log(SetFieldValue.java:71)
> > at
> >
> org.griphyn.vdl.karajan.lib.SetFieldValue.function(SetFieldValue.java:38)
> > at
> >
> org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:62)
> > at
> >
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
> > at
> >
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
> > at
> >
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
> > at
> >
> org.globus.cog.karajan.workflow.nodes.functions.Argument.post(Argument.java:48)
> > at
> >
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
> > at
> >
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
> > at
> >
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
> > at
> >
> org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:66)
> > at
> >
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
> > at
> >
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
> > at
> >
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
> >
> >
> > Any clues?
> >
> > Thanks,
> > --
> > Ketan
> >
> >
> >
> >
> >
> >
> > --
> > Ketan
> >
> >
>
>
>
>
>
>
>
> --
> Ketan
>
>
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>
More information about the Swift-devel
mailing list