[Swift-devel] Fwd: trunk FileNotFoundException
Ketan Maheshwari
ketancmaheshwari at gmail.com
Thu Jul 14 14:08:32 CDT 2011
Hello,
It seems that the Swift on my trunk was a stale version. I updated and
rebuilt after which the NPE has gone.
Regards,
Ketan
On Tue, Jul 12, 2011 at 8:43 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:
> The NPE seems legit, and in quite the right spot considering the recent
> commits. But I was trying to figure out the thing with the workdir
> creation.
>
> In any event, does any of you have a simple test case for the NPE?
>
> On Tue, 2011-07-12 at 21:29 -0400, Glen Hocky wrote:
> > By the way, I also see this error, w/ pbs+coasters and on osg w/
> > condor, no provider staging
> >
> > On Tue, Jul 12, 2011 at 9:26 PM, Ketan Maheshwari
> > <ketancmaheshwari at gmail.com> wrote:
> > No, provider staging is not on.
> >
> > I am using local execution provider:
> >
> > <pool handle="localhost">
> > <filesystem provider="local" />
> > <execution provider="local" />
> > <workdirectory>/var/tmp/swift.workdir</workdirectory>
> > <profile namespace="karajan"
> > key="jobThrottle">0.20</profile>
> > </pool>
> >
> >
> >
> >
> >
> > On Tue, Jul 12, 2011 at 8:15 PM, Mihael Hategan
> > <hategan at mcs.anl.gov> wrote:
> > Is provider staging on?
> >
> >
> > On Tue, 2011-07-12 at 14:16 -0500, Ketan Maheshwari
> > wrote:
> > > Mihael,
> > >
> > > I tried to further investigate the issue and from
> > the logs it seems
> > > that Swift is trying to execute the mkoffset app
> > before creating a
> > > jobs/ directory in workdir. Could it be that this is
> > an ordering
> > > issue. For instance, I see the following line:
> > >
> > > 2011-07-12 13:50:49,559-0500 DEBUG vdl:execute2
> > JOB_START
> > > jobid=mkoffset-mex8fvck tr=mkoffset
> > arguments=[200.0, 60.0]
> > >
> >
> tmpdir=postproc-20110712-1343-eczky6ob/jobs/m/mkoffset-mex8fvck
> > > host=localhost
> > >
> > > but do not see a createdir corresponding to above.
> > >
> > > I have ran this workflow successfully with 0.92.1
> > so, I am pretty sure
> > > that it works correctly as far as order of execution
> > is concerned.
> > >
> > > Thanks for any more insights into this.
> > >
> > > Regards,
> > > Ketan
> > >
> > > ---------- Forwarded message ----------
> > > From: Ketan Maheshwari <ketancmaheshwari at gmail.com>
> > > Date: Mon, Jul 11, 2011 at 10:31 PM
> > > Subject: trunk FileNotFoundException
> > > To: swift-user at ci.uchicago.edu
> > >
> > >
> > > Hello,
> > >
> > > Using Swift trunk, I am running the SCEC workflow
> > from Communicado
> > > using ranger, localhost and OSG resources.
> > >
> > > One particular app 'mkoffset' which is destined to
> > run on localhost is
> > > faulting with FileNotFoundException.
> > >
> > > The log does give information on its mapping and
> > when it gets
> > > 'cleared'.
> > >
> > > The config, tc, sites and log files for the run
> > could be found here:
> > > http://www.mcs.anl.gov/~ketan/files/bundle.tgz (log
> > is 90M, upload
> > > size exceeded!)
> > >
> > > The error stack that I am getting on stdout is:
> > >
> > > Progress: time: Mon, 11 Jul 2011 22:16:38 -0500
> > Selecting site:390
> > > Stage in:16 Active:9 Checking status:1 Finished
> > successfully:36
> > > Failed but can retry:3
> > >
> >
> org.globus.cog.abstraction.impl.file.FileNotFoundException: File not
> > >
> > found:
> /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/stderr.txt
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)
> > > at java.lang.Thread.run(Thread.java:619)
> > >
> >
> org.globus.cog.abstraction.impl.file.FileNotFoundException: File not
> > >
> > found:
> /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/LGU/offset-128
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)
> > > at
> > >
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)
> > > at java.lang.Thread.run(Thread.java:619)
> > > Progress: time: Mon, 11 Jul 2011 22:16:39 -0500
> > Selecting site:389
> > > Stage in:16 Active:9 Checking status:1 Finished
> > successfully:38
> > > Failed but can retry:4
> > > Execution failed:
> > > java.lang.NullPointerException
> > > at
> > >
> >
> org.griphyn.vdl.mapping.AbstractDataNode.getValue(AbstractDataNode.java:333)
> > > at
> > >
> >
> org.griphyn.vdl.karajan.lib.SetFieldValue.log(SetFieldValue.java:71)
> > > at
> > >
> >
> org.griphyn.vdl.karajan.lib.SetFieldValue.function(SetFieldValue.java:38)
> > > at
> > >
> >
> org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:62)
> > > at
> > >
> >
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
> > > at
> > >
> >
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
> > > at
> > >
> >
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
> > > at
> > >
> >
> org.globus.cog.karajan.workflow.nodes.functions.Argument.post(Argument.java:48)
> > > at
> > >
> >
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
> > > at
> > >
> >
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
> > > at
> > >
> >
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
> > > at
> > >
> >
> org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:66)
> > > at
> > >
> >
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
> > > at
> > >
> >
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
> > > at
> > >
> >
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
> > >
> > >
> > > Any clues?
> > >
> > > Thanks,
> > > --
> > > Ketan
> > >
> > >
> > >
> > >
> > >
> > >
> > > --
> > > Ketan
> > >
> > >
> >
> >
> >
> >
> >
> >
> >
> > --
> > Ketan
> >
> >
> >
> > _______________________________________________
> > Swift-devel mailing list
> > Swift-devel at ci.uchicago.edu
> >
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
> >
> >
>
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
--
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110714/b8ad0534/attachment.html>
More information about the Swift-devel
mailing list