[Swift-devel] Fwd: trunk FileNotFoundException

Ketan Maheshwari ketancmaheshwari at gmail.com
Tue Jul 12 20:26:29 CDT 2011 

No, provider staging is not on.

I am using local execution provider:

<pool handle="localhost">
    <filesystem provider="local" />
    <execution provider="local" />
    <workdirectory>/var/tmp/swift.workdir</workdirectory>
    <profile namespace="karajan" key="jobThrottle">0.20</profile>
</pool>



On Tue, Jul 12, 2011 at 8:15 PM, Mihael Hategan <hategan at mcs.anl.gov> wrote:

> Is provider staging on?
>
> On Tue, 2011-07-12 at 14:16 -0500, Ketan Maheshwari wrote:
> > Mihael,
> >
> > I tried to further investigate the issue and from the logs it seems
> > that Swift is trying to execute the mkoffset app before creating a
> > jobs/ directory in workdir. Could it be that this is an ordering
> > issue. For instance, I see the following line:
> >
> > 2011-07-12 13:50:49,559-0500 DEBUG vdl:execute2 JOB_START
> > jobid=mkoffset-mex8fvck tr=mkoffset arguments=[200.0, 60.0]
> > tmpdir=postproc-20110712-1343-eczky6ob/jobs/m/mkoffset-mex8fvck
> > host=localhost
> >
> > but do not see a createdir corresponding to above.
> >
> > I have ran this workflow successfully with 0.92.1 so, I am pretty sure
> > that it works correctly as far as order of execution is concerned.
> >
> > Thanks for any more insights into this.
> >
> > Regards,
> > Ketan
> >
> > ---------- Forwarded message ----------
> > From: Ketan Maheshwari <ketancmaheshwari at gmail.com>
> > Date: Mon, Jul 11, 2011 at 10:31 PM
> > Subject: trunk FileNotFoundException
> > To: swift-user at ci.uchicago.edu
> >
> >
> > Hello,
> >
> > Using Swift trunk, I am running the SCEC workflow from Communicado
> > using ranger, localhost and OSG resources.
> >
> > One particular app 'mkoffset' which is destined to run on localhost is
> > faulting with FileNotFoundException.
> >
> > The log does give information on its mapping and when it gets
> > 'cleared'.
> >
> > The config, tc, sites and log files for the run could be found here:
> > http://www.mcs.anl.gov/~ketan/files/bundle.tgz (log is 90M, upload
> > size exceeded!)
> >
> > The error stack that I am getting on stdout is:
> >
> > Progress:  time: Mon, 11 Jul 2011 22:16:38 -0500  Selecting site:390
> > Stage in:16  Active:9  Checking status:1  Finished successfully:36
> > Failed but can retry:3
> > org.globus.cog.abstraction.impl.file.FileNotFoundException: File not
> > found:
> /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/stderr.txt
> >     at
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)
> >     at
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)
> >     at
> >
> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)
> >     at
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)
> >     at
> >
> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)
> >     at
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)
> >     at java.lang.Thread.run(Thread.java:619)
> > org.globus.cog.abstraction.impl.file.FileNotFoundException: File not
> > found:
> /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/LGU/offset-128
> >     at
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)
> >     at
> >
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)
> >     at
> >
> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)
> >     at
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)
> >     at
> >
> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)
> >     at
> >
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)
> >     at java.lang.Thread.run(Thread.java:619)
> > Progress:  time: Mon, 11 Jul 2011 22:16:39 -0500  Selecting site:389
> > Stage in:16  Active:9  Checking status:1  Finished successfully:38
> > Failed but can retry:4
> > Execution failed:
> >     java.lang.NullPointerException
> >     at
> >
> org.griphyn.vdl.mapping.AbstractDataNode.getValue(AbstractDataNode.java:333)
> >     at
> > org.griphyn.vdl.karajan.lib.SetFieldValue.log(SetFieldValue.java:71)
> >     at
> > org.griphyn.vdl.karajan.lib.SetFieldValue.function(SetFieldValue.java:38)
> >     at
> > org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:62)
> >     at
> >
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
> >     at
> >
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
> >     at
> >
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
> >     at
> >
> org.globus.cog.karajan.workflow.nodes.functions.Argument.post(Argument.java:48)
> >     at
> >
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
> >     at
> >
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
> >     at
> >
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
> >     at
> > org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:66)
> >     at
> >
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
> >     at
> >
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
> >     at
> >
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
> >
> >
> > Any clues?
> >
> > Thanks,
> > --
> > Ketan
> >
> >
> >
> >
> >
> >
> > --
> > Ketan
> >
> >
>
>
>


-- 
Ketan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110712/421d7c8c/attachment.html>

More information about the Swift-devel mailing list