[Swift-devel] Fwd: trunk FileNotFoundException

Glen Hocky glen842 at uchicago.edu
Tue Jul 12 20:29:03 CDT 2011 

By the way, I also see this error, w/ pbs+coasters and on osg w/ condor, no
provider staging

On Tue, Jul 12, 2011 at 9:26 PM, Ketan Maheshwari <
ketancmaheshwari at gmail.com> wrote:

> No, provider staging is not on.
>
> I am using local execution provider:
>
> <pool handle="localhost">
>     <filesystem provider="local" />
>     <execution provider="local" />
>     <workdirectory>/var/tmp/swift.workdir</workdirectory>
>     <profile namespace="karajan" key="jobThrottle">0.20</profile>
> </pool>
>
>
>
>
> On Tue, Jul 12, 2011 at 8:15 PM, Mihael Hategan <hategan at mcs.anl.gov>wrote:
>
>> Is provider staging on?
>>
>> On Tue, 2011-07-12 at 14:16 -0500, Ketan Maheshwari wrote:
>> > Mihael,
>> >
>> > I tried to further investigate the issue and from the logs it seems
>> > that Swift is trying to execute the mkoffset app before creating a
>> > jobs/ directory in workdir. Could it be that this is an ordering
>> > issue. For instance, I see the following line:
>> >
>> > 2011-07-12 13:50:49,559-0500 DEBUG vdl:execute2 JOB_START
>> > jobid=mkoffset-mex8fvck tr=mkoffset arguments=[200.0, 60.0]
>> > tmpdir=postproc-20110712-1343-eczky6ob/jobs/m/mkoffset-mex8fvck
>> > host=localhost
>> >
>> > but do not see a createdir corresponding to above.
>> >
>> > I have ran this workflow successfully with 0.92.1 so, I am pretty sure
>> > that it works correctly as far as order of execution is concerned.
>> >
>> > Thanks for any more insights into this.
>> >
>> > Regards,
>> > Ketan
>> >
>> > ---------- Forwarded message ----------
>> > From: Ketan Maheshwari <ketancmaheshwari at gmail.com>
>> > Date: Mon, Jul 11, 2011 at 10:31 PM
>> > Subject: trunk FileNotFoundException
>> > To: swift-user at ci.uchicago.edu
>> >
>> >
>> > Hello,
>> >
>> > Using Swift trunk, I am running the SCEC workflow from Communicado
>> > using ranger, localhost and OSG resources.
>> >
>> > One particular app 'mkoffset' which is destined to run on localhost is
>> > faulting with FileNotFoundException.
>> >
>> > The log does give information on its mapping and when it gets
>> > 'cleared'.
>> >
>> > The config, tc, sites and log files for the run could be found here:
>> > http://www.mcs.anl.gov/~ketan/files/bundle.tgz (log is 90M, upload
>> > size exceeded!)
>> >
>> > The error stack that I am getting on stdout is:
>> >
>> > Progress:  time: Mon, 11 Jul 2011 22:16:38 -0500  Selecting site:390
>> > Stage in:16  Active:9  Checking status:1  Finished successfully:36
>> > Failed but can retry:3
>> > org.globus.cog.abstraction.impl.file.FileNotFoundException: File not
>> > found:
>> /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/stderr.txt
>> >     at
>> >
>> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)
>> >     at
>> >
>> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)
>> >     at
>> >
>> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)
>> >     at
>> >
>> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)
>> >     at
>> >
>> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)
>> >     at
>> >
>> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)
>> >     at java.lang.Thread.run(Thread.java:619)
>> > org.globus.cog.abstraction.impl.file.FileNotFoundException: File not
>> > found:
>> /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/LGU/offset-128
>> >     at
>> >
>> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)
>> >     at
>> >
>> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)
>> >     at
>> >
>> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)
>> >     at
>> >
>> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)
>> >     at
>> >
>> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)
>> >     at
>> >
>> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)
>> >     at java.lang.Thread.run(Thread.java:619)
>> > Progress:  time: Mon, 11 Jul 2011 22:16:39 -0500  Selecting site:389
>> > Stage in:16  Active:9  Checking status:1  Finished successfully:38
>> > Failed but can retry:4
>> > Execution failed:
>> >     java.lang.NullPointerException
>> >     at
>> >
>> org.griphyn.vdl.mapping.AbstractDataNode.getValue(AbstractDataNode.java:333)
>> >     at
>> > org.griphyn.vdl.karajan.lib.SetFieldValue.log(SetFieldValue.java:71)
>> >     at
>> >
>> org.griphyn.vdl.karajan.lib.SetFieldValue.function(SetFieldValue.java:38)
>> >     at
>> > org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:62)
>> >     at
>> >
>> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
>> >     at
>> >
>> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
>> >     at
>> >
>> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
>> >     at
>> >
>> org.globus.cog.karajan.workflow.nodes.functions.Argument.post(Argument.java:48)
>> >     at
>> >
>> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
>> >     at
>> >
>> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
>> >     at
>> >
>> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
>> >     at
>> > org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:66)
>> >     at
>> >
>> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)
>> >     at
>> >
>> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)
>> >     at
>> >
>> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
>> >
>> >
>> > Any clues?
>> >
>> > Thanks,
>> > --
>> > Ketan
>> >
>> >
>> >
>> >
>> >
>> >
>> > --
>> > Ketan
>> >
>> >
>>
>>
>>
>
>
> --
> Ketan
>
>
>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20110712/904313c0/attachment.html>

More information about the Swift-devel mailing list