Hello,<br><br>It seems that the Swift on my trunk was a stale version. I updated and rebuilt after which the NPE has gone.<br><br>Regards,<br>Ketan<br><br><br><div class="gmail_quote">On Tue, Jul 12, 2011 at 8:43 PM, Mihael Hategan <span dir="ltr"><<a href="mailto:hategan@mcs.anl.gov">hategan@mcs.anl.gov</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">The NPE seems legit, and in quite the right spot considering the recent<br>
commits. But I was trying to figure out the thing with the workdir<br>
creation.<br>
<br>
In any event, does any of you have a simple test case for the NPE?<br>
<div><div></div><div class="h5"><br>
On Tue, 2011-07-12 at 21:29 -0400, Glen Hocky wrote:<br>
> By the way, I also see this error, w/ pbs+coasters and on osg w/<br>
> condor, no provider staging<br>
><br>
> On Tue, Jul 12, 2011 at 9:26 PM, Ketan Maheshwari<br>
> <<a href="mailto:ketancmaheshwari@gmail.com">ketancmaheshwari@gmail.com</a>> wrote:<br>
> No, provider staging is not on.<br>
><br>
> I am using local execution provider:<br>
><br>
> <pool handle="localhost"><br>
> <filesystem provider="local" /><br>
> <execution provider="local" /><br>
> <workdirectory>/var/tmp/swift.workdir</workdirectory><br>
> <profile namespace="karajan"<br>
> key="jobThrottle">0.20</profile><br>
> </pool><br>
><br>
><br>
><br>
><br>
><br>
> On Tue, Jul 12, 2011 at 8:15 PM, Mihael Hategan<br>
> <<a href="mailto:hategan@mcs.anl.gov">hategan@mcs.anl.gov</a>> wrote:<br>
> Is provider staging on?<br>
><br>
><br>
> On Tue, 2011-07-12 at 14:16 -0500, Ketan Maheshwari<br>
> wrote:<br>
> > Mihael,<br>
> ><br>
> > I tried to further investigate the issue and from<br>
> the logs it seems<br>
> > that Swift is trying to execute the mkoffset app<br>
> before creating a<br>
> > jobs/ directory in workdir. Could it be that this is<br>
> an ordering<br>
> > issue. For instance, I see the following line:<br>
> ><br>
> > 2011-07-12 13:50:49,559-0500 DEBUG vdl:execute2<br>
> JOB_START<br>
> > jobid=mkoffset-mex8fvck tr=mkoffset<br>
> arguments=[200.0, 60.0]<br>
> ><br>
> tmpdir=postproc-20110712-1343-eczky6ob/jobs/m/mkoffset-mex8fvck<br>
> > host=localhost<br>
> ><br>
> > but do not see a createdir corresponding to above.<br>
> ><br>
> > I have ran this workflow successfully with 0.92.1<br>
> so, I am pretty sure<br>
> > that it works correctly as far as order of execution<br>
> is concerned.<br>
> ><br>
> > Thanks for any more insights into this.<br>
> ><br>
> > Regards,<br>
> > Ketan<br>
> ><br>
> > ---------- Forwarded message ----------<br>
> > From: Ketan Maheshwari <<a href="mailto:ketancmaheshwari@gmail.com">ketancmaheshwari@gmail.com</a>><br>
> > Date: Mon, Jul 11, 2011 at 10:31 PM<br>
> > Subject: trunk FileNotFoundException<br>
> > To: <a href="mailto:swift-user@ci.uchicago.edu">swift-user@ci.uchicago.edu</a><br>
> ><br>
> ><br>
> > Hello,<br>
> ><br>
> > Using Swift trunk, I am running the SCEC workflow<br>
> from Communicado<br>
> > using ranger, localhost and OSG resources.<br>
> ><br>
> > One particular app 'mkoffset' which is destined to<br>
> run on localhost is<br>
> > faulting with FileNotFoundException.<br>
> ><br>
> > The log does give information on its mapping and<br>
> when it gets<br>
> > 'cleared'.<br>
> ><br>
> > The config, tc, sites and log files for the run<br>
> could be found here:<br>
> > <a href="http://www.mcs.anl.gov/%7Eketan/files/bundle.tgz" target="_blank">http://www.mcs.anl.gov/~ketan/files/bundle.tgz</a> (log<br>
> is 90M, upload<br>
> > size exceeded!)<br>
> ><br>
> > The error stack that I am getting on stdout is:<br>
> ><br>
> > Progress: time: Mon, 11 Jul 2011 22:16:38 -0500<br>
> Selecting site:390<br>
> > Stage in:16 Active:9 Checking status:1 Finished<br>
> successfully:36<br>
> > Failed but can retry:3<br>
> ><br>
> org.globus.cog.abstraction.impl.file.FileNotFoundException: File not<br>
> ><br>
> found: /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/stderr.txt<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)<br>
> > at java.lang.Thread.run(Thread.java:619)<br>
> ><br>
> org.globus.cog.abstraction.impl.file.FileNotFoundException: File not<br>
> ><br>
> found: /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/LGU/offset-128<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)<br>
> > at<br>
> ><br>
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)<br>
> > at java.lang.Thread.run(Thread.java:619)<br>
> > Progress: time: Mon, 11 Jul 2011 22:16:39 -0500<br>
> Selecting site:389<br>
> > Stage in:16 Active:9 Checking status:1 Finished<br>
> successfully:38<br>
> > Failed but can retry:4<br>
> > Execution failed:<br>
> > java.lang.NullPointerException<br>
> > at<br>
> ><br>
> org.griphyn.vdl.mapping.AbstractDataNode.getValue(AbstractDataNode.java:333)<br>
> > at<br>
> ><br>
> org.griphyn.vdl.karajan.lib.SetFieldValue.log(SetFieldValue.java:71)<br>
> > at<br>
> ><br>
> org.griphyn.vdl.karajan.lib.SetFieldValue.function(SetFieldValue.java:38)<br>
> > at<br>
> ><br>
> org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:62)<br>
> > at<br>
> ><br>
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>
> > at<br>
> ><br>
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br>
> > at<br>
> ><br>
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>
> > at<br>
> ><br>
> org.globus.cog.karajan.workflow.nodes.functions.Argument.post(Argument.java:48)<br>
> > at<br>
> ><br>
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>
> > at<br>
> ><br>
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br>
> > at<br>
> ><br>
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>
> > at<br>
> ><br>
> org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:66)<br>
> > at<br>
> ><br>
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>
> > at<br>
> ><br>
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br>
> > at<br>
> ><br>
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>
> ><br>
> ><br>
> > Any clues?<br>
> ><br>
> > Thanks,<br>
> > --<br>
> > Ketan<br>
> ><br>
> ><br>
> ><br>
> ><br>
> ><br>
> ><br>
> > --<br>
> > Ketan<br>
> ><br>
> ><br>
><br>
><br>
><br>
><br>
><br>
><br>
><br>
> --<br>
> Ketan<br>
><br>
><br>
><br>
> _______________________________________________<br>
> Swift-devel mailing list<br>
> <a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>
> <a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br>
><br>
><br>
<br>
<br>
_______________________________________________<br>
Swift-devel mailing list<br>
<a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>Ketan<br><br><br>