By the way, I also see this error, w/ pbs+coasters and on osg w/ condor, no provider staging<br><br><div class="gmail_quote">On Tue, Jul 12, 2011 at 9:26 PM, Ketan Maheshwari <span dir="ltr"><<a href="mailto:ketancmaheshwari@gmail.com">ketancmaheshwari@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">No, provider staging is not on. <br><br>I am using local execution provider:<br><br><pool handle="localhost"><br>
<filesystem provider="local" /><br> <execution provider="local" /><br>
<workdirectory>/var/tmp/swift.workdir</workdirectory><br> <profile namespace="karajan" key="jobThrottle">0.20</profile><br></pool><div><div></div><div class="h5"><br>
<br>
<br><br><div class="gmail_quote">On Tue, Jul 12, 2011 at 8:15 PM, Mihael Hategan <span dir="ltr"><<a href="mailto:hategan@mcs.anl.gov" target="_blank">hategan@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Is provider staging on?<br>
<div><div></div><div><br>
On Tue, 2011-07-12 at 14:16 -0500, Ketan Maheshwari wrote:<br>
> Mihael,<br>
><br>
> I tried to further investigate the issue and from the logs it seems<br>
> that Swift is trying to execute the mkoffset app before creating a<br>
> jobs/ directory in workdir. Could it be that this is an ordering<br>
> issue. For instance, I see the following line:<br>
><br>
> 2011-07-12 13:50:49,559-0500 DEBUG vdl:execute2 JOB_START<br>
> jobid=mkoffset-mex8fvck tr=mkoffset arguments=[200.0, 60.0]<br>
> tmpdir=postproc-20110712-1343-eczky6ob/jobs/m/mkoffset-mex8fvck<br>
> host=localhost<br>
><br>
> but do not see a createdir corresponding to above.<br>
><br>
> I have ran this workflow successfully with 0.92.1 so, I am pretty sure<br>
> that it works correctly as far as order of execution is concerned.<br>
><br>
> Thanks for any more insights into this.<br>
><br>
> Regards,<br>
> Ketan<br>
><br>
> ---------- Forwarded message ----------<br>
> From: Ketan Maheshwari <<a href="mailto:ketancmaheshwari@gmail.com" target="_blank">ketancmaheshwari@gmail.com</a>><br>
> Date: Mon, Jul 11, 2011 at 10:31 PM<br>
> Subject: trunk FileNotFoundException<br>
> To: <a href="mailto:swift-user@ci.uchicago.edu" target="_blank">swift-user@ci.uchicago.edu</a><br>
><br>
><br>
> Hello,<br>
><br>
> Using Swift trunk, I am running the SCEC workflow from Communicado<br>
> using ranger, localhost and OSG resources.<br>
><br>
> One particular app 'mkoffset' which is destined to run on localhost is<br>
> faulting with FileNotFoundException.<br>
><br>
> The log does give information on its mapping and when it gets<br>
> 'cleared'.<br>
><br>
> The config, tc, sites and log files for the run could be found here:<br>
> <a href="http://www.mcs.anl.gov/%7Eketan/files/bundle.tgz" target="_blank">http://www.mcs.anl.gov/~ketan/files/bundle.tgz</a> (log is 90M, upload<br>
> size exceeded!)<br>
><br>
> The error stack that I am getting on stdout is:<br>
><br>
> Progress: time: Mon, 11 Jul 2011 22:16:38 -0500 Selecting site:390<br>
> Stage in:16 Active:9 Checking status:1 Finished successfully:36<br>
> Failed but can retry:3<br>
> org.globus.cog.abstraction.impl.file.FileNotFoundException: File not<br>
> found: /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/stderr.txt<br>
> at<br>
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)<br>
> at<br>
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)<br>
> at<br>
> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)<br>
> at<br>
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)<br>
> at<br>
> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)<br>
> at<br>
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)<br>
> at java.lang.Thread.run(Thread.java:619)<br>
> org.globus.cog.abstraction.impl.file.FileNotFoundException: File not<br>
> found: /var/tmp/postproc-20110711-2209-bx2qm0nb/jobs/e/mkoffset-ea7xcuck/LGU/offset-128<br>
> at<br>
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.getFile(FileResourceImpl.java:225)<br>
> at<br>
> org.globus.cog.abstraction.impl.file.local.FileResourceImpl.putFile(FileResourceImpl.java:268)<br>
> at<br>
> org.globus.cog.abstraction.impl.file.AbstractFileResource.putFile(AbstractFileResource.java:158)<br>
> at<br>
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.doDestination(DelegatedFileTransferHandler.java:314)<br>
> at<br>
> org.globus.cog.abstraction.impl.fileTransfer.CachingDelegatedFileTransferHandler.doDestination(CachingDelegatedFileTransferHandler.java:46)<br>
> at<br>
> org.globus.cog.abstraction.impl.fileTransfer.DelegatedFileTransferHandler.run(DelegatedFileTransferHandler.java:487)<br>
> at java.lang.Thread.run(Thread.java:619)<br>
> Progress: time: Mon, 11 Jul 2011 22:16:39 -0500 Selecting site:389<br>
> Stage in:16 Active:9 Checking status:1 Finished successfully:38<br>
> Failed but can retry:4<br>
> Execution failed:<br>
> java.lang.NullPointerException<br>
> at<br>
> org.griphyn.vdl.mapping.AbstractDataNode.getValue(AbstractDataNode.java:333)<br>
> at<br>
> org.griphyn.vdl.karajan.lib.SetFieldValue.log(SetFieldValue.java:71)<br>
> at<br>
> org.griphyn.vdl.karajan.lib.SetFieldValue.function(SetFieldValue.java:38)<br>
> at<br>
> org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:62)<br>
> at<br>
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>
> at<br>
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br>
> at<br>
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>
> at<br>
> org.globus.cog.karajan.workflow.nodes.functions.Argument.post(Argument.java:48)<br>
> at<br>
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>
> at<br>
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br>
> at<br>
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>
> at<br>
> org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:66)<br>
> at<br>
> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>
> at<br>
> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br>
> at<br>
> org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>
><br>
><br>
> Any clues?<br>
><br>
> Thanks,<br>
> --<br>
> Ketan<br>
><br>
><br>
><br>
><br>
><br>
><br>
> --<br>
> Ketan<br>
><br>
><br>
<br>
<br>
</div></div></blockquote></div><br><br clear="all"><br></div></div>-- <br><font color="#888888">Ketan<br><br><br>
</font><br>_______________________________________________<br>
Swift-devel mailing list<br>
<a href="mailto:Swift-devel@ci.uchicago.edu">Swift-devel@ci.uchicago.edu</a><br>
<a href="https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel" target="_blank">https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel</a><br>
<br></blockquote></div><br>