I think these files were from the job. Because I deleted all the *Results.Rdata before the job submitting, and found these empty files after the execution.<br><br>output of the process of execution:<br>RunID: 3szhlhvg4seu0
<br>cwtsmall started<br>Task(type=4, identity=urn:0-0-0-1-0-1-0-1187633646429) setting status to Active<br>Task(type=4, identity=urn:0-0-0-1-0-1-0-1187633646429) setting status to Completed<br>Task(type=2, identity=urn:0-0-0-1-0-1-0-1187633646432) setting status to Submitted
<br>Task(type=2, identity=urn:0-0-0-1-0-1-0-1187633646432) setting status to Active<br>Task(type=2, identity=urn:0-0-0-1-0-1-0-1187633646432) setting status to Completed<br>...<br>Task(type=2, identity=urn:0-0-0-1-0-1-0-1-1187633646453) setting status to Completed
<br>Staged in scripts/runWaveletsAvg.R to sid-wf1-3szhlhvg4seu0/shared/scripts/ on MIT_CMS<br>Running job cwtsmall-gt3062gi cwtsmall with arguments [scripts/runWaveletsAvg.R, 101, FB] in sid-wf1-3szhlhvg4seu0/cwtsmall-gt3062gi on MIT_CMS
<br>Task(type=1, identity=urn:0-0-0-1-0-1-0-1187633646457) setting status to Submitted<br>Task(type=1, identity=urn:0-0-0-1-0-1-0-1187633646457) setting status to Active<br>Task(type=1, identity=urn:0-0-0-1-0-1-0-1187633646457) setting status to Completed
<br>Task(type=4, identity=urn:0-0-0-1-0-1-0-1187633646459) setting status to Active<br>Task(type=4, identity=urn:0-0-0-1-0-1-0-1187633646459) setting status to Completed<br>Completed job cwtsmall-gt3062gi cwtsmall with arguments [scripts/runWaveletsAvg.R, 101, FB] on MIT_CMS
<br>Staging out sid-wf1-3szhlhvg4seu0/shared//101-FBchannel15_cwt-avgResults.Rdata to 101-FBchannel15_cwt-avgResults.Rdata from MIT_CMS<br>Task(type=4, identity=urn:0-0-0-1-0-1-0-7-1187633646462) setting status to Active<br>
Task(type=4, identity=urn:0-0-0-1-0-1-0-7-1187633646462) setting status to Completed<br>......<br>Task(type=2, identity=urn:0-0-0-1-0-1-0-23-1187633646557) setting status to Active<br>Task(type=2, identity=urn:0-0-0-1-0-1-0-22-1187633646554) setting status to Failed Exception in getFile
<br>Task(type=2, identity=urn:0-0-0-1-0-1-0-2-1187633646560) setting status to Submitted<br>......<br><br>Thanks,<br>Jing<br><br><div><span class="gmail_quote">On 8/20/07, <b class="gmail_sendername">Mihael Hategan</b> <
<a href="mailto:hategan@mcs.anl.gov" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">hategan@mcs.anl.gov</a>> wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
But those are not from the same job.
<br><br>On Mon, 2007-08-20 at 12:28 -0500, Jing Tie wrote:<br>> Yes. I saw 101-FBchannel1_cwt-avgResults.Rdata to<br>> 101-FBchannel28_cwt-avgResults.Rdata 28 output files on the swift<br>> client, but all the files were empty.
<br>><br>> Jing<br>><br>><br>> On 8/20/07, Mihael Hategan <<a href="mailto:hategan@mcs.anl.gov" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">hategan@mcs.anl.gov</a>> wrote:<br>
> On Mon, 2007-08-20 at 12:21 -0500, Jing Tie wrote:<br>> > Yes. There is no *
avgResults.Rdata under shared directory,<br>> only input<br>> > file, scripts, wrapper.sh and seq.sh.<br>><br>> Did the job actually run?<br>><br>> ><br>> > Jing
<br>> ><br>> > On 8/20/07, Mihael Hategan < <a href="mailto:hategan@mcs.anl.gov" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">hategan@mcs.anl.gov</a>> wrote:<br>
> > Not much we can do if the filesystem is broken.
<br>> > Did you check to confirm that the file is not<br>> there?<br>> ><br>> > Mihael<br>> ><br>> > On Mon, 2007-08-20 at 12:07 -0500, Jing Tie wrote:
<br>> > > Hi,<br>> > ><br>> > > Here is another problem. It seems like something<br>> wrong with<br>> > GFS<br>> > > system.
<br>> > ><br>> > > site: MIT_CMS<br>> > > gatekeeper: <a href="http://ce01.cmsaf.mit.edu" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
ce01.cmsaf.mit.edu</a><br>> > > app_dir: /osg/app
<br>> > > data_dir: /osg/data<br>> > > condor_dir: /usr/local/condor/bin<br>> > > R_dir: /osg/app/R- 2.5.1/bin/R<br>> > >
<br>> > > output:<br>> > > Application exception: Exception in getFile<br>> > > task:transfer @ vdl-int.k, line: 235<br>> > > vdl:dostageout @
vdl-int.k, line: 378<br>> > > vdl:execute2 @ execute-default.k, line: 22<br>> > > vdl:execute @ sid-wf1.kml, line: 20<br>> > > wavelettransf @
sid-wf1.kml, line: 362<br>> > > batchtrials @ sid-wf1.kml, line: 402<br>> > > vdl:mains @ sid-wf1.kml , line: 399<br>> > > Caused by:
<br>> ><br>> org.globus.cog.abstraction.impl.file.FileResourceException:<br>> > > Exception in getFile<br>> > > Caused by:<br>> org.globus.ftp.exception.ServerException
: Server<br>> > refused<br>> > > performing the request. Custom message: (error<br>> code<br>> > 1) cwtsmall<br>> > > failed
<br>> > > Provenance graph saved in<br>> sid-wf1-7thy5mbfh09e1.dot<br>> > > The following errors have occurred:<br>> > > 1. Application "cwtsmall" failed (Exception in
<br>> getFile<br>> > > Caused by:<br>> > > Server refused performing the request. Custom<br>> > message: (error code<br>> > > 1)
<br>> > > [Nested exception message: Nested exception is<br>> > ><br>> org.globus.ftp.exception.UnexpectedReplyCodeException :<br>> > > Custom message: Unexpected reply:
<br>> > > 500-Command failed. :<br>> > ><br>> globus_gridftp_server_file.c:globus_l_gfs_file_send:2190:<br>> > > 500-globus_l_gfs_file_open failed.
<br>> > ><br>> ><br>> 500-globus_gridftp_server_file.c:globus_l_gfs_file_open:1694:<br>> > > 500-globus_xio_register_open failed.<br>> > >
<br>> 500-globus_xio_file_driver.c:globus_l_xio_file_open:438:<br>> > > 500-Unable to open<br>> > ><br>> ><br>> file /osgfs/data/sid-wf1-7thy5mbfh09e1/shared//101-FBchannel16_cwt-
avgResults.Rdata<br>> > ><br>> 500-globus_xio_file_driver.c:globus_l_xio_file_open:381:<br>> > > 500-System error in open: No such file or<br>> directory
<br>> > > 500-globus_xio: A system call failed: No such file<br>> or<br>> > directory<br>> > > 500 End.])<br>> > > Arguments: "scripts/runWaveletsAvg.R, 101,
<br>> FB"<br>> > > Host: UCSDT2<br>> > > Directory:<br>> sid-wf1-7thy5mbfh09e1/cwtsmall-mb3l3rfi<br>> > > STDERR:
<br>> > > STDOUT:<br>> > > Errors detected. Cleanup not done.<br>> > > Execution completed with errors<br>> > > sys:throw @
vdl.k, line: 140<br>> > > vdl:mains @ sid-wf1.kml, line: 399<br>> > > at<br>> > ><br>> ><br>> org.globus.cog.karajan.workflow.nodes.FlowNode.fail
(FlowNode.java:413)<br>> > > at<br>> > ><br>> ><br>> org.globus.cog.karajan.workflow.nodes.FlowNode.fail(FlowNode.java:417)<br>> > > at
<br>> > ><br>> org.globus.cog.karajan.workflow.nodes.GenerateErrorNode.post<br>> > > (GenerateErrorNode.java:28)<br>> > > at<br>
> > ><br>> ><br>> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.childCompleted<br>> > > at<br>> > >
<br>> ><br>> org.globus.cog.karajan.workflow.nodes.Sequential.notificationEvent(Sequential.java :33)<br>> > > at<br>> > ><br>> >
org.globus.cog.karajan.workflow.nodes.FlowNode.event<br>> (FlowNode.java:334)<br>> > > at<br>> > ><br>> ><br>> org.globus.cog.karajan.workflow.events.EventBus.send
(EventBus.java:123)<br>> > > at<br>> ><br>> org.globus.cog.karajan.workflow.events.EventBus.sendHooked<br>> > > (EventBus.java:97)<br>> > > at
<br>> > ><br>> ><br>> org.globus.cog.karajan.workflow.nodes.FlowNode.fireNotificationEvent (FlowNode.java:172)<br>> > > at<br>> > >
<br>> ><br>> org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:298)<br>> > > at<br>> > ><br>> ><br>>
org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.executeChildren (AbstractFunction.java:37)<br>> > > at<br>> > ><br>> ><br>>
org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)<br>> > > at<br>> ><br>> org.globus.cog.karajan.workflow.nodes.FlowNode.restart<br>
> > > (FlowNode.java :239)<br>> > > at<br>> > ><br>> ><br>> org.globus.cog.karajan.workflow.nodes.FlowNode.start
(
FlowNode.java :280)<br>> > > at<br>> > ><br>> ><br>> org.globus.cog.karajan.workflow.nodes.FlowNode.controlEvent(FlowNode.java:392)<br>> > > at
<br>> ><br>> org.globus.cog.karajan.workflow.nodes.FlowNode.event<br>> > > (FlowNode.java:331)<br>> > > at<br>> > >
<br>> ><br>> org.globus.cog.karajan.workflow.FlowElementWrapper.event(FlowElementWrapper.java:227)<br>> > > at<br>> > ><br>> >
<br>> org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:123)<br>> > > at<br>> ><br>> org.globus.cog.karajan.workflow.events.EventBus.sendHooked
<br>> > > ( EventBus.java:97)<br>> > > at<br>> > ><br>> org.globus.cog.karajan.workflow.events.EventWorker.run<br>> > (
EventWorker.java:69)<br>> > ><br>> > > Many thanks,<br>> > > Jing<br>> > > _______________________________________________
<br>> > > Swift-user mailing list<br>> > > <a href="mailto:Swift-user@ci.uchicago.edu" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">Swift-user@ci.uchicago.edu
</a><br>> > ><br>> <a href="http://mail.ci.uchicago.edu/mailman/listinfo/swift-user" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
http://mail.ci.uchicago.edu/mailman/listinfo/swift-user</a><br>> ><br>> ><br>><br>><br><br></blockquote></div><br>