[Swift-devel] Issues when running swift on fuse

[yizhu]

Hi,


I tried to run a swift on a directory mounted by fuse (s3fs), but got 
the following error:
(-debug output attached)

since I execute swift on /mnt/s3, the output file should be write 
there,i had rw permission on /mnt/s3, the job seems run correctly (the 
output file: Hello.txt is there), just a issue with log file.

Is there a way to turn off the logging or any ideas to solve this problem?

Thank you very much!


-From

Yi Zhu



[torqueuser at ip-10-251-89-208 ~]$ cd /mnt/s3
[torqueuser at ip-10-251-89-208 s3]$ swift 
/home/torqueuser/swift-0.9/examples/swift/first.swift
log4j:ERROR Failed to flush writer,
java.io.IOException: File too large
	at java.io.FileOutputStream.writeBytes(Native Method)
	at java.io.FileOutputStream.write(FileOutputStream.java:260)
	at sun.nio.cs.StreamEncoder$CharsetSE.writeBytes(StreamEncoder.java:336)
	at 
sun.nio.cs.StreamEncoder$CharsetSE.implFlushBuffer(StreamEncoder.java:404)
	at sun.nio.cs.StreamEncoder$CharsetSE.implFlush(StreamEncoder.java:408)
	at sun.nio.cs.StreamE.ncoder.flush(StreamEncoder.java:152)
	at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:213)
	at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:49)
	at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:306)
	at org.apache.log4j.WriterAppender.append(WriterAppender.java:150)
	at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:221)
	at 
org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57)
	at org.apache.log4j.Category.callAppenders(Category.java:187)
	at org.apache.log4j.Category.forcedLog(Category.java:372)
	at org.apache.log4j.Category.debug(Category.java:241)
	at org.griphyn.vdl.karajan.Loader.main(Loader.java:75)
Swift 0.9 swift-r2860 cog-r2388

RunID: 20090529-0204-55gjsnhc
Progress:  uninitialized:1
Progress:  Submitted:1
Progress:  Active:1
Ex098
org.globus.cog.karajan.workflow.KarajanRuntimeException: Exception 
caught while writing to log file
	at 
org.globus.cog.karajan.workflow.nodes.restartLog.LogVargOperator.update(LogVargOperator.java:40)
	at 
org.globus.cog.karajan.workflow.nodes.functions.VariableArgumentsOperator.append(VariableArgumentsOperator.java:38)
	at 
org.globus.cog.karajan.workflow.nodes.functions.VariableArgumentsOperator.appendAll(VariableArgumentsOperator.java:44)
	at 
org.globus.cog.karajan.workflow.nodes.functions.VariableArgumentsOperator.merge(VariableArgumentsOperator.java:34)
	at 
org.globus.cog.karajan.workflow.nodes.SequentialChoice.commitBuffers(SequentialChoice.java:52)
	at 
org.globus.cog.karajan.workflow.nodes.SequentialChoice.childCompleted(SequentialChoice.java:41)
	at 
org.globus.cog.karajan.workflow.nodes.Sequential.notificationEvent(Sequential.java:33)
	at 
org.globus.cog.karajan.workflow.nodes.SequentialChoice.notificationEvent(SequentialChoice.java:66)
	at org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:332)
	at org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:125)
	at 
org.globus.cog.karajan.workflow.events.EventBus.sendHooked(EventBus.java:99)
	at 
org.globus.cog.karajan.workflow.nodes.FlowNode.fireNotificationEvent(FlowNode.java:176)
	at 
org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:296)
	at 
org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
	at 
org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:51)
	at 
org.globus.cog.karajan.workflow.nodes.Sequential.childCompleted(Sequential.java:45)
	at 
org.globus.cog.karajan.workflow.nodes.Sequential.notificationEvent(Sequential.java:33)
	at org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:332)
	at org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:125)
	at 
org.globus.cog.karajan.workflow.events.EventBus.sendHooked(EventBus.java:99)
	at 
org.globus.cog.karajan.workflow.nodes.FlowNode.fireNotificationEvent(FlowNode.java:176)
	at 
org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:296)
	at 
org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)
	at 
org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:46)
	at 
org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.childCompleted(AbstractSequentialWithArguments.java:192)
	at 
org.globus.cog.karajan.workflow.nodes.Sequential.notificationEvent(Sequential.java:33)
	at org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:332)
	at org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:125)
	at 
org.globus.cog.karajan.workflow.events.EventBus.sendHooked(EventBus.java:99)
	at 
org.globus.cog.karajan.workflow.nodes.FlowNode.fireNotificationEvent(FlowNode.java:176)
	at 
org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:296)
	at 
org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.executeChildren(AbstractFunction.java:37)
	at 
org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)
	at 
org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:233)
	at org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:278)
	at 
org.globus.cog.karajan.workflow.nodes.FlowNode.controlEvent(FlowNode.java:391)
	at org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:329)
	at 
org.globus.cog.karajan.workflow.FlowElementWrapper.event(FlowElementWrapper.java:227)
	at org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:125)
	at 
org.globus.cog.karajan.workflow.events.EventBus.sendHooked(EventBus.java:99)
	at 
org.globus.cog.karajan.workflow.events.EventWorker.run(EventWorker.java:69)
Caused by: java.io.IOException: File too large
	at java.io.FileOutputStream.writeBytes(Native Method)
	at java.io.FileOutputStream.write(FileOutputStream.java:260)
	at sun.nio.cs.StreamEncoder$CharsetSE.writeBytes(StreamEncoder.java:336)
	at 
sun.nio.cs.StreamEncoder$CharsetSE.implFlushBuffer(StreamEncoder.java:404)
	at sun.nio.cs.StreamEncoder$CharsetSE.implFlush(StreamEncoder.java:408)
	at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:152)
	at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:213)
	at 
org.globus.cog.karajan.workflow.nodes.restartLog.FlushableLockedFileWriter.flush(FlushableLockedFileWriter.java:39)
	at 
org.globus.cog.karajan.workflow.nodes.restartLog.LogVargOperator.update(LogVargOperator.java:37)
	... 40 more
Execution failed:
	Exception caught while writing to log file
Caused by:
	File too large
[torqueuser at ip-10-251-89-208 s3]$



-------------- next part --------------
A non-text attachment was scrubbed...
Name: error.log
Type: text/x-log
Size: 35601 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/swift-devel/attachments/20090529/d3a06587/attachment.bin>