Hi Mihael,<div><br></div><div>As discussed in the Swift call last Wednesday, here is the log for the java heap space exceeded run:</div><div><br></div><div><a href="http://ci.uchicago.edu/~ketan/postproc-20120116-1139-evtqkpj9.log.tar.gz">http://ci.uchicago.edu/~ketan/postproc-20120116-1139-evtqkpj9.log.tar.gz</a></div>
<div><br></div><div>Here is the stderr message:</div><div><br></div><div>

<div>Execution failed:</div><div><span style="white-space:pre-wrap">  </span>GC overhead limit exceeded</div><div>Progress:  time: Mon, 16 Jan 2012 12:38:41 -0600  Initializing:18  Selecting site:1421  Submitting:62  Active:167  Stage out:9  Finished successfully:3702 Failed but can retry:216</div>


<div>Progress:  time: Mon, 16 Jan 2012 12:38:53 -0600  Initializing:18  Selecting site:1421  Submitting:62  Active:166  Stage out:10  Finished successfully:3702 Failed but can retry:216</div><div>Uncaught exception: java.lang.OutOfMemoryError: GC overhead limit exceeded in vdl:new @ postproc.kml, line: 2009</div>


<div>java.lang.OutOfMemoryError: GC overhead limit exceeded</div><div><span style="white-space:pre-wrap">     </span>at java.util.Arrays.copyOfRange(Arrays.java:3209)</div><div><span style="white-space:pre-wrap">        </span>at java.lang.String.<init>(String.java:215)</div>


<div><span style="white-space:pre-wrap">  </span>at java.lang.StringBuilder.toString(StringBuilder.java:430)</div><div><span style="white-space:pre-wrap">      </span>at org.griphyn.vdl.mapping.AbstractDataNode.closeShallow(AbstractDataNode.java:413)</div>


<div><span style="white-space:pre-wrap">  </span>at org.griphyn.vdl.mapping.AbstractDataNode.setValue(AbstractDataNode.java:358)</div><div><span style="white-space:pre-wrap">  </span>at org.griphyn.vdl.mapping.RootDataNode.setValue(RootDataNode.java:229)</div>


<div><span style="white-space:pre-wrap">  </span>at org.griphyn.vdl.karajan.lib.New.function(New.java:129)</div><div><span style="white-space:pre-wrap">        </span>at org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:62)</div>


<div><span style="white-space:pre-wrap">  </span>at org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:29)</div><div><span style="white-space:pre-wrap">        </span>at org.globus.cog.karajan.workflow.nodes.Sequential.executeChildren(Sequential.java:20)</div>


<div><span style="white-space:pre-wrap">  </span>at org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)</div><div><span style="white-space:pre-wrap">    </span>at org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:139)</div>


<div><span style="white-space:pre-wrap">  </span>at org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:197)</div><div><span style="white-space:pre-wrap">       </span>at org.globus.cog.karajan.workflow.events.EventBus.start(EventBus.java:104)</div>


<div><span style="white-space:pre-wrap">  </span>at org.globus.cog.karajan.workflow.events.EventTargetPair.run(EventTargetPair.java:40)</div><div><span style="white-space:pre-wrap">   </span>at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)</div>


<div><span style="white-space:pre-wrap">  </span>at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)</div><div><span style="white-space:pre-wrap">    </span>at java.util.concurrent.FutureTask.run(FutureTask.java:138)</div>


<div><span style="white-space:pre-wrap">  </span>at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)</div><div><span style="white-space:pre-wrap">   </span>at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)</div>


<div><span style="white-space:pre-wrap">  </span>at java.lang.Thread.run(Thread.java:662)</div><div>Exception is: java.lang.OutOfMemoryError: GC overhead limit exceeded</div><div>Near Karajan line: vdl:new @ postproc.kml, line: 2009</div>


<div>Progress:  time: Mon, 16 Jan 2012 12:39:02 -0600  Initializing:19  Selecting site:1423  Submitting:62  Active:159  Stage out:15  Finished successfully:3704 Failed but can retry:216</div><div><br></div><div>In a next run, I will try to capture memory usage snapshot at time intervals and see if that provides some more info. Meanwhile may be you get some idea from the log.</div>
<div><br></div><div>Regards,</div>

-- <br>Ketan<br><br><br>
</div>