I just got a freeze running Alberto's script with the default local sites.xml. Here is the info:<br><br>2011-06-17 15:10:34<br>Full thread dump Java HotSpot(TM) Server VM (19.1-b02 mixed mode):<br><br>"Attach Listener" daemon prio=10 tid=0x08fd9800 nid=0x237e waiting on condition [0x00000000]<br>
java.lang.Thread.State: RUNNABLE<br><br> Locked ownable synchronizers:<br> - None<br><br>"Progress ticker" daemon prio=10 tid=0x08c48800 nid=0x2359 waiting on condition [0x9e05c000]<br> java.lang.Thread.State: TIMED_WAITING (sleeping)<br>
at java.lang.Thread.sleep(Native Method)<br> at org.griphyn.vdl.karajan.lib.RuntimeStats$ProgressTicker.run(RuntimeStats.java:141)<br><br> Locked ownable synchronizers:<br> - None<br><br>"Restart Log Sync" daemon prio=10 tid=0x08b80400 nid=0x2358 in Object.wait() [0x9e0ad000]<br>
java.lang.Thread.State: WAITING (on object monitor)<br> at java.lang.Object.wait(Native Method)<br> - waiting on <0xaed6b160> (a org.globus.cog.karajan.workflow.nodes.restartLog.SyncThread)<br> at java.lang.Object.wait(Object.java:485)<br>
at org.globus.cog.karajan.workflow.nodes.restartLog.SyncThread.run(SyncThread.java:47)<br> - locked <0xaed6b160> (a org.globus.cog.karajan.workflow.nodes.restartLog.SyncThread)<br><br> Locked ownable synchronizers:<br>
- None<br><br>"Overloaded Host Monitor" daemon prio=10 tid=0x08b47400 nid=0x2357 waiting on condition [0x9e0fe000]<br> java.lang.Thread.State: TIMED_WAITING (sleeping)<br> at java.lang.Thread.sleep(Native Method)<br>
at org.globus.cog.karajan.scheduler.OverloadedHostMonitor.run(OverloadedHostMonitor.java:47)<br><br> Locked ownable synchronizers:<br> - None<br><br>"Timer-0" daemon prio=10 tid=0x08f14c00 nid=0x2356 in Object.wait() [0x9e676000]<br>
java.lang.Thread.State: TIMED_WAITING (on object monitor)<br> at java.lang.Object.wait(Native Method)<br> - waiting on <0xaf280198> (a java.util.TaskQueue)<br> at java.util.TimerThread.mainLoop(Timer.java:509)<br>
- locked <0xaf280198> (a java.util.TaskQueue)<br> at java.util.TimerThread.run(Timer.java:462)<br><br> Locked ownable synchronizers:<br> - None<br><br>"NBS0" daemon prio=10 tid=0x08b0ec00 nid=0x2355 waiting on condition [0x9e6c7000]<br>
java.lang.Thread.State: WAITING (parking)<br> at sun.misc.Unsafe.park(Native Method)<br> - parking to wait for <0xaf280248> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)<br> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)<br>
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)<br> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)<br> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)<br>
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)<br> at java.lang.Thread.run(Thread.java:662)<br><br> Locked ownable synchronizers:<br> - None<br><br>"pool-1-thread-8" prio=10 tid=0x09008400 nid=0x2354 waiting for monitor entry [0x9e718000]<br>
java.lang.Thread.State: BLOCKED (on object monitor)<br> at org.griphyn.vdl.karajan.WrapperMap.close(WrapperMap.java:25)<br> - waiting to lock <0xaf432670> (a org.griphyn.vdl.karajan.WrapperMap)<br> at org.griphyn.vdl.karajan.lib.VDLFunction.closeShallow(VDLFunction.java:516)<br>
- locked <0xaebee120> (a org.griphyn.vdl.mapping.RootArrayDataNode)<br> at org.griphyn.vdl.karajan.lib.SetFieldValue.deepCopy(SetFieldValue.java:121)<br> at org.griphyn.vdl.karajan.lib.SetFieldValue.function(SetFieldValue.java:49)<br>
- locked <0xaebee120> (a org.griphyn.vdl.mapping.RootArrayDataNode)<br> at org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:67)<br> at org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>
at org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br> at org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br> at org.globus.cog.karajan.workflow.nodes.functions.Argument.post(Argument.java:48)<br>
at org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br> at org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br> at org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>
at org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:71)<br> at org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br> at org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br>
at org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br> at org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:28)<br> at org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>
at org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br> at org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br> at org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:28)<br>
at org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:29)<br> at org.globus.cog.karajan.workflow.nodes.Sequential.executeChildren(Sequential.java:20)<br> at org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)<br>
at org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:139)<br> at org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:197)<br> at org.globus.cog.karajan.workflow.FlowElementWrapper.start(FlowElementWrapper.java:227)<br>
at org.globus.cog.karajan.workflow.events.EventBus.start(EventBus.java:104)<br> at org.globus.cog.karajan.workflow.events.EventTargetPair.run(EventTargetPair.java:40)<br> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)<br>
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)<br> at java.util.concurrent.FutureTask.run(FutureTask.java:138)<br> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)<br>
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)<br> at java.lang.Thread.run(Thread.java:662)<br><br> Locked ownable synchronizers:<br> - <0xaf2805f0> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)<br>
<br>"pool-1-thread-7" prio=10 tid=0x09006800 nid=0x2353 waiting on condition [0x9e769000]<br> java.lang.Thread.State: WAITING (parking)<br> at sun.misc.Unsafe.park(Native Method)<br> - parking to wait for <0xaf2806e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)<br>
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)<br> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)<br> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)<br>
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)<br> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)<br> at java.lang.Thread.run(Thread.java:662)<br>
<br> Locked ownable synchronizers:<br> - None<br><br>"pool-1-thread-6" prio=10 tid=0x09004c00 nid=0x2352 waiting on condition [0x9e7ba000]<br> java.lang.Thread.State: WAITING (parking)<br> at sun.misc.Unsafe.park(Native Method)<br>
- parking to wait for <0xaf2806e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)<br> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)<br> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)<br>
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)<br> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)<br> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)<br>
at java.lang.Thread.run(Thread.java:662)<br><br> Locked ownable synchronizers:<br> - None<br><br>"pool-1-thread-5" prio=10 tid=0x09002800 nid=0x2351 waiting for monitor entry [0x9e80b000]<br> java.lang.Thread.State: BLOCKED (on object monitor)<br>
at org.griphyn.vdl.mapping.AbstractDataNode.addListener(AbstractDataNode.java:575)<br> - waiting to lock <0xaebee120> (a org.griphyn.vdl.mapping.RootArrayDataNode)<br> at org.griphyn.vdl.karajan.DSHandleFutureWrapper.<init>(DSHandleFutureWrapper.java:24)<br>
at org.griphyn.vdl.karajan.WrapperMap.addNodeListener(WrapperMap.java:61)<br> - locked <0xaf432670> (a org.griphyn.vdl.karajan.WrapperMap)<br> at org.griphyn.vdl.karajan.lib.VDLFunction.addFutureListener(VDLFunction.java:523)<br>
at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:88)<br> at org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:67)<br> at org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:29)<br>
at org.globus.cog.karajan.workflow.nodes.Sequential.executeChildren(Sequential.java:20)<br> at org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)<br> at org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:139)<br>
at org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:197)<br> at org.globus.cog.karajan.workflow.FlowElementWrapper.start(FlowElementWrapper.java:227)<br> at org.globus.cog.karajan.workflow.events.EventBus.start(EventBus.java:104)<br>
at org.globus.cog.karajan.workflow.events.EventTargetPair.run(EventTargetPair.java:40)<br> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)<br> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)<br>
at java.util.concurrent.FutureTask.run(FutureTask.java:138)<br> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)<br> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)<br>
at java.lang.Thread.run(Thread.java:662)<br><br> Locked ownable synchronizers:<br> - <0xaf280d48> (a java.util.concurrent.locks.ReentrantLock$NonfairSync)<br><br>"pool-1-thread-4" prio=10 tid=0x08ff3400 nid=0x2350 waiting on condition [0x9e85c000]<br>
java.lang.Thread.State: WAITING (parking)<br> at sun.misc.Unsafe.park(Native Method)<br> - parking to wait for <0xaf2806e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)<br> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)<br>
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)<br> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)<br> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)<br>
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)<br> at java.lang.Thread.run(Thread.java:662)<br><br> Locked ownable synchronizers:<br> - None<br><br>"pool-1-thread-3" prio=10 tid=0x08ff0800 nid=0x234f waiting on condition [0x9e8ad000]<br>
java.lang.Thread.State: WAITING (parking)<br> at sun.misc.Unsafe.park(Native Method)<br> - parking to wait for <0xaf2806e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)<br> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)<br>
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)<br> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)<br> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)<br>
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)<br> at java.lang.Thread.run(Thread.java:662)<br><br> Locked ownable synchronizers:<br> - None<br><br>"pool-1-thread-2" prio=10 tid=0x08ede000 nid=0x234e waiting on condition [0x9ea98000]<br>
java.lang.Thread.State: WAITING (parking)<br> at sun.misc.Unsafe.park(Native Method)<br> - parking to wait for <0xaf2806e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)<br> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)<br>
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)<br> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)<br> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)<br>
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)<br> at java.lang.Thread.run(Thread.java:662)<br><br> Locked ownable synchronizers:<br> - None<br><br>"pool-1-thread-1" prio=10 tid=0x08ef4000 nid=0x234d waiting on condition [0x9eae9000]<br>
java.lang.Thread.State: WAITING (parking)<br> at sun.misc.Unsafe.park(Native Method)<br> - parking to wait for <0xaf2806e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)<br> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)<br>
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)<br> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)<br> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)<br>
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)<br> at java.lang.Thread.run(Thread.java:662)<br><br> Locked ownable synchronizers:<br> - None<br><br>"Hang checker" prio=10 tid=0x08eda400 nid=0x234c waiting for monitor entry [0x9e8fe000]<br>
java.lang.Thread.State: BLOCKED (on object monitor)<br> at org.griphyn.vdl.karajan.Monitor.dumpVariables(Monitor.java:220)<br> - waiting to lock <0xaf432670> (a org.griphyn.vdl.karajan.WrapperMap)<br> at org.griphyn.vdl.karajan.HangChecker.run(HangChecker.java:54)<br>
at java.util.TimerThread.mainLoop(Timer.java:512)<br> at java.util.TimerThread.run(Timer.java:462)<br><br> Locked ownable synchronizers:<br> - None<br><br>"Low Memory Detector" daemon prio=10 tid=0x9f514800 nid=0x234a runnable [0x00000000]<br>
java.lang.Thread.State: RUNNABLE<br><br> Locked ownable synchronizers:<br> - None<br><br>"CompilerThread1" daemon prio=10 tid=0x9f512c00 nid=0x2349 waiting on condition [0x00000000]<br> java.lang.Thread.State: RUNNABLE<br>
<br> Locked ownable synchronizers:<br> - None<br><br>"CompilerThread0" daemon prio=10 tid=0x9f510800 nid=0x2348 waiting on condition [0x00000000]<br> java.lang.Thread.State: RUNNABLE<br><br> Locked ownable synchronizers:<br>
- None<br><br>"Signal Dispatcher" daemon prio=10 tid=0x9f50f000 nid=0x2347 runnable [0x00000000]<br> java.lang.Thread.State: RUNNABLE<br><br> Locked ownable synchronizers:<br> - None<br><br>"Finalizer" daemon prio=10 tid=0x9f500800 nid=0x2346 in Object.wait() [0x9f260000]<br>
java.lang.Thread.State: WAITING (on object monitor)<br> at java.lang.Object.wait(Native Method)<br> - waiting on <0xaf4341c0> (a java.lang.ref.ReferenceQueue$Lock)<br> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)<br>
- locked <0xaf4341c0> (a java.lang.ref.ReferenceQueue$Lock)<br> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)<br> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)<br><br>
Locked ownable synchronizers:<br> - None<br><br>"Reference Handler" daemon prio=10 tid=0x089c3800 nid=0x2345 in Object.wait() [0x9f2b1000]<br> java.lang.Thread.State: WAITING (on object monitor)<br> at java.lang.Object.wait(Native Method)<br>
- waiting on <0xaf2803a0> (a java.lang.ref.Reference$Lock)<br> at java.lang.Object.wait(Object.java:485)<br> at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)<br> - locked <0xaf2803a0> (a java.lang.ref.Reference$Lock)<br>
<br> Locked ownable synchronizers:<br> - None<br><br>"main" prio=10 tid=0x08921400 nid=0x233f in Object.wait() [0xb6ad6000]<br> java.lang.Thread.State: WAITING (on object monitor)<br> at java.lang.Object.wait(Native Method)<br>
- waiting on <0xaf42fe78> (a org.griphyn.vdl.karajan.VDL2ExecutionContext)<br> at java.lang.Object.wait(Object.java:485)<br> at org.globus.cog.karajan.workflow.ExecutionContext.waitFor(ExecutionContext.java:226)<br>
- locked <0xaf42fe78> (a org.griphyn.vdl.karajan.VDL2ExecutionContext)<br> at org.griphyn.vdl.karajan.Loader.main(Loader.java:201)<br><br> Locked ownable synchronizers:<br> - None<br><br>"VM Thread" prio=10 tid=0x089bfc00 nid=0x2344 runnable <br>
<br>"GC task thread#0 (ParallelGC)" prio=10 tid=0x08928800 nid=0x2340 runnable <br><br>"GC task thread#1 (ParallelGC)" prio=10 tid=0x08929c00 nid=0x2341 runnable <br><br>"GC task thread#2 (ParallelGC)" prio=10 tid=0x0892b400 nid=0x2342 runnable <br>
<br>"GC task thread#3 (ParallelGC)" prio=10 tid=0x0892c800 nid=0x2343 runnable <br><br>"VM Periodic Task Thread" prio=10 tid=0x9f51e800 nid=0x234b waiting on condition <br><br>JNI global references: 1370<br>
<br><br>Found one Java-level deadlock:<br>=============================<br>"pool-1-thread-8":<br> waiting to lock monitor 0x09042b08 (object 0xaf432670, a org.griphyn.vdl.karajan.WrapperMap),<br> which is held by "pool-1-thread-5"<br>
"pool-1-thread-5":<br> waiting to lock monitor 0x9f56e630 (object 0xaebee120, a org.griphyn.vdl.mapping.RootArrayDataNode),<br> which is held by "pool-1-thread-8"<br><br>Java stack information for the threads listed above:<br>
===================================================<br>"pool-1-thread-8":<br> at org.griphyn.vdl.karajan.WrapperMap.close(WrapperMap.java:25)<br> - waiting to lock <0xaf432670> (a org.griphyn.vdl.karajan.WrapperMap)<br>
at org.griphyn.vdl.karajan.lib.VDLFunction.closeShallow(VDLFunction.java:516)<br> - locked <0xaebee120> (a org.griphyn.vdl.mapping.RootArrayDataNode)<br> at org.griphyn.vdl.karajan.lib.SetFieldValue.deepCopy(SetFieldValue.java:121)<br>
at org.griphyn.vdl.karajan.lib.SetFieldValue.function(SetFieldValue.java:49)<br> - locked <0xaebee120> (a org.griphyn.vdl.mapping.RootArrayDataNode)<br> at org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:67)<br>
at org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br> at org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br> at org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>
at org.globus.cog.karajan.workflow.nodes.functions.Argument.post(Argument.java:48)<br> at org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>
at org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br> at org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br> at org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:71)<br>
at org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br> at org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br> at org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br>
at org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:28)<br> at org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.completed(AbstractSequentialWithArguments.java:194)<br>
at org.globus.cog.karajan.workflow.nodes.FlowNode.complete(FlowNode.java:214)<br> at org.globus.cog.karajan.workflow.nodes.FlowContainer.post(FlowContainer.java:58)<br> at org.globus.cog.karajan.workflow.nodes.functions.AbstractFunction.post(AbstractFunction.java:28)<br>
at org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:29)<br> at org.globus.cog.karajan.workflow.nodes.Sequential.executeChildren(Sequential.java:20)<br> at org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)<br>
at org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:139)<br> at org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:197)<br> at org.globus.cog.karajan.workflow.FlowElementWrapper.start(FlowElementWrapper.java:227)<br>
at org.globus.cog.karajan.workflow.events.EventBus.start(EventBus.java:104)<br> at org.globus.cog.karajan.workflow.events.EventTargetPair.run(EventTargetPair.java:40)<br> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)<br>
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)<br> at java.util.concurrent.FutureTask.run(FutureTask.java:138)<br> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)<br>
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)<br> at java.lang.Thread.run(Thread.java:662)<br>"pool-1-thread-5":<br> at org.griphyn.vdl.mapping.AbstractDataNode.addListener(AbstractDataNode.java:575)<br>
- waiting to lock <0xaebee120> (a org.griphyn.vdl.mapping.RootArrayDataNode)<br> at org.griphyn.vdl.karajan.DSHandleFutureWrapper.<init>(DSHandleFutureWrapper.java:24)<br> at org.griphyn.vdl.karajan.WrapperMap.addNodeListener(WrapperMap.java:61)<br>
- locked <0xaf432670> (a org.griphyn.vdl.karajan.WrapperMap)<br> at org.griphyn.vdl.karajan.lib.VDLFunction.addFutureListener(VDLFunction.java:523)<br> at org.griphyn.vdl.karajan.lib.Stagein.function(Stagein.java:88)<br>
at org.griphyn.vdl.karajan.lib.VDLFunction.post(VDLFunction.java:67)<br> at org.globus.cog.karajan.workflow.nodes.Sequential.startNext(Sequential.java:29)<br> at org.globus.cog.karajan.workflow.nodes.Sequential.executeChildren(Sequential.java:20)<br>
at org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:63)<br> at org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:139)<br> at org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:197)<br>
at org.globus.cog.karajan.workflow.FlowElementWrapper.start(FlowElementWrapper.java:227)<br> at org.globus.cog.karajan.workflow.events.EventBus.start(EventBus.java:104)<br> at org.globus.cog.karajan.workflow.events.EventTargetPair.run(EventTargetPair.java:40)<br>
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)<br> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)<br> at java.util.concurrent.FutureTask.run(FutureTask.java:138)<br>
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)<br> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)<br> at java.lang.Thread.run(Thread.java:662)<br>
<br>Found 1 deadlock.<br><br><br><div class="gmail_quote">On Fri, Jun 17, 2011 at 3:08 PM, Mihael Hategan <span dir="ltr"><<a href="mailto:hategan@mcs.anl.gov">hategan@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div class="im">On Fri, 2011-06-17 at 15:03 -0500, Michael Wilde wrote:<br>
> This would be a great thing to build into the test suite for any test run that the suite is about to cancel for exceeding its max run time: capture the stack trace, so that if its a deadlock, we can do some diagnosis right form the test results.<br>
><br>
> Can we add some Swift commands to dump Swifts thread/future status as well?<br>
<br>
</div>The hang checker already does that, but there is a class of deadlocks<br>
that has no open futures.<br>
<br>
</blockquote></div><br>