[Swift-devel] "Timer was cancelled" error on Beagle on Swift script termination

[Michael Wilde]

No, I first noticed this last night, and the code Im running hasn't been updated (from 0.92 branch) in the past 2 weeks as far as I know.

- Mike


----- Original Message -----
> PBS is a possibility- did you update from trunk in the last 2 hours?
> 
> On Mon, 21 Mar 2011, Michael Wilde wrote:
> 
> > Ketan, I recall that you ran the same example last week, and did not
> > report this error at that time.
> >
> >
> > Is your impressions the same as mine: that something changed either
> > in
> > Beagle or in the Swift revision we are using there, to cause this?
> >
> >
> > Im somewhat suspicious that a recent change in Beagle's PBS behavior
> > is
> > causing this error in Swift.
> >
> >
> > Mihael, all, do you have any thoughts on what that might be?
> >
> >
> > - Mike
> >
> > ----- Original Message -----
> >
> >
> > Hi,
> >
> > I tried on my home and am getting the same error stack as well.
> >
> > ====
> > [ketan at login2:catsn.works]$ swift -config cf -tc.file tc -sites.file
> > beagle-coaster.xml catsn.swift -n=1
> > Swift svn swift-r4143 (swift modified locally) cog-r3056 (cog
> > modified locally)
> >
> > RunID: 20110321-1213-4abfllee
> > Progress:
> > Progress: Submitting:1
> > Progress: Active:1
> > Final status: Finished successfully:1
> > Got exception in send
> > java.lang.IllegalStateException: Timer was cancelled
> > at java.util.Timer.scheduleImpl(Timer.java:564)
> > at java.util.Timer.schedule(Timer.java:449)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.setupReplyTimeoutChecker(Command.java:155)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.dataSent(Command.java:149)
> > at
> > org.globus.cog.karajan.workflow.service.channels.AbstractPipedChannel.actualSend(AbstractPipedChannel.java:89)
> > at
> > org.globus.cog.karajan.workflow.service.channels.AbstractPipedChannel$Sender.run(AbstractPipedChannel.java:115)
> > Got exception in send
> > java.lang.IllegalStateException: Timer was cancelled
> > at java.util.Timer.scheduleImpl(Timer.java:564)
> > at java.util.Timer.schedule(Timer.java:449)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.setupReplyTimeoutChecker(Command.java:155)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.dataSent(Command.java:149)
> > at
> > org.globus.cog.karajan.workflow.service.channels.AbstractPipedChannel.actualSend(AbstractPipedChannel.java:89)
> > at
> > org.globus.cog.karajan.workflow.service.channels.AbstractPipedChannel$Sender.run(AbstractPipedChannel.java:115)
> > java.lang.IllegalStateException: Timer was cancelled
> > at java.util.Timer.scheduleImpl(Timer.java:564)
> > at java.util.Timer.schedule(Timer.java:449)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.setupReplyTimeoutChecker(Command.java:155)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.dataSent(Command.java:149)
> > at
> > org.globus.cog.karajan.workflow.service.channels.AbstractStreamKarajanChannel$Sender.run(AbstractStreamKarajanChannel.java:253)
> > Canceling job 19904.sdb
> > java.lang.IllegalStateException: Timer was cancelled
> > at java.util.Timer.scheduleImpl(Timer.java:564)
> > at java.util.Timer.schedule(Timer.java:449)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.setupReplyTimeoutChecker(Command.java:155)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.dataSent(Command.java:149)
> > at
> > org.globus.cog.karajan.workflow.service.channels.AbstractStreamKarajanChannel$Sender.run(AbstractStreamKarajanChannel.java:253)
> > Canceling job 19904.sdb
> >
> > ====
> >
> >
> > On Mon, Mar 21, 2011 at 12:14 PM, Michael Wilde < wilde at mcs.anl.gov
> > > wrote:
> >
> >
> > I had not run Swift on beagle for the past two weeks. When I started
> > again last night, Im now getting some kind of coaster service
> > timeout error when the script terminates. The script seems to run OK
> > up to termination.
> >
> > The error is:
> >
> > Canceling job 19876.sdb
> > Got exception in send
> > java.lang.IllegalStateException: Timer was cancelled
> >
> > Is anyone seeing the same thing? Any idea why?
> >
> > This is running swift at:
> >
> > login1$ which swift
> > /home/wilde/swift/rev/swift-r4143+cog-r3056+pbscoast/bin/swift
> > login1$ swift -version
> > Swift svn swift-r4143 (swift modified locally) cog-r3056 (cog
> > modified locally)
> >
> >
> > The log for this example is on CI net in
> > /home/wilde/swift/lab/catsn-20110320-2257-tpoi32je.log
> >
> >
> > Run command and output:
> >
> > login1$ swift -config cf -tc.file tc -sites.file beagle-coaster.xml
> > catsn.swift -n=10
> > Swift svn swift-r4143 (swift modified locally) cog-r3056 (cog
> > modified locally)
> >
> > RunID: 20110320-2257-tpoi32je
> > Progress:
> > Progress: Submitted:9 Active:1
> > Trying to release previously released contact: 3
> > Final status: Finished successfully:10
> > Got exception in send
> > java.lang.IllegalStateException: Timer was cancelled
> > at java.util.Timer.scheduleImpl(Timer.java:564)
> > at java.util.Timer.schedule(Timer.java:449)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.setupReplyTimeoutChecker(Command.java:155)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.dataSent(Command.java:149)
> > at
> > org.globus.cog.karajan.workflow.service.channels.AbstractPipedChannel.actualSend(AbstractPipedChannel.java:89)
> > at
> > org.globus.cog.karajan.workflow.service.channels.AbstractPipedChannel$Sender.run(AbstractPipedChannel.java:115)
> > Canceling job 19876.sdb
> > Got exception in send
> > java.lang.IllegalStateException: Timer was cancelled
> > at java.util.Timer.scheduleImpl(Timer.java:564)
> > at java.util.Timer.schedule(Timer.java:449)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.setupReplyTimeoutChecker(Command.java:155)
> > at
> > org.globus.cog.karajan.workflow.service.commands.Command.dataSent(Command.java:149)
> > at
> > org.globus.cog.karajan.workflow.service.channels.AbstractPipedChannel.actualSend(AbstractPipedChannel.java:89)
> > at
> > org.globus.cog.karajan.workflow.service.channels.AbstractPipedChannel$Sender.run(AbstractPipedChannel.java:115)
> > login1$
> >
> >
> >
> >
> 
> --
> Justin M Wozniak

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory