[Swift-devel] Problem on oops run: Java out of memory

[Mihael Hategan]

What's your workflow, and how much memory are you running swift with?

On Tue, 2009-03-31 at 07:23 -0500, Michael Wilde wrote:
> There is a new way to limit the number of jobs that a for-loop will 
> allow to be active at once.  Thats in the user guide, and it defaults I 
> think to 1024.
> 
> I dont know if there is a per-site limit.
> 
> So it sounds like there may be a swift bug here.  You should report this 
> one to swift-devel after rsyncying your log file to the swift log 
> repository as per the user guide.
> 
> Sounds like nice progress!
> 
> - Mike
> 
> 
> On 3/31/09 1:28 AM, Glen Hocky wrote:
> > Hi Mike,
> > I was able to successfully modify everything so that temperature sweeps 
> > work correctly on teraport.
> > the main problem i've run up against is that i would like to test this 
> > out with a lot of jobs, but i got
> >> Uncaught exception: java.lang.OutOfMemoryError: Java heap space in 
> >> kernel:named @ vdl-int.k
> >> java.lang.OutOfMemoryError: Java heap space
> >>         at java.util.HashMap.addEntry(HashMap.java:753)
> >>         at java.util.HashMap.put(HashMap.java:385)
> >>         at 
> >> org.globus.cog.karajan.arguments.NamedArgumentsImpl.add(NamedArgumentsImpl.java:83) 
> >>
> >>         at 
> >> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.initializeArgs(AbstractSequentialWithArguments.java:158) 
> >>
> >>         at 
> >> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.pre(AbstractSequentialWithArguments.java:138) 
> >>
> >>         at 
> >> org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:62) 
> >>
> >>         at 
> >> org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:233)
> >>         at 
> >> org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:278)
> >>         at 
> >> org.globus.cog.karajan.workflow.nodes.FlowNode.controlEvent(FlowNode.java:391) 
> >>
> >>         at 
> >> org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:329)
> >>         at 
> >> org.globus.cog.karajan.workflow.FlowElementWrapper.event(FlowElementWrapper.java:227) 
> >>
> >>         at 
> >> org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:125)
> >>         at 
> >> org.globus.cog.karajan.workflow.events.EventBus.sendHooked(EventBus.java:99) 
> >>
> >>         at 
> >> org.globus.cog.karajan.workflow.events.EventWorker.run(EventWorker.java:69) 
> >>
> > which makes sense since I was submitting thousands of jobs
> > 
> > i don't see a param to limit the max on a given site to N. do you know 
> > of one?
> ...
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel