[Swift-devel] Problem on oops run: Java out of memory

[Michael Wilde]

There is a new way to limit the number of jobs that a for-loop will 
allow to be active at once.  Thats in the user guide, and it defaults I 
think to 1024.

I dont know if there is a per-site limit.

So it sounds like there may be a swift bug here.  You should report this 
one to swift-devel after rsyncying your log file to the swift log 
repository as per the user guide.

Sounds like nice progress!

- Mike


On 3/31/09 1:28 AM, Glen Hocky wrote:
> Hi Mike,
> I was able to successfully modify everything so that temperature sweeps 
> work correctly on teraport.
> the main problem i've run up against is that i would like to test this 
> out with a lot of jobs, but i got
>> Uncaught exception: java.lang.OutOfMemoryError: Java heap space in 
>> kernel:named @ vdl-int.k
>> java.lang.OutOfMemoryError: Java heap space
>>         at java.util.HashMap.addEntry(HashMap.java:753)
>>         at java.util.HashMap.put(HashMap.java:385)
>>         at 
>> org.globus.cog.karajan.arguments.NamedArgumentsImpl.add(NamedArgumentsImpl.java:83) 
>>
>>         at 
>> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.initializeArgs(AbstractSequentialWithArguments.java:158) 
>>
>>         at 
>> org.globus.cog.karajan.workflow.nodes.AbstractSequentialWithArguments.pre(AbstractSequentialWithArguments.java:138) 
>>
>>         at 
>> org.globus.cog.karajan.workflow.nodes.FlowContainer.execute(FlowContainer.java:62) 
>>
>>         at 
>> org.globus.cog.karajan.workflow.nodes.FlowNode.restart(FlowNode.java:233)
>>         at 
>> org.globus.cog.karajan.workflow.nodes.FlowNode.start(FlowNode.java:278)
>>         at 
>> org.globus.cog.karajan.workflow.nodes.FlowNode.controlEvent(FlowNode.java:391) 
>>
>>         at 
>> org.globus.cog.karajan.workflow.nodes.FlowNode.event(FlowNode.java:329)
>>         at 
>> org.globus.cog.karajan.workflow.FlowElementWrapper.event(FlowElementWrapper.java:227) 
>>
>>         at 
>> org.globus.cog.karajan.workflow.events.EventBus.send(EventBus.java:125)
>>         at 
>> org.globus.cog.karajan.workflow.events.EventBus.sendHooked(EventBus.java:99) 
>>
>>         at 
>> org.globus.cog.karajan.workflow.events.EventWorker.run(EventWorker.java:69) 
>>
> which makes sense since I was submitting thousands of jobs
> 
> i don't see a param to limit the max on a given site to N. do you know 
> of one?
...