[Swift-devel] swift out of memory

[Ioan Raicu]

I routinely use -Xms1536m -Xmx1536m for running Falkon (have the min and 
max heap size the same, to avoid having to resize the heap, which 
ultimately improves performance during these periods).  Those nodes on 
the BG/P have 4GB of memory, so once you find the largest workflows you 
can run with 1GB (or 1.5GB), it would be good to push the heap size up 
as close as you can to the 4GB limit (probably somewhere between 3GB and 
4GB). 

Ioan

Zhao Zhang wrote:
> Mihael told me set options in swift command with -Xmx1024m , I am 
> testing it now.
>
> zhao
>
> Ioan Raicu wrote:
>> I don't think Zhao knows where this is set in Swift.  Where could he 
>> look this up, other than using "top" during a run?
>>
>> Ioan
>>
>> Mihael Hategan wrote:
>>> How much memory are you running the jvm with?
>>>
>>> On Wed, 2008-08-27 at 15:18 -0500, Zhao Zhang wrote:
>>>  
>>>> Hi, I was trying to run 32768 tasks on BGP, swift failed to start 
>>>> and reported the following message.
>>>> Any ideas? Thanks
>>>>
>>>> zhao
>>>>
>>>> JVMDG217: Dump Handler is Processing OutOfMemory - Please Wait.
>>>> JVMDG315: JVM Requesting Heap dump file
>>>> .................................................JVMDG318: Heap 
>>>> dump file written to 
>>>> /gpfs/home/zzhang/swift/etc/heapdump.20080827.142903.2957.phd
>>>> JVMDG303: JVM Requesting Java core file
>>>> JVMDG304: Java core file written to 
>>>> /gpfs/home/zzhang/swift/etc/javacore.20080827.142924.2957.txt
>>>> JVMDG274: Dump Handler has Processed OutOfMemory.
>>>> JVMST109: Insufficient space in Javaheap to satisfy allocation request
>>>>
>>>> _______________________________________________
>>>> Swift-devel mailing list
>>>> Swift-devel at ci.uchicago.edu
>>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>>>>     
>>>
>>> _______________________________________________
>>> Swift-devel mailing list
>>> Swift-devel at ci.uchicago.edu
>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>>>
>>>   
>>
>> -- 
>> ===================================================
>> Ioan Raicu
>> Ph.D. Candidate
>> ===================================================
>> Distributed Systems Laboratory
>> Computer Science Department
>> University of Chicago
>> 1100 E. 58th Street, Ryerson Hall
>> Chicago, IL 60637
>> ===================================================
>> Email: iraicu at cs.uchicago.edu
>> Web:   http://www.cs.uchicago.edu/~iraicu
>> http://dev.globus.org/wiki/Incubator/Falkon
>> http://dsl-wiki.cs.uchicago.edu/index.php/Main_Page
>> ===================================================
>> ===================================================
>>
>>   
>

-- 
===================================================
Ioan Raicu
Ph.D. Candidate
===================================================
Distributed Systems Laboratory
Computer Science Department
University of Chicago
1100 E. 58th Street, Ryerson Hall
Chicago, IL 60637
===================================================
Email: iraicu at cs.uchicago.edu
Web:   http://www.cs.uchicago.edu/~iraicu
http://dev.globus.org/wiki/Incubator/Falkon
http://dsl-wiki.cs.uchicago.edu/index.php/Main_Page
===================================================
===================================================