<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" id="owaParaStyle"></style>
</head>
<body fpstyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">
<div><br>
</div>
Hi Ami,
<div><br>
</div>
<div>When you increase the processor count, you can recompile with a smaller lelt.</div>
<div><br>
</div>
<div>Suppose you have lelt=1000 and you go from P=64 to P=128. Then set lelt=500 and</div>
<div>recompile.</div>
<div><br>
</div>
<div>Make certain lelg >= 500*P and lp >= 128.</div>
<div><br>
</div>
<div>I would suggest lelg="big enough" (and an even number) and lp=32768.</div>
<div><br>
</div>
<div>Paul</div>
<div><br>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div id="divRpF196955" style="direction: ltr;"><font face="Tahoma" size="2" color="#000000"><b>From:</b> nek5000-users-bounces@lists.mcs.anl.gov [nek5000-users-bounces@lists.mcs.anl.gov] on behalf of nek5000-users@lists.mcs.anl.gov [nek5000-users@lists.mcs.anl.gov]<br>
<b>Sent:</b> Monday, November 10, 2014 5:05 AM<br>
<b>To:</b> nek5000-users@lists.mcs.anl.gov<br>
<b>Subject:</b> [Nek5000-users] problem with running nek5000 on supercomputers<br>
</font><br>
</div>
<div></div>
<div>
<div dir="ltr">
<div>
<div>
<div>Hi Neks,<br>
<br>
</div>
I am trying to run my simulation with nek5000 on supercomputers, the size of the problem is something like:
<pre> text data bss dec hex filename
2233955 187412 2554984280 2557405647 986ee9cf nek5000</pre>
</div>
I don't have any problem when I use 32~64 CPUs to run parallel on supercomputers, but once I go for more than 64 CPUs, I always get "allocation failed" error. I have tried to run on different supercomputer like as Gordon SDSC, OSC, TACC, but I got the same
type of error each time. I have checked the active memories, it seems for each of them memories have large unused portion. Does any one have any idea why when I increase the number of CPUs I get this allocation error?!<br>
</div>
<div><br>
</div>
Thank you,<br>
Ami<br>
</div>
</div>
</div>
</div>
</div>
</body>
</html>