<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p><br>
</p>
<p>Hi Jefferson,</p>
<p><br>
</p>
<p>What are lx1 and left set to in your SIZE file?</p>
<p><br>
</p>
<p>It's possible that you're running out of memory.</p>
<p><br>
</p>
<p>If you have, say, 16000 elements total, then you would only need lelt=2</p>
<p>to run on 8192 MPI ranks.</p>
<p><br>
</p>
<p>Note that we generally run with -c32 mode, 2 ranks per core, as this typically</p>
<p>makes better use of the same number of node hours.</p>
<p><br>
</p>
<p>Please let me know if this helps.</p>
<p><br>
</p>
<p>Thanks,</p>
<p>Paul</p>
<p><br>
</p>
</div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Nek5000-users <nek5000-users-bounces@lists.mcs.anl.gov> on behalf of nek5000-users@lists.mcs.anl.gov <nek5000-users@lists.mcs.anl.gov><br>
<b>Sent:</b> Monday, October 9, 2017 2:37:57 PM<br>
<b>To:</b> nek5000-users@lists.mcs.anl.gov<br>
<b>Subject:</b> [Nek5000-users] Issues running on Mira</font>
<div> </div>
</div>
<div>
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p></p>
<p>I'm currently attempting to run Nek5000 on the Argonne supercomputer (Mira) using 512 nodes, but if using all available cores (16 per node) the code seems to hang after some point. All attempts have been made with a run time of 1 hour. When running on 512
nodes with a single core on each node, the code runs fine. Is it possible that start-up for ~8000 cores takes more than an hour or is there something else that could be causing this issue? Note that we definitely have a sufficient number of elements to run
on ~8000 nodes.</p>
<p>Thanks,</p>
<p>Jefferson Davis</p>
<br>
<p></p>
</div>
</div>
</body>
</html>