<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">Dear Ambrish,</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">Postnek will certainly fail -- it is a serial code. You will need to use</p>
<p style="margin-top:0;margin-bottom:0">VisIt (or something comparable) for parallel post-processing.</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">Also, as a matter of course, I strongly recommend starting out with</p>
<p style="margin-top:0;margin-bottom:0">10^4--10^5 elements and running your simulation at lower Reynolds</p>
<p style="margin-top:0;margin-bottom:0">number to go through all steps of the workflow. Then step up to 10^6.</p>
<p style="margin-top:0;margin-bottom:0">Only after that would I consider > 10^7.</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">As I say, you'll be in record territory at that point and thus completely</p>
<p style="margin-top:0;margin-bottom:0">on your own w.r.t. to support. Only a few of our most experienced</p>
<p style="margin-top:0;margin-bottom:0">users have pushed to that high of resolution. If I were tackling the problem</p>
<p style="margin-top:0;margin-bottom:0">you are attempting I would most definitely take these smaller steps first.</p>
<p style="margin-top:0;margin-bottom:0">They take no time and provide a chance to fully debug the whole process,</p>
<p style="margin-top:0;margin-bottom:0">including forcing conditions, boundary conditions, etc. Since they will</p>
<p style="margin-top:0;margin-bottom:0">run a 100 times faster, it make sense to gain insight in this way.</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">hth,</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">Paul</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
</div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Nek5000-users <nek5000-users-bounces@lists.mcs.anl.gov> on behalf of nek5000-users@lists.mcs.anl.gov <nek5000-users@lists.mcs.anl.gov><br>
<b>Sent:</b> Friday, July 13, 2018 12:15:38 PM<br>
<b>To:</b> nek5000-users@lists.mcs.anl.gov<br>
<b>Subject:</b> Re: [Nek5000-users] Getting Error when compiling a large problem</font>
<div> </div>
</div>
<meta content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div id="x_divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Arial,Helvetica,sans-serif">
<p>Dear Paul, <br>
</p>
<p><br>
</p>
<p>Thanks a lot for your prompt response. <br>
</p>
<p></p>
<div><br>
I am trying to generate the grid with 642*642*42 elements. And most probably I have to go to lx1 = 10 or 12. So the problem size will be something like 6400*6400*420. I will have to use 32768 or 65536 cores on SuperMUC.
<br>
</div>
<div><br>
</div>
<div>I generated this grid with earlier version of Nek (svn), and had to change MAXNEL in genbox and genmap directories.
<br>
</div>
<div><br>
</div>
<div>In the new version, it appears that changing MAXNEL in maketools enforces this value everywhere.
<br>
</div>
<br>
<p></p>
<p>I am getting error in the postnek. Prenek appears to have compiled. <br>
</p>
<p><br>
</p>
<p>The error is as follows:</p>
<p><br>
</p>
<p></p>
<div><i>/usr/app-soft/intel/v2017/bin/ifort -o /usr/wrk/people6/ampa9999/Nek_v17/Nek5000/bin/postx postnek.o postnek2.o postnek3.o postnek5.o postnek6.o tsort.o postnek8.o postnek9.o plot.o getfld.o legend.o userf.o revert.o trap.o animate.o genxyz.o screen.o
g3d.o subs.o xinterface.o locglob.o postnek5a.o blas.o xdriver.o scrdmp.o coef.o postnek7.o speclib.o mxm.o byte.o ssyev.o iolib.o -L/usr/lib/X11 -lX11 -lm<br>
make[1]: Leaving directory `/usr/wrk/people6/ampa9999/Nek_v17/Nek5000/tools/postnek'<br>
<br>
ERROR: postnek failed to compile!</i></div>
<br>
<p></p>
<div id="x_Signature">
<div id="x_divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Arial,Helvetica,sans-serif">
<div style="font-family:Tahoma; font-size:13px"><span style="font-size:11pt"></span><br>
<div class="x_BodyFragment"><font size="2"><span style="font-size:10pt">
<div class="x_PlainText"><br>
<br>
<br>
Dear Ambrish,<br>
<br>
<br>
What polynomial order are you using?<br>
<br>
How many processors?<br>
<br>
<br>
This seems like a very large number of elements (a record number).<br>
<br>
<br>
What resolution, in terms of grid points, are you targeting.<br>
<br>
<br>
Best,<br>
<br>
<br>
Paul<br>
<br>
<br>
<br>
<br>
<br>
Dear Nek Users,<br>
<br>
<br>
I need to generate a rectangular grid with 17,310,888 elements. However, when I am changing MAXNEL in the maketools and recompiling, I am getting error. I am attaching the compilation output and my maketools file here. Could you please help me regarding that?
Compilation works fine for MAXNEL=4,000,000.<br>
<br>
Thanks in advance for your help.<br>
<br>
<br>
With best regards,<br>
Ambrish<br>
<br>
<br>
What tools failed? I guess prenek and postnek??<br>
<br>
On 13 Jul 2018, at 17:19, "nek5000-users@lists.mcs.anl.gov <<a href="mailto:nek5000-users@lists.mcs.anl.gov">mailto:nek5000-users@lists.mcs.anl.gov</a>> " <nek5000-users@lists.mcs.anl.gov <<a href="mailto:nek5000-users@lists.mcs.anl.gov">mailto:nek5000-users@lists.mcs.anl.gov</a>>
> wrote:<br>
<br>
<br>
<br>
<br>
</div>
</span></font></div>
</div>
</div>
</div>
<div style="color:rgb(0,0,0)"><font size="2"><span style="font-size:10pt"></span></font></div>
</div>
</div>
</body>
</html>