<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div></div><div>This looks like a bug. </div><div>Can you try with the latest version and run genmap again (this will produce a .ma2 file). Make sure you have just a .ma2 and no .map in your case directory.</div><div><br></div><div>If this works I have to check why the old .map doesn’t.</div><div><br></div><div>Stefan</div><div><br>On 22 Sep 2017, at 13:56, "<a href="mailto:nek5000-users@lists.mcs.anl.gov">nek5000-users@lists.mcs.anl.gov</a>" <<a href="mailto:nek5000-users@lists.mcs.anl.gov">nek5000-users@lists.mcs.anl.gov</a>> wrote:<br><br></div><blockquote type="cite"><div>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Kopano HTML builder 1.0">
<title></title>
<!-- Converted from text/plain format -->
<p><font style="font-family: courier" size="2">
Stefan,<br>
<br>
below is the log file of the run:<br>
<br>
| _ __ ______ __ __ ______ ____ ____ ____ |<br>
| / | / // ____// //_/ / ____/ / __ \\/ __ \\/ __ \\ |<br>
| / |/ // __/ / ,< /___ \\ / / / // / / // / / / |<br>
| / /| // /___ / /| | ____/ / / /_/ // /_/ // /_/ / |<br>
| /_/ |_//_____//_/ |_|/_____/ \\___/ \\___/ \\___/ |<br>
| |<br>
|----------------------------------------------------------|<br>
| |<br>
| NEK5000: Open Source Spectral Element Solver |<br>
| COPYRIGHT (c) 2008-2017 UCHICAGO ARGONNE, LLC |<br>
| Version: 17.0.0-dev |<br>
| Web: <a href="http://nek5000.mcs.anl.gov">http://nek5000.mcs.anl.gov</a> |<br>
| |<br>
\\----------------------------------------------------------/<br>
<br>
<br>
Number of processors: 1024<br>
REAL wdsize : 8<br>
INTEGER wdsize : 4<br>
Timer accuracy : 9.54E-08<br>
<br>
Reading /home/mxd/Nek5000/run/actasys/3d-model/actuatorA.rea<br>
Switch on stress formulation to support PN/PN and IFUSERVP=T<br>
Reading /home/mxd/Nek5000/run/actasys/3d-model/actuatorA.re2<br>
mapping elements to processors<br>
Reading /home/mxd/Nek5000/run/actasys/3d-model/actuatorA.map<br>
<br>
I run my case with 1024 processors as suggested by Paul. The run hung for two hours before reaching the wall time.<br>
<br>
Marco<br>
> On Sep 22, 2017, at 3:09 AM, <a href="mailto:nek5000-users@lists.mcs.anl.gov">nek5000-users@lists.mcs.anl.gov</a> wrote:<br>
> <br>
> Marco,<br>
> <br>
> can you please post your logfile. What version of Nek5000 do you use?<br>
> <br>
> Cheers,<br>
> Stefan<br>
> <br>
> -----Original message-----<br>
>> From:<a href="mailto:nek5000-users@lists.mcs.anl.gov">nek5000-users@lists.mcs.anl.gov</a> <<a href="mailto:nek5000-users@lists.mcs.anl.gov">nek5000-users@lists.mcs.anl.gov</a>><br>
>> Sent: Friday 22nd September 2017 2:40<br>
>> To: <a href="mailto:nek5000-users@lists.mcs.anl.gov">nek5000-users@lists.mcs.anl.gov</a><br>
>> Subject: Re: [Nek5000-users] Simulation hanging at 'mapping elements to processors'<br>
>> <br>
>> Hi Paul,<br>
>> <br class="" /><br>
>> thanks for the help. I will give it a try tomorrow. I am indeed using the XXT coarse grid solver.<br>
>> <br class="" /><br>
>> Marco<br>
>> <br class="" /><br>
>> On Sep 21, 2017, at 6:49 PM, <br>
>> <a href="mailto:nek5000-users@lists.mcs.anl.gov">nek5000-users@lists.mcs.anl.gov</a> <<a href="mailto:nek5000-users@lists.mcs.anl.gov">mailto:nek5000-users@lists.mcs.anl.gov</a>> <<a href="mailto:Nek5000-users@lists.mcs.anl.gov">Nek5000-users@lists.mcs.anl.gov</a> <<a href="mailto:Nek5000-users@lists.mcs.anl.gov">mailto:Nek5000-users@lists.mcs.anl.gov</a>>> wrote:<br>
>> <br class="Apple-interchange-newline" /><br>
>> <br class="Apple-interchange-newline" /><br>
>> Hi Marco,<br>
>> <br class="" /><br>
>> I'm not 100 % about the hanging point, but I suggest - especially for larger problems like this - running on a power of 2 processors (i.e., 1024 in your case).<br>
>> <br class="" /><br>
>> This is particularly critical for performance when the XXT (default) coarse grid solver is used. Less so, perhaps, for the AMG coarse solver...I'm assuming you're using the XXT one - but not certain.<br>
>> <br class="" /><br>
>> Best,<br>
>> <br class="" /><br>
>> Paul<br>
>> <br class="" /><br>
>> -----------<br>
>> From: Nek5000-users <<a href="mailto:nek5000-users-bounces@lists.mcs.anl.gov">nek5000-users-bounces@lists.mcs.anl.gov</a> <<a href="mailto:nek5000-users-bounces@lists.mcs.anl.gov">mailto:nek5000-users-bounces@lists.mcs.anl.gov</a>>><br>
>> on behalf of <a href="mailto:nek5000-users@lists.mcs.anl.gov">nek5000-users@lists.mcs.anl.gov</a> <<a href="mailto:nek5000-users@lists.mcs.anl.gov">mailto:nek5000-users@lists.mcs.anl.gov</a>> <<a href="mailto:nek5000-users@lists.mcs.anl.gov">nek5000-users@lists.mcs.anl.gov</a> <<a href="mailto:nek5000-users@lists.mcs.anl.gov">mailto:nek5000-users@lists.mcs.anl.gov</a>>><br class="" /><br>
>> Sent: Thursday, September 21, 2017 3:37:55 PM<br class="" /><br>
>> To: <a href="mailto:Nek5000-users@lists.mcs.anl.gov">Nek5000-users@lists.mcs.anl.gov</a> <<a href="mailto:Nek5000-users@lists.mcs.anl.gov">mailto:Nek5000-users@lists.mcs.anl.gov</a>><br class="" /><br>
>> Subject: [Nek5000-users] Simulation hanging at 'mapping elements to processors'<br>
>> Hello,<br class="" /><br>
>> <br class="" /><br>
>> I am trying to run a simulation that has ~500,000 elements on 1280 processors with lx1=4 for debugging purposes. My simulation hangs after outputting 'mapping elements to processors’. I generated the mesh with Cubit and then used the exo2nek script to get the<br>
>> re2 file. Genmap runs fine on the re2 file.<br class="" /><br>
>> <br class="" /><br>
>> I was wondering if this problem has been encountered in the past, and what I could do to fix it.<br class="" /><br>
>> <br class="" /><br>
>> Thanks,<br class="" /><br>
>> Marco<br class="" /><br>
>> <br class="" /><br>
>> _______________________________________________<br class="" /><br>
>> Nek5000-users mailing list<br class="" /><br>
>> <a href="mailto:Nek5000-users@lists.mcs.anl.gov">Nek5000-users@lists.mcs.anl.gov</a> <<a href="mailto:Nek5000-users@lists.mcs.anl.gov">mailto:Nek5000-users@lists.mcs.anl.gov</a>><br class="" /><br>
>> <a href="https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users">https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users</a> <<a href="https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users">https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users</a>><br class="" /><br>
>> _______________________________________________<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="" /><br>
>> Nek5000-users<br>
>> mailing list<br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="" /><br>
>> <a href="mailto:Nek5000-users@lists.mcs.anl.gov">Nek5000-users@lists.mcs.anl.gov</a> <<a href="mailto:Nek5000-users@lists.mcs.anl.gov">mailto:Nek5000-users@lists.mcs.anl.gov</a>><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="" /><br>
>> <a href="https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users">https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users</a> <<a href="https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users">https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users</a>><br class="" /><br>
>> _______________________________________________<br>
>> Nek5000-users mailing list<br>
>> <a href="mailto:Nek5000-users@lists.mcs.anl.gov">Nek5000-users@lists.mcs.anl.gov</a><br>
>> <a href="https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users">https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users</a><br>
> _______________________________________________<br>
> Nek5000-users mailing list<br>
> <a href="mailto:Nek5000-users@lists.mcs.anl.gov">Nek5000-users@lists.mcs.anl.gov</a><br>
> <a href="https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users">https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users</a><br>
<br>
_______________________________________________<br>
Nek5000-users mailing list<br>
<a href="mailto:Nek5000-users@lists.mcs.anl.gov">Nek5000-users@lists.mcs.anl.gov</a><br>
<a href="https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users">https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users</a><br>
</font>
</p>
</div></blockquote></body></html>