<div dir="ltr">Hi,<div><br></div><div>I had a similar problem once. Changing mpiexec to mpiexec.mpich2 in the nekbmpi script solved it as far as I was concerned. Might be a similar problem?</div><div><br></div><div>Cheers,</div>
<div>JC</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2014-02-28 17:15 GMT+01:00 <span dir="ltr"><<a href="mailto:nek5000-users@lists.mcs.anl.gov" target="_blank">nek5000-users@lists.mcs.anl.gov</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Dear Nek’s <br><br>I have a problem when running the code on more than one processor. The problem just appeared after a recent update of the system (debian) on our cluster. The code was working perfectly before the update but now I cannot run jobs in parallel anymore. MPI works with other softwares, but not with NEK. In particular I have the following problem:<br>
<br>When I execute a parallel run using the script nekmpi eddy_uv 4 <br><br>the command execute 4 different jobs running on a single processor rather than a single job running on 4 processors. I attach the log to this mail (log.out) . After a few second three jobs are killed and only one remains active. A similar problem was also found on a new machine with a fresh installation of debian. It seems that the scripts is not able to set the correct value of the variable np (or_np).<br>
Anyone found a similar problem ? Any explanation for such behavior ? Any advice to solve the problem ? <br><br>Thanks in advance <br><br><br>Flavio<br><br><br></div><br><div style="word-wrap:break-word"></div><br><div style="word-wrap:break-word">
</div><br><div style="word-wrap:break-word"></div><br><div style="word-wrap:break-word"><div><br></div><div><br></div><div>Platform</div><div>uname -a</div><div><div style="margin:0px;font-size:11px;font-family:Menlo">Linux cfd 2.6.32-5-amd64 #1 SMP Mon Sep 23 22:14:43 UTC 2013 x86_64 GNU/Linux</div>
</div><div style="margin:0px;font-size:11px;font-family:Menlo"><br></div><div style="margin:0px;font-size:11px;font-family:Menlo"><br></div><div style="margin:0px;font-size:11px;font-family:Menlo"><br></div><div style="margin:0px;font-size:11px;font-family:Menlo">
<br></div><div style="margin:0px;font-size:11px;font-family:Menlo"><br></div><div style="margin:0px;font-size:11px;font-family:Menlo"><br></div><div style="margin:0px;font-size:11px;font-family:Menlo"><div style="margin:0px">
ompi_info</div><div style="margin:0px"> Package: Open MPI manuel@ce170155 Distribution</div><div style="margin:0px"> Open MPI: 1.4.2</div><div style="margin:0px"> Open MPI SVN revision: r23093</div>
<div style="margin:0px"> Open MPI release date: May 04, 2010</div><div style="margin:0px"> Open RTE: 1.4.2</div><div style="margin:0px"> Open RTE SVN revision: r23093</div><div style="margin:0px"> Open RTE release date: May 04, 2010</div>
<div style="margin:0px"> OPAL: 1.4.2</div><div style="margin:0px"> OPAL SVN revision: r23093</div><div style="margin:0px"> OPAL release date: May 04, 2010</div><div style="margin:0px"> Ident string: 1.4.2</div>
<div style="margin:0px"> Prefix: /usr</div><div style="margin:0px"> Configured architecture: x86_64-pc-linux-gnu</div><div style="margin:0px"> Configure host: ce170155</div><div style="margin:0px">
Configured by: manuel</div><div style="margin:0px"> Configured on: Wed Sep 1 15:58:32 UTC 2010</div><div style="margin:0px"> Configure host: ce170155</div><div style="margin:0px"> Built by: root</div>
<div style="margin:0px"> Built on: Wed Sep 1 16:01:42 UTC 2010</div><div style="margin:0px"> Built host: ce170155</div><div style="margin:0px"> C bindings: yes</div><div style="margin:0px">
C++ bindings: yes</div><div style="margin:0px"> Fortran77 bindings: yes (all)</div><div style="margin:0px"> Fortran90 bindings: yes</div><div style="margin:0px"> Fortran90 bindings size: small</div>
<div style="margin:0px">
C compiler: gcc</div><div style="margin:0px"> C compiler absolute: /usr/lib/ccache/gcc</div><div style="margin:0px"> C++ compiler: g++</div><div style="margin:0px"> C++ compiler absolute: /usr/lib/ccache/g++</div>
<div style="margin:0px"> Fortran77 compiler: gfortran</div><div style="margin:0px"> Fortran77 compiler abs: /usr/bin/gfortran</div><div style="margin:0px"> Fortran90 compiler: gfortran</div><div style="margin:0px">
Fortran90 compiler abs: /usr/bin/gfortran</div><div style="margin:0px"> C profiling: yes</div><div style="margin:0px"> C++ profiling: yes</div><div style="margin:0px"> Fortran77 profiling: yes</div>
<div style="margin:0px"> Fortran90 profiling: yes</div><div style="margin:0px"> C++ exceptions: no</div><div style="margin:0px"> Thread support: posix (mpi: no, progress: no)</div><div style="margin:0px">
Sparse Groups: no</div><div style="margin:0px"> Internal debug support: no</div><div style="margin:0px"> MPI parameter check: runtime</div><div style="margin:0px">Memory profiling support: no</div><div style="margin:0px">
Memory debugging support: no</div><div style="margin:0px"> libltdl support: yes</div><div style="margin:0px"> Heterogeneous support: yes</div><div style="margin:0px"> mpirun default --prefix: no</div><div style="margin:0px">
MPI I/O support: yes</div><div style="margin:0px"> MPI_WTIME support: gettimeofday</div><div style="margin:0px">Symbol visibility support: yes</div><div style="margin:0px"> FT Checkpoint support: yes (checkpoint thread: no)</div>
<div style="margin:0px"> MCA backtrace: execinfo (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA memory: ptmalloc2 (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA paffinity: linux (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA carto: auto_detect (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA carto: file (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA maffinity: first_use (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA maffinity: libnuma (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA timer: linux (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA installdirs: env (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA installdirs: config (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA crs: none (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA dpm: orte (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA pubsub: orte (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA allocator: basic (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA allocator: bucket (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA coll: basic (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA coll: hierarch (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA coll: inter (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA coll: self (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA coll: sm (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA coll: sync (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA coll: tuned (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA io: romio (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA mpool: fake (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA mpool: rdma (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA mpool: sm (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA pml: cm (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA pml: crcpw (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA pml: csum (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA pml: ob1 (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA pml: v (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA bml: r2 (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA rcache: vma (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA btl: ofud (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA btl: openib (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA btl: self (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA btl: sm (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA btl: tcp (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA topo: unity (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA osc: pt2pt (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA osc: rdma (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA crcp: bkmrk (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA iof: hnp (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA iof: orted (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA iof: tool (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA oob: tcp (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA odls: default (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA ras: slurm (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA ras: tm (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA rmaps: load_balance (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA rmaps: rank_file (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA rmaps: round_robin (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA rmaps: seq (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA rml: ftrm (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA rml: oob (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA routed: binomial (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA routed: direct (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA routed: linear (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA plm: rsh (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA plm: slurm (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA plm: tm (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA snapc: full (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA filem: rsh (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA errmgr: default (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA ess: env (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA ess: hnp (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA ess: singleton (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA ess: slurm (MCA v2.0, API v2.0, Component v1.4.2)</div>
<div style="margin:0px"> MCA ess: tool (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px"> MCA grpcomm: bad (MCA v2.0, API v2.0, Component v1.4.2)</div><div style="margin:0px">
MCA grpcomm: basic (MCA v2.0, API v2.0, Component v1.4.2)</div></div></div><br>_______________________________________________<br>
Nek5000-users mailing list<br>
<a href="mailto:Nek5000-users@lists.mcs.anl.gov">Nek5000-users@lists.mcs.anl.gov</a><br>
<a href="https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users" target="_blank">https://lists.mcs.anl.gov/mailman/listinfo/nek5000-users</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr">Jean-Christophe Loiseau<br><a href="https://sites.google.com/site/loiseaujc/" target="_blank">Homepage</a><br></div>
</div>