<html><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue-Light, Helvetica Neue Light, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:13px"><div class="" style=""><span class="" style="">Did all your tests pass?</span></div><div class="" style="color: rgb(0, 0, 0); font-size: 13px; font-family: HelveticaNeue-Light, 'Helvetica Neue Light', 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif; background-color: transparent; font-style: normal;"><span class="" style="">Are you building hdf5 with mpi support?</span></div><div class="" style="color: rgb(0, 0, 0); font-size: 13px; font-family: HelveticaNeue-Light, 'Helvetica Neue Light', 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif; background-color: transparent; font-style: normal;"><span class="" style="">This could be because due to serial hdf5. I see you have:</span></div><div class="" style="color: rgb(0, 0, 0); font-size:
 13px; font-family: HelveticaNeue-Light, 'Helvetica Neue Light', 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif; background-color: transparent; font-style: normal;"><span class="" style=""><em style="font-family: 'Times New Roman'; font-size: 16px;" class="">FAIL: parallel_hdf5_test                 </em><br class="" style=""></span></div><div class="" style="color: rgb(0, 0, 0); font-size: 13px; font-family: HelveticaNeue-Light, 'Helvetica Neue Light', 'Helvetica Neue', Helvetica, Arial, 'Lucida Grande', sans-serif; background-color: transparent; font-style: normal;"> <br></div><div class="" style="">Rajeev Jain <br class="" style="">630-252-3176 / 630-252-5986 (fax)<br class="" style="">jain@mcs.anl.gov </div><div class="qtdSeparateBR"><br><br></div><div class="yahoo_quoted" style="display: block;"> <div style="font-family: HelveticaNeue-Light, Helvetica Neue Light, Helvetica
 Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 13px;" class=""> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;" class=""> <div dir="ltr" class="" style=""> <font size="2" face="Arial" class="" style=""> On Monday, October 27, 2014 12:24 PM, "Grindeanu, Iulian R." <iulian@mcs.anl.gov> wrote:<br class="" style=""> </font> </div>  <br class="" style=""><br class="" style=""> <div class="" style=""><div id="yiv8014022772" class="" style="">

 
<style type="text/css" class="" style="">
<!--
#yiv8014022772 p
        {margin-top:0;margin-bottom:0;}
#yiv8014022772 p
        {margin-top:0;margin-bottom:0;}
#yiv8014022772 p
        {margin-top:0;margin-bottom:0;}
-->
</style><style type="text/css" class="" style="">#yiv8014022772 P {margin-top:0;margin-bottom:0;}</style>

<div dir="ltr" class="" style="">
<div style="direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt;" class="">Hi Friedrich,<br class="" style="">
<br class="" style="">
What are you trying to do? <br class="" style="">
Rajeev and Vijay have experience running / building nek5000 with moab.<br class="" style="">
<br class="" style="">
Iulian<br class="" style="">
<div style="font-family:Times New Roman;color:#000000;font-size:16px;" class="">
<hr tabindex="-1" class="" style="">
<div style="direction:ltr;" id="yiv8014022772divRpF943484" class=""><font size="2" color="#000000" face="Tahoma" class="" style=""><b class="" style="">From:</b> Grabner, Friedrich [F.M.Grabner@warwick.ac.uk]<br class="" style="">
<b class="" style="">Sent:</b> Monday, October 27, 2014 12:17 PM<br class="" style="">
<b class="" style="">To:</b> Grindeanu, Iulian R.<br class="" style="">
<b class="" style="">Subject:</b> Re: Parallel Test Failure<br class="" style="">
</font><br class="" style="">
</div>
<div class="" style=""></div>
<div class="" style="">
<div class="" style="">Hi Iulian,</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">I have managed to install it although I believe there is some issue when installing on hpc.</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">However now when I try to run my moab enabled nek5000 I can only do so if I secure my resources on the system and then manually start my job.
</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style=""><i class="" style="">nekmpi [casename] [np]</i><br class="" style="">
</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">When I submit a job to the queue I receive the following error:</div>
<div class="" style=""><i class="" style=""></i><br class="" style="">
<i class="" style="">-bash: BASH_FUNC_module(): line 0: syntax error near unexpected token `)'</i><br class="" style="">
<i class="" style="">-bash: BASH_FUNC_module(): line 0: `BASH_FUNC_module() () {  eval $($LMOD_CMD bash "$@");'</i><br class="" style="">
<i class="" style="">-bash: error importing function definition for `BASH_FUNC_module'</i><br class="" style="">
<i class="" style="">/home/eng/esumgy/.bashrc: line 29: module: command not found</i><br class="" style="">
<i class="" style="">mv: cannot stat `pipe.log.8': No such file or directory</i><br class="" style="">
<i class="" style="">mv: cannot stat `pipe.sch': No such file or directory</i><br class="" style="">
<i class="" style="">node6.1259Error re-mmapping shared memory: Cannot allocate memory (err=9)</i><br class="" style="">
<i class="" style="">node6.1259Error re-mmapping shared memory: Cannot allocate memory</i><br class="" style="">
<i class="" style="">[node6:01259] Open MPI detected an unexpected PSM error in opening an endpoint: Error re-mmapping shared memory: Cannot allocate memory</i><br class="" style="">
<i class="" style="">--------------------------------------------------------------------------</i><br class="" style="">
<i class="" style="">mpiexec has exited due to process rank 5 with PID 1259 on</i><br class="" style="">
<i class="" style="">node node6 exiting without calling "finalize". This may</i><br class="" style="">
<i class="" style="">have caused other processes in the application to be</i><br class="" style="">
<i class="" style="">terminated by signals sent by mpiexec (as reported here).</i><br class="" style="">
<i class="" style="">--------------------------------------------------------------------------</i></div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">Could this be as I haven't correctly installed moab or any of it's prerequisites?</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">Regards Friedrich<br class="" style="">
</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style=""><br class="" style="">
</div>
<div dir="ltr" style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri, Arial, Helvetica, sans-serif;" class="">
<hr tabindex="-1" style="display:inline-block;width:98%;" class="">
<div id="yiv8014022772divRplyFwdMsg" dir="ltr" class="" style=""><font style="font-size:11pt;" color="#000000" face="Calibri, sans-serif" class=""><b class="" style="">From:</b> Grindeanu, Iulian R. <iulian@mcs.anl.gov><br class="" style="">
<b class="" style="">Sent:</b> 27 October 2014 16:54<br class="" style="">
<b class="" style="">To:</b> Grabner, Friedrich<br class="" style="">
<b class="" style="">Cc:</b> MOAB dev<br class="" style="">
<b class="" style="">Subject:</b> RE: Parallel Test Failure</font>
<div class="" style=""> </div>
</div>
<div class="" style="">
<div style="direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt;" class="">Hi Friedrich,<br class="" style="">
Thanks for your report.<br class="" style="">
 I could not reproduce your error, so I don't know what is going on.<br class="" style="">
Are these the only errors you see in your make check? <br class="" style="">
Can you try a newer version of moab, or hdf5?<br class="" style="">
<br class="" style="">
We have several nightly builds on our systems that resemble you configuration, for example this one:<br class="" style="">
<a rel="nofollow" target="_blank"  href="http://gnep.mcs.anl.gov:8010/builders/moab-par" class="" style="">http://gnep.mcs.anl.gov:8010/builders/moab-par</a><br class="" style="">
<br class="" style="">
more configurations are here:<br class="" style="">
<br class="" style="">
http://gnep.mcs.anl.gov:8010/waterfall?category=moab<br class="" style="">
<br class="" style="">
thanks,<br class="" style="">
Iulian<br class="" style="">
<br class="" style="">
<div style="font-family:Times New Roman;color:#000000;font-size:16px;" class="">
<hr tabindex="-1" class="" style="">
<div id="yiv8014022772divRpF805639" style="direction:ltr;" class=""><font size="2" color="#000000" face="Tahoma" class="" style=""><b class="" style="">From:</b> Grabner, Friedrich [F.M.Grabner@warwick.ac.uk]<br class="" style="">
<b class="" style="">Sent:</b> Friday, October 24, 2014 8:03 AM<br class="" style="">
<b class="" style="">To:</b> Grindeanu, Iulian R.<br class="" style="">
<b class="" style="">Subject:</b> Re: Parallel Test Failure<br class="" style="">
</font><br class="" style="">
</div>
<div class="" style=""></div>
<div class="" style="">
<div class="" style="">Hi Iulian,</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">See attached!</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">Friedrich<br class="" style="">
</div>
<div dir="ltr" style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri, Arial, Helvetica, sans-serif;" class="">
<hr tabindex="-1" style="display:inline-block;width:98%;" class="">
<div id="yiv8014022772divRplyFwdMsg" dir="ltr" class="" style=""><font style="font-size:11pt;" color="#000000" face="Calibri, sans-serif" class=""><b class="" style="">From:</b> Grindeanu, Iulian R. <iulian@mcs.anl.gov><br class="" style="">
<b class="" style="">Sent:</b> 24 October 2014 13:14<br class="" style="">
<b class="" style="">To:</b> Grabner, Friedrich; moab-announce@mcs.anl.gov<br class="" style="">
<b class="" style="">Subject:</b> RE: Parallel Test Failure</font>
<div class="" style=""> </div>
</div>
<div class="" style="">
<div style="direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt;" class="">can you send your config.log file?<br class="" style="">
Thanks,<br class="" style="">
Iulian<br class="" style="">
<br class="" style="">
<div style="font-family:Times New Roman;color:#000000;font-size:16px;" class="">
<hr tabindex="-1" class="" style="">
<div id="yiv8014022772divRpF384362" style="direction:ltr;" class=""><font size="2" color="#000000" face="Tahoma" class="" style=""><b class="" style="">From:</b> moab-announce-bounces@mcs.anl.gov [moab-announce-bounces@mcs.anl.gov] on behalf of Grabner, Friedrich [F.M.Grabner@warwick.ac.uk]<br class="" style="">
<b class="" style="">Sent:</b> Friday, October 24, 2014 4:22 AM<br class="" style="">
<b class="" style="">To:</b> moab-announce@mcs.anl.gov<br class="" style="">
<b class="" style="">Subject:</b> [MOAB-announce] Parallel Test Failure<br class="" style="">
</font><br class="" style="">
</div>
<div class="" style=""></div>
<div class="" style="">
<div class="" style="">Hi All,</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">I am trying to install moab-4.6.3 on my HPC system following the instructions on following webpage:</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style=""><a rel="nofollow" id="yiv8014022772lnk948719" target="_blank" href="http://trac.mcs.anl.gov/projects/ITAPS/wiki/BuildingAndUsingMOAB" class="" style="">http://trac.mcs.anl.gov/projects/ITAPS/wiki/BuildingAndUsingMOAB</a></div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">I have run everything exactly as specified on my desktop and successfully installed it however on hpc I receive error:</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style=""><i class="" style="">PASS:
 pcomm_unit                                                                                                                                                               &n
bsp;              </i><br class="" style="">
<i class="" style="">FAIL:
 parallel_unit_tests                                                                                                                                                             &nbsp
;       </i><br class="" style="">
<i class="" style="">PASS:
 uber_parallel_test                                                                                                                                                              
        </i><br class="" style="">
<i class="" style="">FAIL:
 scdtest                                                                                                                                                               &nbsp
;                 </i><br class="" style="">
<i class="" style="">PASS:
 pcomm_serial                                                                                                                                                               
             </i><br class="" style="">
<i class="" style="">PASS:
 par_spatial_locator_test                                                                                                                                                             
   </i><br class="" style="">
<i class="" style="">FAIL:
 parallel_hdf5_test                                                                                                                                                              
        </i><br class="" style="">
<i class="" style="">PASS:
 mhdf_parallel                                                                                                                                                              &nbsp
;            </i><br class="" style="">
<i class="" style="">PASS:
 parallel_write_test                                                                                                                                                             &nbsp
;       </i><br class="" style="">
<i class=""
 style="">================================                                                                                                                                                          &
nbsp;   </i><br class="" style="">
<i class="" style="">3 of 9 tests
 failed                                                                                                                                                                
           </i><br class="" style="">
<i class="" style="">See
 test/parallel/test-suite.log                                                                                                                                                            
  </i><br class="" style="">
<i class=""
 style="">================================                                                                                                                                                          &
nbsp;   </i><br class="" style="">
<i class="" style="">make[4]: *** [test-suite.log] Error 1                                                                                                                                                       
  </i><br class="" style="">
<i class="" style="">make[4]: Leaving directory `/gpfs/home/eng/esumgy/moab-4.6.3/test/parallel'                                                                                                                   </i><br class="" style="">
<i class="" style="">make[3]: *** [check-TESTS] Error
 2                                                                                                                                                            </i><br class="" style="">
<i class="" style="">make[3]: Leaving directory `/gpfs/home/eng/esumgy/moab-4.6.3/test/parallel'                                                                                                                   </i><br class="" style="">
<i class="" style="">make[2]: *** [check-am] Error
 2                                                                                                                                                               </i><br class=""
 style="">
<i class="" style="">make[2]: Leaving directory `/gpfs/home/eng/esumgy/moab-4.6.3/test/parallel'                                                                                                                   </i><br class="" style="">
<i class="" style="">make[1]: *** [check-recursive] Error 1                                                                                                                                                      
  </i><br class="" style="">
<i class="" style="">make[1]: Leaving directory `/gpfs/home/eng/esumgy/moab-4.6.3/test</i></div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">I have attached my <i class="" style="">test-suite.log </i>file.</div>
<div class="" style=""><br class="" style="">
</div>
<div class="" style="">Thanks in advance, Friedrich<br class="" style="">
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div><br class="" style=""><br class="" style=""></div>  </div> </div>  </div> </div></body></html>