<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><br style="font-size: 14px; "><div style="font-size: 14px; "><div>Le 10 janv. 2012 à 00:52, Dave Goodell a écrit :</div><br class="Apple-interchange-newline"><blockquote type="cite"><span class="Apple-style-span" style="border-collapse: separate; font-family: Courier; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; ">Make sure you include a call to MPI_Finalize in your test program as well.<br><br>-Dave</span></blockquote></div><div style="font-size: 14px; "><br></div><div style="font-size: 14px; ">I'm afraid that not the problem</div><div style="font-size: 14px; "><br></div><div style="font-size: 14px; ">The question is that there is a limitation in mpich2 software or more probably in my OS|Machine, but I can't find it ?</div><div style="font-size: 14px; ">there is clearly a limit at 152 tasks even after getting rid of limits (*), and increasing shared memory values (**)</div><div style="font-size: 14px; "><br></div><div style="font-size: 14px; "> >mpiexec -genvall -profile -np 152 bin/my_test (my_test = MPI_Init + MPI_Finalize)</div><div style="font-size: 14px; "><br></div><div style="font-size: 14px; ">================================================================================</div><div style="font-size: 14px; ">[mpiexec@ccdvli10] Number of PMI calls seen by the server: 306</div><div style="font-size: 14px; ">================================================================================</div><div style="font-size: 14px; "><br></div><div style="font-size: 14px; "> >mpiexec -genvall -profile -np 153 bin/my_test</div><div style="font-size: 14px; ">Assertion failed in file /scratch/BC/mpich2-1.4.1p1/src/util/wrappers/mpiu_shm_wrappers.h at line 889: seg_sz > 0</div><div style="font-size: 14px; ">internal ABORT - process 0</div><div style="font-size: 14px; ">[proxy:0:0@ccdvli10] send_cmd_downstream (./pm/pmiserv/pmip_pmi_v1.c:80): assert (!closed) failed</div><div style="font-size: 14px; ">[proxy:0:0@ccdvli10] fn_get (./pm/pmiserv/pmip_pmi_v1.c:349): error sending PMI response</div><div style="font-size: 14px; ">[proxy:0:0@ccdvli10] pmi_cb (./pm/pmiserv/pmip_cb.c:327): PMI handler returned error</div><div style="font-size: 14px; ">[proxy:0:0@ccdvli10] HYDT_dmxu_poll_wait_for_event (./tools/demux/demux_poll.c:77): callback returned error status</div><div style="font-size: 14px; ">[proxy:0:0@ccdvli10] main (./pm/pmiserv/pmip.c:226): demux engine error waiting for event</div><div style="font-size: 14px; ">[mpiexec@ccdvli10] control_cb (./pm/pmiserv/pmiserv_cb.c:215): assert (!closed) failed</div><div style="font-size: 14px; ">[mpiexec@ccdvli10] HYDT_dmxu_poll_wait_for_event (./tools/demux/demux_poll.c:77): callback returned error status</div><div style="font-size: 14px; ">[mpiexec@ccdvli10] HYD_pmci_wait_for_completion (./pm/pmiserv/pmiserv_pmci.c:181): error waiting for event</div><div style="font-size: 14px; ">[mpiexec@ccdvli10] main (./ui/mpich/mpiexec.c:405): process manager error waiting for completion</div><div style="font-size: 14px; "><br></div><div style="font-size: 14px; "><br></div><div style="font-size: 14px; ">(*)</div><div style="font-size: 14px; "><div>>limit</div><div>cputime unlimited</div><div>filesize unlimited</div><div>datasize unlimited</div><div>stacksize unlimited</div><div>coredumpsize unlimited</div><div>memoryuse unlimited</div><div>vmemoryuse unlimited</div><div>descriptors 1000000 </div><div>memorylocked unlimited</div><div>maxproc 409600 </div><div><br></div><div>(**)</div><div><br></div><div><div>>sysctl -A | grep kernel.sh</div><div>kernel.shmmni = 16000</div><div>kernel.shmall = 8388608000</div><div>kernel.shmmax = 33554432</div></div><div><br></div><div><br></div><div><br></div><div>Best regards</div></div><div style="font-size: 14px; ">
<div><div><div><div><div>---------------<br>Bernard CHAMBON<br>IN2P3 / CNRS<br>04 72 69 42 18<br></div></div></div></div></div>
</div>
<br style="font-size: 14px; "></body></html>