2011/11/29 Gong Ding <span dir="ltr"><<a href="mailto:gdiso@ustc.edu">gdiso@ustc.edu</a>></span><br><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
Hi,<br>
I meet some very strange problem on AIX6.1 with IBM POE.<br>
<br>
When I start the simulation with 3 or more processors, the following error will occure.<br>
Fatal Error: at line 71 in /gpfs1/cogenda/cogenda/packages/petsc/include/../src/vec/vec/utils/vpscat.h<br>
One or two processors are ok.<br>
<br>
However, when I start my code with -vecscatter_window to avoid the MPI_Startall_irecv call of line 71, everything is ok.<br>
<br>
Some information:<br>
The petsc is configured with<br>
--known-level1-dcache-size=32768 --known-level1-dcache-linesize=32 --known-level1-dcache-assoc=2 --known-memcmp-ok=1 --known-endian=big --known-sizeof-char=1<br>
--known-sizeof-void-p=8 --known-sizeof-short=2 --known-sizeof-int=4 --known-sizeof-long=8 --known-sizeof-long-long=8 --known-sizeof-float=4 --known-sizeof-double=8 --known-sizeof-size_t=8 --known-bits-per-byte=8 --known-sizeof-MPI_Comm=4 --known-sizeof-MPI_Fint=4 --known-mpi-long-double=1 --download-f-blas-lapack=1<br>
--download-mumps=1 --download-blacs=1 --download-parmetis=1 --download-scalapack=1 --download-superlu=1 --with-debugging=0 --with-clanguage=cxx<br>
--with-cc=\"mpcc_r -q64\" --with-fc=\"mpxlf_r -q64\" --with-cxx=\"mpCC_r -q64\" --with-batch=1 --with-shared-libraries=1 --known-mpi-shared-libraries=1<br>
--with-x=0 --with-pic=1<br>
<br>
And I add<br>
#ifndef PETSC_HAVE_MPI_MISSING_TYPESIZE<br>
#define PETSC_HAVE_MPI_MISSING_TYPESIZE<br>
#endif<br>
to petscconf.h for avoiding some mpi compile problem.<br>
<br>
Does anyone meet this problem?<br>
<br>
If I have to use this workaround, how to I add -vecscatter_window in the code instead in command line?</blockquote><div><br></div><div>PetscOptionSetValue('-vecscatter_window', '1')</div><div><br></div><div>
Matt</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><font color="#888888"><br>
Gong Ding<br>
<br>
</font></blockquote></div><br><br clear="all"><div><br></div>-- <br>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>
-- Norbert Wiener<br>