<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">I see the error now. You should pass SUBSET_NONZERO_PATTERN as MatStructure argument to MatAXPY<div class="">DIFFERENT_NONZERO_PATTERN now triggers preallocation, and MATELEMENTAL does not support MatGetRow.<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Feb 27, 2019, at 3:59 PM, Marius Buerkle <<a href="mailto:mbuerkle@web.de" class="">mbuerkle@web.de</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class=""><div style="font-family: Verdana;font-size: 12.0px;" class=""><div class="">
<div class="">Here is the error message and please find an example attached. </div>
<div class="">thanks for the efforts !</div>
<div class=""> </div>
<div class="">[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------<br class="">
[0]PETSC ERROR: No support for this operation for this object type<br class="">
[0]PETSC ERROR: Mat type elemental<br class="">
[0]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.<br class="">
[0]PETSC ERROR: Petsc Development GIT revision: v3.10.3-1681-g73e1f9d014 GIT Date: 2019-02-24 19:52:00 +0100<br class="">
[0]PETSC ERROR: ./a.out on a named tono-hpc1 by marius Thu Feb 28 08:56:48 2019<br class="">
[0]PETSC ERROR: Configure options --prefix=/home/marius/prog/petsc/intel_openmpi_openmp_mkl_dbg_with_slepc --with-fortran-kernels=0 --with-64-bit-indices=0 --CC=mpicc --COPTFLAGS="-g -O0 -qopenmp -std=c11" --CXX=mpicxx --CXXOPTFLAGS="-g -O0 -qopenmp -std=c++14" --FC=mpif90 --FOPTFLAGS="-g -O0 -qopenmp -traceback " --with-mpi=1 --with-x=0 --download-parmetis=1 --download-metis=1 --download-superlu_dist=1 --download-superlu_dist-commit=93a9aa53142253f2a56891e09c6f950d250ae251 --download-superlu_dist-cmake-arguments=-Denable_openmp=TRUE --download-hwloc=1 --download-sowing=1 --with-openmp=0 --with-pthread=0 --download-elemental=1 --download-elemental-commit=de7b5bea1abf5f626b91582f742cf99e2e551bff --with-cxx-dialect=c++11 --with-scalar-type=complex --with-debugging=1 --with-valgrind=0 --with-blaslapack-lib=" -L/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_blacs_openmpi_lp64 -liomp5 -lpthread -lm -ldl" --with-scalapack-lib=" -L/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_blacs_openmpi_lp64 -liomp5 -lpthread -lm -ldl" --with-mkl_pardiso-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_cpardiso-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_sparse-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_sparse_optimize-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-valgrind=1<br class="">
[0]PETSC ERROR: #1 MatGetRow() line 570 in /home/marius/prog/petsc/git/petsc/src/mat/interface/matrix.c<br class="">
[0]PETSC ERROR: #2 MatAXPY_Basic_Preallocate() line 95 in /home/marius/prog/petsc/git/petsc/src/mat/utils/axpy.c<br class="">
[0]PETSC ERROR: #3 MatAXPY() line 51 in /home/marius/prog/petsc/git/petsc/src/mat/utils/axpy.c<br class="">
[1]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------<br class="">
[1]PETSC ERROR: No support for this operation for this object type<br class="">
[1]PETSC ERROR: Mat type elemental<br class="">
[1]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.<br class="">
[1]PETSC ERROR: Petsc Development GIT revision: v3.10.3-1681-g73e1f9d014 GIT Date: 2019-02-24 19:52:00 +0100<br class="">
[1]PETSC ERROR: ./a.out on a named tono-hpc1 by marius Thu Feb 28 08:56:48 2019<br class="">
[1]PETSC ERROR: Configure options --prefix=/home/marius/prog/petsc/intel_openmpi_openmp_mkl_dbg_with_slepc --with-fortran-kernels=0 --with-64-bit-indices=0 --CC=mpicc --COPTFLAGS="-g -O0 -qopenmp -std=c11" --CXX=mpicxx --CXXOPTFLAGS="-g -O0 -qopenmp -std=c++14" --FC=mpif90 --FOPTFLAGS="-g -O0 -qopenmp -traceback " --with-mpi=1 --with-x=0 --download-parmetis=1 --download-metis=1 --download-superlu_dist=1 --download-superlu_dist-commit=93a9aa53142253f2a56891e09c6f950d250ae251 --download-superlu_dist-cmake-arguments=-Denable_openmp=TRUE --download-hwloc=1 --download-sowing=1 --with-openmp=0 --with-pthread=0 --download-elemental=1 --download-elemental-commit=de7b5bea1abf5f626b91582f742cf99e2e551bff --with-cxx-dialect=c++11 --with-scalar-type=complex --with-debugging=1 --with-valgrind=0 --with-blaslapack-lib=" -L/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_blacs_openmpi_lp64 -liomp5 -lpthread -lm -ldl" --with-scalapack-lib=" -L/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_blacs_openmpi_lp64 -liomp5 -lpthread -lm -ldl" --with-mkl_pardiso-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_cpardiso-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_sparse-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_sparse_optimize-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-valgrind=1<br class="">
[1]PETSC ERROR: #1 MatGetRow() line 570 in /home/marius/prog/petsc/git/petsc/src/mat/interface/matrix.c<br class="">
[1]PETSC ERROR: #2 MatAXPY_Basic_Preallocate() line 95 in /home/marius/prog/petsc/git/petsc/src/mat/utils/axpy.c<br class="">
[1]PETSC ERROR: #3 MatAXPY() line 51 in /home/marius/prog/petsc/git/petsc/src/mat/utils/axpy.c<br class="">
[2]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------<br class="">
[2]PETSC ERROR: No support for this operation for this object type<br class="">
[2]PETSC ERROR: Mat type elemental<br class="">
[2]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.<br class="">
[2]PETSC ERROR: Petsc Development GIT revision: v3.10.3-1681-g73e1f9d014 GIT Date: 2019-02-24 19:52:00 +0100<br class="">
[2]PETSC ERROR: ./a.out on a named tono-hpc1 by marius Thu Feb 28 08:56:48 2019<br class="">
[2]PETSC ERROR: Configure options --prefix=/home/marius/prog/petsc/intel_openmpi_openmp_mkl_dbg_with_slepc --with-fortran-kernels=0 --with-64-bit-indices=0 --CC=mpicc --COPTFLAGS="-g -O0 -qopenmp -std=c11" --CXX=mpicxx --CXXOPTFLAGS="-g -O0 -qopenmp -std=c++14" --FC=mpif90 --FOPTFLAGS="-g -O0 -qopenmp -traceback " --with-mpi=1 --with-x=0 --download-parmetis=1 --download-metis=1 --download-superlu_dist=1 --download-superlu_dist-commit=93a9aa53142253f2a56891e09c6f950d250ae251 --download-superlu_dist-cmake-arguments=-Denable_openmp=TRUE --download-hwloc=1 --download-sowing=1 --with-openmp=0 --with-pthread=0 --download-elemental=1 --download-elemental-commit=de7b5bea1abf5f626b91582f742cf99e2e551bff --with-cxx-dialect=c++11 --with-scalar-type=complex --with-debugging=1 --with-valgrind=0 --with-blaslapack-lib=" -L/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_blacs_openmpi_lp64 -liomp5 -lpthread -lm -ldl" --with-scalapack-lib=" -L/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_blacs_openmpi_lp64 -liomp5 -lpthread -lm -ldl" --with-mkl_pardiso-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_cpardiso-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_sparse-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_sparse_optimize-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-valgrind=1<br class="">
[2]PETSC ERROR: #1 MatGetRow() line 570 in /home/marius/prog/petsc/git/petsc/src/mat/interface/matrix.c<br class="">
[2]PETSC ERROR: #2 MatAXPY_Basic_Preallocate() line 95 in /home/marius/prog/petsc/git/petsc/src/mat/utils/axpy.c<br class="">
[2]PETSC ERROR: #3 MatAXPY() line 51 in /home/marius/prog/petsc/git/petsc/src/mat/utils/axpy.c<br class="">
[3]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------<br class="">
[3]PETSC ERROR: No support for this operation for this object type<br class="">
[3]PETSC ERROR: Mat type elemental<br class="">
[3]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.<br class="">
[3]PETSC ERROR: Petsc Development GIT revision: v3.10.3-1681-g73e1f9d014 GIT Date: 2019-02-24 19:52:00 +0100<br class="">
[3]PETSC ERROR: ./a.out on a named tono-hpc1 by marius Thu Feb 28 08:56:48 2019<br class="">
[3]PETSC ERROR: Configure options --prefix=/home/marius/prog/petsc/intel_openmpi_openmp_mkl_dbg_with_slepc --with-fortran-kernels=0 --with-64-bit-indices=0 --CC=mpicc --COPTFLAGS="-g -O0 -qopenmp -std=c11" --CXX=mpicxx --CXXOPTFLAGS="-g -O0 -qopenmp -std=c++14" --FC=mpif90 --FOPTFLAGS="-g -O0 -qopenmp -traceback " --with-mpi=1 --with-x=0 --download-parmetis=1 --download-metis=1 --download-superlu_dist=1 --download-superlu_dist-commit=93a9aa53142253f2a56891e09c6f950d250ae251 --download-superlu_dist-cmake-arguments=-Denable_openmp=TRUE --download-hwloc=1 --download-sowing=1 --with-openmp=0 --with-pthread=0 --download-elemental=1 --download-elemental-commit=de7b5bea1abf5f626b91582f742cf99e2e551bff --with-cxx-dialect=c++11 --with-scalar-type=complex --with-debugging=1 --with-valgrind=0 --with-blaslapack-lib=" -L/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_blacs_openmpi_lp64 -liomp5 -lpthread -lm -ldl" --with-scalapack-lib=" -L/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_blacs_openmpi_lp64 -liomp5 -lpthread -lm -ldl" --with-mkl_pardiso-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_cpardiso-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_sparse-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_sparse_optimize-dir=/home/marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-valgrind=1<br class="">
[3]PETSC ERROR: #1 MatGetRow() line 570 in /home/marius/prog/petsc/git/petsc/src/mat/interface/matrix.c<br class="">
[3]PETSC ERROR: #2 MatAXPY_Basic_Preallocate() line 95 in /home/marius/prog/petsc/git/petsc/src/mat/utils/axpy.c<br class="">
[3]PETSC ERROR: #3 MatAXPY() line 51 in /home/marius/prog/petsc/git/petsc/src/mat/utils/axpy.c</div>
<div class="">
<div name="quote" style="margin:10px 5px 5px 10px; padding: 10px 0 10px 10px; border-left:2px solid #C3D9E5; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<div style="margin:0 0 10px 0;" class=""><br class="">
<b class="">Von:</b> "Stefano Zampini" <<a href="mailto:stefano.zampini@gmail.com" class="">stefano.zampini@gmail.com</a>><br class="">
<b class="">An:</b> "Marius Buerkle" <<a href="mailto:mbuerkle@web.de" class="">mbuerkle@web.de</a>><br class="">
<b class="">Cc:</b> "Matthew Knepley" <<a href="mailto:knepley@gmail.com" class="">knepley@gmail.com</a>>, "PETSc users list" <<a href="mailto:petsc-users@mcs.anl.gov" class="">petsc-users@mcs.anl.gov</a>><br class="">
<b class="">Betreff:</b> Re: [petsc-users] Nonconforming object sizes in axpy</div>
<div name="quoted-content" class=""><br class="">
<br class="">
> On Feb 27, 2019, at 3:25 PM, Marius Buerkle <<a href="mailto:mbuerkle@web.de" class="">mbuerkle@web.de</a>> wrote:<br class="">
><br class="">
> Ok. I also tried without openmp which gave the same error.<br class="">
> The segfault left aside, is MatAXPY supposed to work when Y is of type ELEMENTAL and X of type MATMPIAIJ ? It worked before but now it stops with mat elemental not supported.<br class="">
><br class="">
<br class="">
I cannot find the error line that says Not supported for elemental.<br class="">
The error PETSc is raising in the log you sent is with respect to the nonconforming object sizes (which BTW are correct).<br class="">
Could you please send the backtrace (without openmp) for the error regarding “mat elemental not supported”?<br class="">
<br class="">
<br class="">
<br class="">
><br class="">
>> Von: "Stefano Zampini" <<a href="mailto:stefano.zampini@gmail.com" class="">stefano.zampini@gmail.com</a>><br class="">
>> An: "Marius Buerkle" <<a href="mailto:mbuerkle@web.de" class="">mbuerkle@web.de</a>><br class="">
>> Cc: "Matthew Knepley" <<a href="mailto:knepley@gmail.com" class="">knepley@gmail.com</a>>, "PETSc users list" <<a href="mailto:petsc-users@mcs.anl.gov" class="">petsc-users@mcs.anl.gov</a>><br class="">
>> Betreff: Re: [petsc-users] Nonconforming object sizes in axpy<br class="">
>><br class="">
>> If you check ALL ERROR CODES by doing<br class="">
>> ierr = _AnyPetscCall_();CHKERRQ(ierr);<br class="">
>> The code will stop at the first error<br class="">
>><br class="">
>> I see you are using openmp. Probably this is causing the problem, I don’t know what to say without a MWE.<br class="">
>><br class="">
>><br class="">
>>> On Feb 25, 2019, at 10:50 PM, Marius Buerkle <<a href="mailto:mbuerkle@web.de" class="">mbuerkle@web.de</a>> wrote:<br class="">
>>><br class="">
>>> <error_output.tar.gz><br class="">
>><br class="">
>><br class="">
</div>
</div>
</div>
</div></div></div><span id="cid:8144F291-7136-455E-AFF4-820A7CB3CD0E"><output.tar.gz></span></div></blockquote></div><br class=""></div></body></html>