<html><head></head><body><div style="font-family: Verdana;font-size: 12.0px;"><div>
<div>thanks, using " -mat_superlu_dist_fact SamePattern_SameRowPerm" works also with options other than "-mat_superlu_dist_colperm NATURAL". The solution worked for 32bit integers but when I compile petsc using 64bit indices I get the following error regardless of the options used for mat_superlu_dist_fact and mat_superlu_dist_colperm</div>
<div> </div>
<div>[0]PETSC ERROR: ------------------------------------------------------------------------<br/>
[0]PETSC ERROR: Caught signal number 11 SEGV: Segmentation Violation, probably memory access out of range<br/>
[0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger<br/>
[0]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind<br/>
[0]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors<br/>
[0]PETSC ERROR: likely location of problem given in stack below<br/>
[0]PETSC ERROR: --------------------- Stack Frames ------------------------------------<br/>
[0]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,<br/>
[0]PETSC ERROR: INSTEAD the line number of the start of the function<br/>
[0]PETSC ERROR: is given.<br/>
[0]PETSC ERROR: [0] SuperLU_DIST:pzgssvx line 465 /home/cdfmat_marius/prog/petsc/master_build_gcc_superlu6/petsc/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c<br/>
[0]PETSC ERROR: [0] MatLUFactorNumeric_SuperLU_DIST line 314 /home/cdfmat_marius/prog/petsc/master_build_gcc_superlu6/petsc/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c<br/>
[0]PETSC ERROR: [0] MatLUFactorNumeric line 3080 /home/cdfmat_marius/prog/petsc/master_build_gcc_superlu6/petsc/src/mat/interface/matrix.c<br/>
[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------<br/>
[0]PETSC ERROR: Signal received<br/>
[0]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.<br/>
[0]PETSC ERROR: Petsc Development GIT revision: v3.10.2-723-g2a65a22 GIT Date: 2018-11-25 07:45:29 +0100<br/>
[0]PETSC ERROR: /home/cdfmat_marius/prog/transomat_latest_i8/transomat on a named a122 by cdfmat_marius Fri Dec 7 11:52:52 2018<br/>
[0]PETSC ERROR: Configure options --prefix=/home/cdfmat_marius/prog/petsc/master_gcc_superlu6_debug_i8 --with-64-bit-indices=1 --CC=mpicc --COPTFLAGS="-O0 -march=native -g -std=c11 " --CXX=mpicxx --CXXOPTFLAGS="-O0 -march=native -g -std=c++11" --FC=mpif90 --FOPTFLAGS="-O<br/>
0 -march=native -g -fbacktrace -fdefault-integer-8" --with-mpi=1 --with-x=0 --download-parmetis=/home/cdfmat_marius/prog/petsc/master_build_gcc_superlu6/petsc/externalpackages/git.parmetis.tar.gz --download-metis=/home/cdfmat_marius/prog/petsc/master_build_gcc_superlu6/p<br/>
etsc/externalpackages/git.metis.tar.gz --with-blaslapack-lib=" -L/home/cdfmat_marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -Wl,--no-as-needed -lmkl_scalapack_ilp64 -lmkl_intel_ilp64 -lmkl_sequential -lmkl_core -lmkl_blacs_openmpi_ilp64 -lpthread <br/>
-lm -ldl " --with-lapack-lib=" -L/home/cdfmat_marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -Wl,--no-as-needed -lmkl_scalapack_ilp64 -lmkl_intel_ilp64 -lmkl_sequential -lmkl_core -lmkl_blacs_openmpi_ilp64 -lpthread -lm -ldl " --with-blas-lib=" -L/<br/>
home/cdfmat_marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -Wl,--no-as-needed -lmkl_scalapack_ilp64 -lmkl_intel_ilp64 -lmkl_sequential -lmkl_core -lmkl_blacs_openmpi_ilp64 -lpthread -lm -ldl " --with-scalapack-lib=" -L/home/cdfmat_marius/intel/comp<br/>
ilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -Wl,--no-as-needed -lmkl_scalapack_ilp64 -lmkl_intel_ilp64 -lmkl_sequential -lmkl_core -lmkl_blacs_openmpi_ilp64 -lpthread -lm -ldl " --download-pastix=no --download-superlu_dist=/home/cdfmat_marius/prog/petsc/master_b<br/>
uild_gcc_superlu6/petsc/externalpackages/git.superlu_dist.tar.gz --download-superlu_dist-commit=HEAD --download-hwloc=/home/cdfmat_marius/prog/petsc/master_build_gcc_superlu6/petsc/externalpackages/hwloc-1.11.1.tar.gz --download-sowing=/home/cdfmat_marius/prog/petsc/mast<br/>
er_build_gcc_superlu6/petsc/externalpackages/git.sowing.tar.gz --with-openmp=0 --with-pthread=0 --download-elemental=/home/cdfmat_marius/prog/petsc/master_build_gcc_superlu6/petsc/externalpackages/git.elemental.tar.gz --download-elemental-commit=HEAD --with-cxx-dialect=c<br/>
++11 --with-scalar-type=complex --with-pic=1 --download-elemental-cmake-arguments="-DEL_USE_64BIT_INTS=ON -DEL_USE_64BIT_BLAS_INTS=ON" --with-debugging=1<br/>
[0]PETSC ERROR: #1 User provided function() line 0 in unknown file</div>
<div> </div>
<div> </div>
<div>Is superlu_dist supposed to work with 64 integers?</div>
<div> </div>
<div name="quote" style="margin:10px 5px 5px 10px; padding: 10px 0 10px 10px; border-left:2px solid #C3D9E5; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">
<div name="quoted-content">
<div>
<div>
<div class="gmail_default" style="font-family: verdana , sans-serif;font-size: small;color: rgb(0,0,0);">We just fixed a memory bug in 6.1.0 (which shows up in very rare situation), not sure whether it is related to your problem.</div>
<div class="gmail_default" style="font-family: verdana , sans-serif;font-size: small;color: rgb(0,0,0);"> </div>
But "-mat_superlu_dist_colperm NATURAL" will be very slow, usually generate lots of fill-ins in the LU factors.</div>
<div> </div>
<div>
<div class="gmail_default" style="font-family: verdana , sans-serif;font-size: small;color: rgb(0,0,0);">Sherry</div>
</div>
</div>
<div class="gmail_quote">
<div>On Thu, Dec 6, 2018 at 3:50 PM Marius Buerkle via petsc-users <<a href="mailto:petsc-users@mcs.anl.gov" onclick="parent.window.location.href='mailto:petsc-users@mcs.anl.gov'; return false;" target="_blank">petsc-users@mcs.anl.gov</a>> wrote:</div>
<blockquote class="gmail_quote" style="margin: 0 0 0 0.8ex;border-left: 1.0px rgb(204,204,204) solid;padding-left: 1.0ex;">
<div>
<div style="font-family: Verdana;font-size: 12.0px;">
<div>
<div>Thanks for the suggestion I will try this option. I used already "-mat_superlu_dist_colperm NATURAL" which seems to help but I did not test it thoroughly.</div>
<div> </div>
<div>
<div style="margin: 10.0px 5.0px 5.0px 10.0px;padding: 10.0px 0 10.0px 10.0px;border-left: 2.0px solid rgb(195,217,229);">
<div style="margin: 0 0 10.0px 0;"><br/>
<b>Betreff:</b> Re: [petsc-users] seg fault with superlu</div>
<div>
<div>
<div>
<div>
<div class="gmail_quote">
<div>On Thu, Dec 6, 2018 at 2:55 AM Matthew Knepley via petsc-users <<a href="mailto:petsc-users@mcs.anl.gov" onclick="parent.window.location.href='mailto:petsc-users@mcs.anl.gov'; return false;" target="_blank">petsc-users@mcs.anl.gov</a>> wrote:</div>
<blockquote class="gmail_quote" style="margin: 0.0px 0.0px 0.0px 0.8ex;border-left-width: 1.0px;border-left-style: solid;border-left-color: rgb(204,204,204);padding-left: 1.0ex;">
<div>Satish,
<div> </div>
<div>This is exactly the same method (<span style="font-family: Verdana;font-size: 12.0px;">pzgssvx) that had a problem before. Do you remember what happened?</span></div>
</div>
</blockquote>
<div> </div>
<div>Used to have a bug in the row permutation algorithm. The row permutation is not get populated correctly. It was fixed from PETSc-3.8.x. If the current issue is the same as before, a simple "fix" is to use </div>
<div> </div>
<div>" -mat_superlu_dist_fact SamePattern_SameRowPerm". </div>
<div> </div>
<div>Fande,</div>
<div> </div>
<div> </div>
<blockquote class="gmail_quote" style="margin: 0.0px 0.0px 0.0px 0.8ex;border-left-width: 1.0px;border-left-style: solid;border-left-color: rgb(204,204,204);padding-left: 1.0ex;">
<div>
<div> </div>
<div><span style="font-family: Verdana;font-size: 12.0px;"> Thanks,</span></div>
<div> </div>
<div><span style="font-family: Verdana;font-size: 12.0px;"> Matt</span></div>
</div>
<div class="gmail_quote">
<div>On Wed, Dec 5, 2018 at 8:38 PM Smith, Barry F. via petsc-users <<a href="mailto:petsc-users@mcs.anl.gov" onclick="parent.window.location.href='mailto:petsc-users@mcs.anl.gov'; return false;" target="_blank">petsc-users@mcs.anl.gov</a>> wrote:</div>
<blockquote class="gmail_quote" style="margin: 0.0px 0.0px 0.0px 0.8ex;border-left-width: 1.0px;border-left-style: solid;border-left-color: rgb(204,204,204);padding-left: 1.0ex;"><br/>
I would start with valgrind see if it finds anything. If not and if you can provide the code that reproduces the problem we can take a look at it.<br/>
<br/>
Barry<br/>
<br/>
<a href="https://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind" target="_blank">https://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind</a><br/>
<br/>
<br/>
<br/>
> On Dec 5, 2018, at 7:16 PM, Marius Buerkle via petsc-users <<a href="mailto:petsc-users@mcs.anl.gov" onclick="parent.window.location.href='mailto:petsc-users@mcs.anl.gov'; return false;" target="_blank">petsc-users@mcs.anl.gov</a>> wrote:<br/>
><br/>
> Hi,<br/>
> <br/>
> I get the following error duing MatMatSolve. It works for smaller number of processes but if I increade the number pf processes used it crashes.<br/>
> <br/>
> [25]PETSC ERROR: ------------------------------------------------------------------------<br/>
> [25]PETSC ERROR: Caught signal number 11 SEGV: Segmentation Violation, probably memory access out of range<br/>
> [25]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger<br/>
> [25]PETSC ERROR: or see <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind" target="_blank">http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind</a><br/>
> [25]PETSC ERROR: or try <a href="http://valgrind.org" target="_blank">http://valgrind.org</a> on GNU/linux and Apple Mac OS X to find memory corruption errors<br/>
> [25]PETSC ERROR: likely location of problem given in stack below<br/>
> [25]PETSC ERROR: --------------------- Stack Frames ------------------------------------<br/>
> [25]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,<br/>
> [25]PETSC ERROR: INSTEAD the line number of the start of the function<br/>
> [25]PETSC ERROR: is given.<br/>
> [25]PETSC ERROR: [25] SuperLU_DIST:pzgssvx line 236 /home/cdfmat_marius/prog/petsc/master_build_gcc_local/petsc/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c<br/>
> [25]PETSC ERROR: [25] MatMatSolve_SuperLU_DIST line 200 /home/cdfmat_marius/prog/petsc/master_build_gcc_local/petsc/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c<br/>
> [25]PETSC ERROR: [25] MatMatSolve line 3396 /home/cdfmat_marius/prog/petsc/master_build_gcc_local/petsc/src/mat/interface/matrix.c<br/>
> [25]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------<br/>
> [25]PETSC ERROR: Signal received<br/>
> [25]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.<br/>
> [25]PETSC ERROR: Petsc Development GIT revision: v3.10.2-723-g2a65a22 GIT Date: 2018-11-25 07:45:29 +0100<br/>
> [25]PETSC ERROR: /home/cdfmat_marius/prog/transomat_latest_test4/transomat on a named a003 by cdfmat_marius Thu Dec 6 10:12:23 2018<br/>
> [25]PETSC ERROR: Configure options --prefix=/home/cdfmat_marius/prog/petsc/master_gcc_local_debug --with-64-bit-indices=0 --CC=mpicc --COPTFLAGS="-O0 -mtune=generic -g -std=c11 " --CXX=mpicxx --CXXOPTFLAGS="-O0 -mtune=generic -g -std=c++11 " --FC=mpif90 --FOPTFLAGS="-O0 -mtune=generic -g -fbacktrace -g " --with-mpi=1 --with-x=0 --download-parmetis=/home/cdfmat_marius/prog/petsc/master_build_gcc_local/petsc/externalpackages/git.parmetis.tar.gz --download-metis=/home/cdfmat_marius/prog/petsc/master_build_gcc_local/petsc/externalpackages/git.metis.tar.gz --with-blaslapack-lib=" -L/home/cdfmat_marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -Wl,--no-as-needed -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lmkl_blacs_openmpi_lp64 -lpthread -lm -ldl " --with-scalapack-lib=" -L/home/cdfmat_marius/intel/compilers_and_libraries_2019.1.144/linux/mkl/lib/intel64 -Wl,--no-as-needed -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lmkl_blacs_openmpi_lp64 -lpthread -lm -ldl " --download-pastix=no --download-superlu_dist=/home/cdfmat_marius/prog/petsc/master_build_gcc_local/petsc/externalpackages/git.superlu_dist.tar.gz --download-superlu_dist-commit=HEAD --download-hwloc=/home/cdfmat_marius/prog/petsc/master_build_gcc_local/petsc/externalpackages/hwloc-1.11.1.tar.gz --download-sowing=/home/cdfmat_marius/prog/petsc/master_build_gcc_local/petsc/externalpackages/git.sowing.tar.gz --with-mkl_pardiso-dir=/home/cdfmat_marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-openmp=0 --with-pthread=0 --download-elemental=/home/cdfmat_marius/prog/petsc/master_build_gcc_local/petsc/externalpackages/git.elemental.tar.gz --download-elemental-commit=HEAD --with-mkl_cpardiso-dir=/home/cdfmat_marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_sparse_optimize-dir=/home/cdfmat_marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-mkl_sparse_sp2m-dir=/home/cdfmat_marius/intel/compilers_and_libraries_2019.1.144/linux/mkl --with-cxx-dialect=c++11 --with-scalar-type=complex --with-debugging=1<br/>
> <br/>
> bestm<br/>
> marius<br/>
</blockquote>
</div>
<div> </div>
--
<div class="m_7316140702289264110gmail-m_-3617219364493079408gmail_signature">
<div>
<div>
<div>
<div>
<div>
<div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br/>
-- Norbert Wiener</div>
<div> </div>
<div><a href="http://www.cse.buffalo.edu/~knepley/" target="_blank">https://www.cse.buffalo.edu/~knepley/</a></div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div></div></body></html>