<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">I’m having issues with both SuperLU dist and MUMPS, as compiled by PETsc, in the following sense:<div class=""><br class=""></div><div class="">1. For large enough systems, which seems to vary depending on which computer I’m on, MUMPS seems to just die and never start, when it’s used as the linear solver within a SNES. There’s no error message, it just sits there and doesn’t do anything.</div><div class=""><br class=""></div><div class="">2. When running with SuperLU dist, I got the following error, with no further information:</div><div class=""><br class=""></div><div class=""><div class="" style="margin: 0px; font-family: Menlo;"><div style="margin: 0px;" class="">[3]PETSC ERROR: ------------------------------------------------------------------------</div><div style="margin: 0px;" class="">[3]PETSC ERROR: Caught signal number 11 SEGV: Segmentation Violation, probably memory access out of range</div><div style="margin: 0px;" class="">[3]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger</div><div style="margin: 0px;" class="">[3]PETSC ERROR: or see <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind</a></div><div style="margin: 0px;" class="">[3]PETSC ERROR: or try <a href="http://valgrind.org" class="">http://valgrind.org</a> on GNU/linux and Apple Mac OS X to find memory corruption errors</div><div style="margin: 0px;" class="">[3]PETSC ERROR: likely location of problem given in stack below</div><div style="margin: 0px;" class="">[3]PETSC ERROR: --------------------- Stack Frames ------------------------------------</div><div style="margin: 0px;" class="">[3]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,</div><div style="margin: 0px;" class="">[3]PETSC ERROR: INSTEAD the line number of the start of the function</div><div style="margin: 0px;" class="">[3]PETSC ERROR: is given.</div><div style="margin: 0px;" class="">[3]PETSC ERROR: [3] SuperLU_DIST:pdgssvx line 161 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[3]PETSC ERROR: [3] MatSolve_SuperLU_DIST line 121 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[3]PETSC ERROR: [3] MatSolve line 3104 /home/simpson/software/petsc-3.5.4/src/mat/interface/matrix.c</div><div style="margin: 0px;" class="">[3]PETSC ERROR: [3] PCApply_LU line 194 /home/simpson/software/petsc-3.5.4/src/ksp/pc/impls/factor/lu/lu.c</div><div style="margin: 0px;" class="">[3]PETSC ERROR: [3] KSP_PCApplyBAorAB line 258 /home/simpson/software/petsc-3.5.4/include/petsc-private/kspimpl.h</div><div style="margin: 0px;" class="">[3]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div><div style="margin: 0px;" class="">[3]PETSC ERROR: Signal received</div><div style="margin: 0px;" class="">[3]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div><div style="margin: 0px;" class="">[3]PETSC ERROR: Petsc Release Version 3.5.4, May, 23, 2015 </div><div style="margin: 0px;" class="">[3]PETSC ERROR: ./blowup_batch2 on a arch-linux2-c-debug named proteusi01 by simpson Sat Aug 22 17:01:41 2015</div><div style="margin: 0px;" class="">[3]PETSC ERROR: Configure options --with-mpi-dir=/mnt/HA/opt/openmpi/intel/64/1.8.1-mlnx-ofed --with-blas-lib=/mnt/HA/opt/blas/gcc/64/20110419/libblas.a --with-lapack-lib=/liblapack.a --download-suitesparse=yes --download-superlu=yes --download-superlu_dist=yes --download-mumps=yes --download-metis=yes --download-parmetis=yes --download-scalapack=yes</div><div style="margin: 0px;" class="">[3]PETSC ERROR: #1 User provided function() line 0 in unknown file</div><div style="margin: 0px;" class="">--------------------------------------------------------------------------</div><div style="margin: 0px;" class="">MPI_ABORT was invoked on rank 3 in communicator MPI_COMM_WORLD </div><div style="margin: 0px;" class="">with errorcode 59.</div><div style="margin: 0px; min-height: 16px;" class=""><br class=""></div><div style="margin: 0px;" class="">NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.</div><div style="margin: 0px;" class="">You may or may not see output from other processes, depending on</div><div style="margin: 0px;" class="">exactly when Open MPI kills them.</div><div style="margin: 0px;" class="">--------------------------------------------------------------------------</div><div style="margin: 0px;" class="">[proteusi01:14037] 1 more process has sent help message help-mpi-api.txt / mpi-abort</div><div style="margin: 0px;" class="">[proteusi01:14037] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages</div><div style="margin: 0px;" class="">[6]PETSC ERROR: ------------------------------------------------------------------------</div><div style="margin: 0px;" class="">[6]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end</div><div style="margin: 0px;" class="">[6]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger</div><div style="margin: 0px;" class="">[6]PETSC ERROR: or see <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind</a></div><div style="margin: 0px;" class="">[6]PETSC ERROR: or try <a href="http://valgrind.org" class="">http://valgrind.org</a> on GNU/linux and Apple Mac OS X to find memory corruption errors</div><div style="margin: 0px;" class="">[6]PETSC ERROR: likely location of problem given in stack below</div><div style="margin: 0px;" class="">[6]PETSC ERROR: --------------------- Stack Frames ------------------------------------</div><div style="margin: 0px;" class="">[6]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,</div><div style="margin: 0px;" class="">[6]PETSC ERROR: INSTEAD the line number of the start of the function</div><div style="margin: 0px;" class="">[6]PETSC ERROR: is given.</div><div style="margin: 0px;" class="">[6]PETSC ERROR: [6] SuperLU_DIST:pdgssvx line 161 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[6]PETSC ERROR: [6] MatSolve_SuperLU_DIST line 121 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[6]PETSC ERROR: [6] MatSolve line 3104 /home/simpson/software/petsc-3.5.4/src/mat/interface/matrix.c</div><div style="margin: 0px;" class="">[6]PETSC ERROR: [6] PCApply_LU line 194 /home/simpson/software/petsc-3.5.4/src/ksp/pc/impls/factor/lu/lu.c</div><div style="margin: 0px;" class="">[6]PETSC ERROR: [6] KSP_PCApplyBAorAB line 258 /home/simpson/software/petsc-3.5.4/include/petsc-private/kspimpl.h</div><div style="margin: 0px;" class="">[6]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div><div style="margin: 0px;" class="">[6]PETSC ERROR: Signal received</div><div style="margin: 0px;" class="">[6]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div><div style="margin: 0px;" class="">[6]PETSC ERROR: Petsc Release Version 3.5.4, May, 23, 2015 </div><div style="margin: 0px;" class="">[6]PETSC ERROR: ./blowup_batch2 on a arch-linux2-c-debug named proteusi01 by simpson Sat Aug 22 17:01:41 2015</div><div style="margin: 0px;" class="">[6]PETSC ERROR: Configure options --with-mpi-dir=/mnt/HA/opt/openmpi/intel/64/1.8.1-mlnx-ofed --with-blas-lib=/mnt/HA/opt/blas/gcc/64/20110419/libblas.a --with-lapack-lib=/liblapack.a --download-suitesparse=yes --download-superlu=yes --download-superlu_dist=yes --download-mumps=yes --download-metis=yes --download-parmetis=yes --download-scalapack=yes</div><div style="margin: 0px;" class="">[6]PETSC ERROR: #1 User provided function() line 0 in unknown file</div><div style="margin: 0px;" class="">[7]PETSC ERROR: ------------------------------------------------------------------------</div><div style="margin: 0px;" class="">[7]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end</div><div style="margin: 0px;" class="">[7]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger</div><div style="margin: 0px;" class="">[7]PETSC ERROR: or see <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind</a></div><div style="margin: 0px;" class="">[7]PETSC ERROR: or try <a href="http://valgrind.org" class="">http://valgrind.org</a> on GNU/linux and Apple Mac OS X to find memory corruption errors</div><div style="margin: 0px;" class="">[7]PETSC ERROR: likely location of problem given in stack below</div><div style="margin: 0px;" class="">[7]PETSC ERROR: --------------------- Stack Frames ------------------------------------</div><div style="margin: 0px;" class="">[7]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,</div><div style="margin: 0px;" class="">[7]PETSC ERROR: INSTEAD the line number of the start of the function</div><div style="margin: 0px;" class="">[7]PETSC ERROR: is given.</div><div style="margin: 0px;" class="">[7]PETSC ERROR: [7] SuperLU_DIST:pdgssvx line 161 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[7]PETSC ERROR: [7] MatSolve_SuperLU_DIST line 121 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[7]PETSC ERROR: [7] MatSolve line 3104 /home/simpson/software/petsc-3.5.4/src/mat/interface/matrix.c</div><div style="margin: 0px;" class="">[7]PETSC ERROR: [7] PCApply_LU line 194 /home/simpson/software/petsc-3.5.4/src/ksp/pc/impls/factor/lu/lu.c</div><div style="margin: 0px;" class="">[7]PETSC ERROR: [7] KSP_PCApplyBAorAB line 258 /home/simpson/software/petsc-3.5.4/include/petsc-private/kspimpl.h</div><div style="margin: 0px;" class="">[7]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div><div style="margin: 0px;" class="">[7]PETSC ERROR: Signal received</div><div style="margin: 0px;" class="">[7]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div><div style="margin: 0px;" class="">[7]PETSC ERROR: Petsc Release Version 3.5.4, May, 23, 2015 </div><div style="margin: 0px;" class="">[7]PETSC ERROR: ./blowup_batch2 on a arch-linux2-c-debug named proteusi01 by simpson Sat Aug 22 17:01:41 2015</div><div style="margin: 0px;" class="">[7]PETSC ERROR: Configure options --with-mpi-dir=/mnt/HA/opt/openmpi/intel/64/1.8.1-mlnx-ofed --with-blas-lib=/mnt/HA/opt/blas/gcc/64/20110419/libblas.a --with-lapack-lib=/liblapack.a --download-suitesparse=yes --download-superlu=yes --download-superlu_dist=yes --download-mumps=yes --download-metis=yes --download-parmetis=yes --download-scalapack=yes</div><div style="margin: 0px;" class="">[7]PETSC ERROR: #1 User provided function() line 0 in unknown file</div><div style="margin: 0px;" class="">[0]PETSC ERROR: ------------------------------------------------------------------------</div><div style="margin: 0px;" class="">[0]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end</div><div style="margin: 0px;" class="">[0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger</div><div style="margin: 0px;" class="">[0]PETSC ERROR: or see <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind</a></div><div style="margin: 0px;" class="">[0]PETSC ERROR: or try <a href="http://valgrind.org" class="">http://valgrind.org</a> on GNU/linux and Apple Mac OS X to find memory corruption errors</div><div style="margin: 0px;" class="">[0]PETSC ERROR: likely location of problem given in stack below</div><div style="margin: 0px;" class="">[0]PETSC ERROR: --------------------- Stack Frames ------------------------------------</div><div style="margin: 0px;" class="">[0]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,</div><div style="margin: 0px;" class="">[0]PETSC ERROR: INSTEAD the line number of the start of the function</div><div style="margin: 0px;" class="">[0]PETSC ERROR: is given.</div><div style="margin: 0px;" class="">[0]PETSC ERROR: [0] SuperLU_DIST:pdgssvx line 161 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[0]PETSC ERROR: [0] MatSolve_SuperLU_DIST line 121 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[0]PETSC ERROR: [0] MatSolve line 3104 /home/simpson/software/petsc-3.5.4/src/mat/interface/matrix.c</div><div style="margin: 0px;" class="">[0]PETSC ERROR: [0] PCApply_LU line 194 /home/simpson/software/petsc-3.5.4/src/ksp/pc/impls/factor/lu/lu.c</div><div style="margin: 0px;" class="">[0]PETSC ERROR: [0] KSP_PCApplyBAorAB line 258 /home/simpson/software/petsc-3.5.4/include/petsc-private/kspimpl.h</div><div style="margin: 0px;" class="">[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div><div style="margin: 0px;" class="">[0]PETSC ERROR: Signal received</div><div style="margin: 0px;" class="">[0]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div><div style="margin: 0px;" class="">[0]PETSC ERROR: Petsc Release Version 3.5.4, May, 23, 2015 </div><div style="margin: 0px;" class="">[0]PETSC ERROR: ./blowup_batch2 on a arch-linux2-c-debug named proteusi01 by simpson Sat Aug 22 17:01:41 2015</div><div style="margin: 0px;" class="">[0]PETSC ERROR: Configure options --with-mpi-dir=/mnt/HA/opt/openmpi/intel/64/1.8.1-mlnx-ofed --with-blas-lib=/mnt/HA/opt/blas/gcc/64/20110419/libblas.a --with-lapack-lib=/liblapack.a --download-suitesparse=yes --download-superlu=yes --download-superlu_dist=yes --download-mumps=yes --download-metis=yes --download-parmetis=yes --download-scalapack=yes</div><div style="margin: 0px;" class="">[0]PETSC ERROR: #1 User provided function() line 0 in unknown file</div><div style="margin: 0px;" class="">[1]PETSC ERROR: ------------------------------------------------------------------------</div><div style="margin: 0px;" class="">[1]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end</div><div style="margin: 0px;" class="">[1]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger</div><div style="margin: 0px;" class="">[1]PETSC ERROR: or see <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind</a></div><div style="margin: 0px;" class="">[1]PETSC ERROR: or try <a href="http://valgrind.org" class="">http://valgrind.org</a> on GNU/linux and Apple Mac OS X to find memory corruption errors</div><div style="margin: 0px;" class="">[1]PETSC ERROR: likely location of problem given in stack below</div><div style="margin: 0px;" class="">[1]PETSC ERROR: --------------------- Stack Frames ------------------------------------</div><div style="margin: 0px;" class="">[1]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,</div><div style="margin: 0px;" class="">[1]PETSC ERROR: INSTEAD the line number of the start of the function</div><div style="margin: 0px;" class="">[1]PETSC ERROR: is given.</div><div style="margin: 0px;" class="">[1]PETSC ERROR: [1] SuperLU_DIST:pdgssvx line 161 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[1]PETSC ERROR: [1] MatSolve_SuperLU_DIST line 121 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[1]PETSC ERROR: [1] MatSolve line 3104 /home/simpson/software/petsc-3.5.4/src/mat/interface/matrix.c</div><div style="margin: 0px;" class="">[1]PETSC ERROR: [1] PCApply_LU line 194 /home/simpson/software/petsc-3.5.4/src/ksp/pc/impls/factor/lu/lu.c</div><div style="margin: 0px;" class="">[1]PETSC ERROR: [1] KSP_PCApplyBAorAB line 258 /home/simpson/software/petsc-3.5.4/include/petsc-private/kspimpl.h</div><div style="margin: 0px;" class="">[1]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div><div style="margin: 0px;" class="">[1]PETSC ERROR: Signal received</div><div style="margin: 0px;" class="">[1]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div><div style="margin: 0px;" class="">[1]PETSC ERROR: Petsc Release Version 3.5.4, May, 23, 2015 </div><div style="margin: 0px;" class="">[1]PETSC ERROR: ./blowup_batch2 on a arch-linux2-c-debug named proteusi01 by simpson Sat Aug 22 17:01:41 2015</div><div style="margin: 0px;" class="">[1]PETSC ERROR: Configure options --with-mpi-dir=/mnt/HA/opt/openmpi/intel/64/1.8.1-mlnx-ofed --with-blas-lib=/mnt/HA/opt/blas/gcc/64/20110419/libblas.a --with-lapack-lib=/liblapack.a --download-suitesparse=yes --download-superlu=yes --download-superlu_dist=yes --download-mumps=yes --download-metis=yes --download-parmetis=yes --download-scalapack=yes</div><div style="margin: 0px;" class="">[1]PETSC ERROR: #1 User provided function() line 0 in unknown file</div><div style="margin: 0px;" class="">[2]PETSC ERROR: ------------------------------------------------------------------------</div><div style="margin: 0px;" class="">[2]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end</div><div style="margin: 0px;" class="">[2]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger</div><div style="margin: 0px;" class="">[2]PETSC ERROR: or see <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind</a></div><div style="margin: 0px;" class="">[2]PETSC ERROR: or try <a href="http://valgrind.org" class="">http://valgrind.org</a> on GNU/linux and Apple Mac OS X to find memory corruption errors</div><div style="margin: 0px;" class="">[2]PETSC ERROR: likely location of problem given in stack below</div><div style="margin: 0px;" class="">[2]PETSC ERROR: --------------------- Stack Frames ------------------------------------</div><div style="margin: 0px;" class="">[2]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,</div><div style="margin: 0px;" class="">[2]PETSC ERROR: INSTEAD the line number of the start of the function</div><div style="margin: 0px;" class="">[2]PETSC ERROR: is given.</div><div style="margin: 0px;" class="">[2]PETSC ERROR: [2] SuperLU_DIST:pdgssvx line 161 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[2]PETSC ERROR: [2] MatSolve_SuperLU_DIST line 121 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[2]PETSC ERROR: [2] MatSolve line 3104 /home/simpson/software/petsc-3.5.4/src/mat/interface/matrix.c</div><div style="margin: 0px;" class="">[2]PETSC ERROR: [2] PCApply_LU line 194 /home/simpson/software/petsc-3.5.4/src/ksp/pc/impls/factor/lu/lu.c</div><div style="margin: 0px;" class="">[2]PETSC ERROR: [2] KSP_PCApplyBAorAB line 258 /home/simpson/software/petsc-3.5.4/include/petsc-private/kspimpl.h</div><div style="margin: 0px;" class="">[2]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div><div style="margin: 0px;" class="">[2]PETSC ERROR: Signal received</div><div style="margin: 0px;" class="">[2]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div><div style="margin: 0px;" class="">[2]PETSC ERROR: Petsc Release Version 3.5.4, May, 23, 2015 </div><div style="margin: 0px;" class="">[2]PETSC ERROR: ./blowup_batch2 on a arch-linux2-c-debug named proteusi01 by simpson Sat Aug 22 17:01:41 2015</div><div style="margin: 0px;" class="">[2]PETSC ERROR: Configure options --with-mpi-dir=/mnt/HA/opt/openmpi/intel/64/1.8.1-mlnx-ofed --with-blas-lib=/mnt/HA/opt/blas/gcc/64/20110419/libblas.a --with-lapack-lib=/liblapack.a --download-suitesparse=yes --download-superlu=yes --download-superlu_dist=yes --download-mumps=yes --download-metis=yes --download-parmetis=yes --download-scalapack=yes</div><div style="margin: 0px;" class="">[2]PETSC ERROR: #1 User provided function() line 0 in unknown file</div><div style="margin: 0px;" class="">[4]PETSC ERROR: ------------------------------------------------------------------------</div><div style="margin: 0px;" class="">[4]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end</div><div style="margin: 0px;" class="">[4]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger</div><div style="margin: 0px;" class="">[4]PETSC ERROR: or see <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind</a></div><div style="margin: 0px;" class="">[4]PETSC ERROR: or try <a href="http://valgrind.org" class="">http://valgrind.org</a> on GNU/linux and Apple Mac OS X to find memory corruption errors</div><div style="margin: 0px;" class="">[4]PETSC ERROR: likely location of problem given in stack below</div><div style="margin: 0px;" class="">[4]PETSC ERROR: --------------------- Stack Frames ------------------------------------</div><div style="margin: 0px;" class="">[4]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,</div><div style="margin: 0px;" class="">[4]PETSC ERROR: INSTEAD the line number of the start of the function</div><div style="margin: 0px;" class="">[4]PETSC ERROR: is given.</div><div style="margin: 0px;" class="">[4]PETSC ERROR: [4] SuperLU_DIST:pdgssvx line 161 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[4]PETSC ERROR: [4] MatSolve_SuperLU_DIST line 121 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[4]PETSC ERROR: [4] MatSolve line 3104 /home/simpson/software/petsc-3.5.4/src/mat/interface/matrix.c</div><div style="margin: 0px;" class="">[4]PETSC ERROR: [4] PCApply_LU line 194 /home/simpson/software/petsc-3.5.4/src/ksp/pc/impls/factor/lu/lu.c</div><div style="margin: 0px;" class="">[4]PETSC ERROR: [4] KSP_PCApplyBAorAB line 258 /home/simpson/software/petsc-3.5.4/include/petsc-private/kspimpl.h</div><div style="margin: 0px;" class="">[4]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div><div style="margin: 0px;" class="">[4]PETSC ERROR: Signal received</div><div style="margin: 0px;" class="">[4]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div><div style="margin: 0px;" class="">[4]PETSC ERROR: Petsc Release Version 3.5.4, May, 23, 2015 </div><div style="margin: 0px;" class="">[4]PETSC ERROR: ./blowup_batch2 on a arch-linux2-c-debug named proteusi01 by simpson Sat Aug 22 17:01:41 2015</div><div style="margin: 0px;" class="">[4]PETSC ERROR: Configure options --with-mpi-dir=/mnt/HA/opt/openmpi/intel/64/1.8.1-mlnx-ofed --with-blas-lib=/mnt/HA/opt/blas/gcc/64/20110419/libblas.a --with-lapack-lib=/liblapack.a --download-suitesparse=yes --download-superlu=yes --download-superlu_dist=yes --download-mumps=yes --download-metis=yes --download-parmetis=yes --download-scalapack=yes</div><div style="margin: 0px;" class="">[4]PETSC ERROR: #1 User provided function() line 0 in unknown file</div><div style="margin: 0px;" class="">[5]PETSC ERROR: ------------------------------------------------------------------------</div><div style="margin: 0px;" class="">[5]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end</div><div style="margin: 0px;" class="">[5]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger</div><div style="margin: 0px;" class="">[5]PETSC ERROR: or see <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind</a></div><div style="margin: 0px;" class="">[5]PETSC ERROR: or try <a href="http://valgrind.org" class="">http://valgrind.org</a> on GNU/linux and Apple Mac OS X to find memory corruption errors</div><div style="margin: 0px;" class="">[5]PETSC ERROR: likely location of problem given in stack below</div><div style="margin: 0px;" class="">[5]PETSC ERROR: --------------------- Stack Frames ------------------------------------</div><div style="margin: 0px;" class="">[5]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,</div><div style="margin: 0px;" class="">[5]PETSC ERROR: INSTEAD the line number of the start of the function</div><div style="margin: 0px;" class="">[5]PETSC ERROR: is given.</div><div style="margin: 0px;" class="">[5]PETSC ERROR: [5] SuperLU_DIST:pdgssvx line 161 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[5]PETSC ERROR: [5] MatSolve_SuperLU_DIST line 121 /home/simpson/software/petsc-3.5.4/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c</div><div style="margin: 0px;" class="">[5]PETSC ERROR: [5] MatSolve line 3104 /home/simpson/software/petsc-3.5.4/src/mat/interface/matrix.c</div><div style="margin: 0px;" class="">[5]PETSC ERROR: [5] PCApply_LU line 194 /home/simpson/software/petsc-3.5.4/src/ksp/pc/impls/factor/lu/lu.c</div><div style="margin: 0px;" class="">[5]PETSC ERROR: [5] KSP_PCApplyBAorAB line 258 /home/simpson/software/petsc-3.5.4/include/petsc-private/kspimpl.h</div><div style="margin: 0px;" class="">[5]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div><div style="margin: 0px;" class="">[5]PETSC ERROR: Signal received</div><div style="margin: 0px;" class="">[5]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" class="">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div><div style="margin: 0px;" class="">[5]PETSC ERROR: Petsc Release Version 3.5.4, May, 23, 2015 </div><div style="margin: 0px;" class="">[5]PETSC ERROR: ./blowup_batch2 on a arch-linux2-c-debug named proteusi01 by simpson Sat Aug 22 17:01:41 2015</div><div style="margin: 0px;" class="">[5]PETSC ERROR: Configure options --with-mpi-dir=/mnt/HA/opt/openmpi/intel/64/1.8.1-mlnx-ofed --with-blas-lib=/mnt/HA/opt/blas/gcc/64/20110419/libblas.a --with-lapack-lib=/liblapack.a --download-suitesparse=yes --download-superlu=yes --download-superlu_dist=yes --download-mumps=yes --download-metis=yes --download-parmetis=yes --download-scalapack=yes</div><div style="margin: 0px;" class="">[5]PETSC ERROR: #1 User provided function() line 0 in unknown file</div><div class=""><br class=""></div></div></div><div class=""><div class=""><div class="">-gideon</div></div></div><div apple-content-edited="true" class=""><br class=""></div>
<br class=""></body></html>