-------------------------------------------------------------------------- MPI_ABORT was invoked on rank 27 in communicator MPI_COMM_WORLD with errorcode 59. NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes. You may or may not see output from other processes, depending on exactly when Open MPI kills them. -------------------------------------------------------------------------- [31]PETSC ERROR: ------------------------------------------------------------------------ [31]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [31]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [31]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [31]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [31]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [31]PETSC ERROR: to get more information on the crash. [31]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [31]PETSC ERROR: Signal received [31]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [31]PETSC ERROR: Petsc Release Version 3.10.2, unknown [31]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [31]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [31]PETSC ERROR: #1 User provided function() line 0 in unknown file [0]PETSC ERROR: ------------------------------------------------------------------------ [0]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [0]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [0]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [0]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [0]PETSC ERROR: to get more information on the crash. [0]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [0]PETSC ERROR: Signal received [0]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [0]PETSC ERROR: Petsc Release Version 3.10.2, unknown [0]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [0]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [0]PETSC ERROR: #1 User provided function() line 0 in unknown file [1]PETSC ERROR: ------------------------------------------------------------------------ [1]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [1]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [1]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [1]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [1]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [1]PETSC ERROR: to get more information on the crash. [1]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [1]PETSC ERROR: Signal received [1]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [1]PETSC ERROR: Petsc Release Version 3.10.2, unknown [1]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [1]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [1]PETSC ERROR: #1 User provided function() line 0 in unknown file [2]PETSC ERROR: ------------------------------------------------------------------------ [2]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [2]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [2]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [2]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [2]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [2]PETSC ERROR: to get more information on the crash. [2]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [2]PETSC ERROR: Signal received [2]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [2]PETSC ERROR: Petsc Release Version 3.10.2, unknown [2]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [2]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [2]PETSC ERROR: #1 User provided function() line 0 in unknown file [3]PETSC ERROR: ------------------------------------------------------------------------ [3]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [3]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [3]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [3]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [3]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [3]PETSC ERROR: to get more information on the crash. [3]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [3]PETSC ERROR: Signal received [3]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [3]PETSC ERROR: Petsc Release Version 3.10.2, unknown [3]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [3]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [3]PETSC ERROR: #1 User provided function() line 0 in unknown file [4]PETSC ERROR: ------------------------------------------------------------------------ [4]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [4]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [4]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [4]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [4]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [4]PETSC ERROR: to get more information on the crash. [4]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [4]PETSC ERROR: Signal received [4]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [4]PETSC ERROR: Petsc Release Version 3.10.2, unknown [4]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [4]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [4]PETSC ERROR: #1 User provided function() line 0 in unknown file [5]PETSC ERROR: ------------------------------------------------------------------------ [5]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [5]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [5]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [5]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [5]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [5]PETSC ERROR: to get more information on the crash. [5]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [5]PETSC ERROR: Signal received [5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [5]PETSC ERROR: Petsc Release Version 3.10.2, unknown [5]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [5]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [5]PETSC ERROR: #1 User provided function() line 0 in unknown file [6]PETSC ERROR: ------------------------------------------------------------------------ [6]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [6]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [6]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [6]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [6]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [6]PETSC ERROR: to get more information on the crash. [6]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [6]PETSC ERROR: Signal received [6]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [6]PETSC ERROR: Petsc Release Version 3.10.2, unknown [6]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [6]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [6]PETSC ERROR: #1 User provided function() line 0 in unknown file [7]PETSC ERROR: ------------------------------------------------------------------------ [7]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [7]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [7]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [7]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [7]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [7]PETSC ERROR: to get more information on the crash. [7]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [7]PETSC ERROR: Signal received [7]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [7]PETSC ERROR: Petsc Release Version 3.10.2, unknown [7]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [7]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [7]PETSC ERROR: #1 User provided function() line 0 in unknown file [8]PETSC ERROR: ------------------------------------------------------------------------ [8]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [8]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [8]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [8]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [8]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [8]PETSC ERROR: to get more information on the crash. [8]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [8]PETSC ERROR: Signal received [8]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [8]PETSC ERROR: Petsc Release Version 3.10.2, unknown [8]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [8]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [8]PETSC ERROR: #1 User provided function() line 0 in unknown file [9]PETSC ERROR: ------------------------------------------------------------------------ [9]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [9]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [9]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [9]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [9]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [9]PETSC ERROR: to get more information on the crash. [9]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [9]PETSC ERROR: Signal received [9]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [9]PETSC ERROR: Petsc Release Version 3.10.2, unknown [9]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [9]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [9]PETSC ERROR: #1 User provided function() line 0 in unknown file [10]PETSC ERROR: ------------------------------------------------------------------------ [10]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [10]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [10]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [10]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [10]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [10]PETSC ERROR: to get more information on the crash. [10]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [10]PETSC ERROR: Signal received [10]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [10]PETSC ERROR: Petsc Release Version 3.10.2, unknown [10]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [10]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [10]PETSC ERROR: #1 User provided function() line 0 in unknown file [11]PETSC ERROR: ------------------------------------------------------------------------ [11]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [11]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [11]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [11]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [11]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [11]PETSC ERROR: to get more information on the crash. [11]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [11]PETSC ERROR: Signal received [11]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [11]PETSC ERROR: Petsc Release Version 3.10.2, unknown [11]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [11]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [11]PETSC ERROR: #1 User provided function() line 0 in unknown file [12]PETSC ERROR: ------------------------------------------------------------------------ [12]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [12]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [12]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [12]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [12]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [12]PETSC ERROR: to get more information on the crash. [12]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [12]PETSC ERROR: Signal received [12]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [12]PETSC ERROR: Petsc Release Version 3.10.2, unknown [12]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [12]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [12]PETSC ERROR: #1 User provided function() line 0 in unknown file [14]PETSC ERROR: ------------------------------------------------------------------------ [14]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [14]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [14]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [14]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [14]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [14]PETSC ERROR: to get more information on the crash. [14]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [14]PETSC ERROR: Signal received [14]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [14]PETSC ERROR: Petsc Release Version 3.10.2, unknown [14]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [14]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [14]PETSC ERROR: #1 User provided function() line 0 in unknown file [15]PETSC ERROR: ------------------------------------------------------------------------ [15]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [15]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [15]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [15]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [15]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [15]PETSC ERROR: to get more information on the crash. [15]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [15]PETSC ERROR: Signal received [15]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [15]PETSC ERROR: Petsc Release Version 3.10.2, unknown [15]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [15]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [15]PETSC ERROR: #1 User provided function() line 0 in unknown file [16]PETSC ERROR: ------------------------------------------------------------------------ [16]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [16]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [16]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [16]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [16]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [16]PETSC ERROR: to get more information on the crash. [16]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [16]PETSC ERROR: Signal received [16]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [16]PETSC ERROR: Petsc Release Version 3.10.2, unknown [16]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [16]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [16]PETSC ERROR: #1 User provided function() line 0 in unknown file [17]PETSC ERROR: ------------------------------------------------------------------------ [17]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [17]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [17]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [17]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [17]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [17]PETSC ERROR: to get more information on the crash. [17]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [17]PETSC ERROR: Signal received [17]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [17]PETSC ERROR: Petsc Release Version 3.10.2, unknown [17]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [17]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [17]PETSC ERROR: #1 User provided function() line 0 in unknown file [18]PETSC ERROR: ------------------------------------------------------------------------ [18]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [18]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [18]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [18]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [18]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [18]PETSC ERROR: to get more information on the crash. [18]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [18]PETSC ERROR: Signal received [18]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [18]PETSC ERROR: Petsc Release Version 3.10.2, unknown [18]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [18]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [18]PETSC ERROR: #1 User provided function() line 0 in unknown file [19]PETSC ERROR: ------------------------------------------------------------------------ [19]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [19]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [19]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [19]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [19]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [19]PETSC ERROR: to get more information on the crash. [19]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [19]PETSC ERROR: Signal received [19]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [19]PETSC ERROR: Petsc Release Version 3.10.2, unknown [19]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [19]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [19]PETSC ERROR: #1 User provided function() line 0 in unknown file [20]PETSC ERROR: ------------------------------------------------------------------------ [20]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [20]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [20]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [20]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [20]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [20]PETSC ERROR: to get more information on the crash. [20]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [20]PETSC ERROR: Signal received [20]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [20]PETSC ERROR: Petsc Release Version 3.10.2, unknown [20]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [20]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [20]PETSC ERROR: #1 User provided function() line 0 in unknown file [21]PETSC ERROR: ------------------------------------------------------------------------ [21]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [21]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [21]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [21]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [21]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [21]PETSC ERROR: to get more information on the crash. [21]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [21]PETSC ERROR: Signal received [21]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [21]PETSC ERROR: Petsc Release Version 3.10.2, unknown [21]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [21]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [21]PETSC ERROR: #1 User provided function() line 0 in unknown file [22]PETSC ERROR: ------------------------------------------------------------------------ [22]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [22]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [22]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [22]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [22]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [22]PETSC ERROR: to get more information on the crash. [22]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [22]PETSC ERROR: Signal received [22]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [22]PETSC ERROR: Petsc Release Version 3.10.2, unknown [22]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [22]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [22]PETSC ERROR: #1 User provided function() line 0 in unknown file [23]PETSC ERROR: ------------------------------------------------------------------------ [23]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [23]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [23]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [23]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [23]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [23]PETSC ERROR: to get more information on the crash. [23]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [23]PETSC ERROR: Signal received [23]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [23]PETSC ERROR: Petsc Release Version 3.10.2, unknown [23]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [23]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [23]PETSC ERROR: #1 User provided function() line 0 in unknown file [23]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [23]PETSC ERROR: Out of memory. This could be due to allocating [23]PETSC ERROR: too large an object or bleeding by not properly [23]PETSC ERROR: destroying unneeded objects. [24]PETSC ERROR: ------------------------------------------------------------------------ [24]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [24]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [24]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [24]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [24]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [24]PETSC ERROR: to get more information on the crash. [24]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [24]PETSC ERROR: Signal received [24]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [24]PETSC ERROR: Petsc Release Version 3.10.2, unknown [24]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [24]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [24]PETSC ERROR: #1 User provided function() line 0 in unknown file [25]PETSC ERROR: ------------------------------------------------------------------------ [25]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [25]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [25]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [25]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [25]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [25]PETSC ERROR: to get more information on the crash. [25]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [25]PETSC ERROR: Signal received [25]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [25]PETSC ERROR: Petsc Release Version 3.10.2, unknown [25]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [25]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [25]PETSC ERROR: #1 User provided function() line 0 in unknown file [26]PETSC ERROR: ------------------------------------------------------------------------ [26]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [26]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [26]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [26]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [26]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [26]PETSC ERROR: to get more information on the crash. [26]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [26]PETSC ERROR: Signal received [26]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [26]PETSC ERROR: Petsc Release Version 3.10.2, unknown [26]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [26]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [26]PETSC ERROR: #1 User provided function() line 0 in unknown file [27]PETSC ERROR: ------------------------------------------------------------------------ [27]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [27]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [27]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [27]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [27]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [27]PETSC ERROR: to get more information on the crash. [27]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [27]PETSC ERROR: Signal received [27]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [27]PETSC ERROR: Petsc Release Version 3.10.2, unknown [27]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [27]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [27]PETSC ERROR: #1 User provided function() line 0 in unknown file [28]PETSC ERROR: ------------------------------------------------------------------------ [28]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [28]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [28]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [28]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [28]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [28]PETSC ERROR: to get more information on the crash. [28]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [28]PETSC ERROR: Signal received [28]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [28]PETSC ERROR: Petsc Release Version 3.10.2, unknown [28]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [28]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [28]PETSC ERROR: #1 User provided function() line 0 in unknown file [29]PETSC ERROR: ------------------------------------------------------------------------ [29]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [29]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [29]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [29]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [29]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [29]PETSC ERROR: to get more information on the crash. [29]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [29]PETSC ERROR: Signal received [29]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [29]PETSC ERROR: Petsc Release Version 3.10.2, unknown [29]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [29]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [29]PETSC ERROR: #1 User provided function() line 0 in unknown file [30]PETSC ERROR: ------------------------------------------------------------------------ [30]PETSC ERROR: Caught signal number 15 Terminate: Some process (or the batch system) has told this process to end [30]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger [30]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind [30]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors [30]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run [30]PETSC ERROR: to get more information on the crash. [30]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [30]PETSC ERROR: Signal received [30]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting. [30]PETSC ERROR: Petsc Release Version 3.10.2, unknown [30]PETSC ERROR: ./solveCSys on a linux-cumulus-hpc named r03n28 by vef002 Wed Jan 9 09:47:54 2019 [30]PETSC ERROR: Configure options PETSC_ARCH=linux-cumulus-hpc --with-cc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicc --with-fc=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpifort --with-cxx=/usr/local/depot/openmpi-3.1.1-gcc-7.3.0/bin/mpicxx --download-parmetis --download-metis --download-ptscotch --download-superlu_dist --download-mumps --with-scalar-type=complex --with-debugging=no --download-scalapack --download-superlu --download-fblaslapack=1 --download-cmake [30]PETSC ERROR: #1 User provided function() line 0 in unknown file -------------------------------------------------------------------------- mpiexec noticed that process rank 13 with PID 0 on node r03n28 exited on signal 9 (Killed). -------------------------------------------------------------------------- [r03n28:37680] 27 more processes have sent help message help-mpi-api.txt / mpi-abort [r03n28:37680] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages