[petsc-users] MUMPS error and superLU error

Tue May 26 09:03:49 CDT 2015

I posted a while ago in MUMPS forums but no one seems to reply.

I am solving a large generalized Eigenvalue problem.

I am getting the following error which is attached, after giving the
command:

/cluster/share/venkatesh/petsc-3.5.3/linux-gnu/bin/mpiexec -np 64 -hosts
compute-0-4,compute-0-6,compute-0-7,compute-0-8 ./ex7 -f1 a72t -f2 b72t
-st_type sinvert -eps_nev 3 -eps_target 0.5 -st_ksp_type preonly
-st_pc_type lu -st_pc_factor_mat_solver_package mumps -mat_mumps_icntl_14
200000

IT IS impossible to allocate so much memory per processor.. it is asking
like around 70 GB per processor.

A serial job in MATLAB for the same matrices takes < 60GB.

After trying out superLU_dist, I have attached the error there also
(segmentation error).

Kindly help me.

Venkatesh
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20150526/9f294866/attachment-0001.html>
-------------- next part --------------
Generalized eigenproblem stored in file.

 Reading COMPLEX matrices from binary files...
[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[0]PETSC ERROR: Error in external library
[0]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 451597 megabytes

[0]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[0]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[0]PETSC ERROR: [2]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[2]PETSC ERROR: Error in external library
[2]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 457041 megabytes

[2]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[2]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[2]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[2]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[2]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[1]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[1]PETSC ERROR: Error in external library
[8]PETSC ERROR: [6]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[6]PETSC ERROR: Error in external library
[6]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 64063 megabytes

[6]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[6]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[6]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[6]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[6]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[6]PETSC ERROR: [5]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[5]PETSC ERROR: Error in external library
[5]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 64043 megabytes

[5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[5]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[5]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[5]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[5]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[16]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[16]PETSC ERROR: Error in external library
[16]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 65710 megabytes

[16]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[16]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[16]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[16]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[16]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[16]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[16]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[10]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[10]PETSC ERROR: Error in external library
[10]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 64488 megabytes

[10]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[10]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[10]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[10]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[10]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[10]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[10]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[10]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[10]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[10]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[10]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[10]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[10]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[17]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[17]PETSC ERROR: Error in external library
[17]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 71786 megabytes

[17]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[17]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[17]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[17]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[17]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[17]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[32]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[32]PETSC ERROR: Error in external library
[32]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 73270 megabytes

[32]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[32]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[32]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[32]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[32]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[32]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[32]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[32]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[32]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[32]PETSC ERROR: [3]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[3]PETSC ERROR: Error in external library
[3]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 59714 megabytes

[3]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[3]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[3]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-8.local by venkatesh Wed May 27 00:28:08 2015
[3]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[3]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[3]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[3]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[3]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[3]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[3]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[3]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[3]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[3]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[3]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[3]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 3
[cli_3]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 3
[18]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[18]PETSC ERROR: Error in external library
[18]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 74466 megabytes

[18]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[18]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[18]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[18]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[18]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[18]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[18]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[18]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[18]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[18]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[18]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[18]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[18]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[18]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[18]PETSC ERROR: [33]PETSC ERROR: [48]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[48]PETSC ERROR: Error in external library
[48]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 79966 megabytes

[48]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[48]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[48]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[48]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[48]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[48]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[48]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[48]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[48]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[48]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[48]PETSC ERROR: [7]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[7]PETSC ERROR: Error in external library
[7]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 56809 megabytes

[7]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[7]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[7]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-8.local by venkatesh Wed May 27 00:28:08 2015
[7]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[7]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[7]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[7]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[7]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[7]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[7]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[7]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[7]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[7]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[7]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[7]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 7
[cli_7]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 7
[2]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[2]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[2]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[2]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[2]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[2]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[2]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[2]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[2]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[2]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[1]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 63961 megabytes

[1]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[1]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[1]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[1]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[1]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[1]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[1]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[0]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[0]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[0]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[0]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[0]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[0]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[19]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[19]PETSC ERROR: Error in external library
[19]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 66131 megabytes

[19]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[19]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[19]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-8.local by venkatesh Wed May 27 00:28:08 2015
[19]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[19]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[19]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[19]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[19]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[19]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[19]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[19]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[19]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[19]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[19]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[19]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 19
[cli_19]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 19
#2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[6]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[6]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[6]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[6]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[6]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[6]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[6]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[6]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[6]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[5]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[5]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[5]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[5]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[5]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[5]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[5]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[5]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[16]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[16]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[16]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[16]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[16]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[16]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[16]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[16]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[23]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[23]PETSC ERROR: Error in external library
[23]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 67701 megabytes

[23]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[23]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[23]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-8.local by venkatesh Wed May 27 00:28:08 2015
[23]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[23]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[23]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[23]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[23]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[23]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[23]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[23]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[23]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[23]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[23]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[23]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 23
[10]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[10]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[17]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[17]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[17]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[17]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[17]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[17]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[17]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[20]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[20]PETSC ERROR: Error in external library
[20]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 65476 megabytes

[20]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[20]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[20]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[20]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[20]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[20]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[20]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[20]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[20]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[20]PETSC ERROR: [35]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[35]PETSC ERROR: Error in external library
[35]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 57572 megabytes

[35]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[35]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[35]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-8.local by venkatesh Wed May 27 00:28:08 2015
[35]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[35]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[35]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[35]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[35]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[35]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[35]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[35]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[35]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[35]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[35]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[35]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 35
[14]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[14]PETSC ERROR: Error in external library
[14]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 76742 megabytes

[14]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[14]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[14]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[14]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[14]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[14]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[14]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[14]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[14]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[14]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[14]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[14]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[14]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[21]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[21]PETSC ERROR: Error in external library
[21]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 61748 megabytes

[21]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[21]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[21]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[21]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[21]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[21]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[21]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[21]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[21]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[21]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[21]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[21]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[21]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[21]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[32]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[32]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[32]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[32]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[32]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[39]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[39]PETSC ERROR: Error in external library
[39]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 64773 megabytes

[39]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[39]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[39]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-8.local by venkatesh Wed May 27 00:28:08 2015
[39]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[39]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[39]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[39]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[39]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[39]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[39]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[39]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[39]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[39]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[39]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[39]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 39
[cli_39]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 39
----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 18
[37]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[37]PETSC ERROR: Error in external library
[37]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 55361 megabytes

[37]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[37]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[37]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[37]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[37]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[37]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[40]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[40]PETSC ERROR: Error in external library
[40]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 65450 megabytes

[40]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[40]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[40]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[40]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[40]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[40]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[40]PETSC ERROR: [43]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[43]PETSC ERROR: Error in external library
[43]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 58608 megabytes

[43]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[43]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[43]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-8.local by venkatesh Wed May 27 00:28:08 2015
[43]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[43]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[43]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[43]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[43]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[43]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[43]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[43]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[43]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[43]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[43]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[43]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 43
[cli_43]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 43
[22]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[22]PETSC ERROR: Error in external library
[22]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 65695 megabytes

[22]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[22]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[22]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[22]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[22]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[22]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[22]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[22]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[22]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[41]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[41]PETSC ERROR: Error in external library
[41]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 54285 megabytes

[41]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[41]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[41]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[41]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[41]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[41]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[41]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[41]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[41]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[41]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[41]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[41]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[41]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[41]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[41]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
#7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[48]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[48]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[48]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[48]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[55]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[55]PETSC ERROR: Error in external library
[55]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 48241 megabytes

[55]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[55]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[55]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-8.local by venkatesh Wed May 27 00:28:08 2015
[55]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[55]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[55]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[55]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[55]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[55]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[55]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[55]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[55]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[55]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[55]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[55]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 55
[cli_55]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 55
[34]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[34]PETSC ERROR: Error in external library
[34]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 58458 megabytes

[34]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[34]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[34]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[34]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[34]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[34]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[34]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[34]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[34]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[34]PETSC ERROR: [1]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[1]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[1]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[1]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[1]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[1]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[1]PETSC ERROR: [56]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[56]PETSC ERROR: Error in external library
[56]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 58551 megabytes

[56]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[56]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[56]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[56]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[56]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[56]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[56]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[56]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[56]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[56]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[56]PETSC ERROR: [42]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[42]PETSC ERROR: Error in external library
[42]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 49860 megabytes

[42]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[42]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[42]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[42]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[42]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[42]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[42]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[42]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[42]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[42]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[42]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[5]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[5]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[0]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[0]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[0]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[0]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[0]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[0]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[46]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[46]PETSC ERROR: Error in external library
[46]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 71031 megabytes

[46]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[46]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[46]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[46]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[46]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[46]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[46]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[46]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[46]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[46]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[46]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[46]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[46]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[46]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[46]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[17]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[17]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 17
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 16
[cli_16]: application called MPI_Abort(MPI_COMM_WORLD, 76) - process 2
[cli_2]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 2
#10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[21]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 21
#6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[20]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[20]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[20]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[20]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[20]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 20
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 6
[cli_6]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 6
[25]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[25]PETSC ERROR: Error in external library
[25]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 68676 megabytes

[25]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[25]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[25]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[25]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[25]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[25]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[25]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[25]PETSC ERROR: application called MPI_Abort(MPI_COMM_WORLD, 76) - process 32
[cli_32]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 32
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 10
[cli_10]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 10
[37]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[37]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[37]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[37]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[37]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[37]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[37]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[37]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
#3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[40]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[40]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[40]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[40]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[40]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[40]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[14]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[14]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 14
[cli_14]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 14
#10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[1]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 1
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 48
[cli_48]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 48
[cli_18]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 18
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 5
[cli_5]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 5
#7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[56]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[56]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[56]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[56]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[22]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[22]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[22]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[22]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[22]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[22]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 22
[cli_21]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 21
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 0
#6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[34]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[34]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[34]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[34]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[34]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 34
#4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[25]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[25]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[25]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[25]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[25]PETSC ERROR: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 16
[42]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[42]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[42]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[42]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 42
[37]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 37
[cli_20]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 20
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 46
[cli_46]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 46
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 41
[cli_41]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 41
[40]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[40]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 40
[cli_22]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 22
[cli_1]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 1
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 56
[cli_56]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 56
[cli_34]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 34
[cli_17]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 17
[cli_0]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 0
[cli_42]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 42
#9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[25]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[25]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[cli_40]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 40
[26]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[26]PETSC ERROR: Error in external library
[26]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 58191 megabytes

[26]PETSC ERROR: [cli_37]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 37
[12]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[26]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[26]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[26]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[26]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 25
[cli_25]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 25
--------------------- Error Message --------------------------------------------------------------
[26]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
--------------------- Error Message --------------------------------------------------------------
[52]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[52]PETSC ERROR: Error in external library
[52]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 58405 megabytes

[52]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[52]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[52]PETSC ERROR: [26]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[26]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[26]PETSC ERROR: [33]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[52]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[52]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
#5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[26]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[26]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
Error in external library
[52]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[52]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[52]PETSC ERROR: [26]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[26]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[26]PETSC ERROR: [33]PETSC ERROR: [24]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[24]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[26]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 46237 megabytes

#4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[52]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[52]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[52]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 26
[33]PETSC ERROR: Error in external library
[24]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 69315 megabytes

[24]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[24]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[24]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[24]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[cli_26]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 26
See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[28]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[28]PETSC ERROR: Error in external library
[28]PETSC ERROR: [30]PETSC ERROR: [33]PETSC ERROR: [52]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[52]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[52]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[52]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
--------------------- Error Message --------------------------------------------------------------
[9]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[9]PETSC ERROR: Error in external library
[9]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 70478 megabytes

[9]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[9]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[9]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[9]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[9]PETSC ERROR: [24]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[24]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[24]PETSC ERROR: [30]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 68179 megabytes

[28]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[28]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[28]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[28]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[28]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[38]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[38]PETSC ERROR: Error in external library
[38]PETSC ERROR: [13]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[13]PETSC ERROR: Error in external library
[13]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 70887 megabytes

[13]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[13]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[13]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[13]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[24]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[24]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[24]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 63402 megabytes

[38]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[38]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[38]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[38]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[29]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[29]PETSC ERROR: Error in external library
[29]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 66349 megabytes

[29]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[29]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[29]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[29]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[29]PETSC ERROR: [28]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[28]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[28]PETSC ERROR: [38]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[13]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[13]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[36]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[36]PETSC ERROR: Error in external library
[36]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 67737 megabytes

[36]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[36]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[36]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[36]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[36]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[38]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[38]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[29]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[29]PETSC ERROR: application called MPI_Abort(MPI_COMM_WORLD, 76) - process 52
[cli_52]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 52
#3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[38]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[38]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[13]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[13]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[13]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[24]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[24]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[24]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[24]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[24]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[38]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[38]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[38]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
#3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[29]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[29]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[29]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[28]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[28]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[28]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[28]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[28]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[50]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[50]PETSC ERROR: Error in external library
[50]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 61866 megabytes

[50]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[50]PETSC ERROR: [9]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[9]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[9]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[9]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[36]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[36]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[36]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[36]PETSC ERROR: [38]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[38]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[38]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[13]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[13]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[13]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[13]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 24
Petsc Release Version 3.5.3, Jan, 31, 2015 
[50]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[50]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[50]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
#6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[29]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[29]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[29]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[28]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[28]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[54]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[54]PETSC ERROR: Error in external library
[54]PETSC ERROR: [9]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[9]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[9]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
#5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[36]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[36]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[36]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[36]PETSC ERROR: application called MPI_Abort(MPI_COMM_WORLD, 76) - process 38
[13]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[13]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[cli_24]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 24
[50]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[29]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[29]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 28
[cli_28]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 28
Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 49070 megabytes

[54]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[54]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[54]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[54]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[54]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[9]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[9]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[9]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
#9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[36]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[36]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[cli_38]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 38
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 13
[cli_13]: application called MPI_Abort(MPI_COMM_WORLD, 76) - process 36
[50]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[50]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[50]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[50]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 29
[cli_36]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 36
[50]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[50]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[50]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 9
[12]PETSC ERROR: [54]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[54]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[54]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[54]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 13
Error in external library
[50]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[50]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[cli_29]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 29
[12]PETSC ERROR: [54]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[54]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[54]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[cli_9]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 9
Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 63360 megabytes

application called MPI_Abort(MPI_COMM_WORLD, 76) - process 50
Petsc Release Version 3.5.3, Jan, 31, 2015 
[12]PETSC ERROR: [54]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[54]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[54]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[33]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[cli_50]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 50
./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[12]PETSC ERROR: application called MPI_Abort(MPI_COMM_WORLD, 76) - process 54
[cli_54]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 54
[33]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
Error in external library
Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[12]PETSC ERROR: [30]PETSC ERROR: [33]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 57090 megabytes

#1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[12]PETSC ERROR: [30]PETSC ERROR: [33]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
#2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[12]PETSC ERROR: [30]PETSC ERROR: [33]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
Petsc Release Version 3.5.3, Jan, 31, 2015 
#3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[12]PETSC ERROR: [30]PETSC ERROR: [33]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
#4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[12]PETSC ERROR: [30]PETSC ERROR: [33]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
#5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[12]PETSC ERROR: [30]PETSC ERROR: [33]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
#1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
#6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[12]PETSC ERROR: [30]PETSC ERROR: [33]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
#2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
#7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[12]PETSC ERROR: [30]PETSC ERROR: [33]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
#3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
#8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
#6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[30]PETSC ERROR: [33]PETSC ERROR: [12]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
#9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[8]PETSC ERROR: [30]PETSC ERROR: [33]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
#5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
#10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
Error in external library
[30]PETSC ERROR: [33]PETSC ERROR: [8]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[12]PETSC ERROR: [30]PETSC ERROR: application called MPI_Abort(MPI_COMM_WORLD, 76) - process 33
Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 65248 megabytes

#7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[cli_33]: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[30]PETSC ERROR: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 33
[8]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[45]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[45]PETSC ERROR: Error in external library
[45]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 46032 megabytes

[45]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[45]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[45]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[45]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[45]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[45]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[12]PETSC ERROR: [30]PETSC ERROR: [45]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[45]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[45]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[45]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[45]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[45]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[45]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[45]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
#9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[45]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[8]PETSC ERROR: [30]PETSC ERROR: application called MPI_Abort(MPI_COMM_WORLD, 76) - process 45
[cli_45]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 45
#9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
#10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[49]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[49]PETSC ERROR: Error in external library
[49]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 54280 megabytes

[49]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[49]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[49]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[49]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[49]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[49]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[49]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[30]PETSC ERROR: [57]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[57]PETSC ERROR: Error in external library
[57]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 54334 megabytes

[57]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[57]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[57]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-6.local by venkatesh Wed May 27 00:29:26 2015
[57]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[57]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[57]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[57]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[57]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[57]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[57]PETSC ERROR: [12]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
#3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[49]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[49]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[49]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[49]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[49]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[49]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[49]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[49]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 49
[cli_49]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 49
[8]PETSC ERROR: application called MPI_Abort(MPI_COMM_WORLD, 76) - process 30
#6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[57]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[57]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[57]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[57]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[57]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 57
./ex7 on a linux-gnu named compute-0-4.local by venkatesh Wed May 27 00:28:30 2015
[cli_30]: [cli_57]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 57
#10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 30
[8]PETSC ERROR: [58]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[58]PETSC ERROR: Error in external library
[58]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 89756 megabytes

[58]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[58]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[58]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[58]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[58]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[58]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[58]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[58]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[58]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[58]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[58]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[58]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[12]PETSC ERROR: [62]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[62]PETSC ERROR: Error in external library
[62]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 57502 megabytes

[62]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[62]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[62]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-7.local by venkatesh Wed May 27 00:28:43 2015
[62]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[62]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[62]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[62]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[62]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[62]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[62]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[62]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[62]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[62]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[62]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[62]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 62
Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[58]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[58]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[58]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 58
[cli_58]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 58
----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
[11]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[11]PETSC ERROR: Error in external library
[11]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 61538 megabytes

[11]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[11]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[11]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-8.local by venkatesh Wed May 27 00:28:08 2015
[11]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[11]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[11]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[11]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[11]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[11]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[11]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[11]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[11]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[11]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[11]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[11]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 11
[cli_11]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 11
[cli_62]: aborting job:
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 62
[8]PETSC ERROR: [15]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[15]PETSC ERROR: Error in external library
[15]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: Cannot allocate required memory 61278 megabytes

[15]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[15]PETSC ERROR: Petsc Release Version 3.5.3, Jan, 31, 2015 
[15]PETSC ERROR: ./ex7 on a linux-gnu named compute-0-8.local by venkatesh Wed May 27 00:28:08 2015
[15]PETSC ERROR: Configure options PETSC_ARCH=linux-gnu --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --download-fblaslapack=/cluster/share/apps/fblaslapack-3.4.2.tar.gz --download-mpich=/cluster/share/apps/mpich-3.1.tar.gz --download-mumps=/cluster/share/apps/MUMPS_4.10.0-p3.tar.gz --download-scalapack=/cluster/share/apps/scalapack-2.0.2.tgz --download-blacs=/cluster/share/apps/blacs-dev.tar.gz --download-parmetis=/cluster/share/apps/parmetis-4.0.2-p5.tar.gz --download-metis=/cluster/share/apps/metis-5.0.2-p3.tar.gz --download-cmake=/cluster/share/apps/cmake-2.8.12.2.tar.gz --with-scalar-type=complex --with-fortran-kernels=1 --with-large-file-io=1 --with-debugging=no
[15]PETSC ERROR: #1 MatFactorNumeric_MUMPS() line 743 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/impls/aij/mpi/mumps/mumps.c
[15]PETSC ERROR: #2 MatLUFactorNumeric() line 2893 in /cluster/share/venkatesh/petsc-3.5.3/src/mat/interface/matrix.c
[15]PETSC ERROR: #3 PCSetUp_LU() line 152 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/impls/factor/lu/lu.c
[15]PETSC ERROR: #4 PCSetUp() line 902 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/pc/interface/precon.c
[15]PETSC ERROR: #5 KSPSetUp() line 306 in /cluster/share/venkatesh/petsc-3.5.3/src/ksp/ksp/interface/itfunc.c
[15]PETSC ERROR: #6 STSetUp_Sinvert() line 145 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/impls/sinvert/sinvert.c
[15]PETSC ERROR: #7 STSetUp() line 301 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/sys/classes/st/interface/stsolve.c
[15]PETSC ERROR: #8 EPSSetUp() line 207 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssetup.c
[15]PETSC ERROR: #9 EPSSolve() line 88 in /cluster/share/venkatesh/petsc-3.5.3/slepc-3.5.3/src/eps/interface/epssolve.c
[15]PETSC ERROR: #10 main() line 146 in /cluster/share/venkatesh/petsc-3.5.3/eigs/ex7.c
[15]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
application called MPI_Abort(MPI_COMM_WORLD, 76) - process 15
Generalized eigenproblem stored in file.