1 proc externalsolver stuck at 100% with 12%memory out of 12GB 1 proc externalsolver at 0% mpiexec -np 2 externalsolver [0] PetscInitialize(): PETSc successfully started: number of processors = 2 [0] PetscInitialize(): Running on machine: mat1.uibk.ac.at [1] PetscInitialize(): PETSc successfully started: number of processors = 2 [1] PetscInitialize(): Running on machine: mat1.uibk.ac.at [1] PetscCommDuplicate(): Duplicating a communicator 1140850688 -2080374784 max tags = 2147483647 [1] PetscCommDuplicate(): returning tag 2147483647 [0] PetscCommDuplicate(): Duplicating a communicator 1140850688 -2080374784 max tags = 2147483647 [0] PetscCommDuplicate(): returning tag 2147483647 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850688 -2080374784 [1] PetscCommDuplicate(): returning tag 2147483646 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850688 -2080374784 [0] PetscCommDuplicate(): returning tag 2147483646 [0] MatSetUpPreallocation(): Warning not preallocating matrix storage [0] PetscCommDuplicate(): Duplicating a communicator 1140850689 -2080374783 max tags = 2147483647 [1] PetscCommDuplicate(): Duplicating a communicator 1140850689 -2080374783 max tags = 2147483647 [1] PetscCommDuplicate(): returning tag 2147483647 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483646 [0] PetscCommDuplicate(): returning tag 2147483647 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483646 [0] MatSetOption_MPISBAIJ(): Option SYMMETRIC ignored [0] MatStashScatterBegin_Private(): No of messages: 1 [0] MatStashScatterBegin_Private(): Mesg_to: 1: size: 30544064 [0] MatStashScatterBegin_Private(): No of messages: 0 [0] MatAssemblyBegin_MPISBAIJ(): Stash has 3818007 entries,uses 8 mallocs. [0] MatAssemblyBegin_MPISBAIJ(): Block-Stash has 3818007 entries, uses 8 mallocs. [0] MatAssemblyEnd_SeqSBAIJ(): Matrix size: 221545 X 221545, block size 1; storage space: 16676676 unneeded, 5477824 used [0] MatAssemblyEnd_SeqSBAIJ(): Number of mallocs during MatSetValues is 0 [0] MatAssemblyEnd_SeqSBAIJ(): Most nonzeros blocks in any row is 62 [1] MatAssemblyEnd_SeqSBAIJ(): Matrix size: 225367 X 225367, block size 1; storage space: 16793278 unneeded, 5743422 used [1] MatAssemblyEnd_SeqSBAIJ(): Number of mallocs during MatSetValues is 0 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483645 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483644 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483643 [0] PetscCommDuplicate(): returning tag 2147483639 [0] PetscCommDuplicate(): returning tag 2147483634 [0] VecScatterCreateCommon_PtoS(): Using blocksize 1 scatter [0] VecScatterCreate(): General case: MPI to Seq [0] PetscCommDuplicate(): returning tag 2147483630 [0] PetscCommDuplicate(): returning tag 2147483625 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483642 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483641 [0] PetscCommDuplicate[1] MatAssemblyEnd_SeqSBAIJ(): Most nonzeros blocks in any row is 65 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483645 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483644 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483643 [1] PetscCommDuplicate(): returning tag 2147483639 [1] PetscCommDuplicate(): returning tag 2147483634 [1] PetscCommDuplicate(): returning tag 2147483630 [1] PetscCommDuplicate(): returning tag 2147483625 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483642 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483641 [1] PetscCommDuplicate(): returning tag 2147483620 [1] PetscC(): returning tag 2147483620 [0] VecScatterCreateCommon_PtoS(): Using blocksize 1 scatter [0] VecScatterCreate(): General case: MPI to MPI [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483640 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483639 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483638 [0] MatAssemblyEnd_SeqBAIJ(): Matrix size: 221545 X 6275, block size 1; storage space: 22060506 unneeded, 93994 used [0] MatAssemblyEnd_SeqBAIJ(): Number of mallocs during MatSetValues is 0 [0] MatAssemblyEnd_SeqBAIJ(): Most nonzeros blocks in any row is 32 [0] Mat_CheckCompressedRow(): Found the ratio (num_zerorows 216534)/(num_localrows 221545) > 0.6. Use CompressedRow routines. [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850688 -2080374784 [0] PetsommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483640 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483639 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483638 [1] MatAssemblyEnd_SeqBAIJ(): Matrix size: 225367 X 0, block size 1; storage space: 22536700 unneeded, 0 used [1] MatAssemblyEnd_SeqBAIJ(): Number of mallocs during MatSetValues is 0 [1] MatAssemblyEnd_SeqBAIJ(): Most nonzeros blocks in any row is 0 [1] Mat_CheckCompressedRow(): Found the ratio (num_zerorows 225367)/(num_localrows 225367) > 0.6. Use CompressedRow routines. [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850688 -2080374784 [1] PetscCommDuplicate(): returning tag 2147483614 [1] PetscCommDuplicate(): returning tag 2147483613 [1]before KSPsetup [1] PetscCommDuplicate(): Using internal PcCommDuplicate(): returning tag 2147483614 [0] PetscCommDuplicate(): returning tag 2147483613 [0]before KSPsetup [0] PCSetUp(): Setting up new PC [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483637 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483636 [0] PetscCommDuplicate(): returning tag 2147483612 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483635 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483634 ETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483637 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483636 [1] PetscCommDuplicate(): returning tag 2147483612 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483635 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483634 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483633 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483632 [0] PetscCommDuplicate(): returning tag 2147483607 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483633 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483632 [1] PetscCommDuplicate(): returning tag 2147483607 [0] PetscCommDuplicate(): returning tag 2147483602 [0] VecScatterCreate(): Special case: processor zero gets entire parallel vector, rest get none [1] PetscCommDuplicate(): returning tag 2147483602 DMUMPS 4.8.4 L D L^T Solver for symmetric positive definite matrices Type of parallelism: Working host ****** ANALYSIS STEP ******** Density: NBdense, Average, Median = 0 49 50 Ordering based on METIS ** Peak of sequential stack size (number of real entries) : 16763905. A root of estimated size 2965 has been selected for Scalapack. Leaving analysis phase with ... INFOG(1) = 0 INFOG(2) = 0 -- (20) Number of entries in factors (estim.) = 120657071 -- (3) Storage of factors (REAL, estimated) = 137364268 -- (4) Storage of factors (INT , estimated) = 6138804 -- (5) Maximum frontal size (estimated) = 3705 -- (6) Number of nodes in the tree = 21863 -- (7) Ordering option effectively used = 5 ICNTL(6) Maximum transversal option = 0 ICNTL(7) Pivot order option = 7 Percentage of memory relaxation (effective) = 200 Number of level 2 nodes = 1 Number of split nodes = 0 RINFO(1) Operations during elimination (estim) = 1.114D+11 Distributed matrix entry format (ICNTL(18)) = 3 ** Rank of proc needing largest memory in IC facto : 0 ** Estimated corresponding MBYTES for IC facto : 2085 ** Estimated avg. MBYTES per work. proc at facto (IC) : 2044 ** TOTAL space in MBYTES for IC factorization : 4088 ** Rank of proc needing largest memory for OOC facto : 1 ** Estimated corresponding MBYTES for OOC facto : 644 ** Estimated avg. MBYTES per work. proc at facto (OOC) : 630 ** TOTAL space in MBYTES for OOC factorization : 1261 ****** FACTORIZATION STEP ******** GLOBAL STATISTICS PRIOR NUMERICAL FACTORIZATION ... NUMBER OF WORKING PROCESSES = 2 REAL SPACE FOR FACTORS = 137364268 INTEGER SPACE FOR FACTORS = 6138804 MAXIMUM FRONTAL SIZE (ESTIMATED) = 3705 NUMBER OF NODES IN THE TREE = 21863 Maximum effective relaxed size of S = 239060000 Average effective relaxed size of S = 234725641 REDISTRIB: TOTAL DATA LOCAL/SENT = 9086109 2238491 GLOBAL TIME FOR MATRIX DISTRIBUTION = 0.8155 ** Memory relaxation parameter ( ICNTL(14) ) : 200 ** Rank of processor needing largest memory in facto : 0 ** Space in MBYTES used by this processor for facto : 2085 ** Avg. Space in MBYTES per working proc during facto : 2044 ELAPSED TIME FOR FACTORIZATION = 28.2595 Maximum effective space used in S (KEEP(67) = 77516871 Average effective space used in S (KEEP(67) = 75395654 ** EFF Min: Rank of processor needing largest memory : 0 ** EFF Min: Space in MBYTES used by this processor : 741 ** EFF Min: Avg. Space in MBYTES per working proc : 720 GLOBAL STATISTICS RINFOG(2) OPERATIONS DURING NODE ASSEMBLY = 2.565D+08 ------(3) OPERATIONS DURING NODE ELIMINATION = 1.114D+11 INFOG (9) REAL SPACE FOR FACTORS = 137364268 INFOG(10) INTEGER SPACE FOR FACTORS = 6138809 INFOG(11) MAXIMUM FRONT SIZE = 3705 INFOG(29) NUMBER OF ENTRIES IN FACTORS = 116259976 INFOG(12) NB OF NEGATIVE PIVOTS = 0 INFOG(14) NUMBER OF MEMORY COMPRESS = 0 [0]after KSPsetup [0]RHS setup [1]after KSPsetup [1]RHS setup [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850688 -2080374784 [1] PetscCommDuplicate(): returning tag 2147483601 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850688 -2080374784 [0] PetscCommDuplicate(): returning tag 2147483601 [1] PetscCommDuplicate(): returning tag 2147483596 [0] PetscCommDuplicate(): returning tag 2147483596 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850688 -2080374784 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850688 -2080374784 [1] PetscCommDuplicate(): returning tag 2147483591 [0] PetscCommDuplicate(): returning tag 2147483591 [0] VecAssemblyBegin_MPI(): Stash has 225367 entries, uses 12 mallocs. [0] VecAssemblyBegin_MPI(): Block-Stash has 0 entries, uses 0 mallocs. [0] PetscCommDuplicate(): returning tag 2147483590 [1] PetscCommDuplicate(): returning tag 2147483590 [1] PetscCommDuplicate(): returning tag 2147483589 [0] PetscCommDuplicate(): returning tag 2147483589 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483631 [1] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [1] PetscCommDuplicate(): returning tag 2147483630 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483631 [0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374783 [0] PetscCommDuplicate(): returning tag 2147483630