job.ne299.n63.np1000.sh ======================= log.ne299.n63.np1000, log.ne299.n63.np1000.nonscalable ----------------------------------------------------- MatPtAP 4 1.0 2.1520e+01 1.0 9.13e+08 1.3 1.2e+06 2.4e+04 7.0e+01 16 14 2 29 1 42 74 13 59 1 39953 MatPtAPSymbolic 4 1.0 1.3167e+01 1.0 0.00e+00 0.0 4.9e+05 3.3e+04 3.0e+01 10 0 1 16 0 26 0 5 33 0 0 MatPtAPNumeric 4 1.0 8.3915e+00 1.0 9.13e+08 1.3 7.2e+05 1.7e+04 4.0e+01 6 14 1 12 0 16 74 8 26 1 102460 log.ne299.n63.np1000.scalable --------------------------------- MatPtAP 4 1.0 4.3607e+01 1.0 9.11e+08 1.3 1.2e+06 2.4e+04 6.8e+01 28 14 2 29 1 60 74 13 59 1 19675 MatPtAPSymbolic 4 1.0 1.8610e+01 1.0 0.00e+00 0.0 4.9e+05 3.3e+04 2.8e+01 12 0 1 16 0 26 0 5 33 0 0 MatPtAPNumeric 4 1.0 2.5012e+01 1.0 9.11e+08 1.3 7.2e+05 1.7e+04 4.0e+01 16 14 1 12 0 34 74 8 26 1 34303 log.ne299.n63.np1000.hypre --------------------------- MatPtAP 4 1.0 1.7535e+02 1.0 0.00e+00 0.0 5.0e+05 7.0e+01 5.6e+01 60 0 1 0 1 85 0 7 0 1 0 MatPtAPSymbolic 4 1.0 7.6109e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatPtAPNumeric 4 1.0 1.7535e+02 1.0 0.00e+00 0.0 5.0e+05 7.0e+01 5.6e+01 60 0 1 0 1 85 0 7 0 1 0 job.ne349.n63.np1000.sh ======================== log.ne349.n63.np1000.scalable ---------------------------- MatPtAP 4 1.0 6.7130e+01 1.0 1.41e+09 1.2 1.0e+06 3.4e+04 6.8e+01 26 12 1 26 0 60 74 12 59 1 20105 MatPtAPSymbolic 4 1.0 2.8859e+01 1.0 0.00e+00 0.0 4.4e+05 4.5e+04 2.8e+01 11 0 0 14 0 26 0 5 32 0 0 MatPtAPNumeric 4 1.0 3.8286e+01 1.0 1.41e+09 1.2 6.1e+05 2.7e+04 4.0e+01 15 12 1 12 0 34 74 7 27 0 35252 log.ne349.n63.np1000.hypre -------------------------- MatPtAP 4 1.0 1.8920e+02 1.0 0.00e+00 0.0 4.0e+05 1.0e+02 5.6e+01 50 0 0 0 0 80 0 6 0 1 0 MatPtAPSymbolic 4 1.0 7.5026e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatPtAPNumeric 4 1.0 1.8920e+02 1.0 0.00e+00 0.0 4.0e+05 1.0e+02 5.6e+01 50 0 0 0 0 80 0 6 0 1 0 log.ne349.n63.np1000 ---------------------- ne349.n63.np1000.error: 386]PETSC ERROR: #1 MatLUFactorSymbolic_SeqAIJ() line 366 in /gpfs/mira-home/zhangh/soft/petsc/src/mat/impls/aij/seq/aijfact.c job.ne399.n63.np1000.sh ========================= log.ne399.n63.np1000.hypre --------------------------- MatPtAP 5 1.0 2.4457e+02 1.0 0.00e+00 0.0 3.7e+05 1.4e+02 7.0e+01 46 0 0 0 0 79 0 5 0 0 0 MatPtAPSymbolic 5 1.0 9.3967e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatPtAPNumeric 5 1.0 2.4457e+02 1.0 0.00e+00 0.0 3.7e+05 1.4e+02 7.0e+01 46 0 0 0 0 79 0 5 0 0 0 ne399.n63.np1000.error (MatPtAP are done, take too much memeory?): [242]PETSC ERROR: #1 MatSeqAIJSetPreallocation_SeqAIJ() line 3539 in /gpfs/mira-home/zhangh/soft/petsc/src/mat/impls/aij/seq/aij.c [242]PETSC ERROR: #4 MatGetSubMatrices_MPIAIJ_Local() line 2561 in /gpfs/mira-home/zhangh/soft/petsc/src/mat/impls/aij/mpi/mpiov.c [242]PETSC ERROR: #7 PCSetUp_ASM() line 326 in /gpfs/mira-home/zhangh/soft/petsc/src/ksp/pc/impls/asm/asm.c [242]PETSC ERROR: #10 PCSetUp_MG() line 787 in /gpfs/mira-home/zhangh/soft/petsc/src/ksp/pc/impls/mg/mg.c [242]PETSC ERROR: #11 PCSetUp_GAMG() line 669 in /gpfs/mira-home/zhangh/soft/petsc/src/ksp/pc/impls/gamg/gamg.c job.ne499.n63.np1000.sh ======================= 242]PETSC ERROR: #2 MatTransposeMatMultNumeric_MPIAIJ_MPIAIJ() line 1466 in /gpfs/mira-home/zhangh/soft/petsc/src/mat/impls/aij/mpi/mpimatmatmult.c PetscCalloc1(bi[cm]+1,&ba); -- local nnz of Cmpi job.ne599.n500.np8000.sh ======================== log.ne599.n63.np8000 ---------------------- MatPtAP 5 1.0 3.6224e+01 1.0 9.23e+08 1.3 1.2e+07 2.1e+04 8.7e+01 20 13 2 27 1 45 75 12 60 1 193838 MatPtAPSymbolic 5 1.0 1.6837e+01 1.0 0.00e+00 0.0 4.3e+06 3.3e+04 3.7e+01 9 0 1 15 0 21 0 5 34 0 0 MatPtAPNumeric 5 1.0 1.9404e+01 1.0 9.23e+08 1.3 7.5e+06 1.5e+04 5.0e+01 11 13 1 12 1 24 75 8 26 1 361862 log.ne599.n63.np8000.scalable ----------------------------- MatPtAP 5 1.0 4.6129e+01 1.0 9.22e+08 1.3 1.2e+07 2.1e+04 8.5e+01 24 13 2 27 1 51 75 12 60 1 152103 MatPtAPSymbolic 5 1.0 1.9980e+01 1.0 0.00e+00 0.0 4.3e+06 3.3e+04 3.5e+01 11 0 1 15 0 22 0 5 34 0 0 MatPtAPNumeric 5 1.0 2.6166e+01 1.0 9.22e+08 1.3 7.5e+06 1.5e+04 5.0e+01 14 13 1 12 1 29 75 8 26 1 268150 log.ne599.n63.np8000.hypre ------------------------- MatPtAP 5 1.0 1.9389e+02 1.0 0.00e+00 0.0 5.1e+06 6.1e+01 7.0e+01 57 0 1 0 1 81 0 7 0 1 0 MatPtAPSymbolic 5 1.0 1.7010e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatPtAPNumeric 5 1.0 1.9389e+02 1.0 0.00e+00 0.0 5.1e+06 6.1e+01 7.0e+01 57 0 1 0 1 81 0 7 0 1 0 log.ne599.n63.np8000.nonscalable --------------------------------- [400]PETSC ERROR: #2 MatMatMultNumeric_SeqAIJ_SeqAIJ() line 195 in /gpfs/mira-home/zhangh/soft/petsc/src/mat/impls/aij/seq/matmatmult.c PetscCalloc1(B->cmap->N,&ab_dense); PCSetUp_GAMG() line 560 in /gpfs/mira-home/zhangh/soft/petsc/src/ksp/pc/impls/gamg/gamg.c