node1213:../M6_UNSTR/input_NK ]mpirun -machinefile ~/u1/DNK_proc.list -np 64 -ppn 16 ./fansc13.3.7_64_argus_3.6.1 M6 unstructured -log_view Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.752043648070e+02 true resid norm 2.752043648070e+02 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 2.194386890085e+00 true resid norm 2.194386890085e+00 ||r(i)||/||b|| 7.973663105319e-03 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 1.670581826658e+02 true resid norm 1.670581826658e+02 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 2.569948430616e+00 true resid norm 2.569948430616e+00 ||r(i)||/||b|| 1.538355314062e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 9.257547369364e+01 true resid norm 9.257547369364e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.313440922773e+00 true resid norm 1.313440922773e+00 ||r(i)||/||b|| 1.418778506195e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 8.369829924840e+01 true resid norm 8.369829924840e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.755612504481e+00 true resid norm 1.755612504481e+00 ||r(i)||/||b|| 2.097548600445e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 6.914169407895e+01 true resid norm 6.914169407895e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.291655224317e+00 true resid norm 1.291655224317e+00 ||r(i)||/||b|| 1.868127822905e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 6.104590435991e+01 true resid norm 6.104590435991e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.233624570758e-01 true resid norm 9.233624570758e-01 ||r(i)||/||b|| 1.512570690462e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 5.549660816989e+01 true resid norm 5.549660816989e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.565726049743e-01 true resid norm 7.565726049743e-01 ||r(i)||/||b|| 1.363277198236e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 5.151519211917e+01 true resid norm 5.151519211917e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.994477491086e-01 true resid norm 7.994477491086e-01 ||r(i)||/||b|| 1.551867936859e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.817214948914e+01 true resid norm 4.817214948914e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.301735742108e-01 true resid norm 7.301735742108e-01 ||r(i)||/||b|| 1.515758756780e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.488423462885e+01 true resid norm 4.488423462885e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.176573068538e-01 true resid norm 8.176573068538e-01 ||r(i)||/||b|| 1.821702683838e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.162268814085e+01 true resid norm 4.162268814085e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.015011111792e-01 true resid norm 8.015011111792e-01 ||r(i)||/||b|| 1.925635145109e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.836699551430e+01 true resid norm 3.836699551430e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.913457344428e-01 true resid norm 7.913457344428e-01 ||r(i)||/||b|| 2.062568944570e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.523466007460e+01 true resid norm 3.523466007460e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.961265007254e-01 true resid norm 7.961265007254e-01 ||r(i)||/||b|| 2.259498173219e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.231798686574e+01 true resid norm 3.231798686574e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.433217801203e-01 true resid norm 8.433217801203e-01 ||r(i)||/||b|| 2.609450222329e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.966848812683e+01 true resid norm 2.966848812683e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.098389062960e-01 true resid norm 9.098389062960e-01 ||r(i)||/||b|| 3.066684430991e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.728469298466e+01 true resid norm 2.728469298466e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.810167314288e-01 true resid norm 8.810167314288e-01 ||r(i)||/||b|| 3.228977991154e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.515184764031e+01 true resid norm 2.515184764031e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.107841449213e-01 true resid norm 9.107841449213e-01 ||r(i)||/||b|| 3.621142104334e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.328624731492e+01 true resid norm 2.328624731492e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.211185604233e-01 true resid norm 9.211185604233e-01 ||r(i)||/||b|| 3.955633331409e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.164662728864e+01 true resid norm 2.164662728864e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.078098721758e-01 true resid norm 9.078098721758e-01 ||r(i)||/||b|| 4.193770512472e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.021396182694e+01 true resid norm 2.021396182694e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.070042442049e-01 true resid norm 9.070042442049e-01 ||r(i)||/||b|| 4.487018685253e-02 [20] CL 0.156115: max variation 0.00243381 in last 10 steps at Mach 0.84, Re 1.172e+07, Alpha 3.06[deg], Beta 0[deg]. ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./fansc13.3.7_64_argus_3.6.1 on a petscdev_opt named node1213 with 64 processors, by b0528796 Wed Jul 6 10:51:56 2016 Using Petsc Development GIT revision: v3.6.1-307-g26c82d3 GIT Date: 2015-08-06 11:50:34 -0500 Max Max/Min Avg Total Time (sec): 3.373e+01 1.00002 3.373e+01 Objects: 1.992e+03 1.00201 1.988e+03 Flops: 4.543e+09 1.14790 4.291e+09 2.746e+11 Flops/sec: 1.347e+08 1.14790 1.272e+08 8.142e+09 MPI Messages: 2.841e+04 7.44906 9.613e+03 6.153e+05 MPI Message Lengths: 1.783e+08 3.39706 1.417e+04 8.717e+09 MPI Reductions: 5.827e+03 1.00000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flops and VecAXPY() for complex vectors of length N --> 8N flops Summary of Stages: ----- Time ------ ----- Flops ----- --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total counts %Total Avg %Total counts %Total 0: Main Stage: 3.3728e+01 100.0% 2.7460e+11 100.0% 6.142e+05 99.8% 1.411e+04 99.6% 5.818e+03 99.8% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flops: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent Avg. len: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flops in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max time over all processors) ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flops --- Global --- --- Stage --- Total Max Ratio Max Ratio Max Ratio Mess Avg len Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s ------------------------------------------------------------------------------------------------------------------------ --- Event Stage 0: Main Stage MatMult 592 1.0 1.3552e+00 1.2 8.74e+08 1.2 1.7e+05 5.9e+03 0.0e+00 4 19 28 12 0 4 19 28 12 0 38886 MatMultTranspose 320 1.0 8.3030e-02 1.1 4.78e+07 1.1 2.9e+04 1.2e+03 0.0e+00 0 1 5 0 0 0 1 5 0 0 35278 MatSolve 272 1.1 2.4191e-01 1.3 1.12e+08 1.2 0.0e+00 0.0e+00 0.0e+00 1 2 0 0 0 1 2 0 0 0 27984 MatSOR 320 1.0 1.8817e+00 1.2 9.19e+08 1.2 1.2e+05 4.7e+03 0.0e+00 5 20 19 6 0 5 20 19 6 0 29453 MatLUFactorNum 60 1.0 1.7686e-01 1.4 2.82e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 9563 MatILUFactorSym 3 1.0 1.0428e-02 4.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatScale 16 1.0 3.3216e-03 2.8 6.19e+05 1.2 3.0e+03 9.5e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 11225 MatAssemblyBegin 507 1.0 1.6061e+00 4.6 0.00e+00 0.0 4.3e+03 8.9e+03 8.1e+02 3 0 1 0 14 3 0 1 0 14 0 MatAssemblyEnd 507 1.0 3.5794e-01 1.0 0.00e+00 0.0 3.0e+04 5.6e+02 7.5e+02 1 0 5 0 13 1 0 5 0 13 0 MatGetRow 812753 1.1 1.0723e-01 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetRowIJ 3 3.0 2.2278e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetSubMatrix 10 1.0 3.3400e-02 1.0 0.00e+00 0.0 8.5e+02 6.8e+02 1.6e+02 0 0 0 0 3 0 0 0 0 3 0 MatGetOrdering 3 3.0 9.4101e-0345.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatCoarsen 16 1.0 2.1354e-02 1.1 0.00e+00 0.0 2.7e+04 7.4e+02 5.7e+01 0 0 4 0 1 0 0 4 0 1 0 MatZeroEntries 22 1.0 7.6058e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatPtAP 320 1.0 7.4787e+00 1.0 2.31e+09 1.1 1.2e+05 2.1e+04 1.1e+03 22 51 19 29 19 22 51 20 29 19 18677 MatPtAPSymbolic 32 1.0 7.2976e-01 1.0 0.00e+00 0.0 2.7e+04 1.0e+04 2.2e+02 2 0 4 3 4 2 0 4 3 4 0 MatPtAPNumeric 320 1.0 6.7582e+00 1.0 2.31e+09 1.1 9.3e+04 2.4e+04 9.0e+02 20 51 15 26 15 20 51 15 26 15 20668 MatTrnMatMult 2 1.0 2.1487e-01 1.0 4.41e+06 1.3 6.4e+03 7.2e+03 3.8e+01 1 0 1 1 1 1 0 1 1 1 1207 MatTrnMatMultSym 2 1.0 1.3532e-01 1.1 0.00e+00 0.0 5.4e+03 3.6e+03 3.4e+01 0 0 1 0 1 0 0 1 0 1 0 MatTrnMatMultNum 2 1.0 7.7824e-02 1.0 4.41e+06 1.3 1.1e+03 2.6e+04 4.0e+00 0 0 0 0 0 0 0 0 0 0 3333 MatGetLocalMat 324 1.0 1.7165e-01 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetBrAoCol 320 1.0 1.4097e-01 2.3 0.00e+00 0.0 7.1e+04 2.1e+04 0.0e+00 0 0 12 17 0 0 0 12 17 0 0 MatGetSymTrans 64 1.0 1.8325e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecDot 212 1.0 6.5703e-02 2.0 1.81e+07 1.1 0.0e+00 0.0e+00 2.1e+02 0 0 0 0 4 0 0 0 0 4 16871 VecMDot 179 1.0 2.3955e-01 4.9 3.56e+07 1.1 0.0e+00 0.0e+00 1.8e+02 0 1 0 0 3 0 1 0 0 3 9123 VecNorm 359 1.0 3.4022e-01 2.3 7.15e+07 1.1 0.0e+00 0.0e+00 3.6e+02 1 2 0 0 6 1 2 0 0 6 12894 VecScale 720 1.0 1.6064e-02 1.3 1.15e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 43445 VecCopy 220 1.0 7.5293e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecSet 1213 1.0 5.7940e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecAXPY 305 1.0 7.2862e-02 1.2 3.96e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 33368 VecAYPX 199 1.0 4.2231e-02 2.2 1.87e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 27114 VecMAXPY 219 1.0 7.4783e-02 1.5 5.26e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 43209 VecAssemblyBegin 489 1.0 6.2453e-0110.7 0.00e+00 0.0 0.0e+00 0.0e+00 1.5e+03 1 0 0 0 25 1 0 0 0 25 0 VecAssemblyEnd 489 1.0 2.1520e-03 7.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecScatterBegin 1999 1.0 6.9421e-02 3.9 0.00e+00 0.0 4.1e+05 4.4e+03 0.0e+00 0 0 66 21 0 0 0 66 21 0 0 VecScatterEnd 1999 1.0 4.3129e-01 7.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 KSPGMRESOrthog 20 1.0 2.3158e-01 6.5 1.70e+07 1.1 0.0e+00 0.0e+00 2.0e+01 0 0 0 0 0 0 0 0 0 0 4516 KSPSetUp 442 1.0 1.4956e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 3.2e+01 0 0 0 0 1 0 0 0 0 1 0 KSPSolve 60 1.0 1.3196e+01 1.0 4.53e+09 1.1 5.8e+05 7.6e+03 5.0e+03 39100 94 51 86 39100 94 51 86 20746 PCGAMGGraph_AGG 16 1.0 7.3438e-01 1.0 6.19e+05 1.2 1.5e+04 3.8e+02 4.2e+02 2 0 2 0 7 2 0 2 0 7 51 PCGAMGCoarse_AGG 16 1.0 2.5052e-01 1.0 4.41e+06 1.3 3.9e+04 2.3e+03 1.3e+02 1 0 6 1 2 1 0 6 1 2 1035 PCGAMGProl_AGG 16 1.0 4.1306e-01 1.0 0.00e+00 0.0 8.6e+04 2.2e+03 2.3e+03 1 0 14 2 40 1 0 14 2 40 0 PCGAMGPOpt_AGG 16 1.0 5.9605e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 GAMG: createProl 16 1.0 1.3921e+00 1.0 5.03e+06 1.3 1.4e+05 2.1e+03 2.8e+03 4 0 23 3 49 4 0 23 3 49 213 Graph 32 1.0 7.2444e-01 1.0 6.19e+05 1.2 1.5e+04 3.8e+02 4.2e+02 2 0 2 0 7 2 0 2 0 7 51 MIS/Agg 16 1.0 2.1503e-02 1.1 0.00e+00 0.0 2.7e+04 7.4e+02 5.7e+01 0 0 4 0 1 0 0 4 0 1 0 SA: col data 16 1.0 1.3309e-01 1.0 0.00e+00 0.0 7.8e+04 1.9e+03 2.1e+03 0 0 13 2 36 0 0 13 2 36 0 SA: frmProl0 16 1.0 2.7238e-01 1.0 0.00e+00 0.0 7.2e+03 5.5e+03 1.6e+02 1 0 1 0 3 1 0 1 0 3 0 GAMG: partLevel 16 1.0 8.1264e-01 1.0 1.16e+08 1.1 2.1e+04 8.8e+03 5.3e+02 2 3 3 2 9 2 3 3 2 9 8594 Invert-Sort 5 1.0 2.9643e-0236.4 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+01 0 0 0 0 0 0 0 0 0 0 0 Move A 5 1.0 9.4361e-03 1.1 0.00e+00 0.0 5.9e+02 9.6e+02 8.5e+01 0 0 0 0 1 0 0 0 0 1 0 Move P 5 1.0 2.5612e-02 1.0 0.00e+00 0.0 2.6e+02 2.9e+01 8.5e+01 0 0 0 0 1 0 0 0 0 1 0 PCSetUp 120 1.0 9.1682e+00 1.0 2.35e+09 1.1 2.6e+05 1.1e+04 4.3e+03 27 52 42 32 74 27 52 42 32 74 15452 PCSetUpOnBlocks 60 1.0 1.8802e-01 1.3 2.82e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 8996 PCApply 272 1.0 2.3201e+00 1.1 1.12e+09 1.1 1.8e+05 3.6e+03 0.0e+00 6 25 29 7 0 6 25 29 7 0 29209 SFSetGraph 16 1.0 3.5317e-0322.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFBcastBegin 73 1.0 1.1283e-02 3.6 0.00e+00 0.0 2.7e+04 7.4e+02 1.6e+01 0 0 4 0 0 0 0 4 0 0 0 SFBcastEnd 73 1.0 5.3537e-03 6.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 ------------------------------------------------------------------------------------------------------------------------ Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Matrix 368 365 149426856 0 Matrix Coarsen 16 16 9920 0 Vector 1181 1181 218526896 0 Vector Scatter 99 99 115936 0 Krylov Solver 22 22 72976 0 Preconditioner 22 22 21648 0 Viewer 1 0 0 0 Index Set 267 267 821040 0 Star Forest Bipartite Graph 16 16 13440 0 ======================================================================================================================== Average time to get PetscTime(): 1.19209e-07 Average time for MPI_Barrier(): 7.58171e-06 Average time for zero size MPI_Send(): 7.02962e-06 #PETSc Option Table entries: -flow_ksp_max_it 8 -flow_ksp_monitor_true_residual -flow_ksp_rtol 0.1 -flow_ksp_type fgmres -flow_mg_coarse_ksp_max_it 3 -flow_mg_coarse_pc_asm_overlap 1 -flow_mg_coarse_pc_type bjacobi -flow_mg_coarse_sub_pc_factor_levels 2 -flow_mg_coarse_sub_pc_factor_mat_ordering_type rcm -flow_mg_coarse_sub_pc_type ilu -flow_mg_levels_ksp_type richardson -flow_mg_levels_pc_asm_overlap 1 -flow_mg_levels_pc_type sor -flow_mg_levels_sub_pc_factor_levels 1 -flow_mg_levels_sub_pc_factor_mat_ordering_type rcm -flow_pc_gamg_agg_nsmooths 0 -flow_pc_gamg_reuse_interpolation true -flow_pc_gamg_square_graph 2 -flow_pc_gamg_type agg -flow_pc_mg_cycle v -flow_pc_mg_levels 20 -flow_pc_mg_type kaskade -flow_pc_type gamg -ksp_max_it 50 -ksp_type fgmres -log_view -options_left #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure options: --CFLAGS="-O3 -axAVX" --CXXFLAGS="-std=c++11 -DMPICH_IGNORE_CXX_SEEK -DMPICH_IGNORE_CXX_SEEK" --FC=mpiifort --FFLAGS="-O3 -axAVX" --download-hypre=../petsc_extpacks/hypre-2.10.0b-p1.tar.gz --download-metis=../petsc_extpacks/metis-5.1.0-p1.tar.gz --download-ml=../petsc_extpacks/ml-6.2-win.tar.gz --download-parmetis=../petsc_extpacks/parmetis-4.0.3-p1.tar.gz --download-suitesparse=../petsc_extpacks/SuiteSparse-4.2.1.tar.gz --download-superlu_dist --with-blas-lapack-lib=-mkl --with-cc=mpiicc --with-cxx=mpiicpc --with-debugging=no --download-mumps=../petsc_extpacks/MUMPS_5.0.0-p1.tar.gz --with-scalapack-lib="-L/gpfs/fs1/intel/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_blacs_intelmpi_lp64" --with-scalapack-include=/gpfs/fs1/intel/mkl/include ----------------------------------------- Libraries compiled on Thu Aug 6 17:04:37 2015 on hpc-user13 Machine characteristics: Linux-2.6.32-279.el6.x86_64-x86_64-with-redhat-6.3-Santiago Using PETSc directory: /gpfs/fs2/aero/ACCOUNTS/k0528796/libs/petsc-dev Using PETSc arch: petscdev_opt ----------------------------------------- Using C compiler: mpiicc -O3 -axAVX -fPIC ${COPTFLAGS} ${CFLAGS} Using Fortran compiler: mpiifort -O3 -axAVX -fPIC ${FOPTFLAGS} ${FFLAGS} ----------------------------------------- Using include paths: -I/gpfs/fs2/aero/ACCOUNTS/k0528796/libs/petsc-dev/petscdev_opt/include -I/gpfs/fs2/aero/ACCOUNTS/k0528796/libs/petsc-dev/include -I/gpfs/fs2/aero/ACCOUNTS/k0528796/libs/petsc-dev/include -I/gpfs/fs2/aero/ACCOUNTS/k0528796/libs/petsc-dev/petscdev_opt/include -I/gpfs/fs1/intel/impi/4.1.0.024/intel64/include ----------------------------------------- Using C linker: mpiicc Using Fortran linker: mpiifort Using libraries: -Wl,-rpath,/gpfs/fs2/aero/ACCOUNTS/k0528796/libs/petsc-dev/petscdev_opt/lib -L/gpfs/fs2/aero/ACCOUNTS/k0528796/libs/petsc-dev/petscdev_opt/lib -lpetsc -Wl,-rpath,/gpfs/fs2/aero/ACCOUNTS/k0528796/libs/petsc-dev/petscdev_opt/lib -L/gpfs/fs2/aero/ACCOUNTS/k0528796/libs/petsc-dev/petscdev_opt/lib -lcmumps -ldmumps -lsmumps -lzmumps -lmumps_common -lpord -L/gpfs/fs1/intel/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_blacs_intelmpi_lp64 -lumfpack -lklu -lcholmod -lbtf -lccolamd -lcolamd -lcamd -lamd -lsuitesparseconfig -lsuperlu_dist_4.1 -lHYPRE -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -lmpigc4 -Wl,-rpath,/opt/intel/mpi-rt/4.1 -lml -lmpigc4 -mkl -lparmetis -lmetis -lX11 -lifport -lifcore -lm -lmpigc4 -ldl -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -lmpi -lmpigf -lmpigi -lrt -lpthread -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/opt/intel/mpi-rt/4.1 -limf -lsvml -lirng -lipgo -ldecimal -lcilkrts -lstdc++ -lgcc_s -lirc -lirc_s -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -ldl ----------------------------------------- #PETSc Option Table entries: -flow_ksp_max_it 8 -flow_ksp_monitor_true_residual -flow_ksp_rtol 0.1 -flow_ksp_type fgmres -flow_mg_coarse_ksp_max_it 3 -flow_mg_coarse_pc_asm_overlap 1 -flow_mg_coarse_pc_type bjacobi -flow_mg_coarse_sub_pc_factor_levels 2 -flow_mg_coarse_sub_pc_factor_mat_ordering_type rcm -flow_mg_coarse_sub_pc_type ilu -flow_mg_levels_ksp_type richardson -flow_mg_levels_pc_asm_overlap 1 -flow_mg_levels_pc_type sor -flow_mg_levels_sub_pc_factor_levels 1 -flow_mg_levels_sub_pc_factor_mat_ordering_type rcm -flow_pc_gamg_agg_nsmooths 0 -flow_pc_gamg_reuse_interpolation true -flow_pc_gamg_square_graph 2 -flow_pc_gamg_type agg -flow_pc_mg_cycle v -flow_pc_mg_levels 20 -flow_pc_mg_type kaskade -flow_pc_type gamg -ksp_max_it 50 -ksp_type fgmres -log_view -options_left #End of PETSc Option Table entries There are 8 unused database options. They are: Option left: name:-flow_mg_coarse_ksp_max_it value: 3 Option left: name:-flow_mg_coarse_pc_asm_overlap value: 1 Option left: name:-flow_mg_levels_pc_asm_overlap value: 1 Option left: name:-flow_mg_levels_sub_pc_factor_levels value: 1 Option left: name:-flow_mg_levels_sub_pc_factor_mat_ordering_type value: rcm Option left: name:-flow_pc_mg_cycle value: v Option left: name:-ksp_max_it value: 50 Option left: name:-ksp_type value: fgmres