node1213:../M6_UNSTR/input_NK ]mpirun -machinefile ~/u1/DNK_proc.list -np 64 -ppn 16 ./fansc13.3.7_64_argus M6 unstructured -log_view Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.752043648070e+02 true resid norm 2.752043648070e+02 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 2.072027655180e+00 true resid norm 2.072027655180e+00 ||r(i)||/||b|| 7.529050844208e-03 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 1.670607805350e+02 true resid norm 1.670607805350e+02 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 2.470600866779e+00 true resid norm 2.470600866779e+00 ||r(i)||/||b|| 1.478863476435e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 9.257744907550e+01 true resid norm 9.257744907550e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.318603282554e+00 true resid norm 1.318603282554e+00 ||r(i)||/||b|| 1.424324493408e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 8.371133071735e+01 true resid norm 8.371133071735e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.770065095597e+00 true resid norm 1.770065095597e+00 ||r(i)||/||b|| 2.114486868657e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 6.914265479472e+01 true resid norm 6.914265479472e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.258281699328e+00 true resid norm 1.258281699328e+00 ||r(i)||/||b|| 1.819834229773e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 6.104479801420e+01 true resid norm 6.104479801420e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.271628294813e-01 true resid norm 9.271628294813e-01 ||r(i)||/||b|| 1.518823650241e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 5.549136097241e+01 true resid norm 5.549136097241e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.346261180652e-01 true resid norm 7.346261180652e-01 ||r(i)||/||b|| 1.323856732277e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 5.151172584561e+01 true resid norm 5.151172584561e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.133028045829e-01 true resid norm 7.133028045829e-01 ||r(i)||/||b|| 1.384738703418e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.816875342468e+01 true resid norm 4.816875342468e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.118665131078e-01 true resid norm 7.118665131078e-01 ||r(i)||/||b|| 1.477859530289e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.487878586807e+01 true resid norm 4.487878586807e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.042175248323e-01 true resid norm 8.042175248323e-01 ||r(i)||/||b|| 1.791977009352e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.161834807766e+01 true resid norm 4.161834807766e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.539239184871e-01 true resid norm 7.539239184871e-01 ||r(i)||/||b|| 1.811518124363e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.836264417773e+01 true resid norm 3.836264417773e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.174801787618e-01 true resid norm 8.174801787618e-01 ||r(i)||/||b|| 2.130927615350e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.522883266523e+01 true resid norm 3.522883266523e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.244241726840e-01 true resid norm 8.244241726840e-01 ||r(i)||/||b|| 2.340197248425e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.230771248097e+01 true resid norm 3.230771248097e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.602350447376e-01 true resid norm 8.602350447376e-01 ||r(i)||/||b|| 2.662630618755e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.965932246733e+01 true resid norm 2.965932246733e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.725332011407e-01 true resid norm 8.725332011407e-01 ||r(i)||/||b|| 2.941851426653e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.727459045980e+01 true resid norm 2.727459045980e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.649699929636e-01 true resid norm 8.649699929636e-01 ||r(i)||/||b|| 3.171339984879e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.514218422982e+01 true resid norm 2.514218422982e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.952569714355e-01 true resid norm 8.952569714355e-01 ||r(i)||/||b|| 3.560776435540e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.327732747835e+01 true resid norm 2.327732747835e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.088995756474e-01 true resid norm 9.088995756474e-01 ||r(i)||/||b|| 3.904656049939e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.163582043406e+01 true resid norm 2.163582043406e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.088212488168e-01 true resid norm 9.088212488168e-01 ||r(i)||/||b|| 4.200539801976e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.020504842583e+01 true resid norm 2.020504842583e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.089706022608e-01 true resid norm 9.089706022608e-01 ||r(i)||/||b|| 4.498730134687e-02 [20] CL 0.156121: max variation 0.00242728 in last 10 steps at Mach 0.84, Re 1.172e+07, Alpha 3.06[deg], Beta 0[deg]. ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./fansc13.3.7_64_argus on a petscdev_opt named node1213 with 64 processors, by b0528796 Wed Jul 6 11:08:06 2016 Using Petsc Development GIT revision: v3.7.2-812-gc68d048 GIT Date: 2016-07-05 12:04:34 -0400 Max Max/Min Avg Total Time (sec): 4.234e+01 1.00003 4.234e+01 Objects: 2.441e+03 1.00164 2.437e+03 Flops: 4.949e+09 1.14038 4.659e+09 2.982e+11 Flops/sec: 1.169e+08 1.14035 1.100e+08 7.043e+09 MPI Messages: 4.346e+04 6.26602 1.810e+04 1.158e+06 MPI Message Lengths: 2.065e+08 3.41212 8.744e+03 1.013e+10 MPI Reductions: 6.512e+03 1.00000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flops and VecAXPY() for complex vectors of length N --> 8N flops Summary of Stages: ----- Time ------ ----- Flops ----- --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total counts %Total Avg %Total counts %Total 0: Main Stage: 4.2337e+01 100.0% 2.9819e+11 100.0% 1.157e+06 99.9% 8.714e+03 99.7% 6.503e+03 99.9% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flops: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent Avg. len: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flops in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max time over all processors) ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flops --- Global --- --- Stage --- Total Max Ratio Max Ratio Max Ratio Mess Avg len Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s ------------------------------------------------------------------------------------------------------------------------ --- Event Stage 0: Main Stage MatMult 652 1.0 1.4045e+00 1.2 8.75e+08 1.2 1.8e+05 5.7e+03 0.0e+00 3 18 15 10 0 3 18 15 10 0 37561 MatMultTranspose 380 1.0 9.4827e-02 1.2 4.89e+07 1.1 3.6e+04 1.0e+03 0.0e+00 0 1 3 0 0 0 1 3 0 0 31562 MatSolve 272 1.1 2.4189e-01 1.3 1.12e+08 1.2 0.0e+00 0.0e+00 0.0e+00 1 2 0 0 0 1 2 0 0 0 27987 MatSOR 380 1.0 2.0009e+00 1.2 9.61e+08 1.2 2.9e+05 2.2e+03 0.0e+00 4 19 25 6 0 4 19 25 6 0 28836 MatLUFactorNum 60 1.0 1.7169e-01 1.3 2.85e+07 1.3 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 9856 MatILUFactorSym 3 1.0 9.3882e-03 4.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatScale 19 1.0 6.6147e-03 4.9 6.49e+05 1.2 7.2e+03 4.4e+02 0.0e+00 0 0 1 0 0 0 0 1 0 0 5879 MatAssemblyBegin 2213 1.0 1.9655e+00 4.2 0.00e+00 0.0 1.1e+05 1.9e+04 9.4e+02 3 0 10 22 14 3 0 10 22 14 0 MatAssemblyEnd 2213 1.0 1.0980e+00 1.4 0.00e+00 0.0 6.3e+04 2.9e+02 8.5e+02 2 0 5 0 13 2 0 5 0 13 0 MatGetRow 831521 1.1 1.1663e-01 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetRowIJ 3 3.0 2.6741e-031402.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetSubMatrix 8 1.0 5.4080e-02 1.0 0.00e+00 0.0 1.2e+03 7.1e+02 1.4e+02 0 0 0 0 2 0 0 0 0 2 0 MatGetOrdering 3 3.0 1.9397e-02107.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatCoarsen 19 1.0 3.3676e-02 1.1 0.00e+00 0.0 6.4e+04 2.9e+02 8.5e+01 0 0 5 0 1 0 0 5 0 1 0 MatZeroEntries 402 1.0 1.6595e-01 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatPtAP 380 1.0 7.7259e+00 1.0 2.68e+09 1.1 3.2e+05 1.2e+04 1.3e+03 18 54 28 38 20 18 54 28 39 20 20832 MatPtAPSymbolic 38 1.0 9.8215e-01 1.0 0.00e+00 0.0 5.4e+04 5.8e+03 2.7e+02 2 0 5 3 4 2 0 5 3 4 0 MatPtAPNumeric 380 1.0 6.7484e+00 1.0 2.68e+09 1.1 2.7e+05 1.3e+04 1.1e+03 16 54 23 35 16 16 54 23 35 16 23850 MatTrnMatMult 1 1.0 1.3359e-01 1.1 3.00e+06 1.4 3.1e+03 7.0e+03 1.9e+01 0 0 0 0 0 0 0 0 0 0 1320 MatTrnMatMultSym 1 1.0 8.6439e-02 1.1 0.00e+00 0.0 2.6e+03 3.8e+03 1.7e+01 0 0 0 0 0 0 0 0 0 0 0 MatTrnMatMultNum 1 1.0 4.7411e-02 1.0 3.00e+06 1.4 5.2e+02 2.3e+04 2.0e+00 0 0 0 0 0 0 0 0 0 0 3721 MatGetLocalMat 382 1.0 1.2031e-01 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetBrAoCol 380 1.0 5.8299e-01 5.1 0.00e+00 0.0 1.7e+05 9.8e+03 0.0e+00 1 0 15 17 0 1 0 15 17 0 0 VecDot 212 1.0 7.3246e-02 2.0 1.81e+07 1.1 0.0e+00 0.0e+00 2.1e+02 0 0 0 0 3 0 0 0 0 3 15133 VecMDot 179 1.0 2.8005e-01 4.7 3.56e+07 1.1 0.0e+00 0.0e+00 1.8e+02 0 1 0 0 3 0 1 0 0 3 7804 VecNorm 359 1.0 3.6010e-01 2.1 7.15e+07 1.1 0.0e+00 0.0e+00 3.6e+02 1 1 0 0 6 1 1 0 0 6 12182 VecScale 840 1.0 1.7060e-02 1.4 1.17e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 41420 VecCopy 220 1.0 7.1680e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecSet 1344 1.0 5.5339e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecAXPY 305 1.0 7.4796e-02 1.2 3.96e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 32506 VecAYPX 199 1.0 4.3106e-02 2.2 1.87e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 26564 VecMAXPY 219 1.0 7.8728e-02 1.5 5.26e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 41044 VecAssemblyBegin 562 1.0 7.3376e-01 4.6 0.00e+00 0.0 0.0e+00 0.0e+00 1.7e+03 1 0 0 0 26 1 0 0 0 26 0 VecAssemblyEnd 562 1.0 1.8254e-0236.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecScatterBegin 2314 1.0 9.3190e-02 4.1 0.00e+00 0.0 7.0e+05 2.6e+03 0.0e+00 0 0 60 18 0 0 0 60 18 0 0 VecScatterEnd 2314 1.0 5.2353e-01 3.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 KSPGMRESOrthog 20 1.0 2.7619e-01 5.3 1.70e+07 1.1 0.0e+00 0.0e+00 2.0e+01 0 0 0 0 0 0 0 0 0 0 3786 KSPSetUp 502 1.0 1.7968e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 3.8e+01 0 0 0 0 1 0 0 0 0 1 0 KSPSolve 60 1.0 1.3881e+01 1.0 4.94e+09 1.1 1.1e+06 5.2e+03 5.7e+03 33100 97 57 87 33100 97 58 87 21421 PCGAMGGraph_AGG 19 1.0 8.7233e-01 1.0 6.49e+05 1.2 3.6e+04 1.8e+02 4.9e+02 2 0 3 0 8 2 0 3 0 8 45 PCGAMGCoarse_AGG 19 1.0 1.8468e-01 1.0 3.00e+06 1.4 6.9e+04 8.4e+02 1.2e+02 0 0 6 1 2 0 0 6 1 2 955 PCGAMGProl_AGG 19 1.0 5.2764e-01 1.0 0.00e+00 0.0 2.0e+05 8.8e+02 2.7e+03 1 0 17 2 42 1 0 17 2 42 0 PCGAMGPOpt_AGG 19 1.0 7.8678e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 GAMG: createProl 19 1.0 1.5828e+00 1.0 3.64e+06 1.3 3.0e+05 7.8e+02 3.4e+03 4 0 26 2 51 4 0 26 2 52 136 Graph 38 1.0 8.6498e-01 1.0 6.49e+05 1.2 3.6e+04 1.8e+02 4.9e+02 2 0 3 0 8 2 0 3 0 8 45 MIS/Agg 19 1.0 3.3888e-02 1.1 0.00e+00 0.0 6.4e+04 2.9e+02 8.5e+01 0 0 5 0 1 0 0 5 0 1 0 SA: col data 19 1.0 2.2790e-01 1.0 0.00e+00 0.0 1.9e+05 7.3e+02 2.5e+03 1 0 16 1 38 1 0 16 1 38 0 SA: frmProl0 19 1.0 2.9165e-01 1.0 0.00e+00 0.0 8.7e+03 4.0e+03 1.9e+02 1 0 1 0 3 1 0 1 0 3 0 GAMG: partLevel 19 1.0 1.0612e+00 1.0 1.34e+08 1.1 4.7e+04 5.6e+03 5.4e+02 3 3 4 3 8 3 3 4 3 8 7583 repartition 9 1.0 2.2869e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 0 0 0 0 0 0 0 Invert-Sort 4 1.0 3.2525e-0212.1 0.00e+00 0.0 0.0e+00 0.0e+00 1.6e+01 0 0 0 0 0 0 0 0 0 0 0 Move A 4 1.0 2.9533e-02 1.0 0.00e+00 0.0 9.0e+02 9.3e+02 7.2e+01 0 0 0 0 1 0 0 0 0 1 0 Move P 4 1.0 2.5822e-02 1.0 0.00e+00 0.0 3.0e+02 4.8e+01 7.2e+01 0 0 0 0 1 0 0 0 0 1 0 PCSetUp 120 1.0 9.6353e+00 1.0 2.71e+09 1.1 6.2e+05 6.6e+03 5.0e+03 23 55 54 41 77 23 55 54 41 77 16902 PCSetUpOnBlocks 60 1.0 1.8086e-01 1.3 2.85e+07 1.3 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 9356 PCApply 272 1.0 2.4959e+00 1.1 1.17e+09 1.1 3.6e+05 2.0e+03 0.0e+00 5 24 31 7 0 5 24 31 7 0 28112 SFSetGraph 19 1.0 4.3924e-0325.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFBcastBegin 104 1.0 1.8960e-02 2.1 0.00e+00 0.0 6.4e+04 2.9e+02 1.9e+01 0 0 5 0 0 0 0 5 0 0 0 SFBcastEnd 104 1.0 8.4085e-03 3.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 BuildTwoSided 19 1.0 1.1345e-02 4.7 0.00e+00 0.0 7.2e+03 4.0e+00 1.9e+01 0 0 1 0 0 0 0 1 0 0 0 ------------------------------------------------------------------------------------------------------------------------ Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Matrix 601 598 188796452 0. Matrix Coarsen 19 19 11932 0. Vector 1358 1358 216798096 0. Vector Scatter 110 110 128920 0. Krylov Solver 24 24 76112 0. Preconditioner 24 24 23712 0. PetscRandom 1 1 638 0. Viewer 1 0 0 0. Index Set 284 284 857076 0. Star Forest Bipartite Graph 19 19 16112 0. ======================================================================================================================== Average time to get PetscTime(): 0. Average time for MPI_Barrier(): 1.12057e-05 Average time for zero size MPI_Send(): 1.31577e-05 #PETSc Option Table entries: -flow_ksp_max_it 8 -flow_ksp_monitor_true_residual -flow_ksp_rtol 0.1 -flow_ksp_type fgmres -flow_mg_coarse_ksp_max_it 3 -flow_mg_coarse_pc_asm_overlap 1 -flow_mg_coarse_pc_type bjacobi -flow_mg_coarse_sub_pc_factor_levels 2 -flow_mg_coarse_sub_pc_factor_mat_ordering_type rcm -flow_mg_coarse_sub_pc_type ilu -flow_mg_levels_ksp_type richardson -flow_mg_levels_pc_asm_overlap 1 -flow_mg_levels_pc_type sor -flow_mg_levels_sub_pc_factor_levels 1 -flow_mg_levels_sub_pc_factor_mat_ordering_type rcm -flow_pc_gamg_agg_nsmooths 0 -flow_pc_gamg_reuse_interpolation true -flow_pc_gamg_square_graph 1 -flow_pc_gamg_type agg -flow_pc_mg_cycle v -flow_pc_mg_levels 20 -flow_pc_mg_type kaskade -flow_pc_type gamg -ksp_max_it 50 -ksp_type fgmres -log_view -options_left #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure options: --CFLAGS="-O3 -axAVX -xHost" --CXXFLAGS="-std=c++11 -DMPICH_IGNORE_CXX_SEEK -DMPICH_IGNORE_CXX_SEEK" --FC=mpiifort --FFLAGS="-O3 -axAVX -xHost" --LDFLAGS="-fPIC /home/b0528796/libs/HDF5/1.8.16/lib/libhdf5.a /gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib/libsz.a /gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3/libz.a" --download-hypre=../petsc_extpacks/hypre-2.11.0.tar.gz --download-metis=../petsc_extpacks/metis-5.1.0-p1.tar.gz --download-ml --download-parmetis=../petsc_extpacks/parmetis-4.0.3-p1.tar.gz --download-ptscotch=../petsc_extpacks/scotch_6.0.3.tar.gz --download-suitesparse=../petsc_extpacks/SuiteSparse-4.4.3.tar.gz --download-superlu_dist --download-zoltan=../petsc_extpacks/zoltan_distrib_v3.83.tar.gz --with-blas-lapack-lib=-mkl --with-cc=mpiicc --with-cgns-dir=/home/b0528796/libs/CGNSLIBS/current/ --with-cgns=yes --with-cxx=mpiicpc --with-debugging=no --with-scalapack-include=/gpfs/fs1/intel/mkl/include --with-scalapack-lib="-L/gpfs/fs1/intel/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_blacs_intelmpi_lp64" --download-mumps ----------------------------------------- Libraries compiled on Tue Jul 5 15:06:27 2016 on hpc-user16 Machine characteristics: Linux-2.6.32-279.el6.x86_64-x86_64-with-redhat-6.3-Santiago Using PETSc directory: /home/b0528796/libs/petsc-dev Using PETSc arch: petscdev_opt ----------------------------------------- Using C compiler: mpiicc -O3 -axAVX -xHost -fPIC ${COPTFLAGS} ${CFLAGS} Using Fortran compiler: mpiifort -O3 -axAVX -xHost -fPIC ${FOPTFLAGS} ${FFLAGS} ----------------------------------------- Using include paths: -I/home/b0528796/libs/petsc-dev/petscdev_opt/include -I/home/b0528796/libs/petsc-dev/include -I/home/b0528796/libs/petsc-dev/include -I/home/b0528796/libs/petsc-dev/petscdev_opt/include -I/home/b0528796/libs/CGNSLIBS/current/include -I/gpfs/fs1/intel/impi/4.1.0.024/intel64/include ----------------------------------------- Using C linker: mpiicc Using Fortran linker: mpiifort Using libraries: -Wl,-rpath,/home/b0528796/libs/petsc-dev/petscdev_opt/lib -L/home/b0528796/libs/petsc-dev/petscdev_opt/lib -lpetsc -Wl,-rpath,/home/b0528796/libs/petsc-dev/petscdev_opt/lib -L/home/b0528796/libs/petsc-dev/petscdev_opt/lib -lcmumps -ldmumps -lsmumps -lzmumps -lmumps_common -lpord -L/gpfs/fs1/intel/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_blacs_intelmpi_lp64 -lumfpack -lklu -lcholmod -lbtf -lccolamd -lcolamd -lcamd -lamd -lsuitesparseconfig -lsuperlu_dist -lHYPRE -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/home/b0528796/libs/HDF5/1.8.16/lib -L/home/b0528796/libs/HDF5/1.8.16/lib -lhdf5 -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -lsz -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -lz -lmpigc4 -lmpi_dbg -lhdf5 -lsz -lz -Wl,-rpath,/opt/intel/mpi-rt/4.1 -lml -lhdf5 -lsz -lz -lmpigc4 -lmpi_dbg -lhdf5 -lsz -lz -mkl -lzoltan -lparmetis -lmetis -lptesmumps -lptscotch -lptscotcherr -lscotch -lscotcherr -lX11 -Wl,-rpath,/home/b0528796/libs/CGNSLIBS/current/lib -L/home/b0528796/libs/CGNSLIBS/current/lib -lcgns -lhdf5 -lsz -lz -lifport -lifcore -lm -lhdf5 -lsz -lz -lmpigc4 -lmpi_dbg -lhdf5 -lsz -lz -lrt -lm -lz -ldl -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -lmpi -lmpigf -lmpigi -lrt -lpthread -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/home/b0528796/libs/HDF5/1.8.16/lib -L/home/b0528796/libs/HDF5/1.8.16/lib -lhdf5 -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -lsz -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -lz -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/opt/intel/mpi-rt/4.1 -limf -lsvml -lirng -lipgo -ldecimal -lcilkrts -lstdc++ -lgcc_s -lirc -lirc_s -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -ldl ----------------------------------------- #PETSc Option Table entries: -flow_ksp_max_it 8 -flow_ksp_monitor_true_residual -flow_ksp_rtol 0.1 -flow_ksp_type fgmres -flow_mg_coarse_ksp_max_it 3 -flow_mg_coarse_pc_asm_overlap 1 -flow_mg_coarse_pc_type bjacobi -flow_mg_coarse_sub_pc_factor_levels 2 -flow_mg_coarse_sub_pc_factor_mat_ordering_type rcm -flow_mg_coarse_sub_pc_type ilu -flow_mg_levels_ksp_type richardson -flow_mg_levels_pc_asm_overlap 1 -flow_mg_levels_pc_type sor -flow_mg_levels_sub_pc_factor_levels 1 -flow_mg_levels_sub_pc_factor_mat_ordering_type rcm -flow_pc_gamg_agg_nsmooths 0 -flow_pc_gamg_reuse_interpolation true -flow_pc_gamg_square_graph 1 -flow_pc_gamg_type agg -flow_pc_mg_cycle v -flow_pc_mg_levels 20 -flow_pc_mg_type kaskade -flow_pc_type gamg -ksp_max_it 50 -ksp_type fgmres -log_view -options_left #End of PETSc Option Table entries There are 8 unused database options. They are: Option left: name:-flow_mg_coarse_ksp_max_it value: 3 Option left: name:-flow_mg_coarse_pc_asm_overlap value: 1 Option left: name:-flow_mg_levels_pc_asm_overlap value: 1 Option left: name:-flow_mg_levels_sub_pc_factor_levels value: 1 Option left: name:-flow_mg_levels_sub_pc_factor_mat_ordering_type value: rcm Option left: name:-flow_pc_mg_cycle value: v Option left: name:-ksp_max_it value: 50 Option left: name:-ksp_type value: fgmres