node1213:../M6_UNSTR/input_NK ]mpirun -machinefile ~/u1/DNK_proc.list -np 64 -ppn 16 ./fansc13.3.7_64_argus M6 unstructured -log_view Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.752043648070e+02 true resid norm 2.752043648070e+02 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 2.072027655180e+00 true resid norm 2.072027655180e+00 ||r(i)||/||b|| 7.529050844208e-03 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 1.670607805350e+02 true resid norm 1.670607805350e+02 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 2.470600866779e+00 true resid norm 2.470600866779e+00 ||r(i)||/||b|| 1.478863476435e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 9.257744907550e+01 true resid norm 9.257744907550e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.318603282554e+00 true resid norm 1.318603282554e+00 ||r(i)||/||b|| 1.424324493408e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 8.371133071735e+01 true resid norm 8.371133071735e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.770065095597e+00 true resid norm 1.770065095597e+00 ||r(i)||/||b|| 2.114486868657e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 6.914265479472e+01 true resid norm 6.914265479472e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.258281699328e+00 true resid norm 1.258281699328e+00 ||r(i)||/||b|| 1.819834229773e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 6.104479801420e+01 true resid norm 6.104479801420e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.271628294813e-01 true resid norm 9.271628294813e-01 ||r(i)||/||b|| 1.518823650241e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 5.549136097241e+01 true resid norm 5.549136097241e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.346261180652e-01 true resid norm 7.346261180652e-01 ||r(i)||/||b|| 1.323856732277e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 5.151172584561e+01 true resid norm 5.151172584561e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.133028045829e-01 true resid norm 7.133028045829e-01 ||r(i)||/||b|| 1.384738703418e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.816875342468e+01 true resid norm 4.816875342468e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.118665131078e-01 true resid norm 7.118665131078e-01 ||r(i)||/||b|| 1.477859530289e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.487878586807e+01 true resid norm 4.487878586807e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.042175248323e-01 true resid norm 8.042175248323e-01 ||r(i)||/||b|| 1.791977009352e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.161834807766e+01 true resid norm 4.161834807766e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.539239184871e-01 true resid norm 7.539239184871e-01 ||r(i)||/||b|| 1.811518124363e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.836264417773e+01 true resid norm 3.836264417773e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.174801787618e-01 true resid norm 8.174801787618e-01 ||r(i)||/||b|| 2.130927615350e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.522883266523e+01 true resid norm 3.522883266523e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.244241726840e-01 true resid norm 8.244241726840e-01 ||r(i)||/||b|| 2.340197248425e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.230771248097e+01 true resid norm 3.230771248097e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.602350447376e-01 true resid norm 8.602350447376e-01 ||r(i)||/||b|| 2.662630618755e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.965932246733e+01 true resid norm 2.965932246733e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.725332011407e-01 true resid norm 8.725332011407e-01 ||r(i)||/||b|| 2.941851426653e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.727459045980e+01 true resid norm 2.727459045980e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.649699929636e-01 true resid norm 8.649699929636e-01 ||r(i)||/||b|| 3.171339984879e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.514218422982e+01 true resid norm 2.514218422982e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.952569714355e-01 true resid norm 8.952569714355e-01 ||r(i)||/||b|| 3.560776435540e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.327732747835e+01 true resid norm 2.327732747835e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.088995756474e-01 true resid norm 9.088995756474e-01 ||r(i)||/||b|| 3.904656049939e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.163582043406e+01 true resid norm 2.163582043406e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.088212488168e-01 true resid norm 9.088212488168e-01 ||r(i)||/||b|| 4.200539801976e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.020504842583e+01 true resid norm 2.020504842583e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.089706022608e-01 true resid norm 9.089706022608e-01 ||r(i)||/||b|| 4.498730134687e-02 [20] CL 0.156121: max variation 0.00242728 in last 10 steps at Mach 0.84, Re 1.172e+07, Alpha 3.06[deg], Beta 0[deg]. ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./fansc13.3.7_64_argus on a petscdev_opt named node1213 with 64 processors, by b0528796 Wed Jul 6 11:40:22 2016 Using Petsc Development GIT revision: v3.7.2-812-gc68d048 GIT Date: 2016-07-05 12:04:34 -0400 Max Max/Min Avg Total Time (sec): 4.486e+01 1.00003 4.486e+01 Objects: 2.071e+03 1.00194 2.067e+03 Flops: 4.949e+09 1.14038 4.659e+09 2.982e+11 Flops/sec: 1.103e+08 1.14038 1.039e+08 6.647e+09 MPI Messages: 4.346e+04 6.26602 1.810e+04 1.158e+06 MPI Message Lengths: 2.065e+08 3.41212 8.744e+03 1.013e+10 MPI Reductions: 5.718e+03 1.00000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flops and VecAXPY() for complex vectors of length N --> 8N flops Summary of Stages: ----- Time ------ ----- Flops ----- --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total counts %Total Avg %Total counts %Total 0: Main Stage: 4.4859e+01 100.0% 2.9818e+11 100.0% 1.157e+06 99.9% 8.714e+03 99.7% 5.709e+03 99.8% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flops: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent Avg. len: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flops in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max time over all processors) ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flops --- Global --- --- Stage --- Total Max Ratio Max Ratio Max Ratio Mess Avg len Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s ------------------------------------------------------------------------------------------------------------------------ --- Event Stage 0: Main Stage MatMult 592 1.0 1.3538e+00 1.2 8.75e+08 1.2 1.8e+05 5.7e+03 0.0e+00 3 18 15 10 0 3 18 15 10 0 38967 MatMultTranspose 320 1.0 9.5586e-02 1.2 4.89e+07 1.1 3.6e+04 1.0e+03 0.0e+00 0 1 3 0 0 0 1 3 0 0 31310 MatSolve 272 1.1 2.4101e-01 1.3 1.12e+08 1.2 0.0e+00 0.0e+00 0.0e+00 0 2 0 0 0 0 2 0 0 0 28090 MatSOR 320 1.0 1.9721e+00 1.1 9.61e+08 1.2 2.9e+05 2.2e+03 0.0e+00 4 19 25 6 0 4 19 25 6 0 29256 MatLUFactorNum 60 1.0 1.7419e-01 1.3 3.00e+07 1.3 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 9723 MatILUFactorSym 3 1.0 9.6128e-03 4.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatScale 16 1.0 6.1553e-03 4.3 6.49e+05 1.2 7.2e+03 4.4e+02 0.0e+00 0 0 1 0 0 0 0 1 0 0 6317 MatAssemblyBegin 1870 1.0 2.0109e+00 3.2 0.00e+00 0.0 1.1e+05 1.9e+04 8.0e+02 3 0 10 22 14 3 0 10 22 14 0 MatAssemblyEnd 1870 1.0 1.1299e+00 1.5 0.00e+00 0.0 6.3e+04 2.9e+02 7.1e+02 2 0 5 0 12 2 0 5 0 12 0 MatGetRow 831521 1.1 1.1100e-01 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetRowIJ 3 3.0 2.6011e-032727.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetSubMatrix 6 1.0 5.4135e-02 1.0 0.00e+00 0.0 1.2e+03 7.1e+02 1.0e+02 0 0 0 0 2 0 0 0 0 2 0 MatGetOrdering 3 3.0 2.9941e-0318.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatCoarsen 16 1.0 3.9602e-02 1.1 0.00e+00 0.0 6.4e+04 2.9e+02 7.9e+01 0 0 5 0 1 0 0 5 0 1 0 MatZeroEntries 342 1.0 1.6759e-01 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatPtAP 320 1.0 7.8708e+00 1.0 2.68e+09 1.1 3.2e+05 1.2e+04 1.1e+03 18 54 28 38 20 18 54 28 39 20 20448 MatPtAPSymbolic 32 1.0 9.8569e-01 1.0 0.00e+00 0.0 5.4e+04 5.8e+03 2.2e+02 2 0 5 3 4 2 0 5 3 4 0 MatPtAPNumeric 320 1.0 6.8897e+00 1.0 2.68e+09 1.1 2.7e+05 1.3e+04 9.0e+02 15 54 23 35 16 15 54 23 35 16 23359 MatTrnMatMult 1 1.0 1.3213e-01 1.1 3.00e+06 1.4 3.1e+03 7.0e+03 1.9e+01 0 0 0 0 0 0 0 0 0 0 1335 MatTrnMatMultSym 1 1.0 8.7744e-02 1.1 0.00e+00 0.0 2.6e+03 3.8e+03 1.7e+01 0 0 0 0 0 0 0 0 0 0 0 MatTrnMatMultNum 1 1.0 4.4867e-02 1.0 3.00e+06 1.4 5.2e+02 2.3e+04 2.0e+00 0 0 0 0 0 0 0 0 0 0 3932 MatGetLocalMat 322 1.0 1.2069e-01 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetBrAoCol 320 1.0 6.0242e-01 5.8 0.00e+00 0.0 1.7e+05 9.8e+03 0.0e+00 1 0 15 17 0 1 0 15 17 0 0 VecDot 212 1.0 8.2693e-02 1.9 1.81e+07 1.1 0.0e+00 0.0e+00 2.1e+02 0 0 0 0 4 0 0 0 0 4 13404 VecMDot 179 1.0 2.4609e-01 5.0 3.56e+07 1.1 0.0e+00 0.0e+00 1.8e+02 0 1 0 0 3 0 1 0 0 3 8881 VecNorm 359 1.0 3.1502e-01 2.2 7.15e+07 1.1 0.0e+00 0.0e+00 3.6e+02 1 1 0 0 6 1 1 0 0 6 13926 VecScale 720 1.0 1.9511e-02 1.7 1.17e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 36216 VecCopy 220 1.0 6.7405e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecSet 1203 1.0 5.3953e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecAXPY 305 1.0 7.5152e-02 1.3 3.96e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 32352 VecAYPX 199 1.0 4.2783e-02 2.2 1.87e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 26764 VecMAXPY 219 1.0 6.8136e-02 1.2 5.26e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 47424 VecAssemblyBegin 483 1.0 6.5661e-01 6.5 0.00e+00 0.0 0.0e+00 0.0e+00 1.4e+03 1 0 0 0 25 1 0 0 0 25 0 VecAssemblyEnd 483 1.0 4.0915e-03 8.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecScatterBegin 1992 1.0 9.2902e-02 4.1 0.00e+00 0.0 7.0e+05 2.6e+03 0.0e+00 0 0 60 18 0 0 0 60 18 0 0 VecScatterEnd 1992 1.0 4.8998e-01 3.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 KSPGMRESOrthog 20 1.0 2.4145e-01 6.1 1.70e+07 1.1 0.0e+00 0.0e+00 2.0e+01 0 0 0 0 0 0 0 0 0 0 4331 KSPSetUp 442 1.0 1.7356e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 3.2e+01 0 0 0 0 1 0 0 0 0 1 0 KSPSolve 60 1.0 1.3813e+01 1.0 4.94e+09 1.1 1.1e+06 5.2e+03 4.9e+03 31100 97 57 85 31100 97 58 86 21526 PCGAMGGraph_AGG 16 1.0 8.1813e-01 1.0 6.49e+05 1.2 3.6e+04 1.8e+02 4.2e+02 2 0 3 0 7 2 0 3 0 7 48 PCGAMGCoarse_AGG 16 1.0 1.8573e-01 1.0 3.00e+06 1.4 6.9e+04 8.4e+02 1.1e+02 0 0 6 1 2 0 0 6 1 2 950 PCGAMGProl_AGG 16 1.0 4.9203e-01 1.0 0.00e+00 0.0 2.0e+05 8.8e+02 2.3e+03 1 0 17 2 40 1 0 17 2 40 0 PCGAMGPOpt_AGG 16 1.0 8.1062e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 GAMG: createProl 16 1.0 1.4922e+00 1.0 3.64e+06 1.3 3.0e+05 7.8e+02 2.8e+03 3 0 26 2 50 3 0 26 2 50 144 Graph 32 1.0 8.0912e-01 1.0 6.49e+05 1.2 3.6e+04 1.8e+02 4.2e+02 2 0 3 0 7 2 0 3 0 7 48 MIS/Agg 16 1.0 3.9784e-02 1.0 0.00e+00 0.0 6.4e+04 2.9e+02 7.9e+01 0 0 5 0 1 0 0 5 0 1 0 SA: col data 16 1.0 1.9881e-01 1.0 0.00e+00 0.0 1.9e+05 7.3e+02 2.1e+03 0 0 16 1 36 0 0 16 1 36 0 SA: frmProl0 16 1.0 2.8563e-01 1.0 0.00e+00 0.0 8.7e+03 4.0e+03 1.6e+02 1 0 1 0 3 1 0 1 0 3 0 GAMG: partLevel 16 1.0 1.0843e+00 1.0 1.34e+08 1.1 4.7e+04 5.6e+03 4.3e+02 2 3 4 3 8 2 3 4 3 8 7422 repartition 7 1.0 2.0506e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 1.8e+01 0 0 0 0 0 0 0 0 0 0 0 Invert-Sort 3 1.0 3.1276e-0231.4 0.00e+00 0.0 0.0e+00 0.0e+00 1.2e+01 0 0 0 0 0 0 0 0 0 0 0 Move A 3 1.0 3.0719e-02 1.0 0.00e+00 0.0 9.0e+02 9.3e+02 5.4e+01 0 0 0 0 1 0 0 0 0 1 0 Move P 3 1.0 2.4573e-02 1.0 0.00e+00 0.0 3.0e+02 4.8e+01 5.4e+01 0 0 0 0 1 0 0 0 0 1 0 PCSetUp 120 1.0 9.6780e+00 1.0 2.71e+09 1.1 6.2e+05 6.6e+03 4.2e+03 22 55 54 41 73 22 55 54 41 73 16827 PCSetUpOnBlocks 60 1.0 1.8018e-01 1.3 3.00e+07 1.3 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 9400 PCApply 272 1.0 2.4385e+00 1.1 1.17e+09 1.1 3.6e+05 2.0e+03 0.0e+00 5 24 31 7 0 5 24 31 7 0 28773 SFSetGraph 16 1.0 5.1954e-0335.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFBcastBegin 95 1.0 1.7252e-02 2.5 0.00e+00 0.0 6.4e+04 2.9e+02 1.6e+01 0 0 5 0 0 0 0 5 0 0 0 SFBcastEnd 95 1.0 1.4131e-02 3.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 BuildTwoSided 16 1.0 8.4085e-03 4.3 0.00e+00 0.0 7.2e+03 4.0e+00 1.6e+01 0 0 1 0 0 0 0 1 0 0 0 ------------------------------------------------------------------------------------------------------------------------ Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Matrix 506 503 187749632 0. Matrix Coarsen 16 16 10048 0. Vector 1160 1160 216216344 0. Vector Scatter 92 92 100424 0. Krylov Solver 21 21 72272 0. Preconditioner 21 21 20808 0. PetscRandom 1 1 638 0. Viewer 1 0 0 0. Index Set 237 237 818260 0. Star Forest Bipartite Graph 16 16 13568 0. ======================================================================================================================== Average time to get PetscTime(): 9.53674e-08 Average time for MPI_Barrier(): 1.10149e-05 Average time for zero size MPI_Send(): 1.41114e-05 #PETSc Option Table entries: -flow_ksp_max_it 8 -flow_ksp_monitor_true_residual -flow_ksp_rtol 0.1 -flow_ksp_type fgmres -flow_mg_coarse_ksp_max_it 3 -flow_mg_coarse_pc_asm_overlap 1 -flow_mg_coarse_pc_type bjacobi -flow_mg_coarse_sub_pc_factor_levels 2 -flow_mg_coarse_sub_pc_factor_mat_ordering_type rcm -flow_mg_coarse_sub_pc_type ilu -flow_mg_levels_ksp_type richardson -flow_mg_levels_pc_asm_overlap 1 -flow_mg_levels_pc_type sor -flow_mg_levels_sub_pc_factor_levels 1 -flow_mg_levels_sub_pc_factor_mat_ordering_type rcm -flow_pc_gamg_agg_nsmooths 0 -flow_pc_gamg_reuse_interpolation true -flow_pc_gamg_square_graph 1 -flow_pc_gamg_type agg -flow_pc_mg_cycle v -flow_pc_mg_levels 17 -flow_pc_mg_type kaskade -flow_pc_type gamg -ksp_max_it 50 -ksp_type fgmres -log_view -options_left #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure options: --CFLAGS="-O3 -axAVX -xHost" --CXXFLAGS="-std=c++11 -DMPICH_IGNORE_CXX_SEEK -DMPICH_IGNORE_CXX_SEEK" --FC=mpiifort --FFLAGS="-O3 -axAVX -xHost" --LDFLAGS="-fPIC /home/b0528796/libs/HDF5/1.8.16/lib/libhdf5.a /gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib/libsz.a /gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3/libz.a" --download-hypre=../petsc_extpacks/hypre-2.11.0.tar.gz --download-metis=../petsc_extpacks/metis-5.1.0-p1.tar.gz --download-ml --download-parmetis=../petsc_extpacks/parmetis-4.0.3-p1.tar.gz --download-ptscotch=../petsc_extpacks/scotch_6.0.3.tar.gz --download-suitesparse=../petsc_extpacks/SuiteSparse-4.4.3.tar.gz --download-superlu_dist --download-zoltan=../petsc_extpacks/zoltan_distrib_v3.83.tar.gz --with-blas-lapack-lib=-mkl --with-cc=mpiicc --with-cgns-dir=/home/b0528796/libs/CGNSLIBS/current/ --with-cgns=yes --with-cxx=mpiicpc --with-debugging=no --with-scalapack-include=/gpfs/fs1/intel/mkl/include --with-scalapack-lib="-L/gpfs/fs1/intel/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_blacs_intelmpi_lp64" --download-mumps ----------------------------------------- Libraries compiled on Tue Jul 5 15:06:27 2016 on hpc-user16 Machine characteristics: Linux-2.6.32-279.el6.x86_64-x86_64-with-redhat-6.3-Santiago Using PETSc directory: /home/b0528796/libs/petsc-dev Using PETSc arch: petscdev_opt ----------------------------------------- Using C compiler: mpiicc -O3 -axAVX -xHost -fPIC ${COPTFLAGS} ${CFLAGS} Using Fortran compiler: mpiifort -O3 -axAVX -xHost -fPIC ${FOPTFLAGS} ${FFLAGS} ----------------------------------------- Using include paths: -I/home/b0528796/libs/petsc-dev/petscdev_opt/include -I/home/b0528796/libs/petsc-dev/include -I/home/b0528796/libs/petsc-dev/include -I/home/b0528796/libs/petsc-dev/petscdev_opt/include -I/home/b0528796/libs/CGNSLIBS/current/include -I/gpfs/fs1/intel/impi/4.1.0.024/intel64/include ----------------------------------------- Using C linker: mpiicc Using Fortran linker: mpiifort Using libraries: -Wl,-rpath,/home/b0528796/libs/petsc-dev/petscdev_opt/lib -L/home/b0528796/libs/petsc-dev/petscdev_opt/lib -lpetsc -Wl,-rpath,/home/b0528796/libs/petsc-dev/petscdev_opt/lib -L/home/b0528796/libs/petsc-dev/petscdev_opt/lib -lcmumps -ldmumps -lsmumps -lzmumps -lmumps_common -lpord -L/gpfs/fs1/intel/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_blacs_intelmpi_lp64 -lumfpack -lklu -lcholmod -lbtf -lccolamd -lcolamd -lcamd -lamd -lsuitesparseconfig -lsuperlu_dist -lHYPRE -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/home/b0528796/libs/HDF5/1.8.16/lib -L/home/b0528796/libs/HDF5/1.8.16/lib -lhdf5 -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -lsz -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -lz -lmpigc4 -lmpi_dbg -lhdf5 -lsz -lz -Wl,-rpath,/opt/intel/mpi-rt/4.1 -lml -lhdf5 -lsz -lz -lmpigc4 -lmpi_dbg -lhdf5 -lsz -lz -mkl -lzoltan -lparmetis -lmetis -lptesmumps -lptscotch -lptscotcherr -lscotch -lscotcherr -lX11 -Wl,-rpath,/home/b0528796/libs/CGNSLIBS/current/lib -L/home/b0528796/libs/CGNSLIBS/current/lib -lcgns -lhdf5 -lsz -lz -lifport -lifcore -lm -lhdf5 -lsz -lz -lmpigc4 -lmpi_dbg -lhdf5 -lsz -lz -lrt -lm -lz -ldl -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -lmpi -lmpigf -lmpigi -lrt -lpthread -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/home/b0528796/libs/HDF5/1.8.16/lib -L/home/b0528796/libs/HDF5/1.8.16/lib -lhdf5 -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -lsz -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -lz -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/opt/intel/mpi-rt/4.1 -limf -lsvml -lirng -lipgo -ldecimal -lcilkrts -lstdc++ -lgcc_s -lirc -lirc_s -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -ldl ----------------------------------------- #PETSc Option Table entries: -flow_ksp_max_it 8 -flow_ksp_monitor_true_residual -flow_ksp_rtol 0.1 -flow_ksp_type fgmres -flow_mg_coarse_ksp_max_it 3 -flow_mg_coarse_pc_asm_overlap 1 -flow_mg_coarse_pc_type bjacobi -flow_mg_coarse_sub_pc_factor_levels 2 -flow_mg_coarse_sub_pc_factor_mat_ordering_type rcm -flow_mg_coarse_sub_pc_type ilu -flow_mg_levels_ksp_type richardson -flow_mg_levels_pc_asm_overlap 1 -flow_mg_levels_pc_type sor -flow_mg_levels_sub_pc_factor_levels 1 -flow_mg_levels_sub_pc_factor_mat_ordering_type rcm -flow_pc_gamg_agg_nsmooths 0 -flow_pc_gamg_reuse_interpolation true -flow_pc_gamg_square_graph 1 -flow_pc_gamg_type agg -flow_pc_mg_cycle v -flow_pc_mg_levels 17 -flow_pc_mg_type kaskade -flow_pc_type gamg -ksp_max_it 50 -ksp_type fgmres -log_view -options_left #End of PETSc Option Table entries There are 8 unused database options. They are: Option left: name:-flow_mg_coarse_ksp_max_it value: 3 Option left: name:-flow_mg_coarse_pc_asm_overlap value: 1 Option left: name:-flow_mg_levels_pc_asm_overlap value: 1 Option left: name:-flow_mg_levels_sub_pc_factor_levels value: 1 Option left: name:-flow_mg_levels_sub_pc_factor_mat_ordering_type value: rcm Option left: name:-flow_pc_mg_cycle value: v Option left: name:-ksp_max_it value: 50 Option left: name:-ksp_type value: fgmres