node1213:../M6_UNSTR/input_NK ]mpirun -machinefile ~/u1/DNK_proc.list -np 64 -ppn 16 ./fansc13.3.7_64_argus M6 unstructured -log_view Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.752043648070e+02 true resid norm 2.752043648070e+02 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 2.091765425597e+00 true resid norm 2.091765425597e+00 ||r(i)||/||b|| 7.600771256168e-03 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 1.670613867334e+02 true resid norm 1.670613867334e+02 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 2.512616787559e+00 true resid norm 2.512616787558e+00 ||r(i)||/||b|| 1.504008099470e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 9.257798289044e+01 true resid norm 9.257798289044e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.320715304063e+00 true resid norm 1.320715304063e+00 ||r(i)||/||b|| 1.426597623785e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 8.371110856213e+01 true resid norm 8.371110856213e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.778659633247e+00 true resid norm 1.778659633246e+00 ||r(i)||/||b|| 2.124759382354e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 6.914354155394e+01 true resid norm 6.914354155394e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 1.268118224330e+00 true resid norm 1.268118224330e+00 ||r(i)||/||b|| 1.834037128892e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 6.104671816329e+01 true resid norm 6.104671816329e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.412887548887e-01 true resid norm 9.412887548887e-01 ||r(i)||/||b|| 1.541915410376e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 5.549364933665e+01 true resid norm 5.549364933665e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.381718010328e-01 true resid norm 7.381718010328e-01 ||r(i)||/||b|| 1.330191490119e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 5.151495441635e+01 true resid norm 5.151495441635e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.266302762558e-01 true resid norm 7.266302762558e-01 ||r(i)||/||b|| 1.410522991796e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.817259912568e+01 true resid norm 4.817259912568e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.263256567207e-01 true resid norm 7.263256567207e-01 ||r(i)||/||b|| 1.507756836673e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.488347654464e+01 true resid norm 4.488347654464e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.117366030977e-01 true resid norm 8.117366030977e-01 ||r(i)||/||b|| 1.808542175405e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 4.162424677772e+01 true resid norm 4.162424677772e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 7.612670381648e-01 true resid norm 7.612670381648e-01 ||r(i)||/||b|| 1.828902856141e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.836874541097e+01 true resid norm 3.836874541097e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.260316350845e-01 true resid norm 8.260316350845e-01 ||r(i)||/||b|| 2.152876322217e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.523550330858e+01 true resid norm 3.523550330858e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.299526576713e-01 true resid norm 8.299526576713e-01 ||r(i)||/||b|| 2.355444309686e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 3.231515064745e+01 true resid norm 3.231515064745e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.656092862109e-01 true resid norm 8.656092862109e-01 ||r(i)||/||b|| 2.678648463238e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.966676975503e+01 true resid norm 2.966676975503e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.803153727667e-01 true resid norm 8.803153727667e-01 ||r(i)||/||b|| 2.967344877908e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.728207393769e+01 true resid norm 2.728207393769e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 8.728478103055e-01 true resid norm 8.728478103055e-01 ||r(i)||/||b|| 3.199345520062e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.515061115012e+01 true resid norm 2.515061115012e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.013572455360e-01 true resid norm 9.013572455360e-01 ||r(i)||/||b|| 3.583838341565e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.328660162514e+01 true resid norm 2.328660162514e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.140276885053e-01 true resid norm 9.140276885053e-01 ||r(i)||/||b|| 3.925122708839e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.164540318841e+01 true resid norm 2.164540318841e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.132966074870e-01 true resid norm 9.132966074870e-01 ||r(i)||/||b|| 4.219355950718e-02 Residual norms for flow_ solve. 0 KSP unpreconditioned resid norm 2.021478788000e+01 true resid norm 2.021478788000e+01 ||r(i)||/||b|| 1.000000000000e+00 1 KSP unpreconditioned resid norm 9.133246188581e-01 true resid norm 9.133246188581e-01 ||r(i)||/||b|| 4.518101422978e-02 [20] CL 0.156118: max variation 0.00243165 in last 10 steps at Mach 0.84, Re 1.172e+07, Alpha 3.06[deg], Beta 0[deg]. ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./fansc13.3.7_64_argus on a petscdev_opt named node1213 with 64 processors, by b0528796 Wed Jul 6 10:49:06 2016 Using Petsc Development GIT revision: v3.7.2-812-gc68d048 GIT Date: 2016-07-05 12:04:34 -0400 Max Max/Min Avg Total Time (sec): 3.699e+01 1.00004 3.699e+01 Objects: 1.697e+03 1.00236 1.693e+03 Flops: 4.726e+09 1.14870 4.460e+09 2.854e+11 Flops/sec: 1.278e+08 1.14867 1.206e+08 7.717e+09 MPI Messages: 2.979e+04 6.97938 1.058e+04 6.773e+05 MPI Message Lengths: 1.972e+08 3.37049 1.426e+04 9.661e+09 MPI Reductions: 4.852e+03 1.00000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flops and VecAXPY() for complex vectors of length N --> 8N flops Summary of Stages: ----- Time ------ ----- Flops ----- --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total counts %Total Avg %Total counts %Total 0: Main Stage: 3.6987e+01 100.0% 2.8544e+11 100.0% 6.763e+05 99.8% 1.421e+04 99.6% 4.843e+03 99.8% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flops: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent Avg. len: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flops in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max time over all processors) ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flops --- Global --- --- Stage --- Total Max Ratio Max Ratio Max Ratio Mess Avg len Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s ------------------------------------------------------------------------------------------------------------------------ --- Event Stage 0: Main Stage MatMult 512 1.0 1.3388e+00 1.2 8.74e+08 1.2 1.7e+05 5.9e+03 0.0e+00 3 18 25 11 0 3 18 25 11 0 39361 MatMultTranspose 240 1.0 9.5432e-02 1.3 4.78e+07 1.1 2.9e+04 1.1e+03 0.0e+00 0 1 4 0 0 0 1 4 0 0 30689 MatSolve 272 1.1 2.4158e-01 1.3 1.12e+08 1.2 0.0e+00 0.0e+00 0.0e+00 1 2 0 0 0 1 2 0 0 0 28023 MatSOR 240 1.0 1.8763e+00 1.1 9.21e+08 1.2 1.2e+05 4.7e+03 0.0e+00 5 19 18 6 0 5 19 18 6 0 29532 MatLUFactorNum 60 1.0 1.7222e-01 1.3 2.82e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 9822 MatILUFactorSym 3 1.0 6.6049e-03 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatScale 12 1.0 5.4204e-03 4.6 6.20e+05 1.2 3.0e+03 9.5e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 6877 MatAssemblyBegin 1431 1.0 1.7379e+00 4.4 0.00e+00 0.0 9.2e+04 2.1e+04 6.4e+02 3 0 14 20 13 3 0 14 20 13 0 MatAssemblyEnd 1431 1.0 8.2586e-01 1.5 0.00e+00 0.0 3.0e+04 5.5e+02 5.9e+02 2 0 4 0 12 2 0 4 0 12 0 MatGetRow 813365 1.1 1.0068e-01 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetRowIJ 3 3.0 1.7090e-031792.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetSubMatrix 10 1.0 3.9373e-02 1.0 0.00e+00 0.0 8.8e+02 7.0e+02 1.7e+02 0 0 0 0 4 0 0 0 0 4 0 MatGetOrdering 3 3.0 1.9870e-0312.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatCoarsen 12 1.0 2.2109e-02 1.1 0.00e+00 0.0 3.0e+04 7.4e+02 5.2e+01 0 0 4 0 1 0 0 4 0 1 0 MatZeroEntries 262 1.0 1.6143e-01 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatPtAP 240 1.0 6.8263e+00 1.0 2.50e+09 1.1 1.8e+05 1.9e+04 8.4e+02 18 53 26 36 17 18 53 26 36 17 22052 MatPtAPSymbolic 24 1.0 8.8129e-01 1.0 0.00e+00 0.0 2.7e+04 1.0e+04 1.7e+02 2 0 4 3 3 2 0 4 3 3 0 MatPtAPNumeric 240 1.0 5.9499e+00 1.0 2.50e+09 1.1 1.5e+05 2.1e+04 6.7e+02 16 53 22 33 14 16 53 23 33 14 25300 MatTrnMatMult 2 1.0 1.8966e-01 1.0 4.43e+06 1.3 6.4e+03 7.3e+03 3.8e+01 1 0 1 0 1 1 0 1 0 1 1367 MatTrnMatMultSym 2 1.0 1.2415e-01 1.1 0.00e+00 0.0 5.3e+03 3.6e+03 3.4e+01 0 0 1 0 1 0 0 1 0 1 0 MatTrnMatMultNum 2 1.0 6.6199e-02 1.0 4.43e+06 1.3 1.0e+03 2.6e+04 4.0e+00 0 0 0 0 0 0 0 0 0 0 3917 MatGetLocalMat 244 1.0 1.2551e-01 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatGetBrAoCol 240 1.0 4.6209e-01 5.9 0.00e+00 0.0 7.1e+04 2.1e+04 0.0e+00 1 0 11 15 0 1 0 11 16 0 0 VecDot 212 1.0 7.1635e-02 1.9 1.81e+07 1.1 0.0e+00 0.0e+00 2.1e+02 0 0 0 0 4 0 0 0 0 4 15474 VecMDot 179 1.0 2.5673e-01 4.8 3.56e+07 1.1 0.0e+00 0.0e+00 1.8e+02 0 1 0 0 4 0 1 0 0 4 8513 VecNorm 359 1.0 3.0966e-01 2.2 7.15e+07 1.1 0.0e+00 0.0e+00 3.6e+02 1 2 0 0 7 1 2 0 0 7 14167 VecScale 560 1.0 1.7293e-02 1.4 1.15e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 40355 VecCopy 220 1.0 7.0573e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecSet 1029 1.0 5.4273e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecAXPY 305 1.0 6.6520e-02 1.1 3.96e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 36550 VecAYPX 199 1.0 4.4017e-02 2.3 1.87e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 26014 VecMAXPY 219 1.0 7.3501e-02 1.4 5.26e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 43962 VecAssemblyBegin 385 1.0 7.0621e-01 7.1 0.00e+00 0.0 0.0e+00 0.0e+00 1.1e+03 1 0 0 0 23 1 0 0 0 24 0 VecAssemblyEnd 385 1.0 4.5273e-0313.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecScatterBegin 1571 1.0 7.9660e-02 3.9 0.00e+00 0.0 4.1e+05 4.4e+03 0.0e+00 0 0 60 19 0 0 0 60 19 0 0 VecScatterEnd 1571 1.0 4.1212e-01 5.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 KSPGMRESOrthog 20 1.0 2.4561e-01 6.3 1.70e+07 1.1 0.0e+00 0.0e+00 2.0e+01 0 0 0 0 0 0 0 0 0 0 4258 KSPSetUp 362 1.0 1.5874e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 0 0 0 0 0 0 0 KSPSolve 60 1.0 1.2590e+01 1.0 4.71e+09 1.1 6.4e+05 8.3e+03 4.0e+03 34100 95 55 83 34100 95 56 83 22606 PCGAMGGraph_AGG 12 1.0 7.6174e-01 1.0 6.20e+05 1.2 1.5e+04 3.8e+02 3.1e+02 2 0 2 0 6 2 0 2 0 6 49 PCGAMGCoarse_AGG 12 1.0 2.2672e-01 1.0 4.43e+06 1.3 4.2e+04 2.2e+03 1.2e+02 1 0 6 1 3 1 0 6 1 3 1144 PCGAMGProl_AGG 12 1.0 4.2968e-01 1.0 0.00e+00 0.0 8.6e+04 2.2e+03 1.7e+03 1 0 13 2 36 1 0 13 2 36 0 PCGAMGPOpt_AGG 12 1.0 6.1989e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 GAMG: createProl 12 1.0 1.4148e+00 1.0 5.05e+06 1.3 1.4e+05 2.0e+03 2.2e+03 4 0 21 3 45 4 0 21 3 45 210 Graph 24 1.0 7.5398e-01 1.0 6.20e+05 1.2 1.5e+04 3.8e+02 3.1e+02 2 0 2 0 6 2 0 2 0 6 49 MIS/Agg 12 1.0 2.2275e-02 1.1 0.00e+00 0.0 3.0e+04 7.4e+02 5.2e+01 0 0 4 0 1 0 0 4 0 1 0 SA: col data 12 1.0 1.5331e-01 1.0 0.00e+00 0.0 7.9e+04 1.9e+03 1.6e+03 0 0 12 2 32 0 0 12 2 32 0 SA: frmProl0 12 1.0 2.6959e-01 1.0 0.00e+00 0.0 7.2e+03 5.4e+03 1.2e+02 1 0 1 0 2 1 0 1 0 2 0 GAMG: partLevel 12 1.0 8.0589e-01 1.0 1.25e+08 1.1 2.5e+04 9.6e+03 4.7e+02 2 3 4 2 10 2 3 4 2 10 9340 repartition 6 1.0 2.4226e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+01 0 0 0 0 1 0 0 0 0 1 0 Invert-Sort 5 1.0 3.0649e-0233.9 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+01 0 0 0 0 0 0 0 0 0 0 0 Move A 5 1.0 1.1222e-02 1.0 0.00e+00 0.0 6.0e+02 1.0e+03 9.0e+01 0 0 0 0 2 0 0 0 0 2 0 Move P 5 1.0 2.9528e-02 1.0 0.00e+00 0.0 2.7e+02 2.8e+01 9.0e+01 0 0 0 0 2 0 0 0 0 2 0 PCSetUp 120 1.0 8.5364e+00 1.0 2.53e+09 1.1 3.2e+05 1.2e+04 3.3e+03 23 53 48 39 69 23 53 48 39 69 17867 PCSetUpOnBlocks 60 1.0 1.7648e-01 1.3 2.82e+07 1.2 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 9585 PCApply 272 1.0 2.3152e+00 1.1 1.12e+09 1.2 1.8e+05 3.6e+03 0.0e+00 6 24 26 7 0 6 24 26 7 0 29266 SFSetGraph 12 1.0 3.6721e-0324.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFBcastBegin 64 1.0 1.1242e-02 2.3 0.00e+00 0.0 3.0e+04 7.4e+02 1.2e+01 0 0 4 0 0 0 0 4 0 0 0 SFBcastEnd 64 1.0 5.4443e-03 3.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 BuildTwoSided 12 1.0 8.2293e-03 3.7 0.00e+00 0.0 3.0e+03 4.0e+00 1.2e+01 0 0 0 0 0 0 0 0 0 0 0 ------------------------------------------------------------------------------------------------------------------------ Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Matrix 412 409 180705004 0. Matrix Coarsen 12 12 7536 0. Vector 923 923 214751960 0. Vector Scatter 79 79 95488 0. Krylov Solver 17 17 67152 0. Preconditioner 17 17 16936 0. PetscRandom 1 1 638 0. Viewer 1 0 0 0. Index Set 223 223 790676 0. Star Forest Bipartite Graph 12 12 10176 0. ======================================================================================================================== Average time to get PetscTime(): 9.53674e-08 Average time for MPI_Barrier(): 1.1158e-05 Average time for zero size MPI_Send(): 1.52811e-05 #PETSc Option Table entries: -flow_ksp_max_it 8 -flow_ksp_monitor_true_residual -flow_ksp_rtol 0.1 -flow_ksp_type fgmres -flow_mg_coarse_ksp_max_it 3 -flow_mg_coarse_pc_asm_overlap 1 -flow_mg_coarse_pc_type bjacobi -flow_mg_coarse_sub_pc_factor_levels 2 -flow_mg_coarse_sub_pc_factor_mat_ordering_type rcm -flow_mg_coarse_sub_pc_type ilu -flow_mg_levels_ksp_type richardson -flow_mg_levels_pc_asm_overlap 1 -flow_mg_levels_pc_type sor -flow_mg_levels_sub_pc_factor_levels 1 -flow_mg_levels_sub_pc_factor_mat_ordering_type rcm -flow_pc_gamg_agg_nsmooths 0 -flow_pc_gamg_reuse_interpolation true -flow_pc_gamg_square_graph 2 -flow_pc_gamg_type agg -flow_pc_mg_cycle v -flow_pc_mg_levels 20 -flow_pc_mg_type kaskade -flow_pc_type gamg -ksp_max_it 50 -ksp_type fgmres -log_view -options_left #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure options: --CFLAGS="-O3 -axAVX -xHost" --CXXFLAGS="-std=c++11 -DMPICH_IGNORE_CXX_SEEK -DMPICH_IGNORE_CXX_SEEK" --FC=mpiifort --FFLAGS="-O3 -axAVX -xHost" --LDFLAGS="-fPIC /home/b0528796/libs/HDF5/1.8.16/lib/libhdf5.a /gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib/libsz.a /gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3/libz.a" --download-hypre=../petsc_extpacks/hypre-2.11.0.tar.gz --download-metis=../petsc_extpacks/metis-5.1.0-p1.tar.gz --download-ml --download-parmetis=../petsc_extpacks/parmetis-4.0.3-p1.tar.gz --download-ptscotch=../petsc_extpacks/scotch_6.0.3.tar.gz --download-suitesparse=../petsc_extpacks/SuiteSparse-4.4.3.tar.gz --download-superlu_dist --download-zoltan=../petsc_extpacks/zoltan_distrib_v3.83.tar.gz --with-blas-lapack-lib=-mkl --with-cc=mpiicc --with-cgns-dir=/home/b0528796/libs/CGNSLIBS/current/ --with-cgns=yes --with-cxx=mpiicpc --with-debugging=no --with-scalapack-include=/gpfs/fs1/intel/mkl/include --with-scalapack-lib="-L/gpfs/fs1/intel/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_blacs_intelmpi_lp64" --download-mumps ----------------------------------------- Libraries compiled on Tue Jul 5 15:06:27 2016 on hpc-user16 Machine characteristics: Linux-2.6.32-279.el6.x86_64-x86_64-with-redhat-6.3-Santiago Using PETSc directory: /home/b0528796/libs/petsc-dev Using PETSc arch: petscdev_opt ----------------------------------------- Using C compiler: mpiicc -O3 -axAVX -xHost -fPIC ${COPTFLAGS} ${CFLAGS} Using Fortran compiler: mpiifort -O3 -axAVX -xHost -fPIC ${FOPTFLAGS} ${FFLAGS} ----------------------------------------- Using include paths: -I/home/b0528796/libs/petsc-dev/petscdev_opt/include -I/home/b0528796/libs/petsc-dev/include -I/home/b0528796/libs/petsc-dev/include -I/home/b0528796/libs/petsc-dev/petscdev_opt/include -I/home/b0528796/libs/CGNSLIBS/current/include -I/gpfs/fs1/intel/impi/4.1.0.024/intel64/include ----------------------------------------- Using C linker: mpiicc Using Fortran linker: mpiifort Using libraries: -Wl,-rpath,/home/b0528796/libs/petsc-dev/petscdev_opt/lib -L/home/b0528796/libs/petsc-dev/petscdev_opt/lib -lpetsc -Wl,-rpath,/home/b0528796/libs/petsc-dev/petscdev_opt/lib -L/home/b0528796/libs/petsc-dev/petscdev_opt/lib -lcmumps -ldmumps -lsmumps -lzmumps -lmumps_common -lpord -L/gpfs/fs1/intel/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_blacs_intelmpi_lp64 -lumfpack -lklu -lcholmod -lbtf -lccolamd -lcolamd -lcamd -lamd -lsuitesparseconfig -lsuperlu_dist -lHYPRE -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/home/b0528796/libs/HDF5/1.8.16/lib -L/home/b0528796/libs/HDF5/1.8.16/lib -lhdf5 -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -lsz -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -lz -lmpigc4 -lmpi_dbg -lhdf5 -lsz -lz -Wl,-rpath,/opt/intel/mpi-rt/4.1 -lml -lhdf5 -lsz -lz -lmpigc4 -lmpi_dbg -lhdf5 -lsz -lz -mkl -lzoltan -lparmetis -lmetis -lptesmumps -lptscotch -lptscotcherr -lscotch -lscotcherr -lX11 -Wl,-rpath,/home/b0528796/libs/CGNSLIBS/current/lib -L/home/b0528796/libs/CGNSLIBS/current/lib -lcgns -lhdf5 -lsz -lz -lifport -lifcore -lm -lhdf5 -lsz -lz -lmpigc4 -lmpi_dbg -lhdf5 -lsz -lz -lrt -lm -lz -ldl -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -lmpi -lmpigf -lmpigi -lrt -lpthread -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/home/b0528796/libs/HDF5/1.8.16/lib -L/home/b0528796/libs/HDF5/1.8.16/lib -lhdf5 -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/szip-2.1/lib -lsz -Wl,-rpath,/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -L/gpfs/fs2/aero/SOFTWARE/FLOW_SOLVERS/FANSC/EXT_LIB/zlib-1.2.3 -lz -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/opt/intel/mpi-rt/4.1 -limf -lsvml -lirng -lipgo -ldecimal -lcilkrts -lstdc++ -lgcc_s -lirc -lirc_s -Wl,-rpath,/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -L/gpfs/fs1/intel/impi/4.1.0.024/intel64/lib -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -L/usr/lib/gcc/x86_64-redhat-linux/4.4.6 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/compiler/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/ipp/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/mkl/lib/intel64 -Wl,-rpath,/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -L/gpfs/fs1/intel/composer_xe_2013.1.117/tbb/lib/intel64 -ldl ----------------------------------------- #PETSc Option Table entries: -flow_ksp_max_it 8 -flow_ksp_monitor_true_residual -flow_ksp_rtol 0.1 -flow_ksp_type fgmres -flow_mg_coarse_ksp_max_it 3 -flow_mg_coarse_pc_asm_overlap 1 -flow_mg_coarse_pc_type bjacobi -flow_mg_coarse_sub_pc_factor_levels 2 -flow_mg_coarse_sub_pc_factor_mat_ordering_type rcm -flow_mg_coarse_sub_pc_type ilu -flow_mg_levels_ksp_type richardson -flow_mg_levels_pc_asm_overlap 1 -flow_mg_levels_pc_type sor -flow_mg_levels_sub_pc_factor_levels 1 -flow_mg_levels_sub_pc_factor_mat_ordering_type rcm -flow_pc_gamg_agg_nsmooths 0 -flow_pc_gamg_reuse_interpolation true -flow_pc_gamg_square_graph 2 -flow_pc_gamg_type agg -flow_pc_mg_cycle v -flow_pc_mg_levels 20 -flow_pc_mg_type kaskade -flow_pc_type gamg -ksp_max_it 50 -ksp_type fgmres -log_view -options_left #End of PETSc Option Table entries There are 8 unused database options. They are: Option left: name:-flow_mg_coarse_ksp_max_it value: 3 Option left: name:-flow_mg_coarse_pc_asm_overlap value: 1 Option left: name:-flow_mg_levels_pc_asm_overlap value: 1 Option left: name:-flow_mg_levels_sub_pc_factor_levels value: 1 Option left: name:-flow_mg_levels_sub_pc_factor_mat_ordering_type value: rcm Option left: name:-flow_pc_mg_cycle value: v Option left: name:-ksp_max_it value: 50 Option left: name:-ksp_type value: fgmres