Solving a linear TS problem on 256 processors mx : 16384, my: 16384, energy(in eV) : 2.500000e+04 0 TS dt 1e-07 time 0. 1 TS dt 1e-07 time 1e-07 2 TS dt 1e-07 time 2e-07 3 TS dt 1e-07 time 3e-07 4 TS dt 1e-07 time 4e-07 5 TS dt 1e-07 time 5e-07 6 TS dt 1e-07 time 6e-07 7 TS dt 1e-07 time 7e-07 8 TS dt 1e-07 time 8e-07 9 TS dt 1e-07 time 9e-07 10 TS dt 1e-07 time 1e-06 11 TS dt 1e-07 time 1.1e-06 12 TS dt 1e-07 time 1.2e-06 13 TS dt 1e-07 time 1.3e-06 14 TS dt 1e-07 time 1.4e-06 15 TS dt 1e-07 time 1.5e-06 16 TS dt 1e-07 time 1.6e-06 17 TS dt 1e-07 time 1.7e-06 18 TS dt 1e-07 time 1.8e-06 19 TS dt 1e-07 time 1.9e-06 20 TS dt 1e-07 time 2e-06 21 TS dt 1e-07 time 2.1e-06 22 TS dt 1e-07 time 2.2e-06 23 TS dt 1e-07 time 2.3e-06 24 TS dt 1e-07 time 2.4e-06 25 TS dt 1e-07 time 2.5e-06 26 TS dt 1e-07 time 2.6e-06 27 TS dt 1e-07 time 2.7e-06 28 TS dt 1e-07 time 2.8e-06 29 TS dt 1e-07 time 2.9e-06 30 TS dt 1e-07 time 3e-06 31 TS dt 1e-07 time 3.1e-06 32 TS dt 1e-07 time 3.2e-06 33 TS dt 1e-07 time 3.3e-06 34 TS dt 1e-07 time 3.4e-06 35 TS dt 1e-07 time 3.5e-06 36 TS dt 1e-07 time 3.6e-06 37 TS dt 1e-07 time 3.7e-06 38 TS dt 1e-07 time 3.8e-06 39 TS dt 1e-07 time 3.9e-06 40 TS dt 1e-07 time 4e-06 41 TS dt 1e-07 time 4.1e-06 42 TS dt 1e-07 time 4.2e-06 43 TS dt 1e-07 time 4.3e-06 44 TS dt 1e-07 time 4.4e-06 45 TS dt 1e-07 time 4.5e-06 46 TS dt 1e-07 time 4.6e-06 47 TS dt 1e-07 time 4.7e-06 48 TS dt 1e-07 time 4.8e-06 49 TS dt 1e-07 time 4.9e-06 50 TS dt 1e-07 time 5e-06 51 TS dt 1e-07 time 5.1e-06 52 TS dt 1e-07 time 5.2e-06 53 TS dt 1e-07 time 5.3e-06 54 TS dt 1e-07 time 5.4e-06 55 TS dt 1e-07 time 5.5e-06 56 TS dt 1e-07 time 5.6e-06 57 TS dt 1e-07 time 5.7e-06 58 TS dt 1e-07 time 5.8e-06 59 TS dt 1e-07 time 5.9e-06 60 TS dt 1e-07 time 6e-06 61 TS dt 1e-07 time 6.1e-06 62 TS dt 1e-07 time 6.2e-06 63 TS dt 1e-07 time 6.3e-06 64 TS dt 1e-07 time 6.4e-06 65 TS dt 1e-07 time 6.5e-06 66 TS dt 1e-07 time 6.6e-06 67 TS dt 1e-07 time 6.7e-06 68 TS dt 1e-07 time 6.8e-06 69 TS dt 1e-07 time 6.9e-06 70 TS dt 1e-07 time 7e-06 71 TS dt 1e-07 time 7.1e-06 72 TS dt 1e-07 time 7.2e-06 73 TS dt 1e-07 time 7.3e-06 74 TS dt 1e-07 time 7.4e-06 75 TS dt 1e-07 time 7.5e-06 76 TS dt 1e-07 time 7.6e-06 77 TS dt 1e-07 time 7.7e-06 78 TS dt 1e-07 time 7.8e-06 79 TS dt 1e-07 time 7.9e-06 80 TS dt 1e-07 time 8e-06 81 TS dt 1e-07 time 8.1e-06 82 TS dt 1e-07 time 8.2e-06 83 TS dt 1e-07 time 8.3e-06 84 TS dt 1e-07 time 8.4e-06 85 TS dt 1e-07 time 8.5e-06 86 TS dt 1e-07 time 8.6e-06 87 TS dt 1e-07 time 8.7e-06 88 TS dt 1e-07 time 8.8e-06 89 TS dt 1e-07 time 8.9e-06 90 TS dt 1e-07 time 9e-06 91 TS dt 1e-07 time 9.1e-06 92 TS dt 1e-07 time 9.2e-06 93 TS dt 1e-07 time 9.3e-06 94 TS dt 1e-07 time 9.4e-06 95 TS dt 1e-07 time 9.5e-06 96 TS dt 1e-07 time 9.6e-06 97 TS dt 1e-07 time 9.7e-06 98 TS dt 1e-07 time 9.8e-06 99 TS dt 1e-07 time 9.9e-06 100 TS dt 1e-07 time 1e-05 TS Object: 256 MPI processes type: cn maximum steps=100 maximum time=1e-05 total number of linear solver iterations=100 total number of linear solve failures=0 total number of rejected steps=0 using relative error tolerance of 0.0001, using absolute error tolerance of 0.0001 TSAdapt Object: 256 MPI processes type: none SNES Object: 256 MPI processes type: ksponly maximum iterations=50, maximum function evaluations=10000 tolerances: relative=1e-08, absolute=1e-50, solution=1e-08 total number of linear solver iterations=1 total number of function evaluations=1 norm schedule ALWAYS KSP Object: 256 MPI processes type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: 256 MPI processes type: gamg type is MULTIPLICATIVE, levels=1 cycles=v Cycles per PCApply=1 Using externally compute Galerkin coarse grid matrices GAMG specific options Threshold for dropping small values in graph on each level = Threshold scaling factor for each level not specified = 1. AGG specific options Symmetric graph false Number of levels to square graph 1 Number smoothing steps 1 Complexity: grid = 1. Coarse grid solver -- level ------------------------------- KSP Object: (mg_levels_0_) 256 MPI processes type: preonly maximum iterations=2, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_0_) 256 MPI processes type: sor type = local_symmetric, iterations = 1, local iterations = 1, omega = 1. linear system matrix = precond matrix: Mat Object: 256 MPI processes type: mpiaij rows=268435456, cols=268435456 total: nonzeros=1342111744, allocated nonzeros=1342111744 total number of mallocs used during MatSetValues calls =0 linear system matrix = precond matrix: Mat Object: 256 MPI processes type: mpiaij rows=268435456, cols=268435456 total: nonzeros=1342111744, allocated nonzeros=1342111744 total number of mallocs used during MatSetValues calls =0 ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- /blues/gpfs/home/sajid/projects/tol_study/./ex_dmda on a named apsxrmd-0001 with 256 processors, by sajid Thu May 16 18:25:01 2019 Using Petsc Development GIT revision: 7b55e7c7639b29fc5dfa674847298449a44172dd GIT Date: 2019-05-16 17:08:33 -0500 Max Max/Min Avg Total Time (sec): 2.097e+02 1.000 2.097e+02 Objects: 8.600e+01 1.000 8.600e+01 Flop: 2.141e+10 1.000 2.141e+10 5.482e+12 Flop/sec: 1.021e+08 1.000 1.021e+08 2.614e+10 MPI Messages: 8.200e+02 2.000 7.688e+02 1.968e+05 MPI Message Lengths: 1.324e+07 2.000 1.614e+04 3.177e+09 MPI Reductions: 1.940e+02 1.000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 2.0966e+02 100.0% 5.4815e+12 100.0% 1.968e+05 100.0% 1.614e+04 100.0% 1.870e+02 96.4% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s ------------------------------------------------------------------------------------------------------------------------ --- Event Stage 0: Main Stage BuildTwoSided 1 1.0 1.1815e-01532.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 BuildTwoSidedF 10 1.0 1.3951e+00 4.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFSetGraph 1 1.0 6.1989e-05 7.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFSetUp 1 1.0 1.1834e-01260.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFBcastBegin 3 1.0 1.1549e-03 8.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFBcastEnd 3 1.0 1.5116e-04 8.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecView 1 1.0 1.7509e+01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 8 0 0 0 0 8 0 0 0 0 0 VecScale 100 1.0 7.7454e-01 2.0 4.19e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 2 0 0 0 0 2 0 0 0 138630 VecCopy 300 1.0 2.8602e+00 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 VecSet 409 1.0 2.9403e+00 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 VecAXPY 200 1.0 1.8944e+00 1.8 1.68e+09 1.0 0.0e+00 0.0e+00 0.0e+00 1 8 0 0 0 1 8 0 0 0 226721 VecAYPX 200 1.0 2.3947e+00 1.8 8.39e+08 1.0 0.0e+00 0.0e+00 0.0e+00 1 4 0 0 0 1 4 0 0 0 89675 VecAXPBYCZ 100 1.0 1.7856e+00 1.9 1.26e+09 1.0 0.0e+00 0.0e+00 0.0e+00 1 6 0 0 0 1 6 0 0 0 180399 VecAssemblyBegin 5 1.0 2.7941e-01 8.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecAssemblyEnd 5 1.0 3.6907e-04 3.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecLoad 1 1.0 1.8553e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 VecScatterBegin 206 1.0 1.3546e-01 2.5 0.00e+00 0.0 1.9e+05 1.6e+04 0.0e+00 0 0 98100 0 0 0 98100 0 0 VecScatterEnd 206 1.0 1.0281e+01336.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 2 0 0 0 0 2 0 0 0 0 0 MatMult 200 1.0 2.7779e+01 1.3 7.55e+09 1.0 1.9e+05 1.6e+04 0.0e+00 11 35 98 99 0 11 35 98 99 0 69571 MatSOR 100 1.0 5.8027e+01 1.1 4.61e+09 1.0 0.0e+00 0.0e+00 0.0e+00 26 22 0 0 0 26 22 0 0 0 20340 MatConvert 1 1.0 4.0823e-01 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatScale 200 1.0 6.6993e+00 1.4 4.22e+09 1.0 9.6e+02 1.6e+04 0.0e+00 3 20 0 0 0 3 20 0 0 0 161071 MatAssemblyBegin 208 1.0 1.1558e+00 6.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatAssemblyEnd 208 1.0 1.6818e+01 1.1 0.00e+00 0.0 1.9e+03 4.1e+03 2.4e+01 8 0 1 0 12 8 0 1 0 13 0 MatCoarsen 1 1.0 3.6426e-01 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00 0 0 0 0 1 0 0 0 0 1 0 MatView 2 1.0 2.5861e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00 0 0 0 0 1 0 0 0 0 1 0 MatTrnMatMult 1 1.0 1.7907e+00 1.0 8.39e+06 1.0 0.0e+00 0.0e+00 1.6e+01 1 0 0 0 8 1 0 0 0 9 1199 MatTrnMatMultSym 1 1.0 1.2625e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 1.6e+01 1 0 0 0 8 1 0 0 0 9 0 MatTrnMatMultNum 1 1.0 5.3753e-01 1.1 8.39e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 3995 MatGetLocalMat 2 1.0 2.8500e-01 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 TSStep 100 1.0 1.8337e+02 1.0 2.14e+10 1.0 1.9e+05 1.6e+04 1.4e+02 87100 98100 73 87100 98100 75 29894 TSFunctionEval 200 1.0 6.5416e+01 1.1 1.09e+10 1.0 1.9e+05 1.6e+04 0.0e+00 30 51 98 99 0 30 51 98 99 0 42576 TSJacobianEval 300 1.0 4.0512e+01 1.2 2.52e+09 1.0 0.0e+00 0.0e+00 0.0e+00 18 12 0 0 0 18 12 0 0 0 15902 SNESSolve 100 1.0 1.3425e+02 1.1 1.43e+10 1.0 9.7e+04 1.6e+04 1.4e+02 61 67 49 50 71 61 67 49 50 73 27282 SNESFunctionEval 100 1.0 1.4453e+01 1.1 5.45e+09 1.0 9.6e+04 1.6e+04 0.0e+00 7 25 49 50 0 7 25 49 50 0 96576 SNESJacobianEval 100 1.0 4.0514e+01 1.2 2.52e+09 1.0 0.0e+00 0.0e+00 0.0e+00 18 12 0 0 0 18 12 0 0 0 15901 KSPSetUp 200 1.0 2.9194e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 KSPSolve 100 1.0 8.5055e+01 1.2 4.66e+09 1.0 9.6e+02 1.6e+04 1.4e+02 36 22 0 0 71 36 22 0 0 73 14028 PCGAMGGraph_AGG 1 1.0 2.3504e+00 1.0 4.19e+07 1.0 9.6e+02 1.6e+04 1.2e+01 1 0 0 0 6 1 0 0 0 6 4568 PCGAMGCoarse_AGG 1 1.0 3.2439e+00 1.0 8.39e+06 1.0 0.0e+00 0.0e+00 2.1e+01 2 0 0 0 11 2 0 0 0 11 662 PCGAMGProl_AGG 1 1.0 8.8627e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 2 0 0 0 0 2 0 GAMG: createProl 1 1.0 6.0130e+00 1.0 5.03e+07 1.0 9.6e+02 1.6e+04 3.7e+01 3 0 0 0 19 3 0 0 0 20 2143 Graph 2 1.0 2.3306e+00 1.0 4.19e+07 1.0 9.6e+02 1.6e+04 1.2e+01 1 0 0 0 6 1 0 0 0 6 4607 MIS/Agg 1 1.0 3.6446e-01 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00 0 0 0 0 1 0 0 0 0 1 0 PCSetUp 100 1.0 3.1141e+01 2.7 5.03e+07 1.0 9.6e+02 1.6e+04 1.4e+02 9 0 0 0 71 9 0 0 0 73 414 PCApply 100 1.0 5.9266e+01 1.1 4.61e+09 1.0 0.0e+00 0.0e+00 0.0e+00 27 22 0 0 0 27 22 0 0 0 19915 ------------------------------------------------------------------------------------------------------------------------ Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Distributed Mesh 3 2 9936 0. Index Set 9 9 8429056 0. IS L to G Mapping 1 0 0 0. Star Forest Graph 7 5 4544 0. Discrete System 3 2 1968 0. Vector 23 23 184655472 0. Vec Scatter 5 4 6112 0. Viewer 4 3 2576 0. Matrix 18 18 981364944 0. Matrix Coarsen 1 1 684 0. TSAdapt 1 1 1448 0. TS 1 1 2448 0. DMTS 1 1 792 0. SNES 1 1 1532 0. DMSNES 2 2 1440 0. Krylov Solver 2 2 3176 0. DMKSP interface 1 1 704 0. Preconditioner 2 2 2544 0. PetscRandom 1 1 710 0. ======================================================================================================================== Average time to get PetscTime(): 6.91414e-07 Average time for MPI_Barrier(): 9.51767e-05 Average time for zero size MPI_Send(): 3.58913e-05 #PETSc Option Table entries: -ksp_rtol 1e-5 -ksp_type preonly -log_view -pc_type gamg -prop_steps 100 -ts_monitor -ts_type cn #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with 64 bit PetscInt Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 16 sizeof(PetscInt) 8 Configure options: --prefix=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-develop-ks7ev4igde7karapzd66trpu3xapiimz --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 CFLAGS="-O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gcc" FFLAGS="-O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gfortran" CXXFLAGS="-O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/g++" --with-cc=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicc --with-cxx=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicpc --with-fc=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiifort --FC_LINKER_FLAGS=-lintlc --with-precision=double --with-scalar-type=complex --with-shared-libraries=1 --with-debugging=0 --with-64-bit-indices=1 COPTFLAGS= FOPTFLAGS= CXXOPTFLAGS= --with-blaslapack-lib="/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_intel_lp64.so /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_sequential.so /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_core.so /lib64/libpthread.so /lib64/libm.so /lib64/libdl.so" --with-avx-512-kernels --with-memalign=64 --with-x=0 --with-clanguage=C --with-scalapack=0 --with-metis=1 --with-metis-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2uxjs6gihdopyqjjyapxloxmopt3fyuf --with-hdf5=1 --with-hdf5-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g --with-hypre=0 --with-parmetis=1 --with-parmetis-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-ilq6ip5ckg7shv5pbbqpnqoihqag4x4e --with-mumps=0 --with-trilinos=0 --with-fftw=1 --with-fftw-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf --with-cxx-dialect=C++11 --with-superlu_dist-include=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-develop-ffpm5qwxgoln5tkzhgdhodjmcppgcv5t/include --with-superlu_dist-lib=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-develop-ffpm5qwxgoln5tkzhgdhodjmcppgcv5t/lib/libsuperlu_dist.a --with-superlu_dist=1 --with-suitesparse=0 --with-zlib-include=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/include --with-zlib-lib="-L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/lib -lz" --with-zlib=1 ----------------------------------------- Libraries compiled on 2019-05-16 23:05:30 on apsxrmd-0002 Machine characteristics: Linux-3.10.0-957.5.1.el7.x86_64-x86_64-with-centos-7.6.1810-Core Using PETSc directory: /blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-develop-ks7ev4igde7karapzd66trpu3xapiimz Using PETSc arch: ----------------------------------------- Using C compiler: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicc -O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gcc -fPIC Using Fortran compiler: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiifort -O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gfortran -fPIC ----------------------------------------- Using include paths: -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-develop-ks7ev4igde7karapzd66trpu3xapiimz/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-develop-ffpm5qwxgoln5tkzhgdhodjmcppgcv5t/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-ilq6ip5ckg7shv5pbbqpnqoihqag4x4e/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2uxjs6gihdopyqjjyapxloxmopt3fyuf/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/include ----------------------------------------- Using C linker: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicc Using Fortran linker: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiifort Using libraries: -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-develop-ks7ev4igde7karapzd66trpu3xapiimz/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-develop-ks7ev4igde7karapzd66trpu3xapiimz/lib -lpetsc -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-develop-ffpm5qwxgoln5tkzhgdhodjmcppgcv5t/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-develop-ffpm5qwxgoln5tkzhgdhodjmcppgcv5t/lib -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64 /lib64/libpthread.so /lib64/libm.so /lib64/libdl.so -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g/lib -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-ilq6ip5ckg7shv5pbbqpnqoihqag4x4e/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-ilq6ip5ckg7shv5pbbqpnqoihqag4x4e/lib -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2uxjs6gihdopyqjjyapxloxmopt3fyuf/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2uxjs6gihdopyqjjyapxloxmopt3fyuf/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib/release_mt -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib/release_mt -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64_lin/gcc4.7 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64_lin/gcc4.7 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64_lin -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64_lin -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64/gcc4.7 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64/gcc4.7 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib/gcc/x86_64-pc-linux-gnu/7.3.0 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib/gcc/x86_64-pc-linux-gnu/7.3.0 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib64 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib64 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib -Wl,-rpath,/opt/intel/mpi-rt/2017.0.0/intel64/lib/release_mt -Wl,-rpath,/opt/intel/mpi-rt/2017.0.0/intel64/lib -lsuperlu_dist -lfftw3_mpi -lfftw3 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lhdf5hl_fortran -lhdf5_fortran -lhdf5_hl -lhdf5 -lparmetis -lmetis -lz -lintlc -lstdc++ -ldl -lmpifort -lmpi -lmpigi -lrt -lpthread -lifport -lifcoremt_pic -limf -lsvml -lm -lipgo -lirc -lgcc_s -lirc_s -lquadmath -lstdc++ -ldl -----------------------------------------