Solving a linear TS problem on 256 processors mx : 16384, my: 16384, energy(in eV) : 2.500000e+04 0 TS dt 2e-07 time 0. 1 TS dt 2e-07 time 2e-07 2 TS dt 2e-07 time 4e-07 3 TS dt 2e-07 time 6e-07 4 TS dt 2e-07 time 8e-07 5 TS dt 2e-07 time 1e-06 6 TS dt 2e-07 time 1.2e-06 7 TS dt 2e-07 time 1.4e-06 8 TS dt 2e-07 time 1.6e-06 9 TS dt 2e-07 time 1.8e-06 10 TS dt 2e-07 time 2e-06 11 TS dt 2e-07 time 2.2e-06 12 TS dt 2e-07 time 2.4e-06 13 TS dt 2e-07 time 2.6e-06 14 TS dt 2e-07 time 2.8e-06 15 TS dt 2e-07 time 3e-06 16 TS dt 2e-07 time 3.2e-06 17 TS dt 2e-07 time 3.4e-06 18 TS dt 2e-07 time 3.6e-06 19 TS dt 2e-07 time 3.8e-06 20 TS dt 2e-07 time 4e-06 21 TS dt 2e-07 time 4.2e-06 22 TS dt 2e-07 time 4.4e-06 23 TS dt 2e-07 time 4.6e-06 24 TS dt 2e-07 time 4.8e-06 25 TS dt 2e-07 time 5e-06 26 TS dt 2e-07 time 5.2e-06 27 TS dt 2e-07 time 5.4e-06 28 TS dt 2e-07 time 5.6e-06 29 TS dt 2e-07 time 5.8e-06 30 TS dt 2e-07 time 6e-06 31 TS dt 2e-07 time 6.2e-06 32 TS dt 2e-07 time 6.4e-06 33 TS dt 2e-07 time 6.6e-06 34 TS dt 2e-07 time 6.8e-06 35 TS dt 2e-07 time 7e-06 36 TS dt 2e-07 time 7.2e-06 37 TS dt 2e-07 time 7.4e-06 38 TS dt 2e-07 time 7.6e-06 39 TS dt 2e-07 time 7.8e-06 40 TS dt 2e-07 time 8e-06 41 TS dt 2e-07 time 8.2e-06 42 TS dt 2e-07 time 8.4e-06 43 TS dt 2e-07 time 8.6e-06 44 TS dt 2e-07 time 8.8e-06 45 TS dt 2e-07 time 9e-06 46 TS dt 2e-07 time 9.2e-06 47 TS dt 2e-07 time 9.4e-06 48 TS dt 2e-07 time 9.6e-06 49 TS dt 2e-07 time 9.8e-06 50 TS dt 2e-07 time 1e-05 TS Object: 256 MPI processes type: cn maximum steps=50 maximum time=1e-05 total number of linear solver iterations=50 total number of linear solve failures=0 total number of rejected steps=0 using relative error tolerance of 0.0001, using absolute error tolerance of 0.0001 TSAdapt Object: 256 MPI processes type: none SNES Object: 256 MPI processes type: ksponly maximum iterations=50, maximum function evaluations=10000 tolerances: relative=1e-08, absolute=1e-50, solution=1e-08 total number of linear solver iterations=1 total number of function evaluations=1 norm schedule ALWAYS SNESLineSearch Object: 256 MPI processes type: basic maxstep=1.000000e+08, minlambda=1.000000e-12 tolerances: relative=1.000000e-08, absolute=1.000000e-15, lambda=1.000000e-08 maximum iterations=1 KSP Object: 256 MPI processes type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: 256 MPI processes type: gamg type is MULTIPLICATIVE, levels=1 cycles=v Cycles per PCApply=1 Using externally compute Galerkin coarse grid matrices GAMG specific options Threshold for dropping small values in graph on each level = Threshold scaling factor for each level not specified = 1. AGG specific options Symmetric graph false Number of levels to square graph 1 Number smoothing steps 1 Complexity: grid = 1. Coarse grid solver -- level ------------------------------- KSP Object: (mg_levels_0_) 256 MPI processes type: preonly maximum iterations=2, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_0_) 256 MPI processes type: sor type = local_symmetric, iterations = 1, local iterations = 1, omega = 1. linear system matrix followed by preconditioner matrix: Mat Object: 256 MPI processes type: mpiaij rows=268435456, cols=268435456 total: nonzeros=1342111744, allocated nonzeros=1342111744 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines Mat Object: 256 MPI processes type: mpiaij rows=268435456, cols=268435456 total: nonzeros=1342111744, allocated nonzeros=1342111744 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines linear system matrix followed by preconditioner matrix: Mat Object: 256 MPI processes type: mpiaij rows=268435456, cols=268435456 total: nonzeros=1342111744, allocated nonzeros=1342111744 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines Mat Object: 256 MPI processes type: mpiaij rows=268435456, cols=268435456 total: nonzeros=1342111744, allocated nonzeros=1342111744 total number of mallocs used during MatSetValues calls =0 not using I-node (on process 0) routines ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- /blues/gpfs/home/sajid/projects/tol_study/./ex_dmda on a named apsxrmd-0001 with 256 processors, by sajid Thu May 16 14:09:50 2019 Using Petsc Release Version 3.11.1, Apr, 12, 2019 Max Max/Min Avg Total Time (sec): 4.114e+02 1.000 4.113e+02 Objects: 8.970e+02 1.000 8.970e+02 Flop: 8.228e+09 1.000 8.227e+09 2.106e+12 Flop/sec: 2.000e+07 1.000 2.000e+07 5.120e+09 MPI Messages: 1.220e+03 2.000 1.144e+03 2.928e+05 MPI Message Lengths: 8.292e+06 2.000 6.797e+03 1.990e+09 MPI Reductions: 1.146e+03 1.000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 4.1133e+02 100.0% 2.1062e+12 100.0% 2.928e+05 100.0% 6.797e+03 100.0% 1.139e+03 99.4% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s ------------------------------------------------------------------------------------------------------------------------ --- Event Stage 0: Main Stage BuildTwoSided 1 1.0 7.5317e-02288.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 BuildTwoSidedF 110 1.0 4.7119e+01 3.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 7 0 0 0 0 7 0 0 0 0 0 SFSetGraph 1 1.0 1.5402e-04 9.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFSetUp 1 1.0 1.4858e-0116.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFBcastBegin 3 1.0 8.1061e-02871.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFBcastEnd 3 1.0 1.5497e-0417.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecView 1 1.0 3.6866e+01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 9 0 0 0 0 9 0 0 0 0 0 VecScale 50 1.0 1.2054e+00 1.5 2.10e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 3 0 0 0 0 3 0 0 0 44540 VecCopy 150 1.0 1.9371e+00 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecSet 311 1.0 1.6880e+00 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecAXPY 100 1.0 1.4714e+00 2.0 8.39e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 10 0 0 0 0 10 0 0 0 145944 VecAYPX 100 1.0 1.1729e+00 1.6 4.19e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 5 0 0 0 0 5 0 0 0 91548 VecAXPBYCZ 50 1.0 6.3646e-01 1.5 6.29e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 8 0 0 0 0 8 0 0 0 253059 VecAssemblyBegin 5 1.0 4.7642e-01 3.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecAssemblyEnd 5 1.0 3.6120e-04 4.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecLoad 1 1.0 2.6211e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 VecScatterBegin 106 1.0 8.1288e-02 2.4 0.00e+00 0.0 9.7e+04 1.6e+04 0.0e+00 0 0 33 80 0 0 0 33 80 0 0 VecScatterEnd 106 1.0 1.8041e+0054.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatMult 100 1.0 1.4356e+01 1.2 3.77e+09 1.0 9.6e+04 1.6e+04 0.0e+00 3 46 33 79 0 3 46 33 79 0 67312 MatSOR 50 1.0 3.2020e+01 1.1 2.31e+09 1.0 0.0e+00 0.0e+00 0.0e+00 7 28 0 0 0 7 28 0 0 0 18430 MatConvert 3 1.0 7.5038e-01 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatScale 1 1.0 1.8774e-01 1.7 4.19e+07 1.0 9.6e+02 1.6e+04 0.0e+00 0 1 0 1 0 0 1 0 1 0 57190 MatAssemblyBegin 209 1.0 4.6834e+01 3.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 7 0 0 0 0 7 0 0 0 0 0 MatAssemblyEnd 209 1.0 2.9840e+01 1.0 0.00e+00 0.0 1.9e+05 2.0e+03 8.2e+02 7 0 66 20 72 7 0 66 20 72 0 MatCoarsen 1 1.0 3.3937e-01 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatZeroEntries 100 1.0 1.6584e+00 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatView 4 1.0 1.5290e-01 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatAXPY 100 1.0 2.7582e+02 1.0 0.00e+00 0.0 1.9e+05 2.0e+03 1.0e+03 66 0 66 20 87 66 0 66 20 88 0 MatTrnMatMult 1 1.0 1.9901e+00 1.0 8.39e+06 1.0 0.0e+00 0.0e+00 1.6e+01 0 0 0 0 1 0 0 0 0 1 1079 MatTrnMatMultSym 1 1.0 1.4715e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 1.6e+01 0 0 0 0 1 0 0 0 0 1 0 MatTrnMatMultNum 1 1.0 5.2235e-01 1.1 8.39e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 4111 MatGetLocalMat 2 1.0 2.5915e-01 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 TSStep 50 1.0 3.6251e+02 1.0 8.23e+09 1.0 2.9e+05 6.9e+03 1.1e+03 88100 99100 95 88100 99100 96 5810 TSFunctionEval 100 1.0 1.5823e+01 1.2 4.19e+09 1.0 9.6e+04 1.6e+04 0.0e+00 3 51 33 79 0 3 51 33 79 0 67855 TSJacobianEval 150 1.0 3.0850e+02 1.0 0.00e+00 0.0 1.9e+05 2.0e+03 1.0e+03 74 0 66 20 87 74 0 66 20 88 0 SNESSolve 50 1.0 3.5290e+02 1.0 5.92e+09 1.0 2.4e+05 5.0e+03 1.1e+03 86 72 82 60 95 86 72 82 60 95 4295 SNESFunctionEval 50 1.0 7.8829e+00 1.2 2.73e+09 1.0 4.8e+04 1.6e+04 0.0e+00 2 33 16 40 0 2 33 16 40 0 88535 SNESJacobianEval 50 1.0 3.0850e+02 1.0 0.00e+00 0.0 1.9e+05 2.0e+03 1.0e+03 74 0 66 20 87 74 0 66 20 88 0 KSPSetUp 100 1.0 5.3381e-0274.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 KSPSolve 50 1.0 4.0410e+01 1.1 2.36e+09 1.0 9.6e+02 1.6e+04 8.7e+01 9 29 0 1 8 9 29 0 1 8 14923 PCGAMGGraph_AGG 1 1.0 2.0732e+00 1.0 4.19e+07 1.0 9.6e+02 1.6e+04 1.2e+01 1 1 0 1 1 1 1 0 1 1 5179 PCGAMGCoarse_AGG 1 1.0 3.5856e+00 1.0 8.39e+06 1.0 0.0e+00 0.0e+00 2.1e+01 1 0 0 0 2 1 0 0 0 2 599 PCGAMGProl_AGG 1 1.0 1.1847e-01 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 0 0 GAMG: createProl 1 1.0 6.0383e+00 1.0 5.03e+07 1.0 9.6e+02 1.6e+04 3.7e+01 1 1 0 1 3 1 1 0 1 3 2134 Graph 2 1.0 2.0546e+00 1.1 4.19e+07 1.0 9.6e+02 1.6e+04 1.2e+01 0 1 0 1 1 0 1 0 1 1 5226 MIS/Agg 1 1.0 3.8373e-01 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 PCSetUp 50 1.0 7.5924e+00 1.1 5.03e+07 1.0 9.6e+02 1.6e+04 8.7e+01 2 1 0 1 8 2 1 0 1 8 1697 PCApply 50 1.0 3.2610e+01 1.1 2.31e+09 1.0 0.0e+00 0.0e+00 0.0e+00 7 28 0 0 0 7 28 0 0 0 18097 ------------------------------------------------------------------------------------------------------------------------ Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Distributed Mesh 3 2 9728 0. Index Set 209 209 5195416 0. IS L to G Mapping 1 0 0 0. Star Forest Graph 7 5 4184 0. Discrete System 3 2 1824 0. Vector 225 225 188316648 0. Vec Scatter 107 106 147552 0. Viewer 4 3 2504 0. Matrix 324 324 18154675860 0. Matrix Coarsen 1 1 636 0. TSAdapt 1 1 1240 0. TS 1 1 2056 0. DMTS 1 1 744 0. SNES 1 1 1404 0. DMSNES 2 2 1344 0. SNESLineSearch 1 1 992 0. Krylov Solver 2 2 2912 0. DMKSP interface 1 1 656 0. Preconditioner 2 2 2348 0. PetscRandom 1 1 662 0. ======================================================================================================================== Average time to get PetscTime(): 7.86781e-07 Average time for MPI_Barrier(): 8.50201e-05 Average time for zero size MPI_Send(): 0.000330652 #PETSc Option Table entries: -ksp_rtol 1e-5 -ksp_type preonly -log_view -pc_type gamg -prop_steps 50 -ts_monitor -ts_type cn #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 16 sizeof(PetscInt) 4 Configure options: --prefix=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-3.11.1-znnski52i7eihozxqp5jushd2aquekgw --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 CFLAGS="-O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gcc" FFLAGS="-O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gfortran" CXXFLAGS="-O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/g++" --with-cc=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicc --with-cxx=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicpc --with-fc=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiifort --FC_LINKER_FLAGS=-lintlc --with-precision=double --with-scalar-type=complex --with-shared-libraries=1 --with-debugging=0 --with-64-bit-indices=0 COPTFLAGS= FOPTFLAGS= CXXOPTFLAGS= --with-blaslapack-lib="/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_intel_lp64.so /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_sequential.so /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_core.so /lib64/libpthread.so /lib64/libm.so /lib64/libdl.so" --with-avx-512-kernels --with-memalign=64 --with-x=0 --with-clanguage=C --with-scalapack-lib="/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_scalapack_lp64.so /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_blacs_intelmpi_lp64.so" --with-scalapack=1 --with-metis=1 --with-metis-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2kdch3t6ljztuicullkck2e3arqqt5ex --with-hdf5=1 --with-hdf5-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g --with-hypre=0 --with-parmetis=1 --with-parmetis-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-v3i7edwwswc2n6rmenqvezvtxmohblgb --with-mumps=1 --with-mumps-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/mumps-5.1.2-r3ikbyhtguup57aoebhasf6fxjawkfbz --with-trilinos=0 --with-fftw=1 --with-fftw-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf --with-cxx-dialect=C++11 --with-superlu_dist-include=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-6.1.1-3jhheliclr3aigedstzj273jgu4fbyqg/include --with-superlu_dist-lib=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-6.1.1-3jhheliclr3aigedstzj273jgu4fbyqg/lib/libsuperlu_dist.a --with-superlu_dist=1 --with-suitesparse-include=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/suite-sparse-5.3.0-yoplzbxos5vipsvfn72gp5gttsu5zduu/include --with-suitesparse-lib="-L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/suite-sparse-5.3.0-yoplzbxos5vipsvfn72gp5gttsu5zduu/lib -L/lib64 -lumfpack -lklu -lcholmod -lbtf -lccolamd -lcolamd -lcamd -lamd -lsuitesparseconfig -lrt" --with-suitesparse=1 --with-zlib-include=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/include --with-zlib-lib="-L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/lib -lz" --with-zlib=1 ----------------------------------------- Libraries compiled on 2019-04-15 05:57:10 on apsxrmd-0002 Machine characteristics: Linux-3.10.0-957.5.1.el7.x86_64-x86_64-with-centos-7.6.1810-Core Using PETSc directory: /blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-3.11.1-znnski52i7eihozxqp5jushd2aquekgw Using PETSc arch: ----------------------------------------- Using C compiler: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicc -O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gcc -fPIC Using Fortran compiler: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiifort -O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gfortran -fPIC ----------------------------------------- Using include paths: -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-3.11.1-znnski52i7eihozxqp5jushd2aquekgw/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/mumps-5.1.2-r3ikbyhtguup57aoebhasf6fxjawkfbz/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/suite-sparse-5.3.0-yoplzbxos5vipsvfn72gp5gttsu5zduu/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-6.1.1-3jhheliclr3aigedstzj273jgu4fbyqg/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-v3i7edwwswc2n6rmenqvezvtxmohblgb/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2kdch3t6ljztuicullkck2e3arqqt5ex/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/include ----------------------------------------- Using C linker: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicc Using Fortran linker: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiifort Using libraries: -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-3.11.1-znnski52i7eihozxqp5jushd2aquekgw/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-3.11.1-znnski52i7eihozxqp5jushd2aquekgw/lib -lpetsc -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/mumps-5.1.2-r3ikbyhtguup57aoebhasf6fxjawkfbz/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/mumps-5.1.2-r3ikbyhtguup57aoebhasf6fxjawkfbz/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64 -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/suite-sparse-5.3.0-yoplzbxos5vipsvfn72gp5gttsu5zduu/lib -L/lib64 -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-6.1.1-3jhheliclr3aigedstzj273jgu4fbyqg/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-6.1.1-3jhheliclr3aigedstzj273jgu4fbyqg/lib -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf/lib /lib64/libpthread.so /lib64/libm.so /lib64/libdl.so -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g/lib -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-v3i7edwwswc2n6rmenqvezvtxmohblgb/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-v3i7edwwswc2n6rmenqvezvtxmohblgb/lib -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2kdch3t6ljztuicullkck2e3arqqt5ex/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2kdch3t6ljztuicullkck2e3arqqt5ex/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib/release_mt -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib/release_mt -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64_lin/gcc4.7 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64_lin/gcc4.7 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64_lin -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64_lin -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64/gcc4.7 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64/gcc4.7 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib/gcc/x86_64-pc-linux-gnu/7.3.0 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib/gcc/x86_64-pc-linux-gnu/7.3.0 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib64 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib64 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib -Wl,-rpath,/opt/intel/mpi-rt/2017.0.0/intel64/lib/release_mt -Wl,-rpath,/opt/intel/mpi-rt/2017.0.0/intel64/lib -lcmumps -ldmumps -lsmumps -lzmumps -lmumps_common -lpord -lmkl_scalapack_lp64 -lmkl_blacs_intelmpi_lp64 -lumfpack -lklu -lcholmod -lbtf -lccolamd -lcolamd -lcamd -lamd -lsuitesparseconfig -lrt -lsuperlu_dist -lfftw3_mpi -lfftw3 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lhdf5hl_fortran -lhdf5_fortran -lhdf5_hl -lhdf5 -lparmetis -lmetis -lz -lintlc -lstdc++ -ldl -lmpifort -lmpi -lmpigi -lrt -lpthread -lifport -lifcoremt_pic -limf -lsvml -lm -lipgo -lirc -lgcc_s -lirc_s -lstdc++ -ldl -----------------------------------------