Solving a linear TS problem on 256 processors mx : 16384, my: 16384, energy(in eV) : 2.500000e+04 0 TS dt 2e-07 time 0. 1 TS dt 2e-07 time 2e-07 2 TS dt 2e-07 time 4e-07 3 TS dt 2e-07 time 6e-07 4 TS dt 2e-07 time 8e-07 5 TS dt 2e-07 time 1e-06 6 TS dt 2e-07 time 1.2e-06 7 TS dt 2e-07 time 1.4e-06 8 TS dt 2e-07 time 1.6e-06 9 TS dt 2e-07 time 1.8e-06 10 TS dt 2e-07 time 2e-06 11 TS dt 2e-07 time 2.2e-06 12 TS dt 2e-07 time 2.4e-06 13 TS dt 2e-07 time 2.6e-06 14 TS dt 2e-07 time 2.8e-06 15 TS dt 2e-07 time 3e-06 16 TS dt 2e-07 time 3.2e-06 17 TS dt 2e-07 time 3.4e-06 18 TS dt 2e-07 time 3.6e-06 19 TS dt 2e-07 time 3.8e-06 20 TS dt 2e-07 time 4e-06 21 TS dt 2e-07 time 4.2e-06 22 TS dt 2e-07 time 4.4e-06 23 TS dt 2e-07 time 4.6e-06 24 TS dt 2e-07 time 4.8e-06 25 TS dt 2e-07 time 5e-06 26 TS dt 2e-07 time 5.2e-06 27 TS dt 2e-07 time 5.4e-06 28 TS dt 2e-07 time 5.6e-06 29 TS dt 2e-07 time 5.8e-06 30 TS dt 2e-07 time 6e-06 31 TS dt 2e-07 time 6.2e-06 32 TS dt 2e-07 time 6.4e-06 33 TS dt 2e-07 time 6.6e-06 34 TS dt 2e-07 time 6.8e-06 35 TS dt 2e-07 time 7e-06 36 TS dt 2e-07 time 7.2e-06 37 TS dt 2e-07 time 7.4e-06 38 TS dt 2e-07 time 7.6e-06 39 TS dt 2e-07 time 7.8e-06 40 TS dt 2e-07 time 8e-06 41 TS dt 2e-07 time 8.2e-06 42 TS dt 2e-07 time 8.4e-06 43 TS dt 2e-07 time 8.6e-06 44 TS dt 2e-07 time 8.8e-06 45 TS dt 2e-07 time 9e-06 46 TS dt 2e-07 time 9.2e-06 47 TS dt 2e-07 time 9.4e-06 48 TS dt 2e-07 time 9.6e-06 49 TS dt 2e-07 time 9.8e-06 50 TS dt 2e-07 time 1e-05 TS Object: 256 MPI processes type: cn maximum steps=50 maximum time=1e-05 total number of linear solver iterations=50 total number of linear solve failures=0 total number of rejected steps=0 using relative error tolerance of 0.0001, using absolute error tolerance of 0.0001 TSAdapt Object: 256 MPI processes type: none SNES Object: 256 MPI processes type: ksponly maximum iterations=50, maximum function evaluations=10000 tolerances: relative=1e-08, absolute=1e-50, solution=1e-08 total number of linear solver iterations=1 total number of function evaluations=1 norm schedule ALWAYS KSP Object: 256 MPI processes type: preonly maximum iterations=10000, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: 256 MPI processes type: gamg type is MULTIPLICATIVE, levels=1 cycles=v Cycles per PCApply=1 Using externally compute Galerkin coarse grid matrices GAMG specific options Threshold for dropping small values in graph on each level = Threshold scaling factor for each level not specified = 1. AGG specific options Symmetric graph false Number of levels to square graph 1 Number smoothing steps 1 Complexity: grid = 1. Coarse grid solver -- level ------------------------------- KSP Object: (mg_levels_0_) 256 MPI processes type: preonly maximum iterations=2, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_0_) 256 MPI processes type: sor type = local_symmetric, iterations = 1, local iterations = 1, omega = 1. linear system matrix = precond matrix: Mat Object: 256 MPI processes type: mpiaij rows=268435456, cols=268435456 total: nonzeros=1342111744, allocated nonzeros=1342111744 total number of mallocs used during MatSetValues calls =0 linear system matrix = precond matrix: Mat Object: 256 MPI processes type: mpiaij rows=268435456, cols=268435456 total: nonzeros=1342111744, allocated nonzeros=1342111744 total number of mallocs used during MatSetValues calls =0 ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- /blues/gpfs/home/sajid/projects/tol_study/./ex_dmda on a named apsxrmd-0001 with 256 processors, by sajid Thu May 16 18:21:14 2019 Using Petsc Development GIT revision: 7b55e7c7639b29fc5dfa674847298449a44172dd GIT Date: 2019-05-16 17:08:33 -0500 Max Max/Min Avg Total Time (sec): 1.476e+02 1.001 1.476e+02 Objects: 8.600e+01 1.000 8.600e+01 Flop: 1.072e+10 1.000 1.072e+10 2.744e+12 Flop/sec: 7.266e+07 1.001 7.264e+07 1.860e+10 MPI Messages: 4.200e+02 2.000 3.938e+02 1.008e+05 MPI Message Lengths: 6.685e+06 2.000 1.592e+04 1.604e+09 MPI Reductions: 1.440e+02 1.000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 1.4755e+02 100.0% 2.7440e+12 100.0% 1.008e+05 100.0% 1.592e+04 100.0% 1.370e+02 95.1% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s ------------------------------------------------------------------------------------------------------------------------ --- Event Stage 0: Main Stage BuildTwoSided 1 1.0 6.4121e-02197.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 BuildTwoSidedF 10 1.0 1.7860e+00 3.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 SFSetGraph 1 1.0 9.4891e-0513.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFSetUp 1 1.0 6.4782e-02129.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFBcastBegin 3 1.0 7.7920e-02 4.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 SFBcastEnd 3 1.0 4.7792e-022505.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecView 1 1.0 3.6243e+01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 25 0 0 0 0 25 0 0 0 0 0 VecScale 50 1.0 1.1760e+00 1.5 2.10e+08 1.0 0.0e+00 0.0e+00 0.0e+00 1 2 0 0 0 1 2 0 0 0 45653 VecCopy 150 1.0 1.4832e+00 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 VecSet 209 1.0 1.4432e+00 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 VecAXPY 100 1.0 9.8431e-01 1.9 8.39e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 8 0 0 0 0 8 0 0 0 218171 VecAYPX 100 1.0 1.1222e+00 1.6 4.19e+08 1.0 0.0e+00 0.0e+00 0.0e+00 1 4 0 0 0 1 4 0 0 0 95678 VecAXPBYCZ 50 1.0 9.9353e-01 1.9 6.29e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 6 0 0 0 0 6 0 0 0 162110 VecAssemblyBegin 5 1.0 5.0704e-01 4.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecAssemblyEnd 5 1.0 4.1453e-02440.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 VecLoad 1 1.0 4.9468e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 3 0 0 0 0 3 0 0 0 0 0 VecScatterBegin 106 1.0 7.5188e-02 2.5 0.00e+00 0.0 9.7e+04 1.6e+04 0.0e+00 0 0 96 99 0 0 0 96 99 0 0 VecScatterEnd 106 1.0 6.8655e+00563.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 MatMult 100 1.0 1.5364e+01 1.5 3.77e+09 1.0 9.6e+04 1.6e+04 0.0e+00 8 35 95 98 0 8 35 95 98 0 62893 MatSOR 50 1.0 2.9386e+01 1.2 2.31e+09 1.0 0.0e+00 0.0e+00 0.0e+00 19 22 0 0 0 19 22 0 0 0 20082 MatConvert 1 1.0 4.2708e-01 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatScale 100 1.0 3.3707e+00 1.4 2.12e+09 1.0 9.6e+02 1.6e+04 0.0e+00 2 20 1 1 0 2 20 1 1 0 160863 MatAssemblyBegin 108 1.0 1.2893e+00 5.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 MatAssemblyEnd 108 1.0 9.3494e+00 1.2 0.00e+00 0.0 1.9e+03 4.1e+03 2.4e+01 6 0 2 0 17 6 0 2 0 18 0 MatCoarsen 1 1.0 3.2566e-01 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00 0 0 0 0 1 0 0 0 0 1 0 MatView 2 1.0 1.4238e-01 3.1 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00 0 0 0 0 1 0 0 0 0 1 0 MatTrnMatMult 1 1.0 2.0032e+00 1.0 8.39e+06 1.0 0.0e+00 0.0e+00 1.6e+01 1 0 0 0 11 1 0 0 0 12 1072 MatTrnMatMultSym 1 1.0 1.4505e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 1.6e+01 1 0 0 0 11 1 0 0 0 12 0 MatTrnMatMultNum 1 1.0 5.5704e-01 1.0 8.39e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 3855 MatGetLocalMat 2 1.0 3.1651e-01 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 TSStep 50 1.0 9.5844e+01 1.0 1.07e+10 1.0 9.7e+04 1.6e+04 9.1e+01 65100 96 99 63 65100 96 99 66 28630 TSFunctionEval 100 1.0 3.2650e+01 1.1 5.43e+09 1.0 9.6e+04 1.6e+04 0.0e+00 21 51 95 98 0 21 51 95 98 0 42554 TSJacobianEval 150 1.0 2.0293e+01 1.2 1.26e+09 1.0 0.0e+00 0.0e+00 0.0e+00 13 12 0 0 0 13 12 0 0 0 15873 SNESSolve 50 1.0 7.0168e+01 1.1 7.18e+09 1.0 4.9e+04 1.6e+04 8.7e+01 46 67 49 50 60 46 67 49 50 64 26191 SNESFunctionEval 50 1.0 7.1916e+00 1.2 2.73e+09 1.0 4.8e+04 1.6e+04 0.0e+00 5 25 48 49 0 5 25 48 49 0 97044 SNESJacobianEval 50 1.0 2.0293e+01 1.2 1.26e+09 1.0 0.0e+00 0.0e+00 0.0e+00 13 12 0 0 0 13 12 0 0 0 15873 KSPSetUp 100 1.0 1.5540e-03 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 KSPSolve 50 1.0 4.6484e+01 1.2 2.36e+09 1.0 9.6e+02 1.6e+04 8.7e+01 28 22 1 1 60 28 22 1 1 64 12973 PCGAMGGraph_AGG 1 1.0 2.2528e+00 1.0 4.19e+07 1.0 9.6e+02 1.6e+04 1.2e+01 1 0 1 1 8 1 0 1 1 9 4766 PCGAMGCoarse_AGG 1 1.0 3.7344e+00 1.0 8.39e+06 1.0 0.0e+00 0.0e+00 2.1e+01 3 0 0 0 15 3 0 0 0 15 575 PCGAMGProl_AGG 1 1.0 1.4405e-01 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 3 0 0 0 0 3 0 GAMG: createProl 1 1.0 6.4311e+00 1.0 5.03e+07 1.0 9.6e+02 1.6e+04 3.7e+01 4 0 1 1 26 4 0 1 1 27 2003 Graph 2 1.0 2.2310e+00 1.0 4.19e+07 1.0 9.6e+02 1.6e+04 1.2e+01 1 0 1 1 8 1 0 1 1 9 4813 MIS/Agg 1 1.0 3.2601e-01 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00 0 0 0 0 1 0 0 0 0 1 0 PCSetUp 50 1.0 1.9530e+01 2.1 5.03e+07 1.0 9.6e+02 1.6e+04 8.7e+01 9 0 1 1 60 9 0 1 1 64 660 PCApply 50 1.0 2.9996e+01 1.2 2.31e+09 1.0 0.0e+00 0.0e+00 0.0e+00 19 22 0 0 0 19 22 0 0 0 19674 ------------------------------------------------------------------------------------------------------------------------ Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Distributed Mesh 3 2 9936 0. Index Set 9 9 8429056 0. IS L to G Mapping 1 0 0 0. Star Forest Graph 7 5 4544 0. Discrete System 3 2 1968 0. Vector 23 23 184655472 0. Vec Scatter 5 4 6112 0. Viewer 4 3 2576 0. Matrix 18 18 981364944 0. Matrix Coarsen 1 1 684 0. TSAdapt 1 1 1448 0. TS 1 1 2448 0. DMTS 1 1 792 0. SNES 1 1 1532 0. DMSNES 2 2 1440 0. Krylov Solver 2 2 3176 0. DMKSP interface 1 1 704 0. Preconditioner 2 2 2544 0. PetscRandom 1 1 710 0. ======================================================================================================================== Average time to get PetscTime(): 9.05991e-07 Average time for MPI_Barrier(): 0.000100565 Average time for zero size MPI_Send(): 0.000327289 #PETSc Option Table entries: -ksp_rtol 1e-5 -ksp_type preonly -log_view -pc_type gamg -prop_steps 50 -ts_monitor -ts_type cn #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with 64 bit PetscInt Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 16 sizeof(PetscInt) 8 Configure options: --prefix=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-develop-ks7ev4igde7karapzd66trpu3xapiimz --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 CFLAGS="-O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gcc" FFLAGS="-O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gfortran" CXXFLAGS="-O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/g++" --with-cc=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicc --with-cxx=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicpc --with-fc=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiifort --FC_LINKER_FLAGS=-lintlc --with-precision=double --with-scalar-type=complex --with-shared-libraries=1 --with-debugging=0 --with-64-bit-indices=1 COPTFLAGS= FOPTFLAGS= CXXOPTFLAGS= --with-blaslapack-lib="/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_intel_lp64.so /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_sequential.so /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64/libmkl_core.so /lib64/libpthread.so /lib64/libm.so /lib64/libdl.so" --with-avx-512-kernels --with-memalign=64 --with-x=0 --with-clanguage=C --with-scalapack=0 --with-metis=1 --with-metis-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2uxjs6gihdopyqjjyapxloxmopt3fyuf --with-hdf5=1 --with-hdf5-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g --with-hypre=0 --with-parmetis=1 --with-parmetis-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-ilq6ip5ckg7shv5pbbqpnqoihqag4x4e --with-mumps=0 --with-trilinos=0 --with-fftw=1 --with-fftw-dir=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf --with-cxx-dialect=C++11 --with-superlu_dist-include=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-develop-ffpm5qwxgoln5tkzhgdhodjmcppgcv5t/include --with-superlu_dist-lib=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-develop-ffpm5qwxgoln5tkzhgdhodjmcppgcv5t/lib/libsuperlu_dist.a --with-superlu_dist=1 --with-suitesparse=0 --with-zlib-include=/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/include --with-zlib-lib="-L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/lib -lz" --with-zlib=1 ----------------------------------------- Libraries compiled on 2019-05-16 23:05:30 on apsxrmd-0002 Machine characteristics: Linux-3.10.0-957.5.1.el7.x86_64-x86_64-with-centos-7.6.1810-Core Using PETSc directory: /blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-develop-ks7ev4igde7karapzd66trpu3xapiimz Using PETSc arch: ----------------------------------------- Using C compiler: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicc -O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gcc -fPIC Using Fortran compiler: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiifort -O3 -xMIC-AVX512 -gcc-name=/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/bin/gfortran -fPIC ----------------------------------------- Using include paths: -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-develop-ks7ev4igde7karapzd66trpu3xapiimz/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-develop-ffpm5qwxgoln5tkzhgdhodjmcppgcv5t/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-ilq6ip5ckg7shv5pbbqpnqoihqag4x4e/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2uxjs6gihdopyqjjyapxloxmopt3fyuf/include -I/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/include ----------------------------------------- Using C linker: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiicc Using Fortran linker: /blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/bin/mpiifort Using libraries: -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-develop-ks7ev4igde7karapzd66trpu3xapiimz/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/petsc-develop-ks7ev4igde7karapzd66trpu3xapiimz/lib -lpetsc -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-develop-ffpm5qwxgoln5tkzhgdhodjmcppgcv5t/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/superlu-dist-develop-ffpm5qwxgoln5tkzhgdhodjmcppgcv5t/lib -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/fftw-3.3.8-s7bwdojusvwl3tdqqrdj6xg3jffitfmf/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64 /lib64/libpthread.so /lib64/libm.so /lib64/libdl.so -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/hdf5-1.10.5-4l2oqer7h7evmjcweba5iym767fnvn4g/lib -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-ilq6ip5ckg7shv5pbbqpnqoihqag4x4e/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/parmetis-4.0.3-ilq6ip5ckg7shv5pbbqpnqoihqag4x4e/lib -Wl,-rpath,/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2uxjs6gihdopyqjjyapxloxmopt3fyuf/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/metis-5.1.0-2uxjs6gihdopyqjjyapxloxmopt3fyuf/lib -L/blues/gpfs/home/sajid/packages/spack/opt/spack/linux-centos7-x86_64/intel-18.0.3/zlib-1.2.11-6kmiiipb73pscb6ruoi5xceamyzvgrmu/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib/release_mt -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib/release_mt -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mpi-2018.3.222-4aoglyb6zfpaydn6iuiz63wyj3soolv2/compilers_and_libraries_2018.3.222/linux/mpi/intel64/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64_lin/gcc4.7 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64_lin/gcc4.7 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64_lin -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64_lin -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/intel-18.0.3/intel-mkl-2018.3.222-6ff5hhpjd6k3y4uvcg4mrthoqj3e3ok4/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64/gcc4.7 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/tbb/lib/intel64/gcc4.7 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/lib -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/intel-18.0.3-d6gtsxst5w4bw3ko7qvtaweu23hv5y6b/compilers_and_libraries_2018.3.222/linux/compiler/lib/intel64_lin -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib/gcc/x86_64-pc-linux-gnu/7.3.0 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib/gcc/x86_64-pc-linux-gnu/7.3.0 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib64 -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib64 -Wl,-rpath,/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib -L/blues/gpfs/home/software/spack-0.10.1/opt/spack/linux-centos7-x86_64/gcc-4.8.5/gcc-7.3.0-xyzezhjmbiebkjfoakso464rhfshlkyq/lib -Wl,-rpath,/opt/intel/mpi-rt/2017.0.0/intel64/lib/release_mt -Wl,-rpath,/opt/intel/mpi-rt/2017.0.0/intel64/lib -lsuperlu_dist -lfftw3_mpi -lfftw3 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lhdf5hl_fortran -lhdf5_fortran -lhdf5_hl -lhdf5 -lparmetis -lmetis -lz -lintlc -lstdc++ -ldl -lmpifort -lmpi -lmpigi -lrt -lpthread -lifport -lifcoremt_pic -limf -lsvml -lm -lipgo -lirc -lgcc_s -lirc_s -lquadmath -lstdc++ -ldl -----------------------------------------