Residual norm 0.1454E+03 iterations 10000time 0.18E+04 ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- /scratch/snx3000/nvarini/miniapp/miniapp/./miniapp_f.x on a named nid02177 with 1 processor, by nvarini Thu Aug 13 17:17:39 2020 Using Petsc Release Version 3.13.3, Jul 01, 2020 Max Max/Min Avg Total Time (sec): 1.761e+03 1.000 1.761e+03 Objects: 2.520e+02 1.000 2.520e+02 Flop: 1.397e+12 1.000 1.397e+12 1.397e+12 Flop/sec: 7.934e+08 1.000 7.934e+08 7.934e+08 MPI Messages: 0.000e+00 0.000 0.000e+00 0.000e+00 MPI Message Lengths: 0.000e+00 0.000 0.000e+00 0.000e+00 MPI Reductions: 0.000e+00 0.000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 1.7613e+03 100.0% 1.3973e+12 100.0% 0.000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage MatMult 175871 1.0 9.8711e+02 1.0 5.79e+11 1.0 0.0e+00 0.0e+00 0.0e+00 56 41 0 0 0 56 41 0 0 0 586 0 0 0.00e+00 0 0.00e+00 0 MatMultAdd 41372 1.0 1.2211e+02 1.0 4.18e+10 1.0 0.0e+00 0.0e+00 0.0e+00 7 3 0 0 0 7 3 0 0 0 342 0 0 0.00e+00 0 0.00e+00 0 MatMultTranspose 41372 1.0 1.3449e+02 1.0 4.18e+10 1.0 0.0e+00 0.0e+00 0.0e+00 8 3 0 0 0 8 3 0 0 0 311 0 0 0.00e+00 0 0.00e+00 0 MatSolve 10343 1.0 7.6975e-02 1.0 1.42e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 184 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 7.0095e-05 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 4.0054e-05 1.0 1.06e+04 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 264 0 0 0.00e+00 0 0.00e+00 0 MatConvert 4 1.0 3.5679e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatScale 12 1.0 3.6799e-02 1.0 1.62e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 440 0 0 0.00e+00 0 0.00e+00 0 MatResidual 41372 1.0 2.1977e+02 1.0 1.26e+11 1.0 0.0e+00 0.0e+00 0.0e+00 12 9 0 0 0 12 9 0 0 0 571 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyBegin 23 1.0 6.6757e-06 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 23 1.0 1.9441e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetRowIJ 1 1.0 1.0014e-05 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 1.0 6.1989e-05 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCoarsen 4 1.0 6.8005e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLoad 1 1.0 4.0187e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatView 1 1.0 6.0205e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAXPY 4 1.0 5.3730e-02 1.0 6.25e+05 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 12 0 0 0.00e+00 0 0.00e+00 0 MatMatMultSym 4 1.0 1.3840e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMatMultNum 4 1.0 1.2145e-01 1.0 1.42e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 117 0 0 0.00e+00 0 0.00e+00 0 MatPtAPSymbolic 4 1.0 3.2803e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatPtAPNumeric 4 1.0 5.1093e-01 1.0 6.84e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 134 0 0 0.00e+00 0 0.00e+00 0 MatTrnMatMultSym 1 1.0 8.7710e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetSymTrans 4 1.0 1.7985e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecView 1 1.0 4.3285e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecDot 26 1.0 1.4126e-02 1.0 3.03e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2145 0 0 0.00e+00 0 0.00e+00 0 VecMDot 20347 1.0 1.0439e+02 1.0 2.75e+11 1.0 0.0e+00 0.0e+00 0.0e+00 6 20 0 0 0 6 20 0 0 0 2632 0 0 0.00e+00 0 0.00e+00 0 VecNorm 10380 1.0 5.2074e+00 1.0 1.21e+10 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 2316 0 0 0.00e+00 0 0.00e+00 0 VecScale 10378 1.0 2.8437e+00 1.0 6.03e+09 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2120 0 0 0.00e+00 0 0.00e+00 0 VecCopy 124802 1.0 1.3612e+01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSet 124572 1.0 8.2761e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 10971 1.0 5.4856e+00 1.0 1.28e+10 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 2330 0 0 0.00e+00 0 0.00e+00 0 VecAYPX 248232 1.0 1.0062e+02 1.0 5.18e+10 1.0 0.0e+00 0.0e+00 0.0e+00 6 4 0 0 0 6 4 0 0 0 515 0 0 0.00e+00 0 0.00e+00 0 VecAXPBYCZ 82744 1.0 4.0913e+01 1.0 6.47e+10 1.0 0.0e+00 0.0e+00 0.0e+00 2 5 0 0 0 2 5 0 0 0 1582 0 0 0.00e+00 0 0.00e+00 0 VecMAXPY 20658 1.0 1.6184e+02 1.0 2.87e+11 1.0 0.0e+00 0.0e+00 0.0e+00 9 21 0 0 0 9 21 0 0 0 1771 0 0 0.00e+00 0 0.00e+00 0 VecPointwiseMult 165532 1.0 6.8385e+01 1.0 2.59e+10 1.0 0.0e+00 0.0e+00 0.0e+00 4 2 0 0 0 4 2 0 0 0 379 0 0 0.00e+00 0 0.00e+00 0 VecLoad 1 1.0 8.6461e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSetRandom 4 1.0 2.3053e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecNormalize 10378 1.0 8.0652e+00 1.0 1.81e+10 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 2243 0 0 0.00e+00 0 0.00e+00 0 KSPSetUp 11 1.0 1.9126e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 1.7599e+03 1.0 1.40e+12 1.0 0.0e+00 0.0e+00 0.0e+00100100 0 0 0 100100 0 0 0 794 0 0 0.00e+00 0 0.00e+00 0 KSPGMRESOrthog 10040 1.0 1.7256e+02 1.0 3.61e+11 1.0 0.0e+00 0.0e+00 0.0e+00 10 26 0 0 0 10 26 0 0 0 2093 0 0 0.00e+00 0 0.00e+00 0 PCGAMGGraph_AGG 4 1.0 5.8413e-01 1.0 1.21e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 21 0 0 0.00e+00 0 0.00e+00 0 PCGAMGCoarse_AGG 4 1.0 1.4561e+00 1.0 1.12e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 77 0 0 0.00e+00 0 0.00e+00 0 PCGAMGProl_AGG 4 1.0 1.4452e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 PCGAMGPOpt_AGG 4 1.0 7.7469e-01 1.0 3.13e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 404 0 0 0.00e+00 0 0.00e+00 0 GAMG: createProl 4 1.0 2.9736e+00 1.0 4.37e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 147 0 0 0.00e+00 0 0.00e+00 0 Graph 8 1.0 5.8088e-01 1.0 1.21e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 21 0 0 0.00e+00 0 0.00e+00 0 MIS/Agg 4 1.0 6.8075e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SA: col data 4 1.0 1.6909e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SA: frmProl0 4 1.0 1.3425e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SA: smooth 4 1.0 3.3852e-01 1.0 1.88e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 56 0 0 0.00e+00 0 0.00e+00 0 GAMG: partLevel 4 1.0 8.3950e-01 1.0 6.84e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 81 0 0 0.00e+00 0 0.00e+00 0 PCSetUp 2 1.0 3.8928e+00 1.0 5.06e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 130 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 10343 1.0 7.0753e-03 1.0 1.06e+04 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1 0 0 0.00e+00 0 0.00e+00 0 PCApply 10343 1.0 1.2964e+03 1.0 7.03e+11 1.0 0.0e+00 0.0e+00 0.0e+00 74 50 0 0 0 74 50 0 0 0 542 0 0 0.00e+00 0 0.00e+00 0 DGMRESCompDefl 17 1.0 1.5087e+00 1.0 1.04e+09 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 688 0 0 0.00e+00 0 0.00e+00 0 DGMRESApplyDefl 10272 1.0 9.5906e+01 1.0 2.00e+11 1.0 0.0e+00 0.0e+00 0.0e+00 5 14 0 0 0 5 14 0 0 0 2086 0 0 0.00e+00 0 0.00e+00 0 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Viewer 4 3 2520 0. Matrix 24 24 270168752 0. Matrix Coarsen 4 4 2544 0. Vector 179 179 415890232 0. Krylov Solver 15 15 155968 0. Preconditioner 11 11 11136 0. PetscRandom 8 8 5168 0. Index Set 7 7 6620 0. ======================================================================================================================== Average time to get PetscTime(): 1.19209e-07 #PETSc Option Table entries: -dm_mat_type aijcusparse -dm_vec_type cuda -ksp_atol 1e-15 -ksp_initial_guess_nonzero yes -ksp_reuse_preconditioner yes -ksp_rtol 1e-7 -ksp_type dgmres -ksp_view_mat binary -ksp_view_rhs binary -log_view -mat mat_poisson_5765446_1_1 -mg_levels_ksp_type chebyshev -mg_levels_pc_type jacobi -pc_gamg_agg_nsmooths 1 -pc_gamg_type agg -pc_type gamg -vec vec_poisson_5765446_1_1 #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure options: --prefix=/scratch/snx3000/nvarini/petsc3.13.3-blalapack --with-cc=cc --with-fc=ftn --known-mpi-shared-libraries=1 --known-mpi-c-double-complex=1 --known-mpi-int64_t=1 --known-mpi-long-double=1 --with-batch=1 --known-64-bit-blas-indices=0 --LIBS=-lstdc++ --with-cxxlib-autodetect=0 --with-scalapack=1 --with-cxx=CC --with-debugging=0 --with-mumps-dir=/opt/cray/pe/tpsl/19.06.1/GNU/8.2/haswell/ --with-hypre-dir=/opt/cray/pe/tpsl/19.06.1/GNU/8.2/haswell/ --with-superlu-dir=/opt/cray/pe/tpsl/19.06.1/GNU/8.2/haswell/ --with-metis-dir=/opt/cray/pe/tpsl/19.06.1/GNU/8.2/haswell/ --with-cuda=1 --download-fblaslapack=1 --force --COPTFLAGS=-I/opt/cray/pe/mpt/7.7.10/gni/mpich-intel/16.0/include --with-cxx=CC --CXXOPTFLAGS=-I/opt/cray/pe/mpt/7.7.10/gni/mpich-intel/16.0/include ----------------------------------------- Libraries compiled on 2020-08-13 08:07:39 on daint107 Machine characteristics: Linux-4.12.14-150.35-default-x86_64-with-glibc2.3.4 Using PETSc directory: /scratch/snx3000/nvarini/petsc3.13.3-blalapack Using PETSc arch: ----------------------------------------- Using C compiler: cc -fPIC -I/opt/cray/pe/mpt/7.7.10/gni/mpich-intel/16.0/include Using Fortran compiler: ftn -fPIC -O ----------------------------------------- Using include paths: -I/scratch/snx3000/nvarini/petsc3.13.3-blalapack/include -I/opt/cray/pe/tpsl/19.06.1/GNU/8.2/haswell/include -I/opt/nvidia/cudatoolkit10/10.1.105_3.27-7.0.1.1_4.1__ga311ce7/include ----------------------------------------- Using C linker: cc Using Fortran linker: ftn Using libraries: -Wl,-rpath,/scratch/snx3000/nvarini/petsc3.13.3-blalapack/lib -L/scratch/snx3000/nvarini/petsc3.13.3-blalapack/lib -lpetsc -Wl,-rpath,/opt/cray/pe/tpsl/19.06.1/GNU/8.2/haswell/lib -L/opt/cray/pe/tpsl/19.06.1/GNU/8.2/haswell/lib -Wl,-rpath,/scratch/snx3000/nvarini/petsc3.13.3-blalapack/lib -L/scratch/snx3000/nvarini/petsc3.13.3-blalapack/lib -Wl,-rpath,/opt/nvidia/cudatoolkit10/10.1.105_3.27-7.0.1.1_4.1__ga311ce7/lib64 -L/opt/nvidia/cudatoolkit10/10.1.105_3.27-7.0.1.1_4.1__ga311ce7/lib64 -Wl,-rpath,/opt/cray/pe/libsci_acc/19.10.1/GNU/7.1/x86_64/lib -L/opt/cray/pe/libsci_acc/19.10.1/GNU/7.1/x86_64/lib -Wl,-rpath,/opt/cray/pe/libsci/19.06.1/GNU/8.1/x86_64/lib -L/opt/cray/pe/libsci/19.06.1/GNU/8.1/x86_64/lib -Wl,-rpath,/opt/cray/dmapp/default/lib64 -L/opt/cray/dmapp/default/lib64 -Wl,-rpath,/opt/cray/pe/mpt/7.7.10/gni/mpich-gnu/8.2/lib -L/opt/cray/pe/mpt/7.7.10/gni/mpich-gnu/8.2/lib -Wl,-rpath,/opt/nvidia/cudatoolkit10/10.1.105_3.27-7.0.1.1_4.1__ga311ce7/extras/CUPTI/lib64 -L/opt/nvidia/cudatoolkit10/10.1.105_3.27-7.0.1.1_4.1__ga311ce7/extras/CUPTI/lib64 -Wl,-rpath,/opt/nvidia/cudatoolkit10/10.1.105_3.27-7.0.1.1_4.1__ga311ce7/nvvm/lib64 -L/opt/nvidia/cudatoolkit10/10.1.105_3.27-7.0.1.1_4.1__ga311ce7/nvvm/lib64 -Wl,-rpath,/opt/cray/nvidia/default/lib64 -L/opt/cray/nvidia/default/lib64 -Wl,-rpath,/opt/cray/rca/2.2.20-7.0.1.1_4.9__g8e3fb5b.ari/lib64 -L/opt/cray/rca/2.2.20-7.0.1.1_4.9__g8e3fb5b.ari/lib64 -Wl,-rpath,/opt/cray/pe/atp/2.1.3/libApp -L/opt/cray/pe/atp/2.1.3/libApp -Wl,-rpath,/apps/daint/UES/xalt/xalt2/software/xalt/2.7.24/lib64 -L/apps/daint/UES/xalt/xalt2/software/xalt/2.7.24/lib64 -Wl,-rpath,/opt/gcc/8.3.0/snos/lib/gcc/x86_64-suse-linux/8.3.0 -L/opt/gcc/8.3.0/snos/lib/gcc/x86_64-suse-linux/8.3.0 -Wl,-rpath,/opt/gcc/8.3.0/snos/lib64 -L/opt/gcc/8.3.0/snos/lib64 -Wl,-rpath,/apps/daint/UES/xalt/xalt2/software/xalt/2.7.24/lib -L/apps/daint/UES/xalt/xalt2/software/xalt/2.7.24/lib -Wl,-rpath,/opt/gcc/8.3.0/snos/lib -L/opt/gcc/8.3.0/snos/lib -lHYPRE -lcmumps -ldmumps -lsmumps -lzmumps -lmumps_common -lpord -lsuperlu -lflapack -lfblas -lX11 -lmetis -lcufft -lcublas -lcudart -lcusparse -lcusolver -lcuda -ldl -lstdc++ -lcuda -lrca -lsci_acc_gnu_71_nv60 -lcudart -lgfortran -lm -lcupti -lAtpSigHandler -lAtpSigHCommData -lHYPRE_gnu -lcmumps_gnu -ldmumps_gnu -lesmumps_gnu -lmatio_gnu -lptscotchparmetis_gnu -lscotchmetis_gnu -lsmumps_gnu -lsundials_arkode_gnu -lsundials_cvode_gnu -lsundials_cvodes_gnu -lsundials_fnvecopenmp_gnu -lsundials_fnvecparallel_gnu -lsundials_fnvecserial_gnu -lsundials_ida_gnu -lsundials_idas_gnu -lsundials_kinsol_gnu -lsuperlu_dist_gnu -lsuperlu_gnu -lzmumps_gnu -lsundials_nvecopenmp_gnu -lsundials_nvecparallel_gnu -lsundials_nvecserial_gnu -lmumps_common_gnu -lptscotch_gnu -lparmetis_gnu -lptesmumps_gnu -lpord_gnu -lptscotcherrexit_gnu -lptscotcherr_gnu -lmetis_gnu -lscotch_gnu -lscotcherrexit_gnu -lscotcherr_gnu -lsci_gnu_82_mpi -lsci_gnu_82 -lmpich_gnu_82 -lmpichf90_gnu_82 -lgfortran -lquadmath -lpthread -lm -lgcc_s -lquadmath -ldl -lstdc++ -----------------------------------------