0 KSP Residual norm 2.573279137278e+00 1 KSP Residual norm 2.551849009288e+00 2 KSP Residual norm 2.534147139587e+00 3 KSP Residual norm 2.518884304386e+00 4 KSP Residual norm 2.505290534550e+00 5 KSP Residual norm 2.492887847785e+00 6 KSP Residual norm 2.481369161317e+00 7 KSP Residual norm 2.470530978055e+00 8 KSP Residual norm 2.460234459897e+00 9 KSP Residual norm 2.450382129933e+00 10 KSP Residual norm 2.440903529393e+00 KSP Object: 1 MPI process type: richardson damping factor=1. maximum iterations=10, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using PRECONDITIONED norm type for convergence test PC Object: 1 MPI process type: mg type is MULTIPLICATIVE, levels=3 cycles=v Cycles per PCApply=1 Not using Galerkin computed coarse grid matrices Coarse grid solver -- level 0 ------------------------------- KSP Object: (mg_coarse_) 1 MPI process type: richardson damping factor=1. maximum iterations=2, initial guess is zero tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using PRECONDITIONED norm type for convergence test PC Object: (mg_coarse_) 1 MPI process type: none linear system matrix = precond matrix: Mat Object: 1 MPI process type: seqaijhipsparse rows=110592, cols=110592 total: nonzeros=760320, allocated nonzeros=760320 total number of mallocs used during MatSetValues calls=0 has attached null space not using I-node routines Down solver (pre-smoother) on level 1 ------------------------------- KSP Object: (mg_levels_1_) 1 MPI process type: richardson damping factor=1. maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_1_) 1 MPI process type: none linear system matrix = precond matrix: Mat Object: 1 MPI process type: seqaijhipsparse rows=884736, cols=884736 total: nonzeros=6137856, allocated nonzeros=6137856 total number of mallocs used during MatSetValues calls=0 has attached null space not using I-node routines Up solver (post-smoother) same as down solver (pre-smoother) Down solver (pre-smoother) on level 2 ------------------------------- KSP Object: (mg_levels_2_) 1 MPI process type: richardson damping factor=1. maximum iterations=2, nonzero initial guess tolerances: relative=1e-05, absolute=1e-50, divergence=10000. left preconditioning using NONE norm type for convergence test PC Object: (mg_levels_2_) 1 MPI process type: none linear system matrix = precond matrix: Mat Object: 1 MPI process type: seqaijhipsparse rows=7077888, cols=7077888 total: nonzeros=49324032, allocated nonzeros=49324032 total number of mallocs used during MatSetValues calls=0 has attached null space not using I-node routines Up solver (post-smoother) same as down solver (pre-smoother) linear system matrix = precond matrix: Mat Object: 1 MPI process type: seqaijhipsparse rows=7077888, cols=7077888 total: nonzeros=49324032, allocated nonzeros=49324032 total number of mallocs used during MatSetValues calls=0 has attached null space not using I-node routines Residual norm 0.0183758 Error norm 0.973034 Error norm 0.251172 Error norm 0.000129357 **************************************************************************************************************************************************************** *** WIDEN YOUR WINDOW TO 160 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** **************************************************************************************************************************************************************** ------------------------------------------------------------------ PETSc Performance Summary: ------------------------------------------------------------------ ########################################################## # # # WARNING!!! # # # # This code was run with -log_view_gpu_time # # This provides accurate timing within the GPU kernels # # but can slow down the entire computation by a # # measurable amount. For fastest runs we recommend # # not using this option. # # # ########################################################## /pfs/lustrep1/projappl/project_465000824/petsc/src/ksp/ksp/tutorials/ex34 on a arch-cray-c-opt-rocm-hip named nid007958 with 1 processor, by jourdona Mon Jan 22 13:36:32 2024 Using Petsc Release Version 3.20.3, unknown Max Max/Min Avg Total Time (sec): 5.114e+00 1.000 5.114e+00 Objects: 0.000e+00 0.000 0.000e+00 Flops: 8.728e+09 1.000 8.728e+09 8.728e+09 Flops/sec: 1.707e+09 1.000 1.707e+09 1.707e+09 MPI Msg Count: 0.000e+00 0.000 0.000e+00 0.000e+00 MPI Msg Len (bytes): 0.000e+00 0.000 0.000e+00 0.000e+00 MPI Reductions: 0.000e+00 0.000 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flops and VecAXPY() for complex vectors of length N --> 8N flops Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 4.9270e+00 96.3% 1.7780e+09 20.4% 0.000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% 2: MG Apply: 1.8634e-01 3.6% 6.9504e+09 79.6% 0.000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage BuildTwoSided 3 1.0 1.3569e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 11 1.0 1.1558e-02 1.0 1.01e+09 1.0 0.0e+00 0.0e+00 0.0e+00 0 12 0 0 0 0 57 0 0 0 87153 89068 0 0.00e+00 0 0.00e+00 100 MatMultTranspose 2 1.0 5.6311e-02 1.0 7.96e+06 1.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 141 226 2 1.27e+02 0 0.00e+00 100 MatAssemblyBegin 8 1.0 4.7690e-06 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 8 1.0 6.3132e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatView 4 1.0 5.9642e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatHIPSPARSCopyTo 2 1.0 2.0957e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 1.27e+02 0 0.00e+00 0 KSPSetUp 4 1.0 1.2492e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 2.0548e-01 1.0 8.46e+09 1.0 0.0e+00 0.0e+00 0.0e+00 4 97 0 0 0 Multiple stages 41176 56080 3 7.07e+02 0 0.00e+00 95 DMCoarsen 2 1.0 5.1348e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMCreateInterp 2 1.0 4.2463e-01 1.0 1.12e+08 1.0 0.0e+00 0.0e+00 0.0e+00 8 1 0 0 0 9 6 0 0 0 265 225 2 1.27e+02 0 0.00e+00 7 DMCreateMat 3 1.0 1.7010e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 33 0 0 0 0 35 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetGraph 3 1.0 1.1119e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 2 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 3 1.0 1.1817e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 2 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecNorm 15 1.0 1.1429e-02 1.0 1.91e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 2 0 0 0 0 11 0 0 0 16721 21367 1 5.66e+01 1 8.00e-06 100 VecCopy 1 1.0 2.1368e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSet 3 1.0 7.7056e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 11 1.0 1.7957e-03 1.0 1.56e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 2 0 0 0 0 9 0 0 0 86717 100217 0 0.00e+00 0 0.00e+00 100 VecAYPX 10 1.0 2.5935e-03 1.0 1.42e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 2 0 0 0 0 8 0 0 0 54582 62419 0 0.00e+00 0 0.00e+00 100 VecAssemblyBegin 2 1.0 9.9200e-07 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 2 1.0 3.0100e-07 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecHIPCopyTo 2 1.0 4.1940e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 1.13e+02 0 0.00e+00 0 VecHIPCopyFrom 1 1.0 2.6480e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 5.66e+01 0 PCSetUp 1 1.0 7.8109e-01 1.0 1.12e+08 1.0 0.0e+00 0.0e+00 0.0e+00 15 1 0 0 0 16 6 0 0 0 144 225 2 1.27e+02 0 0.00e+00 7 PCApply 11 1.0 1.8636e-01 1.0 6.95e+09 1.0 0.0e+00 0.0e+00 0.0e+00 4 80 0 0 0 Multiple stages 37296 52407 3 7.07e+02 0 0.00e+00 95 MGSetup Level 0 1 1.0 3.1610e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MGSetup Level 1 1 1.0 2.5463e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 5 0 0 0 0 5 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MGSetup Level 2 1 1.0 1.3987e-05 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 hipBLAS Init 1 1.0 1.2018e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DCtxCreate 2 1.0 1.8295e-05 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DCtxDestroy 2 1.0 1.4228e-05 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DCtxSetUp 2 1.0 1.6372e-05 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DCtxSetDevice 2 1.0 2.3696e-05 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DCtxSync 40 1.0 1.3030e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 2: MG Apply MatMult 110 1.0 9.8034e-02 1.0 4.56e+09 1.0 0.0e+00 0.0e+00 0.0e+00 2 52 0 0 0 53 66 0 0 0 46528 85425 3 7.07e+02 0 0.00e+00 100 MatMultAdd 22 1.0 4.3301e-03 1.0 1.75e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 2 0 0 0 2 3 0 0 0 40456 43047 0 0.00e+00 0 0.00e+00 100 MatMultTranspose 22 1.0 9.5183e-03 1.0 8.76e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 5 1 0 0 0 9202 9702 0 0.00e+00 0 0.00e+00 100 MatResidual 22 1.0 1.6639e-02 1.0 1.31e+09 1.0 0.0e+00 0.0e+00 0.0e+00 0 15 0 0 0 9 19 0 0 0 78597 82795 0 0.00e+00 0 0.00e+00 100 MatHIPSPARSCopyTo 3 1.0 4.2784e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 23 0 0 0 0 0 0 3 7.07e+02 0 0.00e+00 0 KSPSolve 55 1.0 1.5283e-01 1.0 5.38e+09 1.0 0.0e+00 0.0e+00 0.0e+00 3 62 0 0 0 82 77 0 0 0 35202 51826 3 7.07e+02 0 0.00e+00 93 VecNorm 33 1.0 5.7309e-03 1.0 7.30e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 1274 1409 0 0.00e+00 0 0.00e+00 100 VecCopy 154 1.0 1.0459e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 6 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSet 33 1.0 1.3872e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 110 1.0 1.7984e-02 1.0 7.06e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 8 0 0 0 10 10 0 0 0 39233 43965 0 0.00e+00 0 0.00e+00 100 VecAYPX 110 1.0 1.9972e-02 1.0 7.06e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 8 0 0 0 11 10 0 0 0 35329 39226 0 0.00e+00 0 0.00e+00 100 PCApply 121 1.0 8.1802e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 4 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MGSmooth Level 0 11 1.0 1.4368e-02 1.0 5.52e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 8 1 0 0 0 3845 5255 1 9.57e+00 0 0.00e+00 94 MGSmooth Level 1 22 1.0 2.1526e-02 1.0 5.90e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 7 0 0 0 12 8 0 0 0 27409 46315 1 7.72e+01 0 0.00e+00 93 MGResid Level 1 11 1.0 2.5387e-03 1.0 1.45e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 2 0 0 0 1 2 0 0 0 57023 66911 0 0.00e+00 0 0.00e+00 100 MGInterp Level 1 22 1.0 2.8130e-03 1.0 2.92e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 10379 12117 0 0.00e+00 0 0.00e+00 100 MGSmooth Level 2 22 1.0 1.1712e-01 1.0 4.73e+09 1.0 0.0e+00 0.0e+00 0.0e+00 2 54 0 0 0 63 68 0 0 0 40426 58787 1 6.20e+02 0 0.00e+00 93 MGResid Level 2 11 1.0 1.4886e-02 1.0 1.16e+09 1.0 0.0e+00 0.0e+00 0.0e+00 0 13 0 0 0 8 17 0 0 0 78127 85316 0 0.00e+00 0 0.00e+00 100 MGInterp Level 2 22 1.0 1.1119e-02 1.0 2.34e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 3 0 0 0 6 3 0 0 0 21007 21853 0 0.00e+00 0 0.00e+00 100 DCtxSync 527 1.0 3.5601e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Object Type Creations Destructions. Reports information only for process 0. --- Event Stage 0: Main Stage Container 4 4 Krylov Solver 4 4 DMKSP interface 3 3 Matrix 5 5 Matrix Null Space 4 4 Distributed Mesh 3 3 Index Set 6 6 IS L to G Mapping 3 3 Star Forest Graph 9 9 Discrete System 3 3 Weak Form 3 3 Vector 37 33 Preconditioner 4 4 Viewer 1 1 PetscDeviceContext 2 0 Viewer 1 0 --- Event Stage 1: PCMPI --- Event Stage 2: MG Apply Vector 0 4 ======================================================================================================================== Average time to get PetscTime(): 3.21e-08 #PETSc Option Table entries: -da_grid_x 192 # (source: command line) -da_grid_y 192 # (source: command line) -da_grid_z 192 # (source: command line) -dm_mat_type seqaijhipsparse # (source: command line) -dm_vec_type seqhip # (source: command line) -ksp_max_it 10 # (source: command line) -ksp_monitor # (source: command line) -ksp_type richardson # (source: command line) -ksp_view # (source: command line) -log_view # (source: command line) -log_view_gpu_time # (source: command line) -mg_coarse_ksp_max_it 2 # (source: command line) -mg_coarse_ksp_type richardson # (source: command line) -mg_coarse_pc_type none # (source: command line) -mg_levels_ksp_type richardson # (source: command line) -mg_levels_pc_type none # (source: command line) -options_left # (source: command line) -pc_mg_levels 3 # (source: command line) -pc_mg_log # (source: command line) -pc_type mg # (source: command line) #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 4 Configure options: --with-debugging=0 --with-64-bit-indices=0 --with-mpi-dir=/opt/cray/pe/mpich/8.1.27/ofi/cray/14.0 --with-blaslapack-lib="/opt/cray/pe/libsci/23.09.1.1/CRAY/12.0/x86_64/lib/libsci_cray.a /opt/cray/pe/libsci/23.09.1.1/CRAY/12.0/x86_64/lib/libsci_cray.so /opt/cray/pe/libsci/23.09.1.1/CRAY/12.0/x86_64/lib/libsci_cray_mpi.a /opt/cray/pe/libsci/23.09.1.1/CRAY/12.0/x86_64/lib/libsci_cray_mpi.so " --with-clanguage=C --with-cxx-dialect=C++11 --with-fc=0 --with-hip=1 --with-hip-dir=/opt/rocm-5.2.3 --with-hipc=/opt/rocm-5.2.3/bin/hipcc --with-hip-arch=gfx90a --with-make-exec=make --with-scalar-type=real --with-shared-libraries=1 PETSC_ARCH=arch-cray-c-opt-rocm-hip ----------------------------------------- Libraries compiled on 2024-01-17 05:49:23 on uan01 Machine characteristics: Linux-5.14.21-150400.24.81_12.0.75-cray_shasta_c-x86_64-with-glibc2.2.5 Using PETSc directory: /pfs/lustrep1/projappl/project_465000824/petsc Using PETSc arch: arch-cray-c-opt-rocm-hip ----------------------------------------- Using C compiler: /opt/cray/pe/mpich/8.1.27/ofi/cray/14.0/bin/mpicc -fPIC -Wall -Wwrite-strings -Wno-unknown-pragmas -fstack-protector -Qunused-arguments -fvisibility=hidden -g -O3 ----------------------------------------- Using include paths: -I/pfs/lustrep1/projappl/project_465000824/petsc/include -I/pfs/lustrep1/projappl/project_465000824/petsc/arch-cray-c-opt-rocm-hip/include -I/opt/cray/pe/mpich/8.1.27/ofi/cray/14.0/include -I/opt/rocm-5.2.3/include ----------------------------------------- Using C linker: /opt/cray/pe/mpich/8.1.27/ofi/cray/14.0/bin/mpicc Using libraries: -Wl,-rpath,/pfs/lustrep1/projappl/project_465000824/petsc/arch-cray-c-opt-rocm-hip/lib -L/pfs/lustrep1/projappl/project_465000824/petsc/arch-cray-c-opt-rocm-hip/lib -lpetsc -Wl,-rpath,/opt/cray/pe/libsci/23.09.1.1/CRAY/12.0/x86_64/lib -L/opt/cray/pe/libsci/23.09.1.1/CRAY/12.0/x86_64/lib -Wl,-rpath,/opt/rocm-5.2.3/lib -L/opt/rocm-5.2.3/lib -lsci_cray -lsci_cray_mpi -lhipsparse -lhipblas -lhipsolver -lrocsparse -lrocsolver -lrocblas -lrocrand -lamdhip64 -lstdc++ -lquadmath -ldl ----------------------------------------- #PETSc Option Table entries: -da_grid_x 192 # (source: command line) -da_grid_y 192 # (source: command line) -da_grid_z 192 # (source: command line) -dm_mat_type seqaijhipsparse # (source: command line) -dm_vec_type seqhip # (source: command line) -ksp_max_it 10 # (source: command line) -ksp_monitor # (source: command line) -ksp_type richardson # (source: command line) -ksp_view # (source: command line) -log_view # (source: command line) -log_view_gpu_time # (source: command line) -mg_coarse_ksp_max_it 2 # (source: command line) -mg_coarse_ksp_type richardson # (source: command line) -mg_coarse_pc_type none # (source: command line) -mg_levels_ksp_type richardson # (source: command line) -mg_levels_pc_type none # (source: command line) -options_left # (source: command line) -pc_mg_levels 3 # (source: command line) -pc_mg_log # (source: command line) -pc_type mg # (source: command line) #End of PETSc Option Table entries There are no unused options.