[0] 32085 global equations, 10695 vertices [0] 32085 equations in vector, 10695 vertices 0 SNES Function norm 7.375868178352e+00 0 KSP Residual norm 2.028094973649e+03 1 KSP Residual norm 2.008112847064e+02 2 KSP Residual norm 4.895453799965e+01 3 KSP Residual norm 1.274102369644e+01 4 KSP Residual norm 3.715796071494e+00 5 KSP Residual norm 9.971164199296e-01 6 KSP Residual norm 2.824172301382e-01 7 KSP Residual norm 7.819125524446e-02 8 KSP Residual norm 2.175372858574e-02 9 KSP Residual norm 6.417021543987e-03 10 KSP Residual norm 1.753238822711e-03 11 KSP Residual norm 4.264189945850e-04 12 KSP Residual norm 1.251144873333e-04 13 KSP Residual norm 3.633382944294e-05 14 KSP Residual norm 1.060665942146e-05 15 KSP Residual norm 2.770753661481e-06 16 KSP Residual norm 7.472207912941e-07 17 KSP Residual norm 2.029026234441e-07 18 KSP Residual norm 5.495797315166e-08 19 KSP Residual norm 1.490210289093e-08 Linear solve converged due to CONVERGED_RTOL iterations 19 1 SNES Function norm 1.280657442451e-09 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 275373 global equations, 91791 vertices [0] 275373 equations in vector, 91791 vertices 0 SNES Function norm 2.615842974236e+00 0 KSP Residual norm 4.735561022219e+03 1 KSP Residual norm 5.739873425191e+02 2 KSP Residual norm 2.009313657504e+02 3 KSP Residual norm 5.665293581154e+01 4 KSP Residual norm 2.077896251186e+01 5 KSP Residual norm 7.512208007719e+00 6 KSP Residual norm 2.445542793125e+00 7 KSP Residual norm 8.920785259888e-01 8 KSP Residual norm 3.764618008715e-01 9 KSP Residual norm 1.184593266880e-01 10 KSP Residual norm 4.177072787532e-02 11 KSP Residual norm 1.877925827368e-02 12 KSP Residual norm 5.801853037457e-03 13 KSP Residual norm 2.106865927050e-03 14 KSP Residual norm 7.745060424551e-04 15 KSP Residual norm 2.994628827195e-04 16 KSP Residual norm 1.070251973236e-04 17 KSP Residual norm 3.897005495593e-05 18 KSP Residual norm 1.444224478363e-05 19 KSP Residual norm 5.265631414901e-06 20 KSP Residual norm 1.822325416871e-06 21 KSP Residual norm 6.661025501823e-07 22 KSP Residual norm 2.409814198933e-07 23 KSP Residual norm 9.207061738242e-08 24 KSP Residual norm 3.409837819724e-08 Linear solve converged due to CONVERGED_RTOL iterations 24 1 SNES Function norm 1.072007649846e-09 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 2280285 global equations, 760095 vertices [0] 2280285 equations in vector, 760095 vertices 0 SNES Function norm 9.255869095573e-01 0 KSP Residual norm 1.127792314687e+04 1 KSP Residual norm 1.032332793391e+03 2 KSP Residual norm 6.390154503008e+02 3 KSP Residual norm 1.832950639271e+02 4 KSP Residual norm 6.003112613800e+01 5 KSP Residual norm 1.858969486655e+01 6 KSP Residual norm 7.387113171662e+00 7 KSP Residual norm 1.880029153465e+00 8 KSP Residual norm 7.197507646659e-01 9 KSP Residual norm 2.869118241851e-01 10 KSP Residual norm 9.467611116022e-02 11 KSP Residual norm 3.042400164490e-02 12 KSP Residual norm 1.243673049842e-02 13 KSP Residual norm 4.862731867408e-03 14 KSP Residual norm 1.665818642610e-03 15 KSP Residual norm 6.607441769775e-04 16 KSP Residual norm 2.515305394112e-04 17 KSP Residual norm 8.571180710813e-05 18 KSP Residual norm 3.188531283503e-05 19 KSP Residual norm 1.167994058260e-05 20 KSP Residual norm 4.530866822761e-06 21 KSP Residual norm 1.712842101067e-06 22 KSP Residual norm 6.108427138824e-07 23 KSP Residual norm 2.211191895205e-07 24 KSP Residual norm 8.070611988884e-08 Linear solve converged due to CONVERGED_RTOL iterations 24 1 SNES Function norm 8.362559681722e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 18556605 global equations, 6185535 vertices [0] 18556605 equations in vector, 6185535 vertices 0 SNES Function norm 3.273111572912e-01 0 KSP Residual norm 2.819817717390e+04 1 KSP Residual norm 2.881086698833e+03 2 KSP Residual norm 2.098708066413e+03 3 KSP Residual norm 7.383941677178e+02 4 KSP Residual norm 1.950344286336e+02 5 KSP Residual norm 8.313684677146e+01 6 KSP Residual norm 3.500455321011e+01 7 KSP Residual norm 1.020608722590e+01 8 KSP Residual norm 3.780117122540e+00 9 KSP Residual norm 1.603983135078e+00 10 KSP Residual norm 6.350579926503e-01 11 KSP Residual norm 2.000594305117e-01 12 KSP Residual norm 6.956184216539e-02 13 KSP Residual norm 2.736344460461e-02 14 KSP Residual norm 9.666509633419e-03 15 KSP Residual norm 3.411307052900e-03 16 KSP Residual norm 1.314216496024e-03 17 KSP Residual norm 5.115348312543e-04 18 KSP Residual norm 1.971081176299e-04 19 KSP Residual norm 7.367452001251e-05 20 KSP Residual norm 2.821528409684e-05 21 KSP Residual norm 9.983954181917e-06 22 KSP Residual norm 3.921900484538e-06 23 KSP Residual norm 1.552374977339e-06 24 KSP Residual norm 5.990007087448e-07 25 KSP Residual norm 2.261583996032e-07 Linear solve converged due to CONVERGED_RTOL iterations 25 1 SNES Function norm 8.682571705600e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 1) N= 275373, max displ=5.9965999e+01, disp diff= 2.20e-01, error=9.209e-03, rate=4.6 [0] 2) N= 2280285, max displ=5.9969946e+01, disp diff= 3.95e-03, error=5.262e-03, rate=0.81 [0] 3) N= 18556605, max displ=5.9974959e+01, disp diff= 5.01e-03, error=2.493e-04, rate=4.4 ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./ex56 on a arch-summit-opt64-pgi-cuda named e05n06 with 192 processors, by adams Mon Jul 29 12:59:35 2019 Using Petsc Development GIT revision: v3.11.3-1493-g3c7a471 GIT Date: 2019-07-27 19:32:11 -0400 Max Max/Min Avg Total Time (sec): 2.542e+02 1.000 2.542e+02 Objects: 7.194e+03 1.094 6.584e+03 Flop: 1.790e+10 1.355 1.623e+10 3.115e+12 Flop/sec: 7.043e+07 1.355 6.383e+07 1.226e+10 MPI Messages: 2.739e+04 6.125 1.376e+04 2.643e+06 MPI Message Lengths: 9.204e+08 2.760 5.377e+04 1.421e+11 MPI Reductions: 3.644e+03 1.007 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 3.7133e-01 0.1% 0.0000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% 6.000e+00 0.2% 1: Mesh Setup: 1.2116e+01 4.8% 2.2795e+10 0.7% 1.470e+05 5.6% 2.678e+05 27.7% 3.510e+02 9.6% 2: Setup: 5.9579e+01 23.4% 1.2968e+12 41.6% 1.149e+06 43.5% 6.850e+04 55.4% 2.497e+03 68.5% 3: Solve 1: 4.5032e-01 0.2% 2.0568e+09 0.1% 1.637e+05 6.2% 1.467e+03 0.2% 1.450e+02 4.0% 4: Solve 2: 2.7254e+00 1.1% 2.1855e+10 0.7% 2.320e+05 8.8% 4.619e+03 0.8% 1.940e+02 5.3% 5: Solve 3: 2.0188e+01 7.9% 1.8649e+11 6.0% 4.476e+05 16.9% 9.825e+03 3.1% 1.940e+02 5.3% 6: Solve 4: 1.5878e+02 62.5% 1.5853e+12 50.9% 5.034e+05 19.0% 3.637e+04 12.9% 2.310e+02 6.3% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage VecNorm 4 1.0 2.1965e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 1 0 0 0 67 0 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 1: Mesh Setup PetscBarrier 6 1.0 1.6405e-02 1.1 0.00e+00 0.0 1.7e+04 2.1e+01 2.4e+01 0 0 1 0 1 0 0 12 0 7 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSided 57 1.0 2.2858e-01 5.5 0.00e+00 0.0 1.5e+04 8.0e+00 0.0e+00 0 0 1 0 0 1 0 10 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 4 1.0 3.0056e-01160.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMCreateMat 4 1.0 6.3264e+00 1.0 0.00e+00 0.0 5.7e+04 6.8e+05 5.2e+01 2 0 2 28 1 51 0 39 99 15 0 0 8 2.49e+02 0 0.00e+00 0 Mesh Partition 1 1.0 1.0248e-01 7.0 0.00e+00 0.0 1.1e+03 1.2e+03 8.0e+00 0 0 0 0 0 1 0 1 0 2 0 0 0 0.00e+00 0 0.00e+00 0 Mesh Migration 1 1.0 1.1853e-02 1.0 0.00e+00 0.0 6.2e+03 8.7e+02 2.4e+01 0 0 0 0 1 0 0 4 0 7 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartSelf 1 1.0 6.5987e-031326.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblInv 1 1.0 8.0619e-03 5.4 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblSF 1 1.0 2.0588e-03 2.0 0.00e+00 0.0 4.8e+02 9.8e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartStrtSF 1 1.0 1.0180e-03 6.2 0.00e+00 0.0 1.9e+02 1.2e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPointSF 1 1.0 6.7902e-04 1.2 0.00e+00 0.0 3.8e+02 2.4e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 32 1.0 3.0466e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 1 0 0 0 0 11 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistribute 1 1.0 1.1510e-01 4.3 0.00e+00 0.0 7.7e+03 1.0e+03 3.2e+01 0 0 0 0 1 1 0 5 0 9 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistCones 1 1.0 2.2343e-03 1.1 0.00e+00 0.0 1.2e+03 2.1e+03 1.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistLabels 1 1.0 5.2724e-03 1.0 0.00e+00 0.0 3.2e+03 4.9e+02 2.1e+01 0 0 0 0 1 0 0 2 0 6 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistField 1 1.0 3.5230e-03 1.1 0.00e+00 0.0 1.4e+03 6.2e+02 1.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 58 1.0 6.3114e-0118.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.8e+01 0 0 0 0 2 3 0 0 0 17 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 58 1.0 8.8623e-0411.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPrealloc 4 1.0 4.6445e+00 1.0 0.00e+00 0.0 5.7e+04 6.8e+05 4.4e+01 2 0 2 28 1 38 0 39 99 13 0 0 8 2.49e+02 0 0.00e+00 0 SFSetGraph 73 1.0 5.6213e-0322.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 57 1.0 3.1199e-01 1.5 0.00e+00 0.0 7.7e+04 2.6e+05 0.0e+00 0 0 3 14 0 2 0 52 50 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 95 1.0 6.9191e-03 5.9 0.00e+00 0.0 4.3e+04 7.9e+04 0.0e+00 0 0 2 2 0 0 0 29 9 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 95 1.0 6.8467e-02 4.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 37 1.0 1.9834e-0247.5 0.00e+00 0.0 1.9e+04 6.9e+05 0.0e+00 0 0 1 9 0 0 0 13 33 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 29 1.0 1.8736e-01 6.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpBegin 8 1.0 5.0164e-03254.4 0.00e+00 0.0 4.2e+03 7.8e+05 0.0e+00 0 0 0 2 0 0 0 3 8 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpEnd 8 1.0 5.8722e-02 3.0 0.00e+00 0.0 4.2e+03 7.8e+05 0.0e+00 0 0 0 2 0 0 0 3 8 0 0 0 0 0.00e+00 0 0.00e+00 0 SFDistSection 13 1.0 6.9680e-03 1.4 0.00e+00 0.0 1.6e+04 3.3e+03 1.3e+01 0 0 1 0 0 0 0 11 0 4 0 0 0 0.00e+00 0 0.00e+00 0 SFSectionSF 21 1.0 9.2831e-02 1.2 0.00e+00 0.0 2.3e+04 2.8e+05 0.0e+00 0 0 1 5 0 1 0 16 17 0 0 0 0 0.00e+00 0 0.00e+00 0 SFRemoteOff 8 1.0 5.0570e-0214.3 0.00e+00 0.0 8.3e+03 7.9e+03 0.0e+00 0 0 0 0 0 0 0 6 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyBegin 4 1.0 3.0069e-01155.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 4 1.0 6.8515e-01 1.0 0.00e+00 0.0 1.4e+04 1.1e+04 1.6e+01 0 0 1 0 0 6 0 9 0 5 0 0 8 2.49e+02 0 0.00e+00 0 MatCUSPARSCopyTo 8 1.0 5.4909e-01 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 4 0 0 0 0 0 0 8 2.49e+02 0 0.00e+00 0 VecMDot 12 1.0 1.0284e-03 1.0 2.67e+06 1.2 0.0e+00 0.0e+00 1.2e+01 0 0 0 0 0 0 2 0 0 3 493465 0 0 0.00e+00 0 0.00e+00 0 VecNorm 24 1.0 7.0802e-02 8.2 1.34e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 1 0 0 7 3584 0 0 0.00e+00 0 0.00e+00 0 VecScale 24 1.0 3.2260e-04 1.3 6.68e+05 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 393262 0 0 0.00e+00 0 0.00e+00 0 VecSet 72 1.0 7.0689e-04 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecMAXPY 12 1.0 9.9642e-04 1.3 2.67e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 2 0 0 0 509285 0 0 0.00e+00 0 0.00e+00 0 VecNormalize 24 1.0 7.1083e-02 7.9 2.00e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 2 0 0 7 5354 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 2: Setup BuildTwoSided 120 1.0 2.1559e-02 1.4 0.00e+00 0.0 6.0e+04 8.0e+00 0.0e+00 0 0 2 0 0 0 0 5 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 531 1.0 1.4196e+01 4.6 0.00e+00 0.0 3.8e+04 6.1e+05 0.0e+00 3 0 1 16 0 11 0 3 30 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetGraph 120 1.0 2.6513e-04 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 120 1.0 2.6042e-02 1.2 0.00e+00 0.0 3.0e+05 1.6e+03 0.0e+00 0 0 11 0 0 0 0 26 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 685 1.0 1.1554e-02 3.2 0.00e+00 0.0 5.3e+05 5.2e+03 0.0e+00 0 0 20 2 0 0 0 46 4 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 685 1.0 4.9954e-02 7.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 120 1.0 3.7402e-01 1.2 5.50e+08 1.3 8.7e+04 1.2e+04 0.0e+00 0 3 3 1 0 1 7 8 1 0 255642 1437384 105 5.04e+01 105 1.88e+01 18 MatConvert 105 1.0 1.4545e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 3.6e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatScale 36 1.0 2.4822e-02 1.5 1.78e+07 1.2 8.7e+03 3.5e+03 0.0e+00 0 0 0 0 0 0 0 1 0 0 130904 0 0 0.00e+00 12 1.56e-01 0 MatAssemblyBegin 372 1.0 1.4747e+01 2.8 0.00e+00 0.0 3.8e+04 6.1e+05 0.0e+00 3 0 1 16 0 14 0 3 30 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 372 1.0 4.2389e+00 1.2 5.21e+06 2.9 2.7e+05 1.3e+03 4.0e+02 2 0 10 0 11 7 0 24 0 16 188 0 312 6.03e+02 0 0.00e+00 0 MatCreateSubMat 18 1.0 2.0415e+00 1.0 0.00e+00 0.0 3.8e+04 1.1e+05 2.2e+02 1 0 1 3 6 3 0 3 5 9 0 0 54 4.38e+01 0 0.00e+00 0 MatPartitioning 9 1.0 2.9335e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatCoarsen 12 1.0 1.5826e-02 1.0 0.00e+00 0.0 1.8e+05 2.8e+03 8.8e+01 0 0 7 0 2 0 0 16 1 4 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 24 1.0 1.4961e-02 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAXPY 12 1.0 4.7125e-01 1.7 7.06e+05 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 281 0 24 7.48e+01 0 0.00e+00 0 MatTranspose 24 1.0 6.9084e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMatMult 12 1.0 2.2136e+00 1.1 3.31e+08 1.3 9.8e+04 4.0e+04 9.7e+01 1 2 4 3 3 4 4 9 5 4 25977 0 48 1.50e+02 0 0.00e+00 0 MatMatMultSym 12 1.0 1.3681e+00 1.0 0.00e+00 0.0 8.0e+04 3.4e+04 9.6e+01 1 0 3 2 3 2 0 7 3 4 0 0 24 7.48e+01 0 0.00e+00 0 MatMatMultNum 12 1.0 8.3262e-01 1.2 3.31e+08 1.3 1.7e+04 7.1e+04 0.0e+00 0 2 1 1 0 1 4 2 2 0 69062 0 24 7.48e+01 0 0.00e+00 0 MatPtAP 12 1.0 4.7129e+01 1.0 6.80e+09 1.6 2.1e+05 2.8e+05 1.3e+02 19 36 8 42 4 79 87 19 77 5 23853 0 48 1.47e+02 0 0.00e+00 0 MatPtAPSymbolic 12 1.0 2.1406e+01 1.0 0.00e+00 0.0 1.2e+05 3.4e+05 8.4e+01 8 0 5 29 2 36 0 10 52 3 0 0 0 0.00e+00 0 0.00e+00 0 MatPtAPNumeric 12 1.0 2.5780e+01 1.0 6.80e+09 1.6 9.3e+04 2.0e+05 4.8e+01 10 36 4 13 1 43 87 8 24 2 43607 0 48 1.47e+02 0 0.00e+00 0 MatTrnMatMult 12 1.0 1.6500e+00 1.0 4.96e+07 1.3 8.5e+04 8.1e+04 1.4e+02 1 0 3 5 4 3 1 7 9 5 5603 0 48 1.37e+02 0 0.00e+00 0 MatTrnMatMultSym 12 1.0 6.2749e-01 1.0 0.00e+00 0.0 4.9e+04 5.6e+04 8.7e+01 0 0 2 2 2 1 0 4 3 3 0 0 0 0.00e+00 0 0.00e+00 0 MatTrnMatMultNum 12 1.0 1.0226e+00 1.0 4.96e+07 1.3 3.6e+04 1.1e+05 4.8e+01 0 0 1 3 1 2 1 3 5 2 9040 0 48 1.37e+02 0 0.00e+00 0 MatGetLocalMat 48 1.0 5.4917e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetBrAoCol 36 1.0 2.5686e-01 3.4 0.00e+00 0.0 1.2e+05 2.7e+05 0.0e+00 0 0 5 23 0 0 0 11 41 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 317 1.0 2.4539e+00 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 4 0 0 0 0 0 0 317 6.39e+02 0 0.00e+00 0 VecTDot 252 1.0 1.1737e-01 2.3 4.94e+06 1.1 0.0e+00 0.0e+00 2.5e+02 0 0 0 0 7 0 0 0 0 10 7896 115197 0 0.00e+00 0 0.00e+00 99 VecCopy 24 1.0 6.1569e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 5 9.13e-01 0 VecSet 780 1.0 1.8640e-02 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 240 1.0 3.4793e-03 1.2 4.70e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 253684 386729 0 0.00e+00 0 0.00e+00 99 VecAYPX 108 1.0 3.0429e-03 1.3 2.12e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 130532 157350 0 0.00e+00 0 0.00e+00 99 VecAssemblyBegin 429 1.0 3.9788e-02 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 429 1.0 9.8118e-04 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 244 0.00e+00 0 VecPointwiseMult 132 1.0 2.4145e-03 1.2 1.29e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 100529 124642 10 1.83e+00 0 0.00e+00 99 VecScatterBegin 573 1.0 1.1922e-02 2.6 0.00e+00 0.0 3.8e+05 6.4e+03 0.0e+00 0 0 14 2 0 0 0 33 3 0 0 0 0 0.00e+00 77 1.91e+00 0 VecScatterEnd 573 1.0 4.8021e-02 7.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSetRandom 12 1.0 5.7202e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 5 9.13e-01 0 VecCUDACopyTo 110 1.0 5.3783e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 110 1.61e+01 0 0.00e+00 0 VecCUDACopyFrom 605 1.0 1.7954e-02 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 605 2.85e+01 0 KSPSetUp 32 1.0 8.0193e-01 8.5 0.00e+00 0.0 0.0e+00 0.0e+00 3.2e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 PCGAMGGraph_AGG 12 1.0 4.2205e+00 1.0 3.01e+07 1.3 5.1e+04 2.7e+03 1.9e+02 2 0 2 0 5 7 0 4 0 8 1245 0 48 4.06e+01 12 1.56e-01 0 PCGAMGCoarse_AGG 12 1.0 1.7257e+00 1.0 4.96e+07 1.3 3.1e+05 2.4e+04 2.7e+02 1 0 12 5 7 3 1 27 10 11 5357 0 48 1.37e+02 84 1.85e+00 0 PCGAMGProl_AGG 12 1.0 2.9607e-01 1.1 0.00e+00 0.0 2.6e+05 5.8e+03 8.4e+02 0 0 10 1 23 0 0 22 2 34 0 0 24 9.65e+00 372 5.82e+00 0 PCGAMGPOpt_AGG 12 1.0 3.3613e+00 1.1 9.07e+08 1.3 1.8e+05 2.7e+04 4.4e+02 1 5 7 3 12 5 12 16 6 18 47013 737154 187 2.77e+02 115 2.06e+01 13 GAMG: createProl 12 1.0 9.6516e+00 1.0 9.87e+08 1.3 8.0e+05 1.8e+04 1.7e+03 4 6 30 10 48 16 13 70 18 70 17875 618467 307 4.64e+02 583 2.84e+01 11 Graph 24 1.0 4.1838e+00 1.0 3.01e+07 1.3 5.1e+04 2.7e+03 1.9e+02 2 0 2 0 5 7 0 4 0 8 1256 0 48 4.06e+01 12 1.56e-01 0 MIS/Agg 12 1.0 1.5970e-02 1.0 0.00e+00 0.0 1.8e+05 2.8e+03 8.8e+01 0 0 7 0 2 0 0 16 1 4 0 0 0 0.00e+00 0 0.00e+00 0 SA: col data 12 1.0 1.0265e-01 1.0 0.00e+00 0.0 2.3e+05 4.7e+03 7.4e+02 0 0 9 1 20 0 0 20 1 30 0 0 0 0.00e+00 372 5.82e+00 0 SA: frmProl0 12 1.0 1.6814e-01 1.0 0.00e+00 0.0 2.4e+04 1.7e+04 4.8e+01 0 0 1 0 1 0 0 2 1 2 0 0 24 9.65e+00 0 0.00e+00 0 SA: smooth 12 1.0 2.7890e+00 1.1 3.44e+08 1.3 9.8e+04 4.0e+04 1.2e+02 1 2 4 3 3 5 5 9 5 5 21498 0 72 2.24e+02 0 0.00e+00 0 GAMG: partLevel 12 1.0 4.9774e+01 1.0 6.80e+09 1.6 3.5e+05 1.9e+05 6.7e+02 20 36 13 45 18 83 87 30 82 27 22588 0 120 1.91e+02 18 5.52e-02 0 repartition 9 1.0 4.4718e-01 1.1 8.07e+05 2.3 7.3e+04 7.5e+01 2.0e+02 0 0 3 0 5 1 0 6 0 8 284 0 18 2.30e-01 0 0.00e+00 0 Invert-Sort 9 1.0 5.4322e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 3.6e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 Move A 9 1.0 1.7121e+00 1.0 0.00e+00 0.0 2.8e+04 1.5e+05 1.2e+02 1 0 1 3 3 3 0 2 5 5 0 0 27 1.64e+01 0 0.00e+00 0 Move P 9 1.0 5.2223e-01 1.2 0.00e+00 0.0 9.6e+03 1.2e+03 1.2e+02 0 0 0 0 3 1 0 1 0 5 0 0 27 2.74e+01 0 0.00e+00 0 PCSetUp 4 1.0 5.9401e+01 1.0 7.79e+09 1.6 1.1e+06 6.8e+04 2.5e+03 23 42 43 55 68 100100100100100 21832 603520 427 6.55e+02 605 2.85e+01 2 --- Event Stage 3: Solve 1 BuildTwoSided 1 1.0 1.0896e-04 1.9 0.00e+00 0.0 2.6e+02 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 5.6241e-0327.1 0.00e+00 0.0 7.8e+02 1.2e+05 0.0e+00 0 0 0 0 0 0 0 0 39 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 3.1750e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.6844e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 5 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 9.0040e-06 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 5.0314e-0216.1 1.60e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 15 0 0 0 6123 0 0 0.00e+00 2 7.34e-03 0 DMPlexJacobianFE 1 1.0 3.0341e-01 1.0 1.63e+06 1.0 7.8e+02 1.2e+05 0.0e+00 0 0 0 0 0 67 15 0 39 0 1025 0 2 3.24e-01 0 0.00e+00 0 SFSetGraph 1 1.0 1.1020e-06 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.3954e-04 1.8 0.00e+00 0.0 1.3e+03 4.7e+02 0.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 242 1.0 3.0311e-03 6.9 0.00e+00 0.0 1.6e+05 9.0e+02 0.0e+00 0 0 6 0 0 0 0 95 58 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 242 1.0 4.5554e-0217.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 9 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 42 1.0 3.4883e-04 7.4 0.00e+00 0.0 5.7e+03 9.3e+02 0.0e+00 0 0 0 0 0 0 0 3 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 42 1.0 4.4841e-021827.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 199 1.0 5.0978e-02 4.0 8.19e+0763.7 1.5e+05 9.0e+02 0.0e+00 0 0 6 0 0 3 62 91 56 0 24916 156388 218 8.43e-01 179 2.39e-01 65 MatMultAdd 40 1.0 4.1972e-0210.3 1.92e+0635.0 4.6e+03 1.0e+03 0.0e+00 0 0 0 0 0 9 3 3 2 0 1457 0 0 0.00e+00 0 0.00e+00 0 MatMultTranspose 40 1.0 5.1096e-03 7.7 1.92e+0635.0 4.6e+03 1.0e+03 0.0e+00 0 0 0 0 0 0 3 3 2 0 11964 0 0 0.00e+00 20 2.67e-02 0 MatSolve 20 0.0 1.7953e-04 0.0 3.22e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1795 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 1.3968e-0412.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 2.5719e-04248.0 4.82e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1874 0 0 0.00e+00 0 0.00e+00 0 MatResidual 40 1.0 1.1458e-02 3.9 1.82e+0775.8 2.7e+04 9.0e+02 0.0e+00 0 0 1 0 0 1 12 17 10 0 20984 109414 40 1.55e-01 21 2.81e-02 63 MatAssemblyBegin 1 1.0 6.6699e-03 1.6 0.00e+00 0.0 7.8e+02 1.2e+05 0.0e+00 0 0 0 0 0 1 0 0 39 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 3.8204e-03 3.8 2.23e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 932 0 2 3.24e-01 0 0.00e+00 0 MatGetRowIJ 1 0.0 8.3850e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 6.1767e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.1745e-0520.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.2061e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 3.24e-01 0 0.00e+00 0 VecTDot 80 1.0 1.3218e-02 1.5 4.76e+04 4.5 0.0e+00 0.0e+00 8.0e+01 0 0 0 0 2 3 0 0 0 55 291 779 0 0.00e+00 0 0.00e+00 98 VecNorm 44 1.0 5.6165e-0210.0 2.53e+04 4.3 0.0e+00 0.0e+00 4.4e+01 0 0 0 0 1 10 0 0 0 30 38 726 0 0.00e+00 0 0.00e+00 98 VecCopy 126 1.0 1.5765e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.34e-03 0 VecSet 208 1.0 8.5944e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 81 1.0 2.1715e-03 1.3 4.63e+04 4.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1834 2595 2 2.67e-03 0 0.00e+00 98 VecAYPX 276 1.0 7.3037e-03 1.2 1.83e+05 6.9 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 1333 1725 20 2.67e-02 0 0.00e+00 97 VecAXPBYCZ 80 1.0 2.7958e-03 1.2 2.12e+05 5.9 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 1 0 0 0 4713 9329 0 0.00e+00 0 0.00e+00 97 VecPointwiseMult 182 1.0 3.1093e-03 1.2 8.85e+0410.8 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 989 969 3 4.01e-03 0 0.00e+00 95 VecScatterBegin 279 1.0 3.5061e-03 5.7 0.00e+00 0.0 1.6e+05 9.0e+02 0.0e+00 0 0 6 0 0 0 0 97 60 0 0 0 0 0.00e+00 0 0.00e+00 0 VecScatterEnd 279 1.0 4.5575e-02 7.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 9 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 243 1.0 5.6459e-03 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 243 8.76e-01 0 0.00e+00 0 VecCUDACopyFrom 209 1.0 5.0964e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 209 2.91e-01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 9.3650e-01 1.0 1.62e+0829.4 4.5e+05 2.2e+03 6.1e+02 0 0 17 1 17 208166277413420 3653 28500 324 2.87e+00 310 3.61e-01 27 SNESSetUp 1 1.0 1.0177e-04 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 5.4694e-02 7.4 1.67e+06 1.0 3.4e+03 5.4e+02 1.7e+01 0 0 0 0 0 4 15 2 1 12 5737 0 0 0.00e+00 8 2.00e-02 0 SNESJacobianEval 1 1.0 3.0444e-01 1.0 1.65e+06 1.0 1.3e+03 7.2e+04 0.0e+00 0 0 0 0 0 67 15 1 39 0 1031 0 2 3.24e-01 1 3.67e-03 0 KSPSetUp 3 1.0 2.4251e-04 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 9.1492e-02 1.0 8.63e+0757.8 1.6e+05 9.0e+02 1.3e+02 0 0 6 0 3 20 69 97 60 87 15618 38953 241 8.74e-01 200 2.67e-01 60 PCSetUp 1 1.0 4.8855e-04 8.3 4.82e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 987 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 20 1.0 5.0215e-04 6.9 4.82e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 960 0 0 0.00e+00 0 0.00e+00 0 PCApply 20 1.0 7.8494e-02 1.1 8.60e+0769.0 1.3e+05 9.1e+02 6.8e+01 0 0 5 0 2 17 60 81 50 47 15637 46999 203 7.27e-01 162 2.17e-01 57 --- Event Stage 4: Solve 2 BuildTwoSided 1 1.0 1.2854e-04 2.8 0.00e+00 0.0 2.6e+02 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 3.0253e-02130.6 0.00e+00 0.0 7.8e+02 5.4e+05 0.0e+00 0 0 0 0 0 0 0 0 40 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 3.1055e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.8776e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 9.6280e-06 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 2.2284e-02 1.0 1.28e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 11 0 0 0 110608 0 0 0.00e+00 2 3.96e-02 0 DMPlexJacobianFE 1 1.0 2.4510e+00 1.0 1.30e+07 1.0 7.8e+02 5.4e+05 0.0e+00 1 0 0 0 0 89 11 0 40 0 1020 0 2 3.06e+00 0 0.00e+00 0 SFSetGraph 1 1.0 4.4200e-06 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.8535e-04 1.7 0.00e+00 0.0 1.3e+03 1.8e+03 0.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 432 1.0 5.9920e-03 8.4 0.00e+00 0.0 2.1e+05 2.9e+03 0.0e+00 0 0 8 0 0 0 0 92 58 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 432 1.0 1.7051e-0118.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 6 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 77 1.0 3.9123e-04 3.8 0.00e+00 0.0 1.7e+04 1.3e+03 0.0e+00 0 0 1 0 0 0 0 7 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 77 1.0 1.4423e-02152.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 354 1.0 1.7052e-01 5.3 2.45e+08 6.8 1.9e+05 3.1e+03 0.0e+00 0 0 7 0 0 2 69 84 56 0 88272 837242 268 4.49e+00 244 2.51e+00 37 MatMultAdd 75 1.0 1.5955e-0122.7 7.84e+06 3.9 1.6e+04 1.2e+03 0.0e+00 0 0 1 0 0 5 3 7 2 0 4468 0 50 5.69e-04 0 0.00e+00 0 MatMultTranspose 75 1.0 2.2650e-02 6.4 7.84e+06 3.9 1.6e+04 1.2e+03 0.0e+00 0 0 1 0 0 0 3 7 2 0 31474 814 29 1.96e-03 75 2.87e-01 0 MatSolve 25 0.0 9.8587e-05 0.0 2.82e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 286 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.5040e-05 3.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 2.2903e-0538.2 8.94e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 390 0 0 0.00e+00 0 0.00e+00 0 MatResidual 75 1.0 3.8256e-02 6.0 5.40e+07 8.0 3.7e+04 3.1e+03 0.0e+00 0 0 1 0 0 0 13 16 11 0 76030 532437 50 8.37e-01 26 2.98e-01 36 MatAssemblyBegin 1 1.0 3.5655e-02 1.6 0.00e+00 0.0 7.8e+02 5.4e+05 0.0e+00 0 0 0 0 0 1 0 0 40 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 6.5467e-0244.7 9.96e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 260 0 2 3.06e+00 0 0.00e+00 0 MatGetRowIJ 1 0.0 4.0490e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 4.3087e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 3.3401e-04 8.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 4 1.0 5.5360e-0238.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 4 3.06e+00 0 0.00e+00 0 VecTDot 111 1.0 2.5208e-02 2.3 2.05e+05 1.3 0.0e+00 0.0e+00 1.1e+02 0 0 0 0 3 1 0 0 0 57 1530 7146 0 0.00e+00 0 0.00e+00 99 VecNorm 60 1.0 2.4634e-02 3.2 1.13e+05 1.3 0.0e+00 0.0e+00 6.0e+01 0 0 0 0 2 0 0 0 0 31 862 5991 0 0.00e+00 0 0.00e+00 99 VecCopy 233 1.0 1.9679e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.15e-02 0 VecSet 283 1.0 2.2823e-03 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 111 1.0 2.4636e-03 1.3 2.11e+05 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 16095 23185 2 2.29e-02 0 0.00e+00 99 VecAYPX 500 1.0 7.8343e-03 1.3 6.41e+05 1.6 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 13176 18050 25 2.87e-01 0 0.00e+00 97 VecAXPBYCZ 150 1.0 3.5700e-03 1.3 8.19e+05 1.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 39529 79778 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 333 1.0 3.5809e-03 1.2 2.64e+05 2.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 8962 9047 3 3.44e-02 0 0.00e+00 95 VecScatterBegin 504 1.0 7.5065e-03 6.5 0.00e+00 0.0 2.3e+05 2.8e+03 0.0e+00 0 0 9 0 0 0 0 98 60 0 0 0 0 0.00e+00 75 5.94e-04 0 VecScatterEnd 504 1.0 1.7035e-01 7.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 6 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 373 1.0 6.6426e-03 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 373 4.83e+00 0 0.00e+00 0 VecCUDACopyFrom 354 1.1 7.9299e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 354 2.96e+00 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 5.3393e+00 1.0 6.18e+08 6.5 4.2e+05 1.0e+04 8.0e+02 2 1 16 3 22 196166179397412 6803 190700 478 2.03e+01 498 3.40e+00 17 SNESSetUp 1 1.0 8.2784e-05 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 3.1088e-02 1.1 1.32e+07 1.0 3.4e+03 2.1e+03 1.7e+01 0 0 0 0 0 1 11 1 1 9 80066 0 0 0.00e+00 8 1.25e-01 0 SNESJacobianEval 1 1.0 2.4526e+00 1.0 1.32e+07 1.0 1.3e+03 3.3e+05 0.0e+00 1 0 0 0 0 89 11 1 40 0 1024 0 2 3.06e+00 1 1.98e-02 0 KSPSetUp 4 1.0 1.0867e-02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 2.6481e-01 1.0 2.63e+08 6.3 2.3e+05 2.8e+03 1.8e+02 0 1 9 0 5 10 77 98 60 90 63637 210225 375 4.81e+00 345 2.81e+00 35 PCSetUp 1 1.0 1.1637e-04 3.0 8.94e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 77 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 25 1.0 1.3161e-04 2.8 8.94e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 68 0 0 0.00e+00 0 0.00e+00 0 PCApply 25 1.0 2.4551e-01 1.1 2.55e+08 7.3 1.9e+05 2.8e+03 1.0e+02 0 0 7 0 3 9 66 84 50 53 58877 250899 327 4.01e+00 297 2.26e+00 33 --- Event Stage 5: Solve 3 BuildTwoSided 1 1.0 3.2680e-04 9.0 0.00e+00 0.0 2.6e+02 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 1.6932e-01674.6 0.00e+00 0.0 7.8e+02 2.3e+06 0.0e+00 0 0 0 1 0 0 0 0 41 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 3.4706e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.8557e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.0775e-05 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.7718e-01 1.0 1.03e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 1 11 0 0 0 111288 0 0 0.00e+00 2 2.53e-01 0 DMPlexJacobianFE 1 1.0 1.9267e+01 1.0 1.05e+08 1.0 7.8e+02 2.3e+06 0.0e+00 8 1 0 1 0 95 11 0 41 0 1041 0 2 2.64e+01 0 0.00e+00 0 SFSetGraph 1 1.0 4.4094e-05 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 6.1736e-04 1.5 0.00e+00 0.0 1.3e+03 6.9e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 432 1.0 1.3233e-02 6.3 0.00e+00 0.0 3.9e+05 6.4e+03 0.0e+00 0 0 15 2 0 0 0 88 57 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 432 1.0 3.5495e-01 4.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 77 1.0 1.0538e-03 3.4 0.00e+00 0.0 5.1e+04 1.7e+03 0.0e+00 0 0 2 0 0 0 0 11 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 77 1.0 2.9169e-02177.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 354 1.0 6.4959e-01 1.7 8.70e+08 2.0 3.4e+05 7.0e+03 0.0e+00 0 4 13 2 0 2 70 77 55 0 201822 2037853 268 2.32e+01 219 2.08e+01 19 MatMultAdd 75 1.0 2.9425e-0112.0 3.68e+07 1.6 5.0e+04 1.6e+03 0.0e+00 0 0 2 0 0 1 3 11 2 0 20999 0 0 0.00e+00 0 0.00e+00 0 MatMultTranspose 75 1.0 5.5667e-02 2.8 3.68e+07 1.6 5.0e+04 1.6e+03 0.0e+00 0 0 2 0 0 0 3 11 2 0 110998 0 0 0.00e+00 25 2.38e+00 0 MatSolve 25 0.0 4.8998e-04 0.0 7.91e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1614 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.5236e-0430.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 6.3781e-04949.1 1.33e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2079 0 0 0.00e+00 0 0.00e+00 0 MatResidual 75 1.0 1.3139e-01 1.8 1.79e+08 2.1 7.0e+04 6.6e+03 0.0e+00 0 1 3 0 0 0 14 16 11 0 192942 1555089 50 4.33e+00 26 2.47e+00 19 MatAssemblyBegin 1 1.0 1.7924e-01 1.7 0.00e+00 0.0 7.8e+02 2.3e+06 0.0e+00 0 0 0 1 0 1 0 0 41 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 2.3661e-0119.6 4.20e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 310 0 2 2.64e+01 0 0.00e+00 0 MatGetRowIJ 1 0.0 1.1765e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 5.6769e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.7553e-03 4.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.9572e-0117.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 2 2.64e+01 0 0.00e+00 0 VecTDot 111 1.0 3.9958e-02 2.7 1.71e+06 1.3 0.0e+00 0.0e+00 1.1e+02 0 0 0 0 3 0 0 0 0 57 7983 54721 0 0.00e+00 0 0.00e+00 99 VecNorm 60 1.0 2.3989e-02 2.2 9.43e+05 1.3 0.0e+00 0.0e+00 6.0e+01 0 0 0 0 2 0 0 0 0 31 7318 41550 0 0.00e+00 0 0.00e+00 99 VecCopy 233 1.0 2.5566e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 9.50e-02 0 VecSet 333 1.0 1.4361e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 111 1.0 2.4639e-03 1.3 1.76e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 133094 200393 2 1.90e-01 0 0.00e+00 99 VecAYPX 500 1.0 8.8967e-03 1.4 4.64e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 95823 139478 25 2.38e+00 0 0.00e+00 97 VecAXPBYCZ 150 1.0 3.5459e-03 1.1 6.32e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 328809 703419 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 333 1.0 4.1032e-03 1.2 1.46e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 64478 69867 3 2.85e-01 0 0.00e+00 96 VecScatterBegin 504 1.0 1.4559e-02 4.8 0.00e+00 0.0 4.4e+05 5.8e+03 0.0e+00 0 0 17 2 0 0 0 99 58 0 0 0 0 0.00e+00 0 0.00e+00 0 VecScatterEnd 504 1.0 3.5171e-01 3.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 298 1.0 1.3554e-02 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 298 2.61e+01 0 0.00e+00 0 VecCUDACopyFrom 254 1.0 1.2219e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 254 2.43e+01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.9177e+01 1.0 2.10e+09 1.9 7.8e+05 2.6e+04 8.5e+02 11 10 30 14 23 145172174464440 11013 733274 407 1.48e+02 402 2.75e+01 9 SNESSetUp 1 1.0 8.5851e-05 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 2.0427e-01 1.1 1.05e+08 1.0 3.4e+03 8.0e+03 1.7e+01 0 1 0 0 0 1 11 1 1 9 97024 0 0 0.00e+00 8 8.85e-01 0 SNESJacobianEval 1 1.0 1.9271e+01 1.0 1.05e+08 1.0 1.3e+03 1.4e+06 0.0e+00 8 1 0 1 0 95 11 0 41 0 1043 0 2 2.64e+01 1 1.26e-01 0 KSPSetUp 4 1.0 5.2309e-04 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 7.7854e-01 1.0 9.52e+08 1.9 4.4e+05 5.8e+03 1.8e+02 0 5 17 2 5 4 79 99 58 90 188230 780734 296 2.59e+01 245 2.33e+01 19 PCSetUp 1 1.0 9.7375e-0422.3 1.33e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1361 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 25 1.0 9.8855e-0416.7 1.33e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1341 0 0 0.00e+00 0 0.00e+00 0 PCApply 25 1.0 6.9447e-01 1.0 8.64e+08 2.0 4.1e+05 5.4e+03 1.0e+02 0 4 16 2 3 3 67 92 50 53 181167 934986 248 2.17e+01 197 1.87e+01 18 --- Event Stage 6: Solve 4 BuildTwoSided 1 1.0 1.7269e-0333.4 0.00e+00 0.0 2.6e+02 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 9.8845e-011767.3 0.00e+00 0.0 7.8e+02 9.4e+06 0.0e+00 0 0 0 5 0 0 0 0 40 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 3.8261e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 3.6647e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.0780e-05 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.4027e+00 1.0 8.22e+08 1.0 0.0e+00 0.0e+00 0.0e+00 1 5 0 0 0 1 10 0 0 0 112460 0 0 0.00e+00 2 1.79e+00 0 DMPlexJacobianFE 1 1.0 1.5255e+02 1.0 8.37e+08 1.0 7.8e+02 9.4e+06 0.0e+00 60 5 0 5 0 96 10 0 40 0 1053 0 2 2.20e+02 0 0.00e+00 0 SFSetGraph 1 1.0 1.7767e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 3.7512e-03 1.4 0.00e+00 0.0 1.3e+03 2.7e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 588 1.0 3.5960e-02 5.6 0.00e+00 0.0 4.4e+05 2.4e+04 0.0e+00 0 0 17 7 0 0 0 87 58 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 588 1.0 8.0404e-01 5.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 106 1.0 1.4068e-03 2.5 0.00e+00 0.0 6.1e+04 4.3e+03 0.0e+00 0 0 2 0 0 0 0 12 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 106 1.0 9.2135e-0239.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 481 1.0 4.0618e+00 1.1 6.38e+09 1.3 3.8e+05 2.7e+04 0.0e+00 2 36 14 7 0 2 72 75 57 0 279262 6000531 506 1.65e+02 455 2.20e+02 17 MatMultAdd 104 1.0 5.0401e-01 2.4 2.90e+08 1.2 6.0e+04 3.8e+03 0.0e+00 0 2 2 0 0 0 3 12 1 0 105455 3001728 104 2.11e+01 52 1.83e+00 19 MatMultTranspose 104 1.0 3.2296e-01 1.4 2.86e+08 1.2 6.0e+04 3.8e+03 0.0e+00 0 2 2 0 0 0 3 12 1 0 162315 32723711 34 9.93e+01 130 2.67e+00 92 MatSolve 26 0.0 1.0200e-04 0.0 4.60e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 451 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 3.1546e-05 4.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 2.7977e-0545.5 1.76e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 628 0 0 0.00e+00 0 0.00e+00 0 MatResidual 104 1.0 7.8230e-01 1.1 1.25e+09 1.3 7.8e+04 2.6e+04 0.0e+00 0 7 3 1 0 0 14 16 11 0 281277 5214123 104 3.15e+01 79 4.11e+01 18 MatAssemblyBegin 1 1.0 1.0878e+00 2.3 0.00e+00 0.0 7.8e+02 9.4e+06 0.0e+00 0 0 0 5 0 1 0 0 40 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 5.1566e-01 7.1 1.72e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 590 0 2 2.20e+02 0 0.00e+00 0 MatGetRowIJ 1 0.0 3.7500e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 4.5770e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.1444e-02 2.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 6 1.0 3.5583e-01 4.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 6 2.59e+02 0 0.00e+00 0 VecTDot 134 1.0 6.1140e-02 2.9 1.41e+07 1.1 0.0e+00 0.0e+00 1.3e+02 0 0 0 0 4 0 0 0 0 58 43650 278961 0 0.00e+00 0 0.00e+00 100 VecNorm 72 1.0 9.2675e-02 4.8 7.72e+06 1.1 0.0e+00 0.0e+00 7.2e+01 0 0 0 0 2 0 0 0 0 31 15809 266172 0 0.00e+00 0 0.00e+00 100 VecCopy 322 1.0 6.1354e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 28 1.65e+00 0 VecSet 324 1.0 3.2991e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 133 1.0 3.6928e-03 1.2 1.45e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 742374 1317120 2 1.55e+00 0 0.00e+00 100 VecAYPX 684 1.0 2.7076e-02 1.8 3.85e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 268765 669725 52 1.69e+00 0 0.00e+00 100 VecAXPBYCZ 208 1.0 9.6948e-03 1.5 5.32e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 1037754 3288156 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 460 1.0 1.1404e-02 1.4 1.18e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 195237 212952 32 3.26e+00 0 0.00e+00 100 VecScatterBegin 689 1.0 4.4842e-02 4.4 0.00e+00 0.0 5.0e+05 2.2e+04 0.0e+00 0 0 19 8 0 0 0 99 59 0 0 0 0 0.00e+00 156 2.82e+00 0 VecScatterEnd 689 1.0 8.3342e-01 7.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 722 1.0 5.1571e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 722 1.92e+02 0 0.00e+00 0 VecCUDACopyFrom 674 1.0 7.3932e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 674 2.33e+02 0 VecCopyFromSome 26 1.0 1.0913e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 26 9.86e-01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.0627e+02 1.0 1.55e+10 1.3 8.5e+05 9.1e+04 1.0e+03 81 88 32 54 27 130172168421432 13242 3401777 874 1.06e+03 912 2.58e+02 11 SNESSetUp 1 1.0 1.2551e-02300.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 1.5416e+00 1.1 8.30e+08 1.0 3.4e+03 3.2e+04 1.7e+01 1 5 0 0 0 1 10 1 1 7 102594 0 0 0.00e+00 8 6.67e+00 0 SNESJacobianEval 1 1.0 1.5256e+02 1.0 8.40e+08 1.0 1.3e+03 5.7e+06 0.0e+00 60 5 0 5 0 96 10 0 40 0 1054 0 2 2.20e+02 1 8.95e-01 0 KSPSetUp 5 1.0 1.8399e-02 3.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 4.7583e+00 1.0 7.09e+09 1.3 5.0e+05 2.2e+04 2.1e+02 2 41 19 8 6 3 80 99 59 92 266089 3716072 728 2.90e+02 691 2.26e+02 22 PCSetUp 1 1.0 1.3517e-04 3.4 1.76e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 130 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 26 1.0 1.6396e-04 2.9 1.76e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 107 0 0 0.00e+00 0 0.00e+00 0 PCApply 26 1.0 4.0929e+00 1.0 6.14e+09 1.3 4.6e+05 2.0e+04 1.4e+02 2 35 18 7 4 3 69 92 51 59 265499 4172483 678 2.63e+02 641 1.87e+02 23 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Object 0 680 446080 0. Container 0 56 34944 0. Distributed Mesh 0 114 578416 0. DM Label 0 48 33408 0. GraphPartitioner 0 36 26240 0. Index Set 0 192 2466760 0. IS L to G Mapping 0 7 522256 0. Section 0 204 159936 0. Star Forest Graph 0 190 184960 0. Discrete System 0 97 97808 0. Matrix 0 137 577384528 0. Matrix Null Space 0 4 2976 0. Vector 0 268 17637976 0. SNES 0 4 6128 0. DMSNES 0 4 2880 0. Krylov Solver 0 36 74752 0. DMKSP interface 0 4 2816 0. Preconditioner 0 24 28192 0. Linear Space 0 8 5952 0. Dual Space 0 32 26624 0. FE Space 0 8 6976 0. Vec Scatter 0 28 23968 0. Field over DM 0 4 3040 0. Viewer 1 1 896 0. --- Event Stage 1: Mesh Setup Object 704 212 139072 0. Container 60 32 19968 0. Distributed Mesh 208 146 740976 0. DM Label 98 66 45936 0. GraphPartitioner 64 44 32064 0. Index Set 1332 1234 1676632 0. IS L to G Mapping 5 1 101368 0. Section 416 292 228928 0. Star Forest Graph 471 377 364864 0. Discrete System 272 219 220752 0. Matrix 68 52 158080 0. Matrix Null Space 4 0 0 0. Vector 100 36 1183712 0. SNES 4 0 0 0. DMSNES 4 0 0 0. Krylov Solver 4 0 0 0. Preconditioner 4 0 0 0. Linear Space 8 4 2976 0. Dual Space 32 16 13312 0. FE Space 8 4 3488 0. Vec Scatter 4 0 0 0. Field over DM 4 4 3040 0. Viewer 1 0 0 0. --- Event Stage 2: Setup Index Set 313 291 3198288 0. IS L to G Mapping 12 9 116352 0. Star Forest Graph 120 96 98304 0. Matrix 507 390 282080064 0. Matrix Partitioning 9 9 6696 0. Matrix Coarsen 12 12 8208 0. Vector 877 761 13711144 0. Krylov Solver 44 12 23424 0. Preconditioner 32 12 10944 0. Vec Scatter 108 84 71904 0. PetscRandom 24 24 16656 0. --- Event Stage 3: Solve 1 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 56704 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 18 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 4: Solve 2 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 69840 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 5: Solve 3 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 122784 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 6: Solve 4 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 331360 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 26 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. ======================================================================================================================== Average time to get PetscTime(): 6.55e-08 Average time for MPI_Barrier(): 8.0736e-06 Average time for zero size MPI_Send(): 6.20706e-06 #PETSc Option Table entries: -bmat_view :bmcpu.m:ascii_matlab -cells 8,12,16 -check_pointer_intensity 0 -ex56_dm_mat_type aijcusparse -ex56_dm_refine 3 -ex56_dm_vec_type cuda -gamg_est_ksp_max_it 10 -gamg_est_ksp_type cg -ksp_atol 1.e-71 -ksp_converged_reason -ksp_max_it 100 -ksp_monitor -ksp_norm_type preconditioned -ksp_rtol 1.e-11 -ksp_type cg -log_view -lvec_view :lvcpu.m:ascii_matlab -mat_block_size 3 -matptap_via scalable -max_conv_its 4 -mg_levels_esteig_ksp_max_it 10 -mg_levels_esteig_ksp_type cg -mg_levels_ksp_chebyshev_esteig 0,0.05,0,1.05 -mg_levels_ksp_max_it 2 -mg_levels_ksp_type chebyshev -mg_levels_pc_type jacobi -pc_gamg_agg_nsmooths 1 -pc_gamg_coarse_eq_limit 150 -pc_gamg_process_eq_limit 1000 -pc_gamg_repartition true -pc_gamg_reuse_interpolation false -pc_gamg_square_graph 10 -pc_gamg_threshold 0.05 -pc_gamg_threshold_scale .5 -pc_gamg_type agg -pc_type gamg -petscpartitioner_type simple -petscspace_degree 2 -run_type 1 -snes_converged_reason -snes_max_it 2 -snes_monitor -snes_rtol 1.e-10 -snes_type ksponly -use_mat_nearnullspace true -xvec_view :xvcpu.m:ascii_matlab #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with 64 bit PetscInt Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 8 Configure options: --with-cc=mpicc --with-cxx=mpiCC --with-fc=mpif90 --COPTFLAGS="-g -fast" --CXXOPTFLAGS="-g -fast" --FOPTFLAGS="-g -fast" --with-ssl=0 --with-batch=0 --with-mpiexec="jsrun -g 1" --with-cuda=1 --with-cudac=nvcc CUDAFLAGS="-ccbin pgc++" --download-metis --download-viennacl --download-parmetis --download-fblaslapack --with-x=0 --with-64-bit-indices=1 --with-debugging=0 PETSC_ARCH=arch-summit-opt64-pgi-cuda ----------------------------------------- Libraries compiled on 2019-07-28 12:54:27 on login4 Machine characteristics: Linux-4.14.0-115.8.1.el7a.ppc64le-ppc64le-with-redhat-7.6-Maipo Using PETSc directory: /ccs/home/adams/petsc Using PETSc arch: arch-summit-opt64-pgi-cuda ----------------------------------------- Using C compiler: mpicc -g -fast Using Fortran compiler: mpif90 -g -fast ----------------------------------------- Using include paths: -I/ccs/home/adams/petsc/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/sw/summit/cuda/10.1.168/include ----------------------------------------- Using C linker: mpicc Using Fortran linker: mpif90 Using libraries: -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -lpetsc -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -Wl,-rpath,/sw/summit/cuda/10.1.168/lib64 -L/sw/summit/cuda/10.1.168/lib64 /autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib/pgi.ld -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -L/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -L/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -Wl,-rpath,/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -L/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -lflapack -lfblas -lparmetis -lmetis -lcufft -lcublas -lcudart -lcusparse -lstdc++ -ldl -lpthread -lmpiprofilesupport -lmpi_ibm_usempi -lmpi_ibm_mpifh -lmpi_ibm -lpgf90rtl -lpgf90 -lpgf90_rpm1 -lpgf902 -lpgftnrtl -latomic -lpgkomp -lomp -lomptarget -lpgmath -lpgc -lrt -lmass_simdp9 -lmassvp9 -lmassp9 -lm -lgcc_s -lstdc++ -ldl -----------------------------------------