[0] 3465 global equations, 1155 vertices [0] 3465 equations in vector, 1155 vertices 0 SNES Function norm 2.064480037728e+01 0 KSP Residual norm 8.941196885217e+02 1 KSP Residual norm 8.206245806520e+01 2 KSP Residual norm 2.038727661413e+01 3 KSP Residual norm 4.185028631309e+00 4 KSP Residual norm 7.734621159511e-01 5 KSP Residual norm 1.693402692538e-01 6 KSP Residual norm 3.484533686851e-02 7 KSP Residual norm 8.687128607431e-03 8 KSP Residual norm 1.970059355777e-03 9 KSP Residual norm 4.669382551499e-04 10 KSP Residual norm 1.007551899514e-04 11 KSP Residual norm 2.153303673232e-05 12 KSP Residual norm 4.572554697083e-06 13 KSP Residual norm 9.197170637274e-07 14 KSP Residual norm 1.885710605239e-07 15 KSP Residual norm 3.939375393705e-08 16 KSP Residual norm 8.812127473666e-09 Linear solve converged due to CONVERGED_RTOL iterations 16 1 SNES Function norm 1.850854778177e-09 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 32085 global equations, 10695 vertices [0] 32085 equations in vector, 10695 vertices 0 SNES Function norm 7.375868178352e+00 0 KSP Residual norm 2.041593004330e+03 1 KSP Residual norm 2.062884484861e+02 2 KSP Residual norm 6.301427866557e+01 3 KSP Residual norm 1.590305896577e+01 4 KSP Residual norm 5.536075841815e+00 5 KSP Residual norm 1.857411380276e+00 6 KSP Residual norm 5.419145509456e-01 7 KSP Residual norm 1.673994119192e-01 8 KSP Residual norm 5.139069356015e-02 9 KSP Residual norm 1.812000298095e-02 10 KSP Residual norm 6.005359915368e-03 11 KSP Residual norm 2.185967564026e-03 12 KSP Residual norm 6.614914273831e-04 13 KSP Residual norm 2.137395406884e-04 14 KSP Residual norm 7.300165742403e-05 15 KSP Residual norm 2.306985738519e-05 16 KSP Residual norm 7.423123182093e-06 17 KSP Residual norm 2.163766874656e-06 18 KSP Residual norm 6.805775246895e-07 19 KSP Residual norm 2.269456995289e-07 20 KSP Residual norm 6.906592399205e-08 21 KSP Residual norm 2.135977206594e-08 22 KSP Residual norm 6.579604294321e-09 Linear solve converged due to CONVERGED_RTOL iterations 22 1 SNES Function norm 5.280458090408e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 275373 global equations, 91791 vertices [0] 275373 equations in vector, 91791 vertices 0 SNES Function norm 2.615842974236e+00 0 KSP Residual norm 4.515016916299e+03 1 KSP Residual norm 5.691295535125e+02 2 KSP Residual norm 2.370461523407e+02 3 KSP Residual norm 7.446236196514e+01 4 KSP Residual norm 2.352218273324e+01 5 KSP Residual norm 8.026189935933e+00 6 KSP Residual norm 2.662397691460e+00 7 KSP Residual norm 8.030413034017e-01 8 KSP Residual norm 3.322976014573e-01 9 KSP Residual norm 1.133580489568e-01 10 KSP Residual norm 3.408547667986e-02 11 KSP Residual norm 1.286190716794e-02 12 KSP Residual norm 4.390700765626e-03 13 KSP Residual norm 1.458891612284e-03 14 KSP Residual norm 4.739130992460e-04 15 KSP Residual norm 1.663833061080e-04 16 KSP Residual norm 6.046999517287e-05 17 KSP Residual norm 2.094944867511e-05 18 KSP Residual norm 7.320922817218e-06 19 KSP Residual norm 2.552632581067e-06 20 KSP Residual norm 8.802993709472e-07 21 KSP Residual norm 3.257842525253e-07 22 KSP Residual norm 1.143608887736e-07 23 KSP Residual norm 4.009082227245e-08 Linear solve converged due to CONVERGED_RTOL iterations 23 1 SNES Function norm 1.234565672530e-09 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 2280285 global equations, 760095 vertices [0] 2280285 equations in vector, 760095 vertices 0 SNES Function norm 9.255869095573e-01 0 KSP Residual norm 1.113827510602e+04 1 KSP Residual norm 1.093972490326e+03 2 KSP Residual norm 6.713913188103e+02 3 KSP Residual norm 2.086825638626e+02 4 KSP Residual norm 5.860313585671e+01 5 KSP Residual norm 2.137157827920e+01 6 KSP Residual norm 8.793802158095e+00 7 KSP Residual norm 2.509845953583e+00 8 KSP Residual norm 8.644412944161e-01 9 KSP Residual norm 3.529520847828e-01 10 KSP Residual norm 1.427619136174e-01 11 KSP Residual norm 4.807282100798e-02 12 KSP Residual norm 1.629972417747e-02 13 KSP Residual norm 6.235602400568e-03 14 KSP Residual norm 2.259118915931e-03 15 KSP Residual norm 8.735451359611e-04 16 KSP Residual norm 3.163361480417e-04 17 KSP Residual norm 1.082744542732e-04 18 KSP Residual norm 4.030086456991e-05 19 KSP Residual norm 1.446784697978e-05 20 KSP Residual norm 5.458259394919e-06 21 KSP Residual norm 2.080136188946e-06 22 KSP Residual norm 8.018587402204e-07 23 KSP Residual norm 3.053276566226e-07 24 KSP Residual norm 1.162106242824e-07 25 KSP Residual norm 4.426342743177e-08 Linear solve converged due to CONVERGED_RTOL iterations 25 1 SNES Function norm 4.585966267613e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 1) N= 32085, max displ=5.9746061e+01, disp diff= 1.46e-01, error=2.291e-01, rate=0.71 [0] 2) N= 275373, max displ=5.9965999e+01, disp diff= 2.20e-01, error=9.209e-03, rate=4.6 [0] 3) N= 2280285, max displ=5.9969946e+01, disp diff= 3.95e-03, error=5.262e-03, rate=0.81 ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./ex56 on a arch-summit-opt64-pgi-cuda named e05n06 with 24 processors, by adams Mon Jul 29 12:55:09 2019 Using Petsc Development GIT revision: v3.11.3-1493-g3c7a471 GIT Date: 2019-07-27 19:32:11 -0400 Max Max/Min Avg Total Time (sec): 2.369e+02 1.000 2.369e+02 Objects: 6.309e+03 1.018 6.212e+03 Flop: 1.595e+10 1.176 1.498e+10 3.595e+11 Flop/sec: 6.733e+07 1.176 6.321e+07 1.517e+09 MPI Messages: 1.306e+04 3.221 8.391e+03 2.014e+05 MPI Message Lengths: 5.661e+08 2.260 5.095e+04 1.026e+10 MPI Reductions: 3.055e+03 1.005 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 3.3485e-01 0.1% 0.0000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% 6.000e+00 0.2% 1: Mesh Setup: 1.0216e+01 4.3% 2.8460e+09 0.8% 1.452e+04 7.2% 2.169e+05 30.7% 3.510e+02 11.5% 2: Setup: 4.5330e+01 19.1% 1.4306e+11 39.8% 8.021e+04 39.8% 6.611e+04 51.7% 2.002e+03 65.6% 3: Solve 1: 3.6795e-01 0.2% 1.8026e+08 0.1% 1.346e+04 6.7% 1.034e+03 0.1% 1.360e+02 4.5% 4: Solve 2: 2.5411e+00 1.1% 2.2305e+09 0.6% 1.830e+04 9.1% 3.928e+03 0.7% 1.540e+02 5.0% 5: Solve 3: 1.9916e+01 8.4% 2.0916e+10 5.8% 3.210e+04 15.9% 1.015e+04 3.2% 1.910e+02 6.3% 6: Solve 4: 1.5823e+02 66.8% 1.9022e+11 52.9% 4.280e+04 21.3% 3.265e+04 13.6% 1.970e+02 6.5% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage VecNorm 4 1.0 1.5709e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 67 0 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 1: Mesh Setup PetscBarrier 6 1.0 1.4351e-02 1.1 0.00e+00 0.0 1.7e+03 2.1e+01 2.4e+01 0 0 1 0 1 0 0 12 0 7 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSided 57 1.0 1.2513e-0112.2 0.00e+00 0.0 1.5e+03 8.0e+00 0.0e+00 0 0 1 0 0 0 0 10 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 4 1.0 2.1676e-01416.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMCreateMat 4 1.0 5.2563e+00 1.0 0.00e+00 0.0 5.6e+03 5.6e+05 5.2e+01 2 0 3 31 2 51 0 38 99 15 0 0 8 2.38e+02 0 0.00e+00 0 Mesh Partition 1 1.0 2.9436e-03 1.0 0.00e+00 0.0 1.4e+02 1.1e+03 8.0e+00 0 0 0 0 0 0 0 1 0 2 0 0 0 0.00e+00 0 0.00e+00 0 Mesh Migration 1 1.0 2.2176e-03 1.0 0.00e+00 0.0 7.5e+02 7.9e+02 2.4e+01 0 0 0 0 1 0 0 5 0 7 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartSelf 1 1.0 8.1570e-04218.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblInv 1 1.0 1.3154e-03 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblSF 1 1.0 4.0493e-04 1.2 0.00e+00 0.0 5.8e+01 8.7e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartStrtSF 1 1.0 5.0852e-04 1.1 0.00e+00 0.0 2.3e+01 1.1e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPointSF 1 1.0 1.5507e-04 1.3 0.00e+00 0.0 4.6e+01 2.2e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 32 1.0 2.3522e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 1 0 0 0 0 11 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistribute 1 1.0 5.3111e-03 1.0 0.00e+00 0.0 9.3e+02 9.0e+02 3.2e+01 0 0 0 0 1 0 0 6 0 9 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistCones 1 1.0 3.7185e-04 1.1 0.00e+00 0.0 1.5e+02 1.9e+03 1.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistLabels 1 1.0 1.0911e-03 1.0 0.00e+00 0.0 3.8e+02 4.7e+02 2.1e+01 0 0 0 0 1 0 0 3 0 6 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistField 1 1.0 4.6317e-04 1.1 0.00e+00 0.0 1.7e+02 5.3e+02 1.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 58 1.0 1.5887e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 5.8e+01 0 0 0 0 2 0 0 0 0 17 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 58 1.0 1.8853e-04 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPrealloc 4 1.0 4.1811e+00 1.0 0.00e+00 0.0 5.6e+03 5.6e+05 4.4e+01 2 0 3 31 1 41 0 38 99 13 0 0 8 2.38e+02 0 0.00e+00 0 SFSetGraph 73 1.0 3.0053e-0312.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 57 1.0 1.4411e-01 1.2 0.00e+00 0.0 7.6e+03 2.1e+05 0.0e+00 0 0 4 15 0 1 0 52 50 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 95 1.0 4.0583e-03 5.6 0.00e+00 0.0 4.3e+03 6.3e+04 0.0e+00 0 0 2 3 0 0 0 29 9 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 95 1.0 4.3303e-02 9.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 37 1.0 1.0530e-0232.2 0.00e+00 0.0 1.9e+03 5.6e+05 0.0e+00 0 0 1 10 0 0 0 13 33 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 29 1.0 1.2212e-01 7.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpBegin 8 1.0 1.9415e-0392.4 0.00e+00 0.0 4.1e+02 6.4e+05 0.0e+00 0 0 0 3 0 0 0 3 8 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpEnd 8 1.0 3.9402e-02 3.2 0.00e+00 0.0 4.1e+02 6.4e+05 0.0e+00 0 0 0 3 0 0 0 3 8 0 0 0 0 0.00e+00 0 0.00e+00 0 SFDistSection 13 1.0 2.4254e-03 1.9 0.00e+00 0.0 1.6e+03 2.7e+03 1.3e+01 0 0 1 0 0 0 0 11 0 4 0 0 0 0.00e+00 0 0.00e+00 0 SFSectionSF 21 1.0 5.1264e-02 1.1 0.00e+00 0.0 2.3e+03 2.2e+05 0.0e+00 0 0 1 5 0 0 0 16 17 0 0 0 0 0.00e+00 0 0.00e+00 0 SFRemoteOff 8 1.0 3.9774e-0214.0 0.00e+00 0.0 8.2e+02 6.5e+03 0.0e+00 0 0 0 0 0 0 0 6 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyBegin 4 1.0 2.1690e-01383.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 4 1.0 5.3932e-01 1.0 0.00e+00 0.0 1.3e+03 9.0e+03 1.6e+01 0 0 1 0 1 5 0 9 0 5 0 0 8 2.38e+02 0 0.00e+00 0 MatCUSPARSCopyTo 8 1.0 4.6047e-01 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 4 0 0 0 0 0 0 8 2.38e+02 0 0.00e+00 0 VecMDot 12 1.0 7.3528e-04 1.1 2.65e+06 1.1 0.0e+00 0.0e+00 1.2e+01 0 0 0 0 0 0 2 0 0 3 84577 0 0 0.00e+00 0 0.00e+00 0 VecNorm 24 1.0 1.6201e-0221.7 1.32e+06 1.1 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 1 0 0 7 1919 0 0 0.00e+00 0 0.00e+00 0 VecScale 24 1.0 3.2390e-04 1.3 6.62e+05 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 48001 0 0 0.00e+00 0 0.00e+00 0 VecSet 72 1.0 6.1860e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecMAXPY 12 1.0 9.0827e-04 1.2 2.65e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 2 0 0 0 68470 0 0 0.00e+00 0 0.00e+00 0 VecNormalize 24 1.0 1.6531e-0216.1 1.99e+06 1.1 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 2 0 0 7 2821 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 2: Setup BuildTwoSided 98 1.0 7.4645e-03 1.6 0.00e+00 0.0 3.7e+03 8.0e+00 0.0e+00 0 0 2 0 0 0 0 5 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 429 1.0 7.3537e+00 7.4 0.00e+00 0.0 3.0e+03 4.9e+05 0.0e+00 1 0 2 15 0 8 0 4 28 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetGraph 98 1.0 1.6444e-04 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 98 1.0 1.0271e-02 1.2 0.00e+00 0.0 1.9e+04 1.7e+03 0.0e+00 0 0 9 0 0 0 0 23 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 531 1.0 6.2321e-03 2.5 0.00e+00 0.0 3.6e+04 5.2e+03 0.0e+00 0 0 18 2 0 0 0 45 4 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 531 1.0 3.4507e-02 7.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 100 1.0 3.3948e-01 1.1 4.98e+08 1.2 7.5e+03 1.0e+04 0.0e+00 0 3 4 1 0 1 8 9 1 0 33093 374407 105 3.45e+01 105 1.82e+01 12 MatConvert 87 1.0 9.3952e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 2.8e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatScale 30 1.0 2.2599e-02 1.2 1.67e+07 1.2 7.5e+02 3.0e+03 0.0e+00 0 0 0 0 0 0 0 1 0 0 16878 0 0 0.00e+00 10 9.25e-02 0 MatAssemblyBegin 306 1.0 7.7796e+00 3.6 0.00e+00 0.0 3.0e+03 4.9e+05 0.0e+00 2 0 2 15 0 9 0 4 28 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 306 1.0 2.8421e+00 1.1 2.84e+06 2.4 1.6e+04 1.4e+03 3.2e+02 1 0 8 0 11 6 0 20 0 16 18 0 256 5.33e+02 0 0.00e+00 0 MatCreateSubMat 14 1.0 7.1562e-01 1.0 0.00e+00 0.0 2.4e+03 1.6e+05 1.7e+02 0 0 1 4 6 2 0 3 7 8 0 0 42 3.65e+01 0 0.00e+00 0 MatPartitioning 7 1.0 7.1597e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatCoarsen 10 1.0 8.8018e-03 1.0 0.00e+00 0.0 8.4e+03 3.6e+03 4.6e+01 0 0 4 0 2 0 0 10 1 2 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 20 1.0 1.0818e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAXPY 10 1.0 3.8240e-01 1.3 6.92e+05 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 42 0 20 6.97e+01 0 0.00e+00 0 MatTranspose 20 1.0 6.4198e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMatMult 10 1.0 1.8774e+00 1.0 2.99e+08 1.2 7.9e+03 3.6e+04 8.0e+01 1 2 4 3 3 4 5 10 5 4 3599 0 40 1.39e+02 0 0.00e+00 0 MatMatMultSym 10 1.0 1.1213e+00 1.0 0.00e+00 0.0 6.4e+03 3.1e+04 8.0e+01 0 0 3 2 3 2 0 8 4 4 0 0 20 6.97e+01 0 0.00e+00 0 MatMatMultNum 10 1.0 7.6465e-01 1.1 2.99e+08 1.2 1.5e+03 6.0e+04 0.0e+00 0 2 1 1 0 2 5 2 2 0 8836 0 20 6.97e+01 0 0.00e+00 0 MatPtAP 10 1.0 3.6997e+01 1.0 5.64e+09 1.3 1.4e+04 2.8e+05 1.1e+02 16 34 7 38 4 81 86 17 74 5 3318 0 40 1.11e+02 0 0.00e+00 0 MatPtAPSymbolic 10 1.0 1.6846e+01 1.0 0.00e+00 0.0 9.2e+03 3.0e+05 7.0e+01 7 0 5 27 2 37 0 11 51 3 0 0 0 0.00e+00 0 0.00e+00 0 MatPtAPNumeric 10 1.0 2.0155e+01 1.0 5.64e+09 1.3 4.7e+03 2.5e+05 4.0e+01 8 34 2 12 1 44 86 6 22 2 6091 0 40 1.11e+02 0 0.00e+00 0 MatTrnMatMult 10 1.0 1.3635e+00 1.0 4.80e+07 1.2 7.3e+03 6.8e+04 1.1e+02 1 0 4 5 4 3 1 9 9 6 803 0 40 1.28e+02 0 0.00e+00 0 MatTrnMatMultSym 10 1.0 5.4456e-01 1.0 0.00e+00 0.0 4.4e+03 4.6e+04 7.1e+01 0 0 2 2 2 1 0 5 4 4 0 0 0 0.00e+00 0 0.00e+00 0 MatTrnMatMultNum 10 1.0 8.1889e-01 1.0 4.80e+07 1.2 2.9e+03 1.0e+05 4.0e+01 0 0 1 3 1 2 1 4 6 2 1337 0 40 1.28e+02 0 0.00e+00 0 MatGetLocalMat 40 1.0 4.8925e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetBrAoCol 30 1.0 1.6976e-01 3.5 0.00e+00 0.0 1.0e+04 2.1e+05 0.0e+00 0 0 5 22 0 0 0 13 42 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 261 1.0 2.0126e+00 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 4 0 0 0 0 0 0 261 5.56e+02 0 0.00e+00 0 VecTDot 210 1.0 5.2819e-02 1.9 4.85e+06 1.1 0.0e+00 0.0e+00 2.1e+02 0 0 0 0 7 0 0 0 0 10 2151 15455 0 0.00e+00 0 0.00e+00 99 VecCopy 20 1.0 5.8541e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 5 8.96e-01 0 VecSet 642 1.0 1.4011e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 200 1.0 3.4167e-03 1.1 4.62e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 31665 47257 0 0.00e+00 0 0.00e+00 99 VecAYPX 90 1.0 2.9380e-03 1.2 2.08e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 16571 20066 0 0.00e+00 0 0.00e+00 99 VecAssemblyBegin 345 1.0 1.7942e-02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 345 1.0 7.2732e-04 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 164 0.00e+00 0 VecPointwiseMult 110 1.0 2.2693e-03 1.2 1.27e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 13111 16904 10 1.79e+00 0 0.00e+00 99 VecScatterBegin 465 1.0 7.1399e-03 1.9 0.00e+00 0.0 3.0e+04 5.5e+03 0.0e+00 0 0 15 2 0 0 0 37 3 0 0 0 0 0.00e+00 65 1.05e+00 0 VecScatterEnd 465 1.0 3.3896e-02 8.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSetRandom 10 1.0 5.4212e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 5 8.96e-01 0 VecCUDACopyTo 110 1.0 4.6978e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 110 1.37e+01 0 0.00e+00 0 VecCUDACopyFrom 511 1.0 1.5691e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 511 2.71e+01 0 KSPSetUp 28 1.0 4.8995e-01 7.7 0.00e+00 0.0 0.0e+00 0.0e+00 2.8e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 PCGAMGGraph_AGG 10 1.0 2.8285e+00 1.0 2.74e+07 1.1 4.4e+03 2.2e+03 1.6e+02 1 0 2 0 5 6 0 6 0 8 219 0 40 3.88e+01 10 9.25e-02 0 PCGAMGCoarse_AGG 10 1.0 1.4154e+00 1.0 4.80e+07 1.2 1.9e+04 2.8e+04 2.0e+02 1 0 10 5 6 3 1 24 10 10 774 0 40 1.28e+02 70 1.25e+00 0 PCGAMGProl_AGG 10 1.0 2.1953e-01 1.0 0.00e+00 0.0 2.0e+04 5.0e+03 6.8e+02 0 0 10 1 22 0 0 25 2 34 0 0 20 9.47e+00 298 5.70e+00 0 PCGAMGPOpt_AGG 10 1.0 2.7936e+00 1.0 8.22e+08 1.1 1.5e+04 2.3e+04 3.7e+02 1 5 8 4 12 6 13 19 7 18 6650 89965 175 2.45e+02 115 2.00e+01 9 GAMG: createProl 10 1.0 7.3330e+00 1.0 8.98e+08 1.1 5.9e+04 1.7e+04 1.4e+03 3 6 29 10 46 16 14 74 19 70 2767 69291 275 4.22e+02 493 2.70e+01 8 Graph 20 1.0 2.8004e+00 1.0 2.74e+07 1.1 4.4e+03 2.2e+03 1.6e+02 1 0 2 0 5 6 0 6 0 8 221 0 40 3.88e+01 10 9.25e-02 0 MIS/Agg 10 1.0 8.9216e-03 1.0 0.00e+00 0.0 8.4e+03 3.6e+03 4.6e+01 0 0 4 0 2 0 0 10 1 2 0 0 0 0.00e+00 0 0.00e+00 0 SA: col data 10 1.0 7.0189e-02 1.0 0.00e+00 0.0 1.8e+04 4.0e+03 6.0e+02 0 0 9 1 20 0 0 22 1 30 0 0 0 0.00e+00 298 5.70e+00 0 SA: frmProl0 10 1.0 1.3608e-01 1.0 0.00e+00 0.0 2.1e+03 1.3e+04 4.0e+01 0 0 1 0 1 0 0 3 1 2 0 0 20 9.47e+00 0 0.00e+00 0 SA: smooth 10 1.0 2.3266e+00 1.0 3.12e+08 1.1 7.9e+03 3.6e+04 1.0e+02 1 2 4 3 3 5 5 10 5 5 3028 0 60 2.09e+02 0 0.00e+00 0 GAMG: partLevel 10 1.0 3.7949e+01 1.0 5.64e+09 1.3 2.1e+04 2.0e+05 5.3e+02 16 34 10 42 17 84 86 26 81 26 3235 0 96 1.48e+02 14 2.99e-02 0 repartition 7 1.0 1.5104e-01 1.1 5.79e+05 2.0 3.2e+03 9.1e+01 1.5e+02 0 0 2 0 5 0 0 4 0 8 79 0 14 1.73e-01 0 0.00e+00 0 Invert-Sort 7 1.0 9.3438e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 2.8e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 Move A 7 1.0 4.3954e-01 1.1 0.00e+00 0.0 1.9e+03 2.0e+05 9.1e+01 0 0 1 4 3 1 0 2 7 5 0 0 21 1.23e+01 0 0.00e+00 0 Move P 7 1.0 3.7887e-01 1.1 0.00e+00 0.0 5.2e+02 1.6e+03 9.1e+01 0 0 0 0 3 1 0 1 0 5 0 0 21 2.42e+01 0 0.00e+00 0 PCSetUp 4 1.0 4.5247e+01 1.0 6.53e+09 1.3 8.0e+04 6.6e+04 2.0e+03 19 40 40 52 65 100100100100100 3162 66336 371 5.69e+02 511 2.71e+01 1 --- Event Stage 3: Solve 1 BuildTwoSided 1 1.0 5.5990e-05 2.3 0.00e+00 0.0 2.6e+01 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 4.2126e-0364.9 0.00e+00 0.0 7.6e+01 8.5e+04 0.0e+00 0 0 0 0 0 0 0 1 47 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 2.5247e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.0900e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 5 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 8.5000e-06 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 5.2305e-03 1.0 1.60e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 21 0 0 0 7363 0 0 0.00e+00 2 6.48e-03 0 DMPlexJacobianFE 1 1.0 3.0037e-01 1.0 1.62e+06 1.0 7.6e+01 8.5e+04 0.0e+00 0 0 0 0 0 81 21 1 47 0 129 0 2 2.25e-01 0 0.00e+00 0 SFSetGraph 1 1.0 8.0100e-07 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 7.2927e-05 1.6 0.00e+00 0.0 1.3e+02 3.2e+02 0.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 209 1.0 9.3546e-04 3.1 0.00e+00 0.0 1.3e+04 5.6e+02 0.0e+00 0 0 6 0 0 0 0 95 51 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 209 1.0 1.3144e-02 7.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 36 1.0 6.7670e-05 1.7 0.00e+00 0.0 4.9e+02 5.6e+02 0.0e+00 0 0 0 0 0 0 0 4 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 36 1.0 9.4135e-0440.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 172 1.0 1.4806e-02 1.3 6.96e+06 6.4 1.2e+04 5.6e+02 0.0e+00 0 0 6 0 0 4 50 91 49 0 6039 10378 188 3.92e-01 172 1.80e-01 54 MatMultAdd 34 1.0 1.0998e-0210.1 2.69e+05 4.5 3.9e+02 6.0e+02 0.0e+00 0 0 0 0 0 3 2 3 2 0 390 0 34 1.26e-03 0 0.00e+00 0 MatMultTranspose 34 1.0 1.5560e-02 1.8 2.69e+05 4.5 3.9e+02 6.0e+02 0.0e+00 0 0 0 0 0 2 2 3 2 0 275 925 21 4.72e-03 51 1.97e-02 3 MatSolve 17 0.0 1.8631e-05 0.0 1.07e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 575 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.3167e-05 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 2.0214e-0529.4 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 185 0 0 0.00e+00 0 0.00e+00 0 MatResidual 34 1.0 3.2199e-03 1.3 1.50e+06 7.5 2.2e+03 5.6e+02 0.0e+00 0 0 1 0 0 1 9 16 9 0 5132 7801 34 7.08e-02 18 2.08e-02 54 MatAssemblyBegin 1 1.0 4.9116e-03 1.5 0.00e+00 0.0 7.6e+01 8.5e+04 0.0e+00 0 0 0 0 0 1 0 1 47 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 2.5021e-03 2.5 1.43e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 89 0 2 2.25e-01 0 0.00e+00 0 MatGetRowIJ 1 0.0 3.5300e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 4.0023e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 1.0037e-05 7.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 4 1.0 1.0746e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 4 2.27e-01 0 0.00e+00 0 VecTDot 74 1.0 6.7145e-03 1.1 1.78e+04 2.0 0.0e+00 0.0e+00 7.4e+01 0 0 0 0 2 2 0 0 0 54 56 83 0 0.00e+00 0 0.00e+00 98 VecNorm 41 1.0 4.4844e-03 1.4 1.00e+04 2.0 0.0e+00 0.0e+00 4.1e+01 0 0 0 0 1 1 0 0 0 30 47 80 0 0.00e+00 0 0.00e+00 98 VecCopy 108 1.0 1.3231e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.15e-03 0 VecSet 147 1.0 1.3289e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 75 1.0 1.8836e-03 1.1 1.85e+04 2.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 207 299 2 2.31e-03 0 0.00e+00 98 VecAYPX 237 1.0 6.0079e-03 1.2 5.01e+04 2.4 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 1 0 0 0 151 196 17 1.96e-02 0 0.00e+00 96 VecAXPBYCZ 68 1.0 2.2429e-03 1.1 5.92e+04 2.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 1 0 0 0 542 1145 0 0.00e+00 0 0.00e+00 97 VecPointwiseMult 158 1.0 2.7119e-03 1.2 2.25e+04 3.4 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 107 104 3 3.47e-03 0 0.00e+00 94 VecScatterBegin 240 1.0 1.7692e-03 3.6 0.00e+00 0.0 1.3e+04 5.6e+02 0.0e+00 0 0 6 0 0 0 0 97 52 0 0 0 0 0.00e+00 51 1.36e-03 0 VecScatterEnd 240 1.0 1.3221e-02 4.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 261 1.0 4.8970e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 261 4.19e-01 0 0.00e+00 0 VecCUDACopyFrom 250 1.1 4.8833e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 249 2.22e-01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 4.9100e-01 1.0 1.49e+07 2.8 2.8e+04 1.6e+03 5.1e+02 0 0 14 0 17 133146207320377 536 2424 338 1.48e+00 346 2.69e-01 22 SNESSetUp 1 1.0 7.9952e-05 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 9.1711e-03 1.0 1.67e+06 1.0 3.3e+02 3.7e+02 1.7e+01 0 0 0 0 1 2 22 2 1 12 4326 0 0 0.00e+00 8 1.76e-02 0 SNESJacobianEval 1 1.0 3.0160e-01 1.0 1.64e+06 1.0 1.3e+02 5.1e+04 0.0e+00 0 0 0 0 0 82 22 1 47 0 130 0 2 2.25e-01 1 3.24e-03 0 KSPSetUp 3 1.0 2.1901e-04 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 5.7217e-02 1.0 7.47e+06 5.8 1.3e+04 5.6e+02 1.2e+02 0 0 6 0 4 16 56 97 52 86 1772 2700 263 4.21e-01 240 2.01e-01 51 PCSetUp 1 1.0 1.1058e-04 2.7 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 34 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 17 1.0 1.1666e-04 2.5 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 32 0 0 0.00e+00 0 0.00e+00 0 PCApply 17 1.0 4.7829e-02 1.0 7.34e+06 6.8 1.1e+04 5.6e+02 6.8e+01 0 0 5 0 2 13 48 81 44 50 1809 3200 231 3.54e-01 208 1.64e-01 50 --- Event Stage 4: Solve 2 BuildTwoSided 1 1.0 7.2138e-05 4.1 0.00e+00 0.0 2.6e+01 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 2.1663e-02774.1 0.00e+00 0.0 7.6e+01 4.2e+05 0.0e+00 0 0 0 0 0 0 0 0 45 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 2.5948e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.1344e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 5 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 8.7960e-06 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 2.2069e-02 1.0 1.28e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 14 0 0 0 13961 0 0 0.00e+00 2 3.67e-02 0 DMPlexJacobianFE 1 1.0 2.3897e+00 1.0 1.30e+07 1.0 7.6e+01 4.2e+05 0.0e+00 1 0 0 0 0 94 14 0 45 0 130 0 2 2.59e+00 0 0.00e+00 0 SFSetGraph 1 1.0 3.2520e-06 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.1669e-04 1.8 0.00e+00 0.0 1.3e+02 1.3e+03 0.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 275 1.0 2.2945e-03 4.2 0.00e+00 0.0 1.7e+04 2.2e+03 0.0e+00 0 0 9 0 0 0 0 94 53 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 275 1.0 4.9904e-02 8.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 48 1.0 1.4312e-04 2.2 0.00e+00 0.0 8.6e+02 1.7e+03 0.0e+00 0 0 0 0 0 0 0 5 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 48 1.0 3.8649e-03119.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 226 1.0 7.1983e-02 2.4 1.20e+08 3.6 1.6e+04 2.2e+03 0.0e+00 0 0 8 0 0 1 64 89 50 0 19832 61166 248 2.80e+00 203 2.17e+00 27 MatMultAdd 46 1.0 4.4802e-0215.2 3.65e+06 2.2 7.6e+02 1.7e+03 0.0e+00 0 0 0 0 0 2 3 4 2 0 1494 0 0 0.00e+00 0 0.00e+00 0 MatMultTranspose 46 1.0 6.6990e-03 3.9 3.65e+06 2.2 7.6e+02 1.7e+03 0.0e+00 0 0 0 0 0 0 3 4 2 0 9994 0 0 0.00e+00 23 2.46e-01 0 MatSolve 23 0.0 2.4629e-04 0.0 3.23e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1310 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 1.2366e-0411.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 2.2102e-04228.1 3.92e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1772 0 0 0.00e+00 0 0.00e+00 0 MatResidual 46 1.0 1.5581e-02 2.6 2.56e+07 4.2 3.0e+03 2.2e+03 0.0e+00 0 0 2 0 0 0 12 17 9 0 17504 40777 46 5.20e-01 24 2.57e-01 27 MatAssemblyBegin 1 1.0 2.4302e-02 1.6 0.00e+00 0.0 7.6e+01 4.2e+05 0.0e+00 0 0 0 0 0 1 0 0 45 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 1.5562e-02 5.6 6.98e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 79 0 2 2.59e+00 0 0.00e+00 0 MatGetRowIJ 1 0.0 7.7030e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 4.6910e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.1417e-04 4.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.1367e-02 8.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 2.59e+00 0 0.00e+00 0 VecTDot 86 1.0 1.1532e-02 1.6 1.87e+05 1.3 0.0e+00 0.0e+00 8.6e+01 0 0 0 0 3 0 0 0 0 56 368 863 0 0.00e+00 0 0.00e+00 98 VecNorm 47 1.0 6.8110e-03 1.3 1.04e+05 1.3 0.0e+00 0.0e+00 4.7e+01 0 0 0 0 2 0 0 0 0 31 344 720 0 0.00e+00 0 0.00e+00 98 VecCopy 144 1.0 1.7488e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.07e-02 0 VecSet 235 1.0 1.0585e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 87 1.0 2.2973e-03 1.2 1.93e+05 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1901 2744 2 2.14e-02 0 0.00e+00 98 VecAYPX 315 1.0 7.7545e-03 1.2 5.37e+05 1.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1434 1972 23 2.46e-01 0 0.00e+00 97 VecAXPBYCZ 92 1.0 3.0777e-03 1.1 6.96e+05 1.4 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 4921 10162 0 0.00e+00 0 0.00e+00 97 VecPointwiseMult 206 1.0 3.2433e-03 1.1 2.00e+05 1.8 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1072 1049 3 3.21e-02 0 0.00e+00 95 VecScatterBegin 318 1.0 2.6009e-03 3.2 0.00e+00 0.0 1.8e+04 2.2e+03 0.0e+00 0 0 9 0 0 0 0 97 54 0 0 0 0 0.00e+00 0 0.00e+00 0 VecScatterEnd 318 1.0 5.0015e-02 7.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 276 1.0 5.9828e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 276 3.10e+00 0 0.00e+00 0 VecCUDACopyFrom 236 1.0 6.1196e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 236 2.56e+00 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 3.3179e+00 1.0 2.43e+08 2.8 3.3e+04 8.0e+03 5.9e+02 1 1 16 3 19 131156179367382 1049 14928 357 1.46e+01 337 2.93e+00 13 SNESSetUp 1 1.0 7.6329e-05 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 3.0811e-02 1.0 1.32e+07 1.0 3.3e+02 1.5e+03 1.7e+01 0 0 0 0 1 1 14 2 1 11 10180 0 0 0.00e+00 8 1.16e-01 0 SNESJacobianEval 1 1.0 2.3927e+00 1.0 1.31e+07 1.0 1.3e+02 2.5e+05 0.0e+00 1 0 0 0 0 94 14 1 45 0 131 0 2 2.59e+00 1 1.84e-02 0 KSPSetUp 3 1.0 1.0402e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 1.2385e-01 1.0 1.29e+08 3.4 1.8e+04 2.2e+03 1.4e+02 0 0 9 0 4 5 72 97 54 88 12939 16322 274 3.08e+00 227 2.43e+00 27 PCSetUp 1 1.0 4.1717e-04 7.7 3.92e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 939 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 23 1.0 4.3202e-04 6.0 3.92e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 907 0 0 0.00e+00 0 0.00e+00 0 PCApply 23 1.0 1.0793e-01 1.0 1.22e+08 3.9 1.5e+04 2.2e+03 6.8e+01 0 0 7 0 2 4 61 82 45 44 12686 19455 230 2.59e+00 183 1.96e+00 26 --- Event Stage 5: Solve 3 BuildTwoSided 1 1.0 1.9482e-04 6.2 0.00e+00 0.0 2.6e+01 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 1.3491e-013834.6 0.00e+00 0.0 7.6e+01 1.8e+06 0.0e+00 0 0 0 1 0 0 0 0 43 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 3.0120e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.3158e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 9.6410e-06 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.7516e-01 1.0 1.03e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 1 12 0 0 0 14071 0 0 0.00e+00 2 2.42e-01 0 DMPlexJacobianFE 1 1.0 1.9115e+01 1.0 1.04e+08 1.0 7.6e+01 1.8e+06 0.0e+00 8 1 0 1 0 96 12 0 43 0 131 0 2 2.44e+01 0 0.00e+00 0 SFSetGraph 1 1.0 2.1779e-05 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 4.2366e-04 1.4 0.00e+00 0.0 1.3e+02 5.5e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 416 1.0 7.0907e-03 3.7 0.00e+00 0.0 2.9e+04 6.1e+03 0.0e+00 0 0 14 2 0 0 0 91 54 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 416 1.0 1.7661e-01 4.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 74 1.0 5.4158e-04 2.3 0.00e+00 0.0 2.8e+03 2.3e+03 0.0e+00 0 0 1 0 0 0 0 9 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 74 1.0 1.5754e-02204.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 341 1.0 5.0242e-01 1.3 7.27e+08 1.5 2.6e+04 6.5e+03 0.0e+00 0 4 13 2 0 2 68 82 52 0 28324 195431 258 1.78e+01 235 1.94e+01 13 MatMultAdd 72 1.0 1.5413e-01 8.0 3.11e+07 1.3 2.7e+03 2.2e+03 0.0e+00 0 0 1 0 0 1 3 8 2 0 4285 0 48 3.98e-03 0 0.00e+00 0 MatMultTranspose 72 1.0 3.6808e-02 1.8 3.11e+07 1.3 2.7e+03 2.2e+03 0.0e+00 0 0 1 0 0 0 3 8 2 0 17944 515 28 1.16e-02 72 2.20e+00 0 MatSolve 24 0.0 8.4895e-05 0.0 1.51e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 178 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.0823e-05 3.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 1.9825e-0516.9 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 188 0 0 0.00e+00 0 0.00e+00 0 MatResidual 72 1.0 9.8203e-02 1.4 1.42e+08 1.6 5.3e+03 6.2e+03 0.0e+00 0 1 3 0 0 0 13 16 10 0 27828 157531 48 3.31e+00 25 2.29e+00 13 MatAssemblyBegin 1 1.0 1.3648e-01 1.8 0.00e+00 0.0 7.6e+01 1.8e+06 0.0e+00 0 0 0 1 0 1 0 0 43 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 1.3052e-0112.7 3.05e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 43 0 2 2.44e+01 0 0.00e+00 0 MatGetRowIJ 1 0.0 3.4890e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 4.4525e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 1.8869e-03 2.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 4 1.0 1.0174e-0110.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 4 2.44e+01 0 0.00e+00 0 VecTDot 109 1.0 2.0426e-02 2.2 1.64e+06 1.2 0.0e+00 0.0e+00 1.1e+02 0 0 0 0 4 0 0 0 0 57 1833 7126 0 0.00e+00 0 0.00e+00 99 VecNorm 59 1.0 1.5208e-02 2.0 9.04e+05 1.2 0.0e+00 0.0e+00 5.9e+01 0 0 0 0 2 0 0 0 0 31 1358 5168 0 0.00e+00 0 0.00e+00 99 VecCopy 224 1.0 2.2420e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 9.18e-02 0 VecSet 273 1.0 2.2435e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 109 1.0 2.2720e-03 1.1 1.68e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 16951 26279 2 1.84e-01 0 0.00e+00 99 VecAYPX 481 1.0 8.4481e-03 1.2 4.39e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 11725 18421 24 2.20e+00 0 0.00e+00 97 VecAXPBYCZ 144 1.0 3.5361e-03 1.2 5.97e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 38245 84200 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 321 1.0 3.9005e-03 1.2 1.39e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 7904 8470 3 2.75e-01 0 0.00e+00 96 VecScatterBegin 485 1.0 8.7919e-03 3.0 0.00e+00 0.0 3.2e+04 5.8e+03 0.0e+00 0 0 16 2 0 0 0 99 56 0 0 0 0 0.00e+00 72 4.13e-03 0 VecScatterEnd 485 1.0 1.6617e-01 4.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 359 1.0 1.1616e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 359 2.05e+01 0 0.00e+00 0 VecCUDACopyFrom 341 1.1 1.1819e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 340 2.26e+01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.5389e+01 1.0 1.74e+09 1.5 5.5e+04 2.6e+04 7.9e+02 11 10 28 14 26 127165173435412 1357 62964 464 1.23e+02 484 2.55e+01 7 SNESSetUp 1 1.0 8.0806e-05 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 2.0154e-01 1.0 1.04e+08 1.0 3.3e+02 6.3e+03 1.7e+01 0 1 0 0 1 1 12 1 1 9 12350 0 0 0.00e+00 8 8.52e-01 0 SNESJacobianEval 1 1.0 1.9124e+01 1.0 1.05e+08 1.0 1.3e+02 1.1e+06 0.0e+00 8 1 0 1 0 96 12 0 44 0 131 0 2 2.44e+01 1 1.21e-01 0 KSPSetUp 4 1.0 9.8217e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 6.1297e-01 1.0 8.05e+08 1.5 3.2e+04 5.8e+03 1.7e+02 0 4 16 2 6 3 76 99 56 90 25956 68622 361 2.03e+01 331 2.17e+01 14 PCSetUp 1 1.0 1.0995e-04 2.3 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 34 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 24 1.0 1.2570e-04 1.9 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 30 0 0 0.00e+00 0 0.00e+00 0 PCApply 24 1.0 5.3416e-01 1.0 7.01e+08 1.6 2.9e+04 5.5e+03 1.0e+02 0 4 14 2 3 3 65 89 48 53 25487 79252 315 1.71e+01 285 1.74e+01 13 --- Event Stage 6: Solve 4 BuildTwoSided 1 1.0 1.0893e-0333.2 0.00e+00 0.0 2.6e+01 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 7.5264e-0115305.7 0.00e+00 0.0 7.6e+01 7.7e+06 0.0e+00 0 0 0 6 0 0 0 0 42 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 2.9184e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.2003e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.0044e-05 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.4157e+00 1.0 8.22e+08 1.0 0.0e+00 0.0e+00 0.0e+00 1 5 0 0 0 1 10 0 0 0 13928 0 0 0.00e+00 2 1.75e+00 0 DMPlexJacobianFE 1 1.0 1.5220e+02 1.0 8.37e+08 1.0 7.6e+01 7.7e+06 0.0e+00 64 6 0 6 0 96 11 0 42 0 132 0 2 2.11e+02 0 0.00e+00 0 SFSetGraph 1 1.0 1.7015e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 2.9059e-03 1.1 0.00e+00 0.0 1.3e+02 2.2e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 448 1.0 2.0668e-02 4.0 0.00e+00 0.0 3.8e+04 2.1e+04 0.0e+00 0 0 19 8 0 0 0 89 56 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 448 1.0 3.9415e-01 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 80 1.0 9.4445e-04 2.0 0.00e+00 0.0 4.6e+03 4.1e+03 0.0e+00 0 0 2 0 0 0 0 11 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 80 1.0 8.3386e-0241.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 367 1.0 3.9088e+00 1.0 5.85e+09 1.2 3.3e+04 2.3e+04 0.0e+00 2 37 17 7 0 2 71 78 55 0 34437 549642 506 1.41e+02 429 2.16e+02 11 MatMultAdd 78 1.0 3.5906e-01 1.8 2.71e+08 1.2 4.5e+03 3.6e+03 0.0e+00 0 2 2 0 0 0 3 11 1 0 17421 274837 52 2.03e+01 52 1.37e+00 12 MatMultTranspose 78 1.0 2.7130e-01 1.2 2.68e+08 1.2 4.5e+03 3.6e+03 0.0e+00 0 2 2 0 0 0 3 11 1 0 22768 8296378 4 9.40e+01 78 2.20e+00 93 MatSolve 26 0.0 4.7904e-04 0.0 7.46e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1557 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.2925e-0426.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 5.7261e-04557.0 1.14e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1999 0 0 0.00e+00 0 0.00e+00 0 MatResidual 78 1.0 7.5142e-01 1.0 1.13e+09 1.2 6.9e+03 2.2e+04 0.0e+00 0 7 3 1 0 0 14 16 11 0 34675 452615 104 2.68e+01 79 4.04e+01 12 MatAssemblyBegin 1 1.0 8.2720e-01 2.4 0.00e+00 0.0 7.6e+01 7.7e+06 0.0e+00 0 0 0 6 0 0 0 0 42 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 4.0560e-01 3.7 1.27e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 59 0 2 2.11e+02 0 0.00e+00 0 MatGetRowIJ 1 0.0 1.0547e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 5.8918e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 1.8453e-02 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 4 1.0 3.0346e-01 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 4 2.48e+02 0 0.00e+00 0 VecTDot 113 1.0 3.6681e-02 1.8 1.39e+07 1.1 0.0e+00 0.0e+00 1.1e+02 0 0 0 0 4 0 0 0 0 57 8941 37916 0 0.00e+00 0 0.00e+00 100 VecNorm 61 1.0 7.1643e-02 3.1 7.64e+06 1.1 0.0e+00 0.0e+00 6.1e+01 0 0 0 0 2 0 0 0 0 31 2513 34571 0 0.00e+00 0 0.00e+00 100 VecCopy 242 1.0 5.6308e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 28 1.62e+00 0 VecSet 293 1.0 2.1586e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 113 1.0 3.5541e-03 1.1 1.43e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 94785 170499 2 1.52e+00 0 0.00e+00 100 VecAYPX 519 1.0 2.1472e-02 1.6 3.80e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 41647 89260 52 1.66e+00 0 0.00e+00 100 VecAXPBYCZ 156 1.0 8.9007e-03 1.4 5.26e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 138902 382841 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 345 1.0 9.9578e-03 1.2 1.16e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 27477 30337 32 3.20e+00 0 0.00e+00 100 VecScatterBegin 523 1.0 2.7211e-02 3.3 0.00e+00 0.0 4.2e+04 1.9e+04 0.0e+00 0 0 21 8 0 0 0 99 57 0 0 0 0 0.00e+00 78 1.92e+00 0 VecScatterEnd 523 1.0 4.5069e-01 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 644 1.0 4.4981e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 644 1.68e+02 0 0.00e+00 0 VecCUDACopyFrom 570 1.0 6.9270e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 570 2.28e+02 0 VecCopyFromSome 26 1.0 9.9231e-04 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 26 5.44e-01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 1.9719e+02 1.0 1.40e+10 1.2 7.1e+04 7.6e+04 7.9e+02 83 89 35 52 26 125167165386402 1615 331702 772 9.54e+02 765 2.52e+02 8 SNESSetUp 1 1.0 5.5923e-03123.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 1.5290e+00 1.0 8.29e+08 1.0 3.3e+02 2.6e+04 1.7e+01 1 6 0 0 1 1 10 1 1 9 12962 0 0 0.00e+00 8 6.54e+00 0 SNESJacobianEval 1 1.0 1.5224e+02 1.0 8.39e+08 1.0 1.3e+02 4.6e+06 0.0e+00 64 6 0 6 0 96 11 0 42 0 132 0 2 2.11e+02 1 8.75e-01 0 KSPSetUp 4 1.0 1.3446e-02 3.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 4.5116e+00 1.0 6.52e+09 1.2 4.2e+04 1.9e+04 1.8e+02 2 42 21 8 6 3 79 99 57 90 33307 365094 646 2.60e+02 587 2.21e+02 16 PCSetUp 1 1.0 8.8922e-0415.9 1.14e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1287 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 26 1.0 9.0793e-0412.2 1.14e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1261 0 0 0.00e+00 0 0.00e+00 0 PCApply 26 1.0 3.8662e+00 1.0 5.58e+09 1.2 3.9e+04 1.8e+04 1.0e+02 2 36 19 7 3 2 68 91 49 52 33282 401323 596 2.37e+02 537 1.83e+02 17 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Object 0 680 446080 0. Container 0 56 34944 0. Distributed Mesh 0 114 578416 0. DM Label 0 48 33408 0. GraphPartitioner 0 36 26240 0. Index Set 0 188 457872 0. IS L to G Mapping 0 7 486880 0. Section 0 204 159936 0. Star Forest Graph 0 186 180864 0. Discrete System 0 97 97808 0. Matrix 0 121 502093136 0. Matrix Null Space 0 4 2976 0. Vector 0 244 17598504 0. SNES 0 4 6128 0. DMSNES 0 4 2880 0. Krylov Solver 0 32 67552 0. DMKSP interface 0 4 2816 0. Preconditioner 0 22 26016 0. Linear Space 0 8 5952 0. Dual Space 0 32 26624 0. FE Space 0 8 6976 0. Vec Scatter 0 24 20544 0. Field over DM 0 4 3040 0. Viewer 1 1 896 0. --- Event Stage 1: Mesh Setup Object 704 212 139072 0. Container 60 32 19968 0. Distributed Mesh 208 146 740976 0. DM Label 98 66 45936 0. GraphPartitioner 64 44 32064 0. Index Set 828 730 933072 0. IS L to G Mapping 5 1 16392 0. Section 416 292 228928 0. Star Forest Graph 471 377 364864 0. Discrete System 272 219 220752 0. Matrix 68 52 158080 0. Matrix Null Space 4 0 0 0. Vector 100 36 1114592 0. SNES 4 0 0 0. DMSNES 4 0 0 0. Krylov Solver 4 0 0 0. Preconditioner 4 0 0 0. Linear Space 8 4 2976 0. Dual Space 32 16 13312 0. FE Space 8 4 3488 0. Vec Scatter 4 0 0 0. Field over DM 4 4 3040 0. Viewer 1 0 0 0. --- Event Stage 2: Setup Index Set 253 235 866224 0. IS L to G Mapping 10 7 66784 0. Star Forest Graph 98 78 79872 0. Matrix 414 313 258019032 0. Matrix Partitioning 7 7 5208 0. Matrix Coarsen 10 10 6840 0. Vector 719 619 13114008 0. Krylov Solver 38 10 19520 0. Preconditioner 28 10 9120 0. Vec Scatter 88 68 58208 0. PetscRandom 20 20 13880 0. --- Event Stage 3: Solve 1 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 55808 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 18 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 4: Solve 2 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 67728 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 18 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 5: Solve 3 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 113984 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 6: Solve 4 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 299392 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. ======================================================================================================================== Average time to get PetscTime(): 3.87e-08 Average time for MPI_Barrier(): 1.792e-06 Average time for zero size MPI_Send(): 5.05433e-06 #PETSc Option Table entries: -bmat_view :bmcpu.m:ascii_matlab -cells 4,6,8 -check_pointer_intensity 0 -ex56_dm_mat_type aijcusparse -ex56_dm_refine 3 -ex56_dm_vec_type cuda -gamg_est_ksp_max_it 10 -gamg_est_ksp_type cg -ksp_atol 1.e-71 -ksp_converged_reason -ksp_max_it 100 -ksp_monitor -ksp_norm_type preconditioned -ksp_rtol 1.e-11 -ksp_type cg -log_view -lvec_view :lvcpu.m:ascii_matlab -mat_block_size 3 -matptap_via scalable -max_conv_its 4 -mg_levels_esteig_ksp_max_it 10 -mg_levels_esteig_ksp_type cg -mg_levels_ksp_chebyshev_esteig 0,0.05,0,1.05 -mg_levels_ksp_max_it 2 -mg_levels_ksp_type chebyshev -mg_levels_pc_type jacobi -pc_gamg_agg_nsmooths 1 -pc_gamg_coarse_eq_limit 150 -pc_gamg_process_eq_limit 1000 -pc_gamg_repartition true -pc_gamg_reuse_interpolation false -pc_gamg_square_graph 10 -pc_gamg_threshold 0.05 -pc_gamg_threshold_scale .5 -pc_gamg_type agg -pc_type gamg -petscpartitioner_type simple -petscspace_degree 2 -run_type 1 -snes_converged_reason -snes_max_it 2 -snes_monitor -snes_rtol 1.e-10 -snes_type ksponly -use_mat_nearnullspace true -xvec_view :xvcpu.m:ascii_matlab #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with 64 bit PetscInt Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 8 Configure options: --with-cc=mpicc --with-cxx=mpiCC --with-fc=mpif90 --COPTFLAGS="-g -fast" --CXXOPTFLAGS="-g -fast" --FOPTFLAGS="-g -fast" --with-ssl=0 --with-batch=0 --with-mpiexec="jsrun -g 1" --with-cuda=1 --with-cudac=nvcc CUDAFLAGS="-ccbin pgc++" --download-metis --download-viennacl --download-parmetis --download-fblaslapack --with-x=0 --with-64-bit-indices=1 --with-debugging=0 PETSC_ARCH=arch-summit-opt64-pgi-cuda ----------------------------------------- Libraries compiled on 2019-07-28 12:54:27 on login4 Machine characteristics: Linux-4.14.0-115.8.1.el7a.ppc64le-ppc64le-with-redhat-7.6-Maipo Using PETSc directory: /ccs/home/adams/petsc Using PETSc arch: arch-summit-opt64-pgi-cuda ----------------------------------------- Using C compiler: mpicc -g -fast Using Fortran compiler: mpif90 -g -fast ----------------------------------------- Using include paths: -I/ccs/home/adams/petsc/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/sw/summit/cuda/10.1.168/include ----------------------------------------- Using C linker: mpicc Using Fortran linker: mpif90 Using libraries: -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -lpetsc -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -Wl,-rpath,/sw/summit/cuda/10.1.168/lib64 -L/sw/summit/cuda/10.1.168/lib64 /autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib/pgi.ld -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -L/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -L/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -Wl,-rpath,/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -L/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -lflapack -lfblas -lparmetis -lmetis -lcufft -lcublas -lcudart -lcusparse -lstdc++ -ldl -lpthread -lmpiprofilesupport -lmpi_ibm_usempi -lmpi_ibm_mpifh -lmpi_ibm -lpgf90rtl -lpgf90 -lpgf90_rpm1 -lpgf902 -lpgftnrtl -latomic -lpgkomp -lomp -lomptarget -lpgmath -lpgc -lrt -lmass_simdp9 -lmassvp9 -lmassp9 -lm -lgcc_s -lstdc++ -ldl -----------------------------------------