[0] 3465 global equations, 1155 vertices [0] 3465 equations in vector, 1155 vertices 0 SNES Function norm 2.064480037728e+01 0 KSP Residual norm 8.983754158902e+02 1 KSP Residual norm 8.703501579333e+01 2 KSP Residual norm 1.897376919673e+01 3 KSP Residual norm 3.464853389715e+00 4 KSP Residual norm 6.446003161988e-01 5 KSP Residual norm 1.435394674889e-01 6 KSP Residual norm 2.741566572116e-02 7 KSP Residual norm 5.603966832304e-03 8 KSP Residual norm 1.211865414017e-03 9 KSP Residual norm 2.872792896940e-04 10 KSP Residual norm 6.686555525579e-05 11 KSP Residual norm 1.293045626803e-05 12 KSP Residual norm 2.617455350836e-06 13 KSP Residual norm 5.126245385039e-07 14 KSP Residual norm 1.055575866875e-07 15 KSP Residual norm 2.219464939400e-08 16 KSP Residual norm 4.602676175891e-09 Linear solve converged due to CONVERGED_RTOL iterations 16 1 SNES Function norm 1.084953778975e-09 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 32085 global equations, 10695 vertices [0] 32085 equations in vector, 10695 vertices 0 SNES Function norm 7.375868178352e+00 0 KSP Residual norm 2.039563937053e+03 1 KSP Residual norm 2.031299395673e+02 2 KSP Residual norm 6.295940236803e+01 3 KSP Residual norm 1.598760679769e+01 4 KSP Residual norm 5.633168441901e+00 5 KSP Residual norm 1.835514570416e+00 6 KSP Residual norm 5.368245793535e-01 7 KSP Residual norm 1.621109153017e-01 8 KSP Residual norm 5.083447623800e-02 9 KSP Residual norm 1.806722449433e-02 10 KSP Residual norm 6.018387775454e-03 11 KSP Residual norm 2.128472243170e-03 12 KSP Residual norm 6.446352496980e-04 13 KSP Residual norm 2.128693024588e-04 14 KSP Residual norm 7.335269990268e-05 15 KSP Residual norm 2.314341590107e-05 16 KSP Residual norm 7.432257942739e-06 17 KSP Residual norm 2.181149560221e-06 18 KSP Residual norm 6.709029299559e-07 19 KSP Residual norm 2.268534070638e-07 20 KSP Residual norm 6.871669969990e-08 21 KSP Residual norm 2.130300750419e-08 22 KSP Residual norm 6.697419930722e-09 Linear solve converged due to CONVERGED_RTOL iterations 22 1 SNES Function norm 5.280647900138e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 275373 global equations, 91791 vertices [0] 275373 equations in vector, 91791 vertices 0 SNES Function norm 2.615842974236e+00 0 KSP Residual norm 4.688467406648e+03 1 KSP Residual norm 5.244834238192e+02 2 KSP Residual norm 2.224065714756e+02 3 KSP Residual norm 6.818805869653e+01 4 KSP Residual norm 2.215217249807e+01 5 KSP Residual norm 6.854586480095e+00 6 KSP Residual norm 2.268417380223e+00 7 KSP Residual norm 6.743309041069e-01 8 KSP Residual norm 2.618694789569e-01 9 KSP Residual norm 9.343006622012e-02 10 KSP Residual norm 2.754289996795e-02 11 KSP Residual norm 1.043244808880e-02 12 KSP Residual norm 3.630855074132e-03 13 KSP Residual norm 1.193187125855e-03 14 KSP Residual norm 3.933968617304e-04 15 KSP Residual norm 1.367919344914e-04 16 KSP Residual norm 5.042904090929e-05 17 KSP Residual norm 1.669179374697e-05 18 KSP Residual norm 5.530723962785e-06 19 KSP Residual norm 1.922404366931e-06 20 KSP Residual norm 6.827066439293e-07 21 KSP Residual norm 2.582252307370e-07 22 KSP Residual norm 9.159659273120e-08 23 KSP Residual norm 3.194094420042e-08 Linear solve converged due to CONVERGED_RTOL iterations 23 1 SNES Function norm 1.031668432446e-09 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 2280285 global equations, 760095 vertices [0] 2280285 equations in vector, 760095 vertices 0 SNES Function norm 9.255869095573e-01 0 KSP Residual norm 1.094613477757e+04 1 KSP Residual norm 1.002422676749e+03 2 KSP Residual norm 6.601916987411e+02 3 KSP Residual norm 2.093805742604e+02 4 KSP Residual norm 5.959317900948e+01 5 KSP Residual norm 2.106860616105e+01 6 KSP Residual norm 8.755019400083e+00 7 KSP Residual norm 2.556723229460e+00 8 KSP Residual norm 8.567049436656e-01 9 KSP Residual norm 3.466168360603e-01 10 KSP Residual norm 1.444650574241e-01 11 KSP Residual norm 4.858594535694e-02 12 KSP Residual norm 1.600813069120e-02 13 KSP Residual norm 6.220436871221e-03 14 KSP Residual norm 2.257379483328e-03 15 KSP Residual norm 8.604098357464e-04 16 KSP Residual norm 3.199575117962e-04 17 KSP Residual norm 1.108464439510e-04 18 KSP Residual norm 4.074846807032e-05 19 KSP Residual norm 1.475933976478e-05 20 KSP Residual norm 5.529896697596e-06 21 KSP Residual norm 2.085778928916e-06 22 KSP Residual norm 8.122010102959e-07 23 KSP Residual norm 3.156979120208e-07 24 KSP Residual norm 1.208493334087e-07 25 KSP Residual norm 4.628196183850e-08 Linear solve converged due to CONVERGED_RTOL iterations 25 1 SNES Function norm 4.703466676735e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 1) N= 32085, max displ=5.9746061e+01, disp diff= 1.46e-01, error=2.291e-01, rate=0.71 [0] 2) N= 275373, max displ=5.9965999e+01, disp diff= 2.20e-01, error=9.209e-03, rate=4.6 [0] 3) N= 2280285, max displ=5.9969946e+01, disp diff= 3.95e-03, error=5.262e-03, rate=0.81 ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./ex56 on a arch-summit-opt64-pgi-cuda named e33n06 with 24 processors, by adams Wed Aug 14 10:42:53 2019 Using Petsc Development GIT revision: v3.11.3-1683-gb35a45d GIT Date: 2019-08-12 14:17:22 -0400 Max Max/Min Avg Total Time (sec): 2.832e+02 1.000 2.832e+02 Objects: 5.968e+03 1.017 5.882e+03 Flop: 1.592e+10 1.232 1.500e+10 3.599e+11 Flop/sec: 5.622e+07 1.232 5.295e+07 1.271e+09 MPI Messages: 2.165e+04 3.679 1.469e+04 3.525e+05 MPI Message Lengths: 5.626e+08 2.194 2.913e+04 1.027e+10 MPI Reductions: 2.605e+03 1.005 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 3.7186e-01 0.1% 0.0000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% 6.000e+00 0.2% 1: Mesh Setup: 5.2956e+01 18.7% 1.4596e+11 40.6% 1.604e+05 45.5% 5.239e+04 81.8% 1.976e+03 76.2% 2: Solve 0: 5.3952e-01 0.2% 1.8245e+08 0.1% 1.346e+04 3.8% 1.034e+03 0.1% 1.020e+02 3.9% 3: Solve 1: 3.0515e+00 1.1% 2.2360e+09 0.6% 3.185e+04 9.0% 2.483e+03 0.8% 1.540e+02 5.9% 4: Solve 2: 2.4128e+01 8.5% 2.0999e+10 5.8% 4.514e+04 12.8% 7.481e+03 3.3% 1.570e+02 6.1% 5: Solve 3: 2.0216e+02 71.4% 1.9055e+11 52.9% 1.016e+05 28.8% 1.411e+04 14.0% 1.970e+02 7.6% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage VecNorm 4 1.0 2.1675e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 1 0 0 0 67 0 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 1: Mesh Setup PetscBarrier 6 1.0 1.4121e-02 1.1 0.00e+00 0.0 1.7e+03 2.1e+01 2.4e+01 0 0 0 0 1 0 0 1 0 1 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSided 137 1.0 1.3085e-01 8.1 0.00e+00 0.0 7.4e+03 8.0e+00 0.0e+00 0 0 2 0 0 0 0 5 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 334 1.0 7.3053e+0022.0 0.00e+00 0.0 4.4e+03 3.4e+05 0.0e+00 1 0 1 15 0 5 0 3 18 0 0 0 0 0.00e+00 0 0.00e+00 0 DMCreateMat 4 1.0 5.3253e+00 1.0 0.00e+00 0.0 5.6e+03 5.6e+05 5.2e+01 2 0 2 31 2 10 0 3 37 3 0 0 8 2.38e+02 0 0.00e+00 0 Mesh Partition 1 1.0 3.2000e-03 1.0 0.00e+00 0.0 1.4e+02 1.1e+03 8.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 Mesh Migration 1 1.0 2.2223e-03 1.0 0.00e+00 0.0 7.5e+02 7.9e+02 2.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartSelf 1 1.0 8.2681e-04104.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblInv 1 1.0 1.4361e-03 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblSF 1 1.0 4.3473e-04 1.3 0.00e+00 0.0 5.8e+01 8.7e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartStrtSF 1 1.0 6.9792e-04 1.1 0.00e+00 0.0 2.3e+01 1.1e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPointSF 1 1.0 1.4738e-04 2.0 0.00e+00 0.0 4.6e+01 2.2e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 32 1.0 2.4052e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 2 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistribute 1 1.0 5.5402e-03 1.0 0.00e+00 0.0 9.3e+02 9.0e+02 3.2e+01 0 0 0 0 1 0 0 1 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistCones 1 1.0 3.7457e-04 1.1 0.00e+00 0.0 1.5e+02 1.9e+03 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistLabels 1 1.0 1.0656e-03 1.0 0.00e+00 0.0 3.8e+02 4.7e+02 2.1e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistField 1 1.0 4.6499e-04 1.1 0.00e+00 0.0 1.7e+02 5.3e+02 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 58 1.0 2.1764e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 5.8e+01 0 0 0 0 2 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 58 1.0 1.9564e-04 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPrealloc 4 1.0 4.1812e+00 1.0 0.00e+00 0.0 5.6e+03 5.6e+05 4.4e+01 1 0 2 31 2 8 0 3 37 2 0 0 8 2.38e+02 0 0.00e+00 0 SFSetGraph 153 1.0 3.3804e-03 9.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 137 1.0 1.5430e-01 1.2 0.00e+00 0.0 3.7e+04 4.3e+04 0.0e+00 0 0 11 16 0 0 0 23 19 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 528 1.0 1.1360e-02 2.3 0.00e+00 0.0 7.9e+04 5.9e+03 0.0e+00 0 0 22 5 0 0 0 49 6 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 528 1.0 5.2982e-02 3.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 37 1.0 1.0650e-0235.6 0.00e+00 0.0 1.9e+03 5.6e+05 0.0e+00 0 0 1 10 0 0 0 1 12 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 29 1.0 1.1826e-01 7.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpBegin 8 1.0 1.8731e-03110.0 0.00e+00 0.0 4.1e+02 6.4e+05 0.0e+00 0 0 0 3 0 0 0 0 3 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpEnd 8 1.0 3.6747e-02 2.9 0.00e+00 0.0 4.1e+02 6.4e+05 0.0e+00 0 0 0 3 0 0 0 0 3 0 0 0 0 0.00e+00 0 0.00e+00 0 SFDistSection 13 1.0 2.4007e-03 1.9 0.00e+00 0.0 1.6e+03 2.7e+03 1.3e+01 0 0 0 0 1 0 0 1 0 1 0 0 0 0.00e+00 0 0.00e+00 0 SFSectionSF 21 1.0 4.9387e-02 1.1 0.00e+00 0.0 2.3e+03 2.2e+05 0.0e+00 0 0 1 5 0 0 0 1 6 0 0 0 0 0.00e+00 0 0.00e+00 0 SFRemoteOff 8 1.0 4.0997e-0214.5 0.00e+00 0.0 8.2e+02 6.5e+03 0.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 80 1.0 3.0633e-02 1.2 4.96e+08 1.2 1.3e+04 5.9e+03 0.0e+00 0 3 4 1 0 0 8 8 1 0 367469 1664216 60 3.17e+00 68 9.08e+00 99 MatConvert 70 1.0 7.2743e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatScale 24 1.0 2.0818e-02 1.2 1.67e+07 1.2 1.3e+03 1.7e+03 0.0e+00 0 0 0 0 0 0 0 1 0 0 18323 0 0 0.00e+00 8 9.61e-02 0 MatAssemblyBegin 251 1.0 7.3934e+0012.7 0.00e+00 0.0 4.4e+03 3.4e+05 0.0e+00 1 0 1 15 0 5 0 3 18 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 251 1.0 2.8177e+00 1.1 2.90e+06 2.5 2.7e+04 1.3e+03 2.8e+02 1 0 8 0 11 5 0 17 0 14 18 0 200 6.81e+02 0 0.00e+00 0 MatCreateSubMat 12 1.0 3.0119e-01 1.0 0.00e+00 0.0 5.1e+03 2.6e+04 1.4e+02 0 0 1 1 6 1 0 3 2 7 0 0 36 1.52e+01 0 0.00e+00 0 MatPartitioning 6 1.0 1.0283e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 1.9e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatCoarsen 8 1.0 9.3068e-03 1.0 0.00e+00 0.0 1.6e+04 2.0e+03 5.9e+01 0 0 5 0 2 0 0 10 0 3 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 16 1.0 1.0048e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAXPY 8 1.0 3.8584e-01 1.4 6.92e+05 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 42 0 16 6.97e+01 0 0.00e+00 0 MatTranspose 16 1.0 6.2782e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMatMult 8 1.0 1.4108e+00 1.0 2.98e+08 1.2 1.4e+04 2.2e+04 6.4e+01 0 2 4 3 2 3 5 9 4 3 4787 0 16 6.97e+01 0 0.00e+00 0 MatMatMultSym 8 1.0 1.0357e+00 1.0 0.00e+00 0.0 1.1e+04 1.9e+04 6.4e+01 0 0 3 2 2 2 0 7 2 3 0 0 16 6.97e+01 0 0.00e+00 0 MatMatMultNum 8 1.0 3.7492e-01 1.0 2.98e+08 1.2 2.7e+03 3.6e+04 0.0e+00 0 2 1 1 0 1 5 2 1 0 18014 0 0 0.00e+00 0 0.00e+00 0 MatPtAP 8 1.0 3.5884e+01 1.0 5.63e+09 1.4 2.2e+04 1.9e+05 8.8e+01 13 34 6 40 3 68 84 14 48 4 3422 0 32 1.11e+02 0 0.00e+00 0 MatPtAPSymbolic 8 1.0 1.6015e+01 1.0 0.00e+00 0.0 1.5e+04 1.9e+05 5.6e+01 6 0 4 28 2 30 0 9 34 3 0 0 0 0.00e+00 0 0.00e+00 0 MatPtAPNumeric 8 1.0 1.9884e+01 1.0 5.63e+09 1.4 6.6e+03 1.8e+05 3.2e+01 7 34 2 12 1 38 84 4 14 2 6176 0 32 1.11e+02 0 0.00e+00 0 MatTrnMatMult 8 1.0 1.3137e+00 1.0 4.80e+07 1.2 1.2e+04 4.2e+04 8.9e+01 0 0 3 5 3 2 1 7 6 5 834 0 32 1.28e+02 0 0.00e+00 0 MatTrnMatMultSym 8 1.0 5.3530e-01 1.0 0.00e+00 0.0 6.9e+03 3.0e+04 5.7e+01 0 0 2 2 2 1 0 4 2 3 0 0 0 0.00e+00 0 0.00e+00 0 MatTrnMatMultNum 8 1.0 7.7842e-01 1.0 4.80e+07 1.2 5.1e+03 5.9e+04 3.2e+01 0 0 1 3 1 1 1 3 4 2 1407 0 32 1.28e+02 0 0.00e+00 0 MatGetLocalMat 32 1.0 4.8166e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetBrAoCol 24 1.0 1.5861e-01 2.6 0.00e+00 0.0 1.9e+04 1.3e+05 0.0e+00 0 0 5 23 0 0 0 12 28 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 200 1.0 1.9996e+00 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 4 0 0 0 0 0 0 200 6.81e+02 0 0.00e+00 0 VecMDot 12 1.0 7.3372e-04 1.0 2.65e+06 1.1 0.0e+00 0.0e+00 1.2e+01 0 0 0 0 0 0 0 0 0 1 84757 0 0 0.00e+00 0 0.00e+00 0 VecTDot 168 1.0 2.5115e-02 1.9 4.84e+06 1.1 0.0e+00 0.0e+00 1.7e+02 0 0 0 0 6 0 0 0 0 9 4522 12286 0 0.00e+00 0 0.00e+00 100 VecNorm 24 1.0 2.2758e-0219.3 1.32e+06 1.1 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 1366 0 0 0.00e+00 0 0.00e+00 0 VecScale 24 1.0 3.2366e-04 1.3 6.62e+05 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 48036 0 0 0.00e+00 0 0.00e+00 0 VecCopy 16 1.0 6.4093e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 6 9.00e-01 0 VecSet 580 1.0 1.5209e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 160 1.0 4.1682e-03 1.1 4.61e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 25949 26371 0 0.00e+00 0 0.00e+00 100 VecAYPX 72 1.0 5.4142e-03 1.6 2.08e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 8990 9032 0 0.00e+00 0 0.00e+00 100 VecMAXPY 12 1.0 8.9961e-04 1.2 2.65e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 69129 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyBegin 262 1.0 1.2747e-02 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 262 1.0 4.6461e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 24 0.00e+00 0 VecPointwiseMult 88 1.0 2.4743e-03 1.1 1.27e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 12021 14528 12 1.80e+00 0 0.00e+00 100 VecScatterBegin 358 1.0 1.9946e-02 1.5 0.00e+00 0.0 6.2e+04 2.8e+03 0.0e+00 0 0 18 2 0 0 0 39 2 0 0 0 0 0.00e+00 116 9.85e+00 0 VecScatterEnd 358 1.0 1.1129e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSetRandom 8 1.0 5.6732e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 6 9.00e-01 0 VecNormalize 24 1.0 2.3060e-0215.8 1.99e+06 1.1 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 2023 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 72 1.0 1.9346e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 72 4.96e+00 0 0.00e+00 0 VecCUDACopyFrom 316 1.0 8.9004e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 316 9.19e+00 0 VecCopyFromSome 60 1.0 1.1883e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 60 8.75e+00 0 KSPSetUp 24 1.0 4.9758e-01 9.0 0.00e+00 0.0 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 PCGAMGGraph_AGG 8 1.0 2.6339e+00 1.0 2.72e+07 1.2 7.6e+03 1.3e+03 1.3e+02 1 0 2 0 5 5 0 5 0 6 235 0 32 3.88e+01 8 9.61e-02 0 PCGAMGCoarse_AGG 8 1.0 1.3641e+00 1.0 4.80e+07 1.2 3.5e+04 1.6e+04 1.8e+02 0 0 10 5 7 3 1 22 7 9 803 0 32 1.28e+02 56 1.26e+00 0 PCGAMGProl_AGG 8 1.0 2.0869e-01 1.0 0.00e+00 0.0 4.3e+04 2.4e+03 5.1e+02 0 0 12 1 20 0 0 27 1 26 0 0 16 9.46e+00 224 5.70e+00 0 PCGAMGPOpt_AGG 8 1.0 2.0125e+00 1.1 8.19e+08 1.2 2.7e+04 1.4e+04 3.0e+02 1 5 8 4 11 4 13 17 5 15 9241 418076 104 1.44e+02 80 1.09e+01 62 GAMG: createProl 8 1.0 6.2926e+00 1.0 8.94e+08 1.2 1.1e+05 9.4e+03 1.1e+03 2 6 32 10 43 12 14 70 13 56 3228 314615 184 3.21e+02 368 1.79e+01 57 Graph 16 1.0 2.6040e+00 1.0 2.72e+07 1.2 7.6e+03 1.3e+03 1.3e+02 1 0 2 0 5 5 0 5 0 6 237 0 32 3.88e+01 8 9.61e-02 0 MIS/Agg 8 1.0 9.3985e-03 1.0 0.00e+00 0.0 1.6e+04 2.0e+03 5.9e+01 0 0 5 0 2 0 0 10 0 3 0 0 0 0.00e+00 0 0.00e+00 0 SA: col data 8 1.0 6.6305e-02 1.0 0.00e+00 0.0 4.1e+04 1.9e+03 4.5e+02 0 0 12 1 17 0 0 25 1 23 0 0 0 0.00e+00 224 5.70e+00 0 SA: frmProl0 8 1.0 1.3006e-01 1.0 0.00e+00 0.0 2.6e+03 1.1e+04 3.2e+01 0 0 1 0 1 0 0 2 0 2 0 0 16 9.46e+00 0 0.00e+00 0 SA: smooth 8 1.0 1.8604e+00 1.1 3.10e+08 1.2 1.4e+04 2.2e+04 8.0e+01 1 2 4 3 3 3 5 9 4 4 3785 0 32 1.39e+02 0 0.00e+00 0 GAMG: partLevel 8 1.0 3.6351e+01 1.0 5.63e+09 1.4 3.3e+04 1.3e+05 4.5e+02 13 34 9 41 17 69 84 21 50 23 3378 0 80 1.27e+02 0 0.00e+00 0 repartition 6 1.0 1.4243e-01 1.1 2.09e+05 2.5 4.1e+03 4.4e+01 1.3e+02 0 0 1 0 5 0 0 3 0 7 28 0 12 5.78e-02 0 0.00e+00 0 Invert-Sort 6 1.0 6.7439e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 Move A 6 1.0 1.5720e-01 1.1 0.00e+00 0.0 3.9e+03 3.3e+04 7.8e+01 0 0 1 1 3 0 0 2 2 4 0 0 18 4.07e+00 0 0.00e+00 0 Move P 6 1.0 1.7893e-01 1.1 0.00e+00 0.0 1.1e+03 4.2e+02 7.8e+01 0 0 0 0 3 0 0 1 0 4 0 0 18 1.11e+01 0 0.00e+00 0 PCSetUp 4 1.0 4.2603e+01 1.0 6.52e+09 1.4 1.5e+05 3.6e+04 1.6e+03 15 40 41 51 62 80 98 91 63 82 3359 300479 264 4.47e+02 376 1.79e+01 8 --- Event Stage 2: Solve 0 BuildTwoSided 1 1.0 1.0227e-04 3.8 0.00e+00 0.0 2.6e+01 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 6.7159e-021653.8 0.00e+00 0.0 7.6e+01 8.5e+04 0.0e+00 0 0 0 0 0 12 0 1 47 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 2.5153e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 5 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.0517e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 7 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 8.1150e-06 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 4.8204e-02 1.0 1.60e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 9 21 0 0 0 799 0 0 0.00e+00 2 6.48e-03 0 DMPlexJacobianFE 1 1.0 4.3192e-01 1.0 1.62e+06 1.0 7.6e+01 8.5e+04 0.0e+00 0 0 0 0 0 80 21 1 47 0 89 0 2 2.25e-01 0 0.00e+00 0 SFSetGraph 1 1.0 9.8200e-07 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.1869e-04 2.6 0.00e+00 0.0 1.3e+02 3.2e+02 0.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 114 1.0 8.7538e-04 3.2 0.00e+00 0.0 1.3e+04 5.6e+02 0.0e+00 0 0 4 0 0 0 0 95 51 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 114 1.0 1.1394e-02 9.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 19 1.0 6.0600e-05 1.8 0.00e+00 0.0 4.9e+02 5.6e+02 0.0e+00 0 0 0 0 0 0 0 4 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 19 1.0 2.0148e-0386.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 94 1.0 1.1914e-02 1.4 4.98e+06 7.1 1.2e+04 5.6e+02 0.0e+00 0 0 3 0 0 2 46 91 49 0 7006 14768 111 3.03e-01 77 8.75e-02 100 MatMultAdd 17 1.0 9.3791e-03 8.9 2.69e+05 9.1 3.9e+02 6.0e+02 0.0e+00 0 0 0 0 0 2 2 3 2 0 443 0 0 0.00e+00 17 1.96e-02 0 MatMultTranspose 17 1.0 2.6854e-03 2.3 2.69e+05 9.1 3.9e+02 6.0e+02 0.0e+00 0 0 0 0 0 0 2 3 2 0 1546 0 0 0.00e+00 34 2.94e-02 0 MatSolve 17 0.0 4.0931e-04 0.0 1.64e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 3995 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 3.6224e-03325.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 3.6326e-034736.1 6.89e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 4 0 0 0 1898 0 0 0.00e+00 0 0.00e+00 0 MatResidual 17 1.0 2.8723e-03 1.3 9.07e+05 7.0 2.2e+03 5.6e+02 0.0e+00 0 0 1 0 0 0 8 16 9 0 5297 9985 17 5.12e-02 17 1.93e-02 100 MatAssemblyBegin 1 1.0 6.7459e-0246.9 0.00e+00 0.0 7.6e+01 8.5e+04 0.0e+00 0 0 0 0 0 12 0 1 47 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 2.5166e-03 2.5 1.43e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 88 0 2 2.25e-01 0 0.00e+00 0 MatGetRowIJ 1 0.0 2.2550e-04 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 3.5906e-04 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 1.0460e-05 7.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.0816e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 2.25e-01 0 0.00e+00 0 VecTDot 53 1.0 6.4725e-03 1.2 1.78e+04 2.7 0.0e+00 0.0e+00 5.3e+01 0 0 0 0 2 1 0 0 0 52 57 75 0 0.00e+00 0 0.00e+00 100 VecNorm 30 1.0 4.4381e-03 1.4 1.00e+04 2.7 0.0e+00 0.0e+00 3.0e+01 0 0 0 0 1 1 0 0 0 29 47 75 0 0.00e+00 0 0.00e+00 100 VecCopy 55 1.0 1.3658e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.15e-03 0 VecSet 125 1.0 1.1247e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 55 1.0 1.9267e-03 1.1 1.85e+04 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 198 203 2 2.31e-03 0 0.00e+00 100 VecAYPX 126 1.0 5.7871e-03 1.2 4.23e+04 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 151 152 0 0.00e+00 0 0.00e+00 100 VecAXPBYCZ 34 1.0 2.1958e-03 1.1 5.71e+04 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 537 601 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 79 1.0 2.5440e-03 1.1 1.33e+04 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 108 111 3 3.47e-03 0 0.00e+00 100 VecScatterBegin 128 1.0 2.9660e-03 1.3 0.00e+00 0.0 1.3e+04 5.6e+02 0.0e+00 0 0 4 0 0 0 0 97 52 0 0 0 0 0.00e+00 77 8.75e-02 0 VecScatterEnd 128 1.0 1.1447e-02 3.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 116 1.0 2.8729e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 116 3.08e-01 0 0.00e+00 0 VecCUDACopyFrom 61 1.0 1.4744e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 61 7.10e-02 0 VecCopyFromSome 77 1.0 2.0084e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 77 8.75e-02 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 6.3279e-01 1.0 1.49e+07 2.8 2.8e+04 1.6e+03 3.1e+02 0 0 8 0 12 117144207320306 414 3000 156 1.19e+00 180 1.93e-01 37 SNESSetUp 1 1.0 6.5589e-05 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 5.2185e-02 1.0 1.67e+06 1.0 3.3e+02 3.7e+02 1.7e+01 0 0 0 0 1 10 22 2 1 17 760 0 0 0.00e+00 8 1.76e-02 0 SNESJacobianEval 1 1.0 4.3316e-01 1.0 1.64e+06 1.0 1.3e+02 5.1e+04 0.0e+00 0 0 0 0 0 80 21 1 47 0 90 0 2 2.25e-01 1 3.24e-03 0 KSPSetUp 2 1.0 1.0412e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 5.4191e-02 1.0 9.35e+06 7.3 1.3e+04 5.6e+02 8.3e+01 0 0 4 0 3 10 57 97 52 81 1911 3494 114 3.06e-01 129 1.38e-01 84 PCSetUp 1 1.0 7.6414e-03169.2 6.89e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 4 0 0 0 902 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 17 1.0 7.6468e-03150.8 6.89e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 4 0 0 0 902 0 0 0.00e+00 0 0.00e+00 0 PCApply 17 1.0 4.5053e-02 1.0 9.22e+06 8.5 1.1e+04 5.6e+02 3.4e+01 0 0 3 0 1 8 49 81 44 33 1968 4007 98 2.58e-01 113 1.19e-01 81 --- Event Stage 3: Solve 1 BuildTwoSided 1 1.0 1.0815e-04 4.0 0.00e+00 0.0 2.6e+01 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 3.0096e-021150.5 0.00e+00 0.0 7.6e+01 4.2e+05 0.0e+00 0 0 0 0 0 1 0 0 41 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 2.5656e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.2434e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 5 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 8.6360e-06 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 2.2152e-02 1.0 1.28e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 14 0 0 0 13908 0 0 0.00e+00 2 3.67e-02 0 DMPlexJacobianFE 1 1.0 2.9462e+00 1.0 1.30e+07 1.0 7.6e+01 4.2e+05 0.0e+00 1 0 0 0 0 96 14 0 41 0 106 0 2 2.59e+00 0 0.00e+00 0 SFSetGraph 1 1.0 3.6970e-06 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.5334e-04 1.9 0.00e+00 0.0 1.3e+02 1.3e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 275 1.0 2.6442e-03 4.8 0.00e+00 0.0 2.9e+04 1.6e+03 0.0e+00 0 0 8 0 0 0 0 90 57 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 275 1.0 1.6682e-02 4.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 48 1.0 2.8785e-04 2.3 0.00e+00 0.0 3.0e+03 5.3e+02 0.0e+00 0 0 1 0 0 0 0 10 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 48 1.0 3.6404e-03105.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 226 1.0 2.7575e-02 1.6 8.02e+07 1.9 2.6e+04 1.7e+03 0.0e+00 0 0 7 0 0 1 64 80 55 0 51914 156736 147 1.72e+00 101 1.05e+00 89 MatMultAdd 46 1.0 1.4379e-02 6.3 3.48e+06 1.8 2.9e+03 4.9e+02 0.0e+00 0 0 1 0 0 0 3 9 2 0 4686 0 0 0.00e+00 23 2.46e-01 0 MatMultTranspose 46 1.0 6.7622e-03 2.1 3.48e+06 1.8 2.9e+03 4.9e+02 0.0e+00 0 0 1 0 0 0 3 9 2 0 9964 0 0 0.00e+00 69 3.06e-01 0 MatSolve 23 0.0 2.0415e-04 0.0 5.34e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2616 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.3425e-0434.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 5.8400e-04928.5 8.34e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1428 0 0 0.00e+00 0 0.00e+00 0 MatResidual 46 1.0 6.2501e-03 1.6 1.56e+07 1.9 5.1e+03 1.6e+03 0.0e+00 0 0 1 0 0 0 12 16 11 0 43753 101675 23 2.74e-01 23 2.40e-01 87 MatAssemblyBegin 1 1.0 3.0755e-02 4.4 0.00e+00 0.0 7.6e+01 4.2e+05 0.0e+00 0 0 0 0 0 1 0 0 41 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 1.3383e-02 4.6 6.98e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 92 0 2 2.59e+00 0 0.00e+00 0 MatGetRowIJ 1 0.0 5.8623e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 1.0423e-04 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.3640e-04 4.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 9.0439e-03 6.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 2.59e+00 0 0.00e+00 0 VecTDot 86 1.0 8.0406e-03 1.2 1.94e+05 1.5 0.0e+00 0.0e+00 8.6e+01 0 0 0 0 3 0 0 0 0 56 527 759 0 0.00e+00 0 0.00e+00 98 VecNorm 47 1.0 6.2960e-03 1.3 1.07e+05 1.5 0.0e+00 0.0e+00 4.7e+01 0 0 0 0 2 0 0 0 0 31 373 662 0 0.00e+00 0 0.00e+00 98 VecCopy 144 1.0 1.7601e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.07e-02 0 VecSet 235 1.0 1.8372e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 87 1.0 2.2884e-03 1.1 1.99e+05 1.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1908 1927 2 2.14e-02 0 0.00e+00 98 VecAYPX 315 1.0 6.8395e-03 1.1 5.15e+05 1.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1626 1604 0 0.00e+00 0 0.00e+00 97 VecAXPBYCZ 92 1.0 3.0987e-03 1.1 6.98e+05 1.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 4888 5355 0 0.00e+00 0 0.00e+00 97 VecPointwiseMult 206 1.0 3.2689e-03 1.1 1.64e+05 1.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1064 1041 3 3.21e-02 0 0.00e+00 95 VecScatterBegin 318 1.0 6.6176e-03 1.5 0.00e+00 0.0 3.1e+04 1.5e+03 0.0e+00 0 0 9 0 0 0 0 99 58 0 0 0 0 0.00e+00 101 1.05e+00 0 VecScatterEnd 318 1.0 1.5299e-02 3.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 152 1.0 3.3405e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 152 1.78e+00 0 0.00e+00 0 VecCUDACopyFrom 102 1.0 2.4398e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 102 6.97e-01 0 VecCopyFromSome 101 1.0 3.5917e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 101 1.05e+00 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 3.6433e+00 1.0 1.89e+08 1.8 5.7e+04 5.2e+03 5.9e+02 1 1 16 3 23 119156178371384 960 34849 218 1.19e+01 291 2.01e+00 40 SNESSetUp 1 1.0 7.9511e-05 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 3.0206e-02 1.0 1.32e+07 1.0 3.3e+02 1.5e+03 1.7e+01 0 0 0 0 1 1 14 1 1 11 10383 0 0 0.00e+00 8 1.16e-01 0 SNESJacobianEval 1 1.0 2.9493e+00 1.0 1.31e+07 1.0 1.3e+02 2.5e+05 0.0e+00 1 0 0 0 0 96 14 0 41 0 106 0 2 2.59e+00 1 1.84e-02 0 KSPSetUp 3 1.0 1.0412e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 7.6876e-02 1.0 8.90e+07 1.8 3.1e+04 1.5e+03 1.4e+02 0 0 9 0 5 3 72 99 58 88 20917 38978 150 1.76e+00 194 1.62e+00 81 PCSetUp 1 1.0 9.4723e-0425.0 8.34e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 881 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 23 1.0 9.5397e-0420.7 8.34e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 874 0 0 0.00e+00 0 0.00e+00 0 PCApply 23 1.0 6.3478e-02 1.0 7.75e+07 1.9 2.9e+04 1.4e+03 6.8e+01 0 0 8 0 3 2 61 90 50 44 21646 44848 128 1.49e+00 172 1.39e+00 78 --- Event Stage 4: Solve 2 BuildTwoSided 1 1.0 1.4542e-04 6.9 0.00e+00 0.0 2.6e+01 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 2.2054e-015751.1 0.00e+00 0.0 7.6e+01 1.8e+06 0.0e+00 0 0 0 1 0 1 0 0 42 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 2.8709e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.1349e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 9.3210e-06 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.7627e-01 1.0 1.03e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 1 12 0 0 0 13983 0 0 0.00e+00 2 2.42e-01 0 DMPlexJacobianFE 1 1.0 2.3616e+01 1.0 1.04e+08 1.0 7.6e+01 1.8e+06 0.0e+00 8 1 0 1 0 98 12 0 42 0 106 0 2 2.44e+01 0 0.00e+00 0 SFSetGraph 1 1.0 2.1511e-05 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 3.8847e-04 1.2 0.00e+00 0.0 1.3e+02 5.5e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 286 1.0 5.4541e-03 3.1 0.00e+00 0.0 4.1e+04 4.6e+03 0.0e+00 0 0 12 2 0 0 0 91 56 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 286 1.0 1.1937e-0113.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 50 1.0 3.0131e-04 1.9 0.00e+00 0.0 3.8e+03 1.3e+03 0.0e+00 0 0 1 0 0 0 0 8 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 50 1.0 3.4873e-0292.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 235 1.0 4.6477e-02 1.2 6.49e+08 1.5 3.7e+04 5.0e+03 0.0e+00 0 4 11 2 0 0 68 83 55 0 306073 939987 259 7.83e+00 211 1.18e+01 100 MatMultAdd 48 1.0 1.0349e-0116.4 2.99e+07 1.4 3.7e+03 1.1e+03 0.0e+00 0 0 1 0 0 0 3 8 1 0 6399 251016 24 1.35e-01 72 3.30e-01 93 MatMultTranspose 48 1.0 1.2044e-01 1.0 2.94e+07 1.4 3.7e+03 1.1e+03 0.0e+00 0 0 1 0 0 0 3 8 1 0 5412 190360 2 6.52e+00 96 3.65e-01 93 MatSolve 24 0.0 3.4276e-03 0.0 1.22e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 3551 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 5.1003e-027092.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 3.9745e-0254896.5 7.96e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2002 0 0 0.00e+00 0 0.00e+00 0 MatResidual 48 1.0 1.1007e-02 1.1 1.25e+08 1.5 7.8e+03 4.7e+03 0.0e+00 0 1 2 0 0 0 13 17 11 0 248060 624165 48 1.51e+00 48 2.24e+00 100 MatAssemblyBegin 1 1.0 2.2790e-01 6.9 0.00e+00 0.0 7.6e+01 1.8e+06 0.0e+00 0 0 0 1 0 1 0 0 42 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 1.3217e-01 9.9 3.05e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 43 0 2 2.44e+01 0 0.00e+00 0 MatGetRowIJ 1 0.0 1.0921e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 1.9634e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 1.8289e-03 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.0384e-01 8.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 2.44e+01 0 0.00e+00 0 VecTDot 88 1.0 1.0539e-02 1.2 1.62e+06 1.2 0.0e+00 0.0e+00 8.8e+01 0 0 0 0 3 0 0 0 0 56 3550 5130 0 0.00e+00 0 0.00e+00 100 VecNorm 48 1.0 1.5053e-02 2.3 8.95e+05 1.2 0.0e+00 0.0e+00 4.8e+01 0 0 0 0 2 0 0 0 0 31 1372 4484 0 0.00e+00 0 0.00e+00 100 VecCopy 150 1.0 3.8317e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 26 1.94e-01 0 VecSet 196 1.0 2.0668e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 89 1.0 2.9872e-03 1.1 1.67e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 12885 13262 2 1.84e-01 0 0.00e+00 100 VecAYPX 328 1.0 1.4720e-02 1.2 4.36e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 6802 7362 24 9.80e-02 0 0.00e+00 100 VecAXPBYCZ 96 1.0 6.2887e-03 1.0 6.01e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 21953 24545 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 214 1.0 7.1863e-03 1.1 1.34e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 4282 4626 30 3.86e-01 0 0.00e+00 100 VecScatterBegin 331 1.0 2.4464e-02 1.2 0.00e+00 0.0 4.5e+04 4.3e+03 0.0e+00 0 0 13 2 0 0 0 99 57 0 0 0 0 0.00e+00 307 1.23e+01 0 VecScatterEnd 331 1.0 1.3995e-01 5.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 339 1.0 7.9258e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 339 8.64e+00 0 0.00e+00 0 VecCUDACopyFrom 155 1.0 3.7902e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 155 1.63e+00 0 VecCopyFromSome 259 1.0 1.7848e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 259 1.21e+01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.8428e+01 1.0 1.58e+09 1.3 8.2e+04 1.5e+04 5.3e+02 10 10 23 12 21 118165182372340 1219 233642 411 8.63e+01 514 1.57e+01 49 SNESSetUp 1 1.0 8.2114e-05 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 2.0296e-01 1.0 1.04e+08 1.0 3.3e+02 6.3e+03 1.7e+01 0 1 0 0 1 1 12 1 1 11 12264 0 0 0.00e+00 8 8.52e-01 0 SNESJacobianEval 1 1.0 2.3625e+01 1.0 1.05e+08 1.0 1.3e+02 1.1e+06 0.0e+00 8 1 0 1 0 98 12 0 42 0 106 0 2 2.44e+01 1 1.21e-01 0 KSPSetUp 3 1.0 1.0689e-03 4.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 3.2131e-01 1.0 7.23e+08 1.3 4.5e+04 4.3e+03 1.4e+02 0 4 13 2 5 1 76 99 57 88 49777 257674 339 1.50e+01 405 1.27e+01 99 PCSetUp 1 1.0 9.2741e-022259.6 7.96e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 858 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 24 1.0 9.2749e-021823.7 7.96e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 858 0 0 0.00e+00 0 0.00e+00 0 PCApply 24 1.0 3.0488e-01 1.0 6.19e+08 1.3 4.2e+04 4.0e+03 6.8e+01 0 4 12 2 3 1 65 92 50 43 44907 263683 316 1.39e+01 382 1.07e+01 99 --- Event Stage 5: Solve 3 BuildTwoSided 1 1.0 1.1118e-0345.6 0.00e+00 0.0 2.6e+01 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 1.3297e+013591.7 0.00e+00 0.0 7.6e+01 7.7e+06 0.0e+00 4 0 0 6 0 6 0 0 41 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 2.9982e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.2139e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 9.2110e-06 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.3934e+00 1.0 8.22e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 5 0 0 0 1 10 0 0 0 14151 0 0 0.00e+00 2 1.75e+00 0 DMPlexJacobianFE 1 1.0 2.0002e+02 1.0 8.37e+08 1.0 7.6e+01 7.7e+06 0.0e+00 71 6 0 6 0 99 11 0 41 0 100 0 2 2.11e+02 0 0.00e+00 0 SFSetGraph 1 1.0 1.6895e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 2.8059e-03 1.1 0.00e+00 0.0 1.3e+02 2.2e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 448 1.0 1.7747e-02 5.2 0.00e+00 0.0 9.1e+04 9.1e+03 0.0e+00 0 0 26 8 0 0 0 89 57 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 448 1.0 1.5127e-01 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 80 1.0 1.1522e-03 1.5 0.00e+00 0.0 1.1e+04 1.8e+03 0.0e+00 0 0 3 0 0 0 0 11 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 80 1.0 4.1404e-02 6.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 367 1.0 2.4492e-01 1.1 5.90e+09 1.2 8.0e+04 1.0e+04 0.0e+00 0 37 23 8 0 0 71 79 56 0 550936 4478083 279 3.26e+01 227 1.05e+02 99 MatMultAdd 78 1.0 5.3268e-02 2.1 2.72e+08 1.2 1.1e+04 1.5e+03 0.0e+00 0 2 3 0 0 0 3 10 1 0 117398 534053 26 5.44e-01 78 2.20e+00 93 MatMultTranspose 78 1.0 2.4719e-01 1.1 2.68e+08 1.2 1.1e+04 1.5e+03 0.0e+00 0 2 3 0 0 0 3 10 1 0 24982 610388 2 5.67e+01 130 2.34e+00 93 MatSolve 26 0.0 3.8133e-04 0.0 5.38e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1412 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 1.7641e-0424.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 4.7447e-04710.3 7.02e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1480 0 0 0.00e+00 0 0.00e+00 0 MatResidual 78 1.0 4.9754e-02 1.3 1.14e+09 1.2 1.7e+04 9.0e+03 0.0e+00 0 7 5 2 0 0 14 17 11 0 524929 3689879 52 6.20e+00 52 2.00e+01 99 MatAssemblyBegin 1 1.0 1.3400e+0183.9 0.00e+00 0.0 7.6e+01 7.7e+06 0.0e+00 4 0 0 6 0 6 0 0 41 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 4.0198e-01 4.5 1.27e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 60 0 2 2.11e+02 0 0.00e+00 0 MatGetRowIJ 1 0.0 5.1617e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 9.7596e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 1.3412e-02 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 2.8230e-01 3.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 2.11e+02 0 0.00e+00 0 VecTDot 113 1.0 1.6546e-02 1.7 1.39e+07 1.1 0.0e+00 0.0e+00 1.1e+02 0 0 0 0 4 0 0 0 0 57 19821 40347 0 0.00e+00 0 0.00e+00 100 VecNorm 61 1.0 4.5256e-02 3.7 7.64e+06 1.1 0.0e+00 0.0e+00 6.1e+01 0 0 0 0 2 0 0 0 0 31 3978 36122 0 0.00e+00 0 0.00e+00 100 VecCopy 242 1.0 9.8720e-03 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 28 1.62e+00 0 VecSet 293 1.0 2.9344e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 113 1.0 3.3676e-03 1.1 1.43e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 100033 107742 2 1.52e+00 0 0.00e+00 100 VecAYPX 519 1.0 3.1594e-02 1.9 3.80e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 28304 29788 26 8.29e-01 0 0.00e+00 100 VecAXPBYCZ 156 1.0 1.2699e-02 1.8 5.26e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 97354 103448 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 345 1.0 1.0739e-02 1.4 1.16e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 25477 27901 32 3.20e+00 0 0.00e+00 100 VecScatterBegin 523 1.0 1.3874e-01 1.3 0.00e+00 0.0 1.0e+05 8.2e+03 0.0e+00 0 0 29 8 0 0 0100 58 0 0 0 0 0.00e+00 331 1.08e+02 0 VecScatterEnd 523 1.0 1.2734e-01 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 365 1.0 1.1011e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 365 3.87e+01 0 0.00e+00 0 VecCUDACopyFrom 193 1.0 6.4025e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 193 1.22e+01 0 VecCopyFromSome 279 1.0 1.2016e-01 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 279 1.07e+02 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.3986e+02 1.0 1.40e+10 1.2 1.7e+05 3.2e+04 8.0e+02 85 89 49 54 31 119167169385404 1329 1280900 463 6.99e+02 618 1.35e+02 50 SNESSetUp 1 1.0 4.2598e-0399.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 1.5056e+00 1.0 8.29e+08 1.0 3.3e+02 2.6e+04 1.7e+01 1 6 0 0 1 1 10 0 1 9 13163 0 0 0.00e+00 8 6.54e+00 0 SNESJacobianEval 1 1.0 2.0006e+02 1.0 8.39e+08 1.0 1.3e+02 4.6e+06 0.0e+00 71 6 0 6 0 99 11 0 41 0 101 0 2 2.11e+02 1 8.75e-01 0 KSPSetUp 4 1.0 1.4128e-02 4.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 6.4183e-01 1.0 6.57e+09 1.2 1.0e+05 8.2e+03 1.8e+02 0 42 29 8 7 0 79100 58 90 234631 1348037 365 9.38e+01 463 1.12e+02 99 PCSetUp 1 1.0 7.7392e-0419.5 7.02e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 908 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 26 1.0 7.8752e-0415.0 7.02e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 892 0 0 0.00e+00 0 0.00e+00 0 PCApply 26 1.0 5.9217e-01 1.0 5.63e+09 1.2 9.8e+04 7.4e+03 1.0e+02 0 36 28 7 4 0 68 96 51 52 217748 1304205 340 8.93e+01 438 9.31e+01 99 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Object 0 680 446080 0. Container 0 56 34944 0. Distributed Mesh 0 114 578416 0. DM Label 0 48 33408 0. GraphPartitioner 0 36 26240 0. Index Set 0 186 277856 0. IS L to G Mapping 0 6 509904 0. Section 0 204 159936 0. Star Forest Graph 0 182 176768 0. Discrete System 0 97 97808 0. Matrix 0 98 440130544 0. Matrix Null Space 0 4 2976 0. Vector 0 220 14947832 0. SNES 0 4 6128 0. DMSNES 0 4 2880 0. Krylov Solver 0 28 60352 0. DMKSP interface 0 4 2816 0. Preconditioner 0 20 23840 0. Linear Space 0 8 5952 0. Dual Space 0 32 26624 0. FE Space 0 8 6976 0. Vec Scatter 0 20 17120 0. Field over DM 0 4 3040 0. Viewer 1 1 896 0. --- Event Stage 1: Mesh Setup Object 704 212 139072 0. Container 60 32 19968 0. Distributed Mesh 208 146 740976 0. DM Label 98 66 45936 0. GraphPartitioner 64 44 32064 0. Index Set 1038 924 1492776 0. IS L to G Mapping 13 7 53640 0. Section 416 292 228928 0. Star Forest Graph 551 441 430400 0. Discrete System 272 219 220752 0. Matrix 402 308 237708408 0. Matrix Partitioning 6 6 4464 0. Matrix Coarsen 8 8 5472 0. Matrix Null Space 4 0 0 0. Vector 670 522 12643800 0. SNES 4 0 0 0. DMSNES 4 0 0 0. Krylov Solver 36 8 15616 0. Preconditioner 28 8 7296 0. Linear Space 8 4 2976 0. Dual Space 32 16 13312 0. FE Space 8 4 3488 0. Vec Scatter 76 56 47936 0. Field over DM 4 4 3040 0. Viewer 1 0 0 0. PetscRandom 16 16 11104 0. --- Event Stage 2: Solve 0 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 54048 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 14 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 3: Solve 1 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 65760 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 18 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 4: Solve 2 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 112224 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 18 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 5: Solve 3 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 297312 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. ======================================================================================================================== Average time to get PetscTime(): 3.89e-08 Average time for MPI_Barrier(): 1.6606e-06 Average time for zero size MPI_Send(): 5.86721e-06 #PETSc Option Table entries: -bmat_view :bmcpu.m:ascii_matlab -cells 4,6,8 -check_pointer_intensity 0 -ex56_dm_mat_type aijcusparse -ex56_dm_refine 3 -ex56_dm_vec_type cuda -gamg_est_ksp_max_it 10 -gamg_est_ksp_type cg -ksp_atol 1.e-71 -ksp_converged_reason -ksp_max_it 100 -ksp_monitor -ksp_norm_type preconditioned -ksp_rtol 1.e-11 -ksp_type cg -log_view -lvec_view :lvcpu.m:ascii_matlab -mat_block_size 3 -matptap_via scalable -max_conv_its 4 -mg_levels_esteig_ksp_max_it 10 -mg_levels_esteig_ksp_type cg -mg_levels_ksp_chebyshev_esteig 0,0.05,0,1.05 -mg_levels_ksp_max_it 2 -mg_levels_ksp_type chebyshev -mg_levels_pc_type jacobi -pc_gamg_agg_nsmooths 1 -pc_gamg_coarse_eq_limit 1000 -pc_gamg_process_eq_limit 150 -pc_gamg_repartition true -pc_gamg_reuse_interpolation true -pc_gamg_square_graph 10 -pc_gamg_threshold 0.05 -pc_gamg_threshold_scale .5 -pc_gamg_type agg -pc_type gamg -petscpartitioner_type simple -petscspace_degree 2 -run_type 1 -snes_converged_reason -snes_max_it 2 -snes_monitor -snes_rtol 1.e-10 -snes_type ksponly -use_mat_nearnullspace true -xvec_view :xvcpu.m:ascii_matlab #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with 64 bit PetscInt Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 8 Configure options: --with-cc=mpicc --with-cxx=mpiCC --with-fc=mpif90 COPTFLAGS="-g -fast" CXXOPTFLAGS="-g -fast" FOPTFLAGS="-g -fast" --with-ssl=0 --with-batch=0 --with-mpiexec="jsrun -g 1" --with-cuda=1 --with-cudac=nvcc CUDAFLAGS="-ccbin pgc++" --download-metis --download-viennacl --download-parmetis --download-fblaslapack --with-x=0 --with-64-bit-indices=1 --with-debugging=0 PETSC_ARCH=arch-summit-opt64-pgi-cuda ----------------------------------------- Libraries compiled on 2019-08-13 01:26:30 on login5 Machine characteristics: Linux-4.14.0-115.8.1.el7a.ppc64le-ppc64le-with-redhat-7.6-Maipo Using PETSc directory: /ccs/home/adams/petsc Using PETSc arch: arch-summit-opt64-pgi-cuda ----------------------------------------- Using C compiler: mpicc -g -fast -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include Using Fortran compiler: mpif90 -g -fast -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include ----------------------------------------- Using include paths: -I/ccs/home/adams/petsc/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/sw/summit/cuda/10.1.168/include ----------------------------------------- Using C linker: mpicc Using Fortran linker: mpif90 Using libraries: -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -lpetsc -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -Wl,-rpath,/sw/summit/cuda/10.1.168/lib64 -L/sw/summit/cuda/10.1.168/lib64 /autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib/pgi.ld -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -L/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -L/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -Wl,-rpath,/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -L/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -lflapack -lfblas -lparmetis -lmetis -lcufft -lcublas -lcudart -lcusparse -lcusolver -lstdc++ -ldl -lpthread -lmpiprofilesupport -lmpi_ibm_usempi -lmpi_ibm_mpifh -lmpi_ibm -lpgf90rtl -lpgf90 -lpgf90_rpm1 -lpgf902 -lpgftnrtl -latomic -lpgkomp -lomp -lomptarget -lpgmath -lpgc -lrt -lmass_simdp9 -lmassvp9 -lmassp9 -lm -lgcc_s -lstdc++ -ldl -----------------------------------------