[0] 2280285 global equations, 760095 vertices [0] 2280285 equations in vector, 760095 vertices 0 SNES Function norm 9.255869095573e-01 0 KSP Residual norm 1.172676128879e+04 1 KSP Residual norm 1.166720128479e+03 2 KSP Residual norm 5.871822091281e+02 3 KSP Residual norm 1.471680150512e+02 4 KSP Residual norm 3.789327452316e+01 5 KSP Residual norm 1.145608826997e+01 6 KSP Residual norm 4.810494659299e+00 7 KSP Residual norm 1.264439955279e+00 8 KSP Residual norm 3.920768345029e-01 9 KSP Residual norm 1.444657725250e-01 10 KSP Residual norm 4.795661666223e-02 11 KSP Residual norm 1.590719976394e-02 12 KSP Residual norm 5.706892721794e-03 13 KSP Residual norm 1.991095056093e-03 14 KSP Residual norm 6.878586091359e-04 15 KSP Residual norm 2.339233898049e-04 16 KSP Residual norm 8.571594939252e-05 17 KSP Residual norm 2.716559135709e-05 18 KSP Residual norm 9.425419152838e-06 19 KSP Residual norm 3.246693439562e-06 20 KSP Residual norm 1.033808368640e-06 21 KSP Residual norm 3.657798110880e-07 22 KSP Residual norm 1.266830922850e-07 23 KSP Residual norm 4.285032231597e-08 Linear solve converged due to CONVERGED_RTOL iterations 23 1 SNES Function norm 4.244486145764e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 18556605 global equations, 6185535 vertices [0] 18556605 equations in vector, 6185535 vertices 0 SNES Function norm 3.273111572912e-01 0 KSP Residual norm 2.880912428329e+04 1 KSP Residual norm 2.845111885158e+03 2 KSP Residual norm 1.851809514247e+03 3 KSP Residual norm 6.340400771768e+02 4 KSP Residual norm 2.529090486446e+02 5 KSP Residual norm 1.153644213110e+02 6 KSP Residual norm 4.007216162888e+01 7 KSP Residual norm 1.613624540334e+01 8 KSP Residual norm 8.509540310412e+00 9 KSP Residual norm 3.062975925634e+00 10 KSP Residual norm 1.106350733012e+00 11 KSP Residual norm 4.683565695870e-01 12 KSP Residual norm 2.518325306237e-01 13 KSP Residual norm 1.085178785604e-01 14 KSP Residual norm 4.081113096483e-02 15 KSP Residual norm 1.639757217591e-02 16 KSP Residual norm 6.735592508555e-03 17 KSP Residual norm 3.081556004191e-03 18 KSP Residual norm 1.296642334893e-03 19 KSP Residual norm 6.314836904317e-04 20 KSP Residual norm 2.461077003629e-04 21 KSP Residual norm 1.299068153150e-04 22 KSP Residual norm 5.523834528479e-05 23 KSP Residual norm 2.417952771490e-05 24 KSP Residual norm 1.059327116177e-05 25 KSP Residual norm 4.602339446687e-06 26 KSP Residual norm 2.096703189513e-06 27 KSP Residual norm 9.530200001377e-07 28 KSP Residual norm 4.260311615283e-07 29 KSP Residual norm 1.722077112819e-07 Linear solve converged due to CONVERGED_RTOL iterations 29 1 SNES Function norm 7.476265896518e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 149720445 global equations, 49906815 vertices [0] 149720445 equations in vector, 49906815 vertices 0 SNES Function norm 1.157278881750e-01 0 KSP Residual norm 6.889890447971e+04 1 KSP Residual norm 7.292706581063e+03 2 KSP Residual norm 5.997794770523e+03 3 KSP Residual norm 2.162930236498e+03 4 KSP Residual norm 6.574233358692e+02 5 KSP Residual norm 2.655039235660e+02 6 KSP Residual norm 1.155003016624e+02 7 KSP Residual norm 3.468325381040e+01 8 KSP Residual norm 1.414439717946e+01 9 KSP Residual norm 6.744496257421e+00 10 KSP Residual norm 2.893237271891e+00 11 KSP Residual norm 1.068262728656e+00 12 KSP Residual norm 4.198915446529e-01 13 KSP Residual norm 1.817684403563e-01 14 KSP Residual norm 7.974138471787e-02 15 KSP Residual norm 3.583884354300e-02 16 KSP Residual norm 1.525222972161e-02 17 KSP Residual norm 6.022665483982e-03 18 KSP Residual norm 2.432265584528e-03 19 KSP Residual norm 1.068614832139e-03 20 KSP Residual norm 4.443498500119e-04 21 KSP Residual norm 1.940200038257e-04 22 KSP Residual norm 8.259756220287e-05 23 KSP Residual norm 3.390246018406e-05 24 KSP Residual norm 1.430010954377e-05 25 KSP Residual norm 6.505757959670e-06 26 KSP Residual norm 2.823316602130e-06 27 KSP Residual norm 1.171657101821e-06 28 KSP Residual norm 5.102697066246e-07 Linear solve converged due to CONVERGED_RTOL iterations 28 1 SNES Function norm 4.277832198480e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 1202854653 global equations, 400951551 vertices [0] 1202854653 equations in vector, 400951551 vertices 0 SNES Function norm 4.091651078489e-02 0 KSP Residual norm 1.745708386329e+05 1 KSP Residual norm 1.631786912486e+04 2 KSP Residual norm 1.510239264949e+04 3 KSP Residual norm 6.490086282112e+03 4 KSP Residual norm 1.848262518419e+03 5 KSP Residual norm 7.288722413691e+02 6 KSP Residual norm 3.313539211598e+02 7 KSP Residual norm 1.234916432224e+02 8 KSP Residual norm 4.675128704967e+01 9 KSP Residual norm 1.820088506703e+01 10 KSP Residual norm 7.743907379606e+00 11 KSP Residual norm 3.287966677624e+00 12 KSP Residual norm 1.368422324636e+00 13 KSP Residual norm 5.220451722393e-01 14 KSP Residual norm 2.240789870680e-01 15 KSP Residual norm 9.382746491560e-02 16 KSP Residual norm 3.533731637163e-02 17 KSP Residual norm 1.453837701582e-02 18 KSP Residual norm 6.367120970912e-03 19 KSP Residual norm 2.744412633379e-03 20 KSP Residual norm 1.095531966418e-03 21 KSP Residual norm 4.901937139736e-04 22 KSP Residual norm 2.151503231548e-04 23 KSP Residual norm 8.843735369999e-05 24 KSP Residual norm 3.811047453494e-05 25 KSP Residual norm 1.670947665264e-05 26 KSP Residual norm 7.263967976175e-06 27 KSP Residual norm 3.106977861995e-06 28 KSP Residual norm 1.368629076969e-06 Linear solve converged due to CONVERGED_RTOL iterations 28 1 SNES Function norm 4.286654225316e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 1) N= 18556605, max displ=5.9974959e+01, disp diff= 5.01e-03, error=2.493e-04, rate=4.4 [0] 2) N= 149720445, max displ=5.9975171e+01, disp diff= 2.12e-04, error=3.740e-05, rate=2.7 [0] 3) N= 1202854653, max displ=5.9975570e+01, disp diff= 4.00e-04, error=-3.623e-04, rate=nan ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./ex56 on a arch-summit-opt64-pgi-cuda named e33n06 with 12288 processors, by adams Wed Aug 14 11:05:44 2019 Using Petsc Development GIT revision: v3.11.3-1683-gb35a45d GIT Date: 2019-08-12 14:17:22 -0400 Max Max/Min Avg Total Time (sec): 6.790e+02 1.000 6.790e+02 Objects: 4.387e+04 6.404 6.923e+03 Flop: 1.850e+10 1.331 1.786e+10 2.195e+14 Flop/sec: 2.725e+07 1.331 2.630e+07 3.232e+11 MPI Messages: 6.429e+05 30.839 1.672e+05 2.054e+09 MPI Message Lengths: 1.489e+09 4.035 5.856e+03 1.203e+13 MPI Reductions: 4.851e+03 1.005 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 8.8433e-01 0.1% 0.0000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% 6.000e+00 0.1% 1: Mesh Setup: 2.6571e+02 39.1% 9.0075e+13 41.0% 9.242e+08 45.0% 1.072e+04 82.4% 3.942e+03 81.5% 2: Solve 0: 1.1339e+00 0.2% 1.8630e+11 0.1% 5.299e+07 2.6% 4.998e+02 0.2% 1.910e+02 4.0% 3: Solve 1: 4.2807e+00 0.6% 1.7841e+12 0.8% 2.332e+08 11.4% 5.725e+02 1.1% 2.090e+02 4.3% 4: Solve 2: 4.6181e+01 6.8% 1.4055e+13 6.4% 1.807e+08 8.8% 2.223e+03 3.3% 2.400e+02 5.0% 5: Solve 3: 3.6081e+02 53.1% 1.1337e+14 51.7% 6.632e+08 32.3% 2.348e+03 12.9% 2.400e+02 5.0% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage VecNorm 4 1.0 3.6448e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 41 0 0 0 67 0 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 1: Mesh Setup PetscBarrier 6 1.0 3.7060e-02 1.1 0.00e+00 0.0 2.4e+06 2.1e+01 2.4e+01 0 0 0 0 0 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSided 203 1.0 1.8772e+00 1.7 0.00e+00 0.0 2.7e+07 8.0e+00 0.0e+00 0 0 1 0 0 1 0 3 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 648 1.0 1.9244e+01 3.6 0.00e+00 0.0 6.1e+06 2.8e+05 0.0e+00 1 0 0 14 0 4 0 1 17 0 0 0 0 0.00e+00 0 0.00e+00 0 DMCreateMat 4 1.0 1.2236e+01 1.0 0.00e+00 0.0 8.6e+06 3.3e+05 5.2e+01 2 0 0 23 1 5 0 1 28 1 0 0 8 2.58e+02 0 0.00e+00 0 Mesh Partition 1 1.0 1.6046e+00 1.6 0.00e+00 0.0 7.4e+04 1.2e+03 8.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 Mesh Migration 1 1.0 8.3762e-01 1.0 0.00e+00 0.0 3.4e+05 1.0e+03 2.4e+01 0 0 0 0 0 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartSelf 1 1.0 4.3906e-014189.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblInv 1 1.0 4.8278e-0111.3 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblSF 1 1.0 3.3282e-01 1.4 0.00e+00 0.0 3.1e+04 9.8e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartStrtSF 1 1.0 9.8042e-0217.1 0.00e+00 0.0 1.2e+04 1.2e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPointSF 1 1.0 5.4765e-02 1.3 0.00e+00 0.0 2.5e+04 2.4e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 32 1.0 5.0619e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistribute 1 1.0 2.4955e+00 1.3 0.00e+00 0.0 4.4e+05 1.1e+03 3.2e+01 0 0 0 0 1 1 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistCones 1 1.0 1.9013e-01 1.1 0.00e+00 0.0 8.0e+04 2.1e+03 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistLabels 1 1.0 2.6206e-01 1.0 0.00e+00 0.0 1.4e+05 6.5e+02 2.1e+01 0 0 0 0 0 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistField 1 1.0 3.2588e-01 1.0 0.00e+00 0.0 9.2e+04 6.2e+02 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 58 1.0 1.3059e+00 7.9 0.00e+00 0.0 0.0e+00 0.0e+00 5.8e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 58 1.0 5.9316e-02771.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPrealloc 4 1.0 6.5074e+00 1.0 0.00e+00 0.0 8.6e+06 3.3e+05 4.4e+01 1 0 0 23 1 2 0 1 28 1 0 0 8 2.58e+02 0 0.00e+00 0 SFSetGraph 219 1.0 6.2808e-0314.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 203 1.0 2.0488e+00 1.4 0.00e+00 0.0 1.4e+08 1.1e+04 0.0e+00 0 0 7 12 0 1 0 15 15 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 1465 1.0 4.2417e-0138.0 0.00e+00 0.0 6.3e+08 8.8e+02 0.0e+00 0 0 30 5 0 0 0 68 6 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 1465 1.0 1.0326e+00 4.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 37 1.0 2.2360e-0246.4 0.00e+00 0.0 2.6e+06 3.6e+05 0.0e+00 0 0 0 8 0 0 0 0 9 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 29 1.0 1.7352e-01 4.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpBegin 8 1.0 5.6553e-03248.2 0.00e+00 0.0 5.8e+05 4.1e+05 0.0e+00 0 0 0 2 0 0 0 0 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpEnd 8 1.0 8.6306e-02 3.8 0.00e+00 0.0 5.8e+05 4.1e+05 0.0e+00 0 0 0 2 0 0 0 0 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFDistSection 13 1.0 3.8166e-01 1.2 0.00e+00 0.0 2.0e+06 1.8e+03 1.3e+01 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSectionSF 21 1.0 5.2666e-01 1.3 0.00e+00 0.0 1.9e+06 2.4e+05 0.0e+00 0 0 0 4 0 0 0 0 5 0 0 0 0 0.00e+00 0 0.00e+00 0 SFRemoteOff 8 1.0 6.4815e-0216.9 0.00e+00 0.0 1.2e+06 4.0e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 140 1.0 3.0170e-0110.7 5.41e+08 1.3 7.4e+07 1.3e+03 0.0e+00 0 3 4 1 0 0 7 8 1 0 21149278 24421309 60 6.37e+00 74 1.01e+01 99 MatConvert 108 1.0 2.0782e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.8e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatScale 42 1.0 2.8867e-02 1.6 1.79e+07 1.3 7.4e+06 3.4e+02 0.0e+00 0 0 0 0 0 0 0 1 0 0 7446896 0 0 0.00e+00 14 2.05e-01 0 MatAssemblyBegin 422 1.0 1.9075e+01 3.5 0.00e+00 0.0 6.1e+06 2.8e+05 0.0e+00 1 0 0 14 0 4 0 1 17 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 422 1.0 1.0865e+01 1.0 2.48e+0716.2 1.1e+08 3.8e+02 5.0e+02 2 0 5 0 10 4 0 12 0 13 5694 0 340 7.25e+02 0 0.00e+00 0 MatCreateSubMat 24 1.0 3.9220e+00 1.0 0.00e+00 0.0 2.4e+07 5.5e+03 2.9e+02 1 0 1 1 6 1 0 3 1 7 0 0 72 2.14e+01 0 0.00e+00 0 MatPartitioning 12 1.0 1.6526e+02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 3.3e+01 24 0 0 0 1 62 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatCoarsen 14 1.0 1.6133e-01 1.0 0.00e+00 0.0 3.2e+08 3.6e+02 6.6e+02 0 0 15 1 14 0 0 34 1 17 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 20 1.0 6.0601e-03 4.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAXPY 14 1.0 5.8379e-01 1.8 7.07e+05 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 14713 0 28 7.72e+01 0 0.00e+00 0 MatTranspose 28 1.0 7.3040e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMatMult 14 1.0 5.0672e+00 1.0 3.25e+08 1.3 6.7e+07 5.4e+03 1.2e+02 1 2 3 3 2 2 4 7 4 3 755529 0 28 7.72e+01 0 0.00e+00 0 MatMatMultSym 14 1.0 3.3400e+00 1.0 0.00e+00 0.0 5.2e+07 4.8e+03 1.1e+02 0 0 3 2 2 1 0 6 2 3 0 0 28 7.72e+01 0 0.00e+00 0 MatMatMultNum 14 1.0 1.6438e+00 1.0 3.25e+08 1.3 1.5e+07 7.7e+03 0.0e+00 0 2 1 1 0 1 4 2 1 0 2329030 0 0 0.00e+00 0 0.00e+00 0 MatPtAP 14 1.0 5.6798e+01 1.0 6.60e+09 1.5 8.6e+07 6.8e+04 1.5e+02 8 35 4 48 3 21 86 9 59 4 1358819 0 56 1.72e+02 0 0.00e+00 0 MatPtAPSymbolic 14 1.0 2.3578e+01 1.0 0.00e+00 0.0 6.2e+07 6.6e+04 9.8e+01 3 0 3 34 2 9 0 7 42 2 0 0 0 0.00e+00 0 0.00e+00 0 MatPtAPNumeric 14 1.0 3.3249e+01 1.0 6.60e+09 1.5 2.4e+07 7.1e+04 5.6e+01 5 35 1 14 1 12 86 3 17 1 2321227 0 56 1.72e+02 0 0.00e+00 0 MatTrnMatMult 14 1.0 2.5358e+00 1.0 4.57e+07 1.3 4.3e+07 9.6e+03 1.6e+02 0 0 2 3 3 1 1 5 4 4 218005 0 40 6.74e+01 0 0.00e+00 0 MatTrnMatMultSym 14 1.0 1.8297e+00 1.0 0.00e+00 0.0 3.5e+07 6.1e+03 1.4e+02 0 0 2 2 3 1 0 4 2 4 0 0 16 6.74e+01 0 0.00e+00 0 MatTrnMatMultNum 14 1.0 7.0784e-01 1.0 4.57e+07 1.3 7.6e+06 2.6e+04 2.4e+01 0 0 0 2 0 0 1 1 2 1 780993 0 24 3.56e-02 0 0.00e+00 0 MatGetLocalMat 64 1.0 5.7806e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetBrAoCol 42 1.0 6.7439e-01 4.0 0.00e+00 0.0 1.0e+08 3.3e+04 0.0e+00 0 0 5 28 0 0 0 11 34 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 340 1.0 2.4312e+00 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 340 7.25e+02 0 0.00e+00 0 VecMDot 12 1.0 1.5902e-03 1.1 2.70e+06 1.2 0.0e+00 0.0e+00 1.2e+01 0 0 0 0 0 0 0 0 0 0 20727717 0 0 0.00e+00 0 0.00e+00 0 VecTDot 294 1.0 4.0720e-01 3.4 4.95e+06 1.2 0.0e+00 0.0e+00 2.9e+02 0 0 0 0 6 0 0 0 0 7 147653 5823684 0 0.00e+00 0 0.00e+00 100 VecNorm 24 1.0 1.9188e-01 3.3 1.35e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 0 0 0 0 0 1 85890 0 0 0.00e+00 0 0.00e+00 0 VecScale 24 1.0 4.3587e-04 1.7 6.74e+05 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 18905629 0 0 0.00e+00 0 0.00e+00 0 VecCopy 28 1.0 7.4669e-04 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 6 9.30e-01 0 VecSet 994 1.0 1.7168e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 280 1.0 4.3353e-03 1.4 4.71e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 13208596 13478033 0 0.00e+00 0 0.00e+00 100 VecAYPX 126 1.0 7.5596e-03 3.2 2.12e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 3408691 3428506 0 0.00e+00 0 0.00e+00 100 VecMAXPY 12 1.0 1.5758e-03 2.1 2.70e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 20917876 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyBegin 514 1.0 4.8881e-01 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 514 1.0 1.4240e-03 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 256 0.00e+00 0 VecPointwiseMult 154 1.0 2.6466e-03 1.2 1.30e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 5949934 7256643 12 1.86e+00 0 0.00e+00 100 VecScatterBegin 682 1.0 7.0794e-02 4.5 0.00e+00 0.0 3.2e+08 6.4e+02 0.0e+00 0 0 16 2 0 0 0 35 2 0 0 0 0 0.00e+00 158 1.18e+01 0 VecScatterEnd 682 1.0 3.1847e-0114.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSetRandom 14 1.0 8.5525e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 6 9.30e-01 0 VecNormalize 24 1.0 1.9221e-01 3.3 2.02e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 0 0 0 0 0 1 128616 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 72 1.0 2.4573e-03 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 72 8.24e+00 0 0.00e+00 0 VecCUDACopyFrom 592 1.0 1.5500e-02 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 592 1.09e+01 0 VecCopyFromSome 60 1.0 2.5714e-02 3.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 60 9.28e+00 0 KSPSetUp 36 1.0 7.7946e-01 6.7 0.00e+00 0.0 0.0e+00 0.0e+00 3.6e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 PCGAMGGraph_AGG 14 1.0 4.9843e+00 1.0 2.96e+07 1.3 3.4e+07 3.2e+02 2.2e+02 1 0 2 0 5 2 0 4 0 6 70168 0 56 4.20e+01 14 2.05e-01 0 PCGAMGCoarse_AGG 14 1.0 2.8994e+00 1.0 4.57e+07 1.3 3.9e+08 1.4e+03 8.8e+02 0 0 19 5 18 1 1 42 5 22 190666 0 40 6.74e+01 98 2.14e+00 0 PCGAMGProl_AGG 14 1.0 1.2752e+00 1.1 0.00e+00 0.0 2.1e+08 5.6e+02 1.0e+03 0 0 10 1 21 0 0 23 1 25 0 0 28 9.79e+00 446 5.90e+00 0 PCGAMGPOpt_AGG 14 1.0 6.3711e+00 1.0 8.92e+08 1.3 1.4e+08 3.2e+03 5.2e+02 1 5 7 4 11 2 12 15 5 13 1652803 23111475 128 1.63e+02 86 1.19e+01 61 GAMG: createProl 14 1.0 1.5472e+01 1.0 9.68e+08 1.3 7.8e+08 1.5e+03 2.6e+03 2 5 38 9 54 6 13 84 11 67 738917 22492661 252 2.82e+02 644 2.02e+01 57 Graph 28 1.0 4.9117e+00 1.0 2.96e+07 1.3 3.4e+07 3.2e+02 2.2e+02 1 0 2 0 5 2 0 4 0 6 71205 0 56 4.20e+01 14 2.05e-01 0 MIS/Agg 14 1.0 1.6153e-01 1.0 0.00e+00 0.0 3.2e+08 3.6e+02 6.6e+02 0 0 15 1 14 0 0 34 1 17 0 0 0 0.00e+00 0 0.00e+00 0 SA: col data 14 1.0 8.2030e-01 1.0 0.00e+00 0.0 2.1e+08 4.3e+02 8.9e+02 0 0 10 1 18 0 0 23 1 23 0 0 0 0.00e+00 446 5.90e+00 0 SA: frmProl0 14 1.0 3.3756e-01 1.0 0.00e+00 0.0 3.4e+06 9.1e+03 5.6e+01 0 0 0 0 1 0 0 0 0 1 0 0 28 9.79e+00 0 0.00e+00 0 SA: smooth 14 1.0 5.7185e+00 1.1 3.38e+08 1.3 6.7e+07 5.4e+03 1.5e+02 1 2 3 3 3 2 4 7 4 4 697834 0 56 1.54e+02 0 0.00e+00 0 GAMG: partLevel 14 1.0 2.2750e+02 1.0 6.60e+09 1.5 1.3e+08 4.6e+04 8.7e+02 33 35 6 49 18 86 86 14 60 22 339269 0 152 1.93e+02 0 0.00e+00 0 repartition 12 1.0 1.6563e+02 1.0 5.13e+05 5.2 1.7e+07 2.4e+01 2.6e+02 24 0 1 0 5 62 0 2 0 7 23 0 24 1.08e-01 0 0.00e+00 0 Invert-Sort 12 1.0 8.1622e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.8e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 Move A 12 1.0 2.7114e+00 1.0 0.00e+00 0.0 1.7e+07 7.4e+03 1.6e+02 0 0 1 1 3 1 0 2 1 4 0 0 36 7.65e+00 0 0.00e+00 0 Move P 12 1.0 1.5712e+00 1.1 0.00e+00 0.0 6.1e+06 1.0e+02 1.6e+02 0 0 0 0 3 1 0 1 0 4 0 0 36 1.37e+01 0 0.00e+00 0 PCSetUp 4 1.0 2.4337e+02 1.0 7.56e+09 1.5 9.1e+08 7.8e+03 3.6e+03 36 40 44 59 74 92 98 98 71 91 364110 22345207 404 4.75e+02 652 2.02e+01 7 --- Event Stage 2: Solve 0 BuildTwoSided 1 1.0 1.7796e-03 2.2 0.00e+00 0.0 3.6e+04 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 2.4828e-01365.1 0.00e+00 0.0 1.1e+05 6.9e+04 0.0e+00 0 0 0 0 0 22 0 0 28 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 6.4636e-04 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 6.9572e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.7239e-05 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 3.1229e-01102.2 1.60e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 11 0 0 0 63140 0 0 0.00e+00 2 7.34e-03 0 DMPlexJacobianFE 1 1.0 6.1648e-01 1.0 1.63e+06 1.0 1.1e+05 6.9e+04 0.0e+00 0 0 0 0 0 54 11 0 28 0 32496 0 2 4.14e-01 0 0.00e+00 0 SFSetGraph 1 1.0 2.4530e-06 4.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.8907e-03 1.6 0.00e+00 0.0 1.8e+05 2.7e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 416 1.0 2.7261e-0232.7 0.00e+00 0.0 4.8e+07 3.8e+02 0.0e+00 0 0 2 0 0 0 0 90 69 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 416 1.0 9.9823e-02 4.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 8 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 74 1.0 2.4352e-0321.1 0.00e+00 0.0 4.9e+06 1.3e+02 0.0e+00 0 0 0 0 0 0 0 9 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 74 1.0 3.1283e-016487.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 341 1.0 7.8915e-02 5.8 7.02e+0744.2 4.3e+07 4.1e+02 0.0e+00 0 0 2 0 0 2 70 81 67 0 1656337 14136345 153 1.19e+00 105 1.56e-01 83 MatMultAdd 72 1.0 9.3762e-02 6.6 1.43e+0619.2 4.8e+06 1.2e+02 0.0e+00 0 0 0 0 0 7 3 9 2 0 67565 0 0 0.00e+00 24 3.56e-02 0 MatMultTranspose 72 1.0 2.8390e-0212.2 1.43e+0619.2 4.8e+06 1.2e+02 0.0e+00 0 0 0 0 0 1 3 9 2 0 223141 0 0 0.00e+00 96 8.22e-02 0 MatSolve 24 0.0 5.0515e-04 0.0 8.33e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1649 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 3.2961e-0425.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 9.1967e-041622.0 1.52e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1658 0 0 0.00e+00 0 0.00e+00 0 MatResidual 72 1.0 1.8396e-02 5.3 1.58e+0752.7 8.3e+06 4.1e+02 0.0e+00 0 0 0 0 0 0 14 16 13 0 1377458 8813663 24 2.14e-01 24 3.56e-02 80 MatAssemblyBegin 1 1.0 2.4919e-0185.3 0.00e+00 0.0 1.1e+05 6.9e+04 0.0e+00 0 0 0 0 0 22 0 0 28 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 5.7074e-03 5.7 2.73e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 53651 0 2 4.14e-01 0 0.00e+00 0 MatGetRowIJ 1 0.0 9.2419e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 1.6091e-04 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 7.7417e-0558.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.3350e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 4.14e-01 0 0.00e+00 0 VecTDot 109 1.0 2.0573e-02 1.5 3.22e+04 2.7 0.0e+00 0.0e+00 1.1e+02 0 0 0 0 2 2 0 0 0 57 15049 48940 0 0.00e+00 0 0.00e+00 98 VecNorm 59 1.0 3.2714e-0135.0 1.76e+04 2.7 0.0e+00 0.0e+00 5.9e+01 0 0 0 0 1 27 0 0 0 31 522 46275 0 0.00e+00 0 0.00e+00 99 VecCopy 224 1.0 1.9732e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.48e-03 0 VecSet 321 1.0 2.4204e-03 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 109 1.0 2.5346e-03 1.5 3.27e+04 2.6 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 125984 128310 2 2.97e-03 0 0.00e+00 99 VecAYPX 481 1.0 8.4565e-03 1.4 1.00e+05 3.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 97259 95614 0 0.00e+00 0 0.00e+00 97 VecAXPBYCZ 144 1.0 3.5952e-03 1.3 1.30e+05 3.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 312192 337070 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 321 1.0 3.8472e-03 1.3 4.24e+04 4.4 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 66648 65863 3 4.45e-03 0 0.00e+00 95 VecScatterBegin 485 1.0 3.2633e-02 8.7 0.00e+00 0.0 5.2e+07 3.6e+02 0.0e+00 0 0 3 0 0 1 0 99 71 0 0 0 0 0.00e+00 105 1.56e-01 0 VecScatterEnd 485 1.0 1.0071e-01 2.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 8 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 158 1.0 4.0617e-03 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 158 1.19e+00 0 0.00e+00 0 VecCUDACopyFrom 130 1.0 3.3900e-03 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 130 1.44e-01 0 VecCopyFromSome 105 1.0 2.8890e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 105 1.56e-01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 8.3533e+00 1.0 1.52e+0825.6 1.8e+08 7.9e+02 1.1e+03 1 0 9 1 22 737182341537555 40501 410850 248 3.80e+00 369 3.75e-01 35 SNESSetUp 1 1.0 1.1464e-04 3.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 3.1915e-0132.4 1.67e+06 1.0 4.7e+05 3.1e+02 1.7e+01 0 0 0 0 0 3 11 1 1 9 62129 0 0 0.00e+00 8 2.06e-02 0 SNESJacobianEval 1 1.0 6.1752e-01 1.0 1.65e+06 1.0 1.8e+05 4.2e+04 0.0e+00 0 0 0 0 0 54 11 0 28 0 32523 0 2 4.14e-01 1 3.67e-03 0 KSPSetUp 4 1.0 3.9408e-04 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 2.0090e-01 1.2 7.32e+0739.5 5.2e+07 3.6e+02 1.7e+02 0 0 3 0 4 17 79 99 71 90 728531 3305801 156 1.19e+00 226 2.75e-01 76 PCSetUp 1 1.0 1.4396e-0328.7 1.52e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1059 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 24 1.0 1.4517e-0324.1 1.52e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1050 0 0 0.00e+00 0 0.00e+00 0 PCApply 24 1.0 1.8211e-01 1.3 7.28e+0747.1 4.6e+07 3.5e+02 1.0e+02 0 0 2 0 2 16 68 88 61 53 694307 3831418 133 9.86e-01 203 2.41e-01 72 --- Event Stage 3: Solve 1 BuildTwoSided 1 1.0 1.7714e-03 2.0 0.00e+00 0.0 3.6e+04 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 7.6478e-01897.8 0.00e+00 0.0 1.1e+05 2.9e+05 0.0e+00 0 0 0 0 0 17 0 0 24 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 5.6415e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 6.3405e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.6950e-05 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 2.3737e-02 1.1 1.28e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 9 0 0 0 6645600 0 0 0.00e+00 2 3.96e-02 0 DMPlexJacobianFE 1 1.0 3.7486e+00 1.0 1.31e+07 1.0 1.1e+05 2.9e+05 0.0e+00 1 0 0 0 0 86 9 0 24 0 42807 0 2 3.44e+00 0 0.00e+00 0 SFSetGraph 1 1.0 1.2486e-05 5.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.9963e-03 1.5 0.00e+00 0.0 1.8e+05 9.7e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 512 1.0 7.6208e-0259.3 0.00e+00 0.0 2.1e+08 4.6e+02 0.0e+00 0 0 10 1 0 0 0 92 74 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 512 1.0 4.0463e-01 7.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 9 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 92 1.0 7.5568e-0320.9 0.00e+00 0.0 1.9e+07 1.4e+02 0.0e+00 0 0 1 0 0 0 0 8 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 92 1.0 4.7300e-02467.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 419 1.0 1.9933e-01 8.0 1.61e+08 3.7 2.0e+08 4.9e+02 0.0e+00 0 1 10 1 0 2 74 84 72 0 6585486 102246791 189 4.67e+00 129 1.56e+00 84 MatMultAdd 90 1.0 3.9824e-0112.4 5.94e+06 2.3 1.9e+07 1.3e+02 0.0e+00 0 0 1 0 0 8 3 8 2 0 153963 0 0 0.00e+00 30 3.62e-01 0 MatMultTranspose 90 1.0 5.6888e-0212.5 5.94e+06 2.3 1.9e+07 1.3e+02 0.0e+00 0 0 1 0 0 0 3 8 2 0 1077800 0 0 0.00e+00 120 5.63e-01 0 MatSolve 30 0.0 9.2537e-03 0.0 2.54e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2748 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 9.7080e-0213723.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 8.2276e-02141368.0 1.73e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2108 0 0 0.00e+00 0 0.00e+00 0 MatResidual 90 1.0 5.7801e-0210.2 3.51e+07 4.2 4.3e+07 4.6e+02 0.0e+00 0 0 2 0 0 0 14 19 15 0 4452869 66653666 30 8.12e-01 30 3.62e-01 82 MatAssemblyBegin 1 1.0 7.6844e-0167.9 0.00e+00 0.0 1.1e+05 2.9e+05 0.0e+00 0 0 0 0 0 18 0 0 24 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 7.9223e-0252.9 1.13e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 16567 0 2 3.44e+00 0 0.00e+00 0 MatGetRowIJ 1 0.0 1.7669e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 3.1933e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 3.7721e-0411.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 6.9375e-0250.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 3.44e+00 0 0.00e+00 0 VecTDot 121 1.0 3.0229e-02 1.8 2.49e+05 1.7 0.0e+00 0.0e+00 1.2e+02 0 0 0 0 3 1 0 0 0 58 98117 429197 0 0.00e+00 0 0.00e+00 99 VecNorm 65 1.0 3.8133e-02 3.0 1.35e+05 1.7 0.0e+00 0.0e+00 6.5e+01 0 0 0 0 1 1 0 0 0 31 42319 339654 0 0.00e+00 0 0.00e+00 99 VecCopy 278 1.0 2.4531e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.21e-02 0 VecSet 393 1.0 3.6843e-03 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 121 1.0 2.9383e-03 1.5 2.55e+05 1.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1034486 1050405 2 2.42e-02 0 0.00e+00 99 VecAYPX 595 1.0 9.2431e-03 1.4 7.07e+05 1.6 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 894651 887950 0 0.00e+00 0 0.00e+00 97 VecAXPBYCZ 180 1.0 4.2977e-03 1.3 9.68e+05 1.6 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 2649050 2881549 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 393 1.0 4.5690e-03 1.3 2.22e+05 1.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 556023 560388 3 3.62e-02 0 0.00e+00 96 VecScatterBegin 599 1.0 8.6708e-0214.8 0.00e+00 0.0 2.3e+08 4.3e+02 0.0e+00 0 0 11 1 0 0 0100 76 0 0 0 0 0.00e+00 129 1.56e+00 0 VecScatterEnd 599 1.0 4.0543e-01 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 9 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 194 1.0 4.8007e-03 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 194 4.73e+00 0 0.00e+00 0 VecCUDACopyFrom 160 1.0 5.1745e-03 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 160 1.09e+00 0 VecCopyFromSome 129 1.0 4.5210e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 129 1.56e+00 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 4.3785e+01 1.0 4.66e+08 4.4 3.9e+08 1.6e+03 9.4e+02 6 1 19 5 19 1023165165456451 67190 23291561 282 2.09e+01 423 3.04e+00 41 SNESSetUp 1 1.0 8.7217e-05 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 3.3845e-02 1.1 1.32e+07 1.0 4.7e+05 1.1e+03 1.7e+01 0 0 0 0 0 1 9 0 0 8 4673283 0 0 0.00e+00 8 1.28e-01 0 SNESJacobianEval 1 1.0 3.7501e+00 1.0 1.32e+07 1.0 1.8e+05 1.8e+05 0.0e+00 1 0 0 0 0 86 9 0 24 0 42845 0 2 3.44e+00 1 1.98e-02 0 KSPSetUp 4 1.0 4.3844e-0229.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 5.4639e-01 1.0 3.25e+08 6.4 2.3e+08 4.3e+02 1.9e+02 0 1 11 1 4 13 82100 76 91 2681439 25213553 192 4.70e+00 280 2.49e+00 78 PCSetUp 1 1.0 1.8259e-014484.3 1.73e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 950 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 30 1.0 1.8261e-013317.0 1.73e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 950 0 0 0.00e+00 0 0.00e+00 0 PCApply 30 1.0 5.2199e-01 1.1 3.19e+08 7.6 2.3e+08 4.1e+02 1.0e+02 0 1 11 1 2 12 70 97 68 49 2406922 29147858 163 3.92e+00 251 2.14e+00 74 --- Event Stage 4: Solve 2 BuildTwoSided 1 1.0 1.8108e-03 3.2 0.00e+00 0.0 3.6e+04 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 2.1384e+0111932.7 0.00e+00 0.0 1.1e+05 1.2e+06 0.0e+00 3 0 0 1 0 46 0 0 33 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 7.0951e-04 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 7.7816e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.5357e-05 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.8168e-01 1.1 1.03e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 9 0 0 0 6946233 0 0 0.00e+00 2 2.53e-01 0 DMPlexJacobianFE 1 1.0 4.4889e+01 1.0 1.05e+08 1.0 1.1e+05 1.2e+06 0.0e+00 7 1 0 1 0 97 9 0 33 0 28632 0 2 2.80e+01 0 0.00e+00 0 SFSetGraph 1 1.0 9.7965e-05 5.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 2.3689e-03 1.8 0.00e+00 0.0 1.8e+05 3.7e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 651 1.0 7.2777e-0219.0 0.00e+00 0.0 1.6e+08 1.6e+03 0.0e+00 0 0 8 2 0 0 0 89 66 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 651 1.0 2.4461e-01 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 118 1.0 6.2213e-0312.3 0.00e+00 0.0 1.9e+07 3.4e+02 0.0e+00 0 0 1 0 0 0 0 11 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 118 1.0 5.5855e-01396.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 532 1.0 2.2575e-01 3.5 9.24e+08 1.6 1.4e+08 1.8e+03 0.0e+00 0 5 7 2 0 0 73 78 64 0 45643547 607537137 309 1.99e+01 251 1.54e+01 99 MatMultAdd 116 1.0 2.1186e-01 5.8 4.19e+07 1.6 1.9e+07 3.1e+02 0.0e+00 0 0 1 0 0 0 3 11 1 0 2298325 137318260 29 3.70e-01 87 6.02e-01 92 MatMultTranspose 116 1.0 7.0607e-01 4.8 4.13e+07 1.6 1.9e+07 3.1e+02 0.0e+00 0 0 1 0 0 1 3 11 1 0 678098 85165291 2 7.65e+00 174 7.14e-01 92 MatSolve 29 0.0 5.7552e-04 0.0 9.17e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1594 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.5674e-0436.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 1.0418e-031688.5 1.33e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1273 0 0 0.00e+00 0 0.00e+00 0 MatResidual 116 1.0 5.1285e-02 3.3 1.83e+08 1.6 3.1e+07 1.7e+03 0.0e+00 0 1 2 0 0 0 14 17 13 0 39271461 348908527 58 3.96e+00 58 2.94e+00 99 MatAssemblyBegin 1 1.0 2.1400e+01404.6 0.00e+00 0.0 1.1e+05 1.2e+06 0.0e+00 3 0 0 1 0 46 0 0 33 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 2.4057e-0117.1 4.61e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 22525 0 2 2.80e+01 0 0.00e+00 0 MatGetRowIJ 1 0.0 7.8199e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 1.3379e-04 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.8754e-03 4.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.9547e-0114.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 2.80e+01 0 0.00e+00 0 VecTDot 140 1.0 3.6071e-02 1.7 1.92e+06 1.3 0.0e+00 0.0e+00 1.4e+02 0 0 0 0 3 0 0 0 0 58 646559 2764198 0 0.00e+00 0 0.00e+00 100 VecNorm 75 1.0 7.4142e-02 1.8 1.05e+06 1.3 0.0e+00 0.0e+00 7.5e+01 0 0 0 0 2 0 0 0 0 31 171501 2305627 0 0.00e+00 0 0.00e+00 100 VecCopy 358 1.0 4.9063e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 31 2.17e-01 0 VecSet 415 1.0 4.2000e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 139 1.0 3.5483e-03 1.5 1.97e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 6738281 6994701 2 1.95e-01 0 0.00e+00 100 VecAYPX 759 1.0 1.9573e-02 1.4 5.41e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 3330024 3672609 29 1.16e-01 0 0.00e+00 100 VecAXPBYCZ 232 1.0 8.1019e-03 1.2 7.52e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 11164870 12491342 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 508 1.0 9.1609e-03 1.2 1.65e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2163504 2350915 35 4.20e-01 0 0.00e+00 100 VecScatterBegin 764 1.0 1.0029e-01 4.0 0.00e+00 0.0 1.8e+08 1.5e+03 0.0e+00 0 0 9 2 0 0 0100 67 0 0 0 0 0.00e+00 367 1.63e+01 0 VecScatterEnd 764 1.0 7.6581e-01 7.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 404 1.0 1.1917e-02 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 404 2.10e+01 0 0.00e+00 0 VecCUDACopyFrom 243 1.0 7.3640e-03 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 243 2.07e+00 0 VecCopyFromSome 309 1.0 2.2331e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 309 1.58e+01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 6.9170e+01 1.0 2.14e+09 1.7 3.6e+08 4.7e+03 1.3e+03 10 11 18 14 26 150169200422521 342623 138626355 524 1.13e+02 744 2.03e+01 51 SNESSetUp 1 1.0 1.2020e-04 3.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 2.0797e-01 1.1 1.05e+08 1.0 4.7e+05 4.2e+03 1.7e+01 0 1 0 0 0 0 9 0 0 7 6075964 0 0 0.00e+00 8 8.95e-01 0 SNESJacobianEval 1 1.0 4.4891e+01 1.0 1.05e+08 1.0 1.8e+05 7.3e+05 0.0e+00 7 1 0 1 0 97 9 0 33 0 28650 0 2 2.80e+01 1 1.26e-01 0 KSPSetUp 5 1.0 2.6620e-0227.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 1.1266e+00 1.0 1.03e+09 1.6 1.8e+08 1.5e+03 2.2e+02 0 5 9 2 5 2 82100 67 92 10210761 151138813 404 2.84e+01 543 1.69e+01 99 PCSetUp 1 1.0 1.4590e-0336.5 1.33e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 909 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 29 1.0 1.4717e-0328.1 1.33e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 901 0 0 0.00e+00 0 0.00e+00 0 PCApply 29 1.0 1.0983e+00 1.0 8.89e+08 1.6 1.7e+08 1.4e+03 1.4e+02 0 4 8 2 3 2 70 96 59 57 8978021 156566635 376 2.59e+01 515 1.42e+01 98 --- Event Stage 5: Solve 3 BuildTwoSided 1 1.0 5.1458e-0310.5 0.00e+00 0.0 3.6e+04 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 1.7081e+0239358.5 0.00e+00 0.0 1.1e+05 4.9e+06 0.0e+00 25 0 0 4 0 47 0 0 34 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 7.4098e-04 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 7.3447e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 2.6415e-05 3.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.4722e+00 1.1 8.22e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 5 0 0 0 0 9 0 0 0 6857339 0 0 0.00e+00 2 1.79e+00 0 DMPlexJacobianFE 1 1.0 3.5766e+02 1.0 8.38e+08 1.0 1.1e+05 4.9e+06 0.0e+00 53 5 0 4 0 99 9 0 34 0 28769 0 2 2.26e+02 0 0.00e+00 0 SFSetGraph 1 1.0 3.2974e-04 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 7.2891e-03 2.0 0.00e+00 0.0 1.8e+05 1.4e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 651 1.0 1.5415e-0122.6 0.00e+00 0.0 6.2e+08 1.6e+03 0.0e+00 0 0 30 8 0 0 0 94 64 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 651 1.0 8.8498e-01 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 118 1.0 1.7247e-0210.2 0.00e+00 0.0 4.2e+07 5.4e+02 0.0e+00 0 0 2 0 0 0 0 6 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 118 1.0 1.5505e-0158.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 532 1.0 6.0182e-01 2.4 6.94e+09 1.3 5.8e+08 1.7e+03 0.0e+00 0 38 28 8 0 0 74 87 63 0 138481546 2426185228 309 6.89e+01 251 1.23e+02 99 MatMultAdd 116 1.0 7.3066e-01 8.3 3.22e+08 1.3 4.2e+07 4.8e+02 0.0e+00 0 2 2 0 0 0 3 6 1 0 5337019 179709884 29 1.24e+00 87 3.11e+00 92 MatMultTranspose 116 1.0 3.5128e-01 1.5 3.18e+08 1.3 4.2e+07 4.8e+02 0.0e+00 0 2 2 0 0 0 3 6 1 0 10947969 260588074 2 6.14e+01 174 3.49e+00 92 MatSolve 29 0.0 8.9750e-03 0.0 2.76e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 3075 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 1.2285e-0116900.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 1.7307e-01283263.3 2.07e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1198 0 0 0.00e+00 0 0.00e+00 0 MatResidual 116 1.0 1.6583e-01 3.4 1.36e+09 1.3 1.3e+08 1.5e+03 0.0e+00 0 7 6 2 0 0 14 20 13 0 98257034 1549459107 58 1.35e+01 58 2.36e+01 99 MatAssemblyBegin 1 1.0 1.7091e+02736.0 0.00e+00 0.0 1.1e+05 4.9e+06 0.0e+00 25 0 0 4 0 47 0 0 34 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 5.7650e-01 3.5 1.86e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 38194 0 2 2.26e+02 0 0.00e+00 0 MatGetRowIJ 1 0.0 2.0815e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 3.5401e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.2226e-02 3.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 4.0883e-01 4.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 2.26e+02 0 0.00e+00 0 VecTDot 140 1.0 9.5268e-02 1.8 1.53e+07 1.1 0.0e+00 0.0e+00 1.4e+02 0 0 0 0 3 0 0 0 0 58 1966813 18677951 0 0.00e+00 0 0.00e+00 100 VecNorm 75 1.0 2.2694e-01 2.5 8.36e+06 1.1 0.0e+00 0.0e+00 7.5e+01 0 0 0 0 2 0 0 0 0 31 450157 17391663 0 0.00e+00 0 0.00e+00 100 VecCopy 358 1.0 1.7542e-02 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 31 1.75e+00 0 VecSet 415 1.0 5.7201e-03 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 139 1.0 3.9140e-03 1.4 1.57e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 49077106 53354904 2 1.57e+00 0 0.00e+00 100 VecAYPX 759 1.0 5.3993e-02 2.9 4.30e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 9698409 10492089 29 9.32e-01 0 0.00e+00 100 VecAXPBYCZ 232 1.0 1.6806e-02 2.4 5.97e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 43241129 45714281 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 508 1.0 1.6897e-02 2.0 1.31e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 9422969 10064394 35 3.38e+00 0 0.00e+00 100 VecScatterBegin 764 1.0 2.7735e-01 2.6 0.00e+00 0.0 6.6e+08 1.5e+03 0.0e+00 0 0 32 8 0 0 0100 65 0 0 0 0 0.00e+00 367 1.28e+02 0 VecScatterEnd 764 1.0 9.2039e-01 3.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 404 1.0 2.0057e-02 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 404 7.60e+01 0 0.00e+00 0 VecCUDACopyFrom 243 1.0 1.0267e-02 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 243 1.38e+01 0 VecCopyFromSome 309 1.0 1.5711e-01 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 309 1.26e+02 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 5.3464e+02 1.0 1.59e+10 1.3 1.1e+09 6.1e+03 1.2e+03 79 87 54 56 25 148168167433507 357314 588572287 522 7.67e+02 744 1.57e+02 51 SNESSetUp 1 1.0 2.9598e-02763.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 1.5750e+00 1.1 8.30e+08 1.0 4.7e+05 1.6e+04 1.7e+01 0 5 0 0 0 0 9 0 0 7 6414307 0 0 0.00e+00 8 6.71e+00 0 SNESJacobianEval 1 1.0 3.5767e+02 1.0 8.40e+08 1.0 1.8e+05 2.9e+06 0.0e+00 53 5 0 4 0 99 9 0 34 0 28778 0 2 2.26e+02 1 8.95e-01 0 KSPSetUp 5 1.0 4.4981e-02112.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 1.6125e+00 1.0 7.74e+09 1.3 6.6e+08 1.5e+03 2.2e+02 0 42 32 8 5 0 82100 65 92 57652827 609545013 404 1.36e+02 543 1.32e+02 99 PCSetUp 1 1.0 2.9953e-017299.4 2.07e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 692 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 29 1.0 2.9955e-015389.7 2.07e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 692 0 0 0.00e+00 0 0.00e+00 0 PCApply 29 1.0 1.5312e+00 1.1 6.65e+09 1.3 6.6e+08 1.4e+03 1.4e+02 0 36 32 8 3 0 70 99 58 57 52047545 603554443 376 1.26e+02 515 1.10e+02 98 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Object 0 680 446080 0. Container 0 56 34944 0. Distributed Mesh 0 114 578416 0. DM Label 0 48 33408 0. GraphPartitioner 0 36 26240 0. Index Set 0 197 42483928 0. IS L to G Mapping 0 6 558096 0. Section 0 204 159936 0. Star Forest Graph 0 194 189056 0. Discrete System 0 97 97808 0. Matrix 0 146 508612288 0. Matrix Null Space 0 4 2976 0. Vector 0 292 15363704 0. SNES 0 4 6128 0. DMSNES 0 4 2880 0. Krylov Solver 0 40 81952 0. DMKSP interface 0 4 2816 0. Preconditioner 0 26 30368 0. Linear Space 0 8 5952 0. Dual Space 0 32 26624 0. FE Space 0 8 6976 0. Vec Scatter 0 32 27392 0. Field over DM 0 4 3040 0. Viewer 1 1 896 0. --- Event Stage 1: Mesh Setup Object 704 212 139072 0. Container 60 32 19968 0. Distributed Mesh 208 146 740976 0. DM Label 98 66 45936 0. GraphPartitioner 64 44 32064 0. Index Set 38000 37875 93238672 0. IS L to G Mapping 19 13 5892808 0. Section 416 292 228928 0. Star Forest Graph 617 495 485696 0. Discrete System 272 219 220752 0. Matrix 658 516 261732256 0. Matrix Partitioning 12 12 8928 0. Matrix Coarsen 14 14 9576 0. Matrix Null Space 4 0 0 0. Vector 1144 948 16348456 0. SNES 4 0 0 0. DMSNES 4 0 0 0. Krylov Solver 54 14 27328 0. Preconditioner 40 14 12768 0. Linear Space 8 4 2976 0. Dual Space 32 16 13312 0. FE Space 8 4 3488 0. Vec Scatter 136 104 89024 0. Field over DM 4 4 3040 0. Viewer 1 0 0 0. PetscRandom 28 28 19432 0. --- Event Stage 2: Solve 0 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 54528 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 3: Solve 1 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 67248 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 4: Solve 2 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 117168 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 26 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 5: Solve 3 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 314928 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 26 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. ======================================================================================================================== Average time to get PetscTime(): 3.92e-08 Average time for MPI_Barrier(): 2.91734e-05 Average time for zero size MPI_Send(): 7.70389e-06 #PETSc Option Table entries: -bmat_view :bmcpu.m:ascii_matlab -cells 32,48,64 -check_pointer_intensity 0 -ex56_dm_mat_type aijcusparse -ex56_dm_refine 3 -ex56_dm_vec_type cuda -gamg_est_ksp_max_it 10 -gamg_est_ksp_type cg -ksp_atol 1.e-71 -ksp_converged_reason -ksp_max_it 100 -ksp_monitor -ksp_norm_type preconditioned -ksp_rtol 1.e-11 -ksp_type cg -log_view -lvec_view :lvcpu.m:ascii_matlab -mat_block_size 3 -matptap_via scalable -max_conv_its 4 -mg_levels_esteig_ksp_max_it 10 -mg_levels_esteig_ksp_type cg -mg_levels_ksp_chebyshev_esteig 0,0.05,0,1.05 -mg_levels_ksp_max_it 2 -mg_levels_ksp_type chebyshev -mg_levels_pc_type jacobi -pc_gamg_agg_nsmooths 1 -pc_gamg_coarse_eq_limit 1000 -pc_gamg_process_eq_limit 150 -pc_gamg_repartition true -pc_gamg_reuse_interpolation true -pc_gamg_square_graph 10 -pc_gamg_threshold 0.05 -pc_gamg_threshold_scale .5 -pc_gamg_type agg -pc_type gamg -petscpartitioner_type simple -petscspace_degree 2 -run_type 1 -snes_converged_reason -snes_max_it 2 -snes_monitor -snes_rtol 1.e-10 -snes_type ksponly -use_mat_nearnullspace true -xvec_view :xvcpu.m:ascii_matlab #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with 64 bit PetscInt Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 8 Configure options: --with-cc=mpicc --with-cxx=mpiCC --with-fc=mpif90 COPTFLAGS="-g -fast" CXXOPTFLAGS="-g -fast" FOPTFLAGS="-g -fast" --with-ssl=0 --with-batch=0 --with-mpiexec="jsrun -g 1" --with-cuda=1 --with-cudac=nvcc CUDAFLAGS="-ccbin pgc++" --download-metis --download-viennacl --download-parmetis --download-fblaslapack --with-x=0 --with-64-bit-indices=1 --with-debugging=0 PETSC_ARCH=arch-summit-opt64-pgi-cuda ----------------------------------------- Libraries compiled on 2019-08-13 01:26:30 on login5 Machine characteristics: Linux-4.14.0-115.8.1.el7a.ppc64le-ppc64le-with-redhat-7.6-Maipo Using PETSc directory: /ccs/home/adams/petsc Using PETSc arch: arch-summit-opt64-pgi-cuda ----------------------------------------- Using C compiler: mpicc -g -fast -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include Using Fortran compiler: mpif90 -g -fast -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include ----------------------------------------- Using include paths: -I/ccs/home/adams/petsc/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/sw/summit/cuda/10.1.168/include ----------------------------------------- Using C linker: mpicc Using Fortran linker: mpif90 Using libraries: -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -lpetsc -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -Wl,-rpath,/sw/summit/cuda/10.1.168/lib64 -L/sw/summit/cuda/10.1.168/lib64 /autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib/pgi.ld -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -L/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -L/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -Wl,-rpath,/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -L/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -lflapack -lfblas -lparmetis -lmetis -lcufft -lcublas -lcudart -lcusparse -lcusolver -lstdc++ -ldl -lpthread -lmpiprofilesupport -lmpi_ibm_usempi -lmpi_ibm_mpifh -lmpi_ibm -lpgf90rtl -lpgf90 -lpgf90_rpm1 -lpgf902 -lpgftnrtl -latomic -lpgkomp -lomp -lomptarget -lpgmath -lpgc -lrt -lmass_simdp9 -lmassvp9 -lmassp9 -lm -lgcc_s -lstdc++ -ldl -----------------------------------------