[0] 32085 global equations, 10695 vertices [0] 32085 equations in vector, 10695 vertices 0 SNES Function norm 7.375868178352e+00 0 KSP Residual norm 1.950620277026e+03 1 KSP Residual norm 1.897041668228e+02 2 KSP Residual norm 5.064203064323e+01 3 KSP Residual norm 1.315556595722e+01 4 KSP Residual norm 3.774169210489e+00 5 KSP Residual norm 9.960152093018e-01 6 KSP Residual norm 2.918541935438e-01 7 KSP Residual norm 7.970519263349e-02 8 KSP Residual norm 2.197387133772e-02 9 KSP Residual norm 6.612095898235e-03 10 KSP Residual norm 1.855630274721e-03 11 KSP Residual norm 4.575846015253e-04 12 KSP Residual norm 1.306685008760e-04 13 KSP Residual norm 3.645538962234e-05 14 KSP Residual norm 1.079867947187e-05 15 KSP Residual norm 2.854841482805e-06 16 KSP Residual norm 7.507700407038e-07 17 KSP Residual norm 2.043211316932e-07 18 KSP Residual norm 5.621515417481e-08 19 KSP Residual norm 1.516336222743e-08 Linear solve converged due to CONVERGED_RTOL iterations 19 1 SNES Function norm 1.320133258057e-09 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 275373 global equations, 91791 vertices [0] 275373 equations in vector, 91791 vertices 0 SNES Function norm 2.615842974236e+00 0 KSP Residual norm 4.857980217187e+03 1 KSP Residual norm 5.081548296664e+02 2 KSP Residual norm 1.895035320567e+02 3 KSP Residual norm 5.439412873077e+01 4 KSP Residual norm 2.063768586688e+01 5 KSP Residual norm 6.994116071427e+00 6 KSP Residual norm 2.274647357167e+00 7 KSP Residual norm 8.292216597248e-01 8 KSP Residual norm 3.562018500449e-01 9 KSP Residual norm 1.111448548836e-01 10 KSP Residual norm 3.681149353801e-02 11 KSP Residual norm 1.639772687156e-02 12 KSP Residual norm 5.449944545443e-03 13 KSP Residual norm 1.944408196561e-03 14 KSP Residual norm 6.976973687467e-04 15 KSP Residual norm 2.661295941993e-04 16 KSP Residual norm 9.098204687120e-05 17 KSP Residual norm 3.273826518664e-05 18 KSP Residual norm 1.270355561030e-05 19 KSP Residual norm 4.500263163404e-06 20 KSP Residual norm 1.574180444688e-06 21 KSP Residual norm 5.581743866213e-07 22 KSP Residual norm 2.071806446552e-07 23 KSP Residual norm 8.182785240701e-08 24 KSP Residual norm 2.971185879177e-08 Linear solve converged due to CONVERGED_RTOL iterations 24 1 SNES Function norm 9.545364422874e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 2280285 global equations, 760095 vertices [0] 2280285 equations in vector, 760095 vertices 0 SNES Function norm 9.255869095573e-01 0 KSP Residual norm 1.160664853723e+04 1 KSP Residual norm 1.067477037968e+03 2 KSP Residual norm 6.304620830366e+02 3 KSP Residual norm 1.757745969517e+02 4 KSP Residual norm 6.001771567262e+01 5 KSP Residual norm 1.986945501090e+01 6 KSP Residual norm 7.714170756562e+00 7 KSP Residual norm 1.922478397025e+00 8 KSP Residual norm 8.369560131636e-01 9 KSP Residual norm 3.236933539522e-01 10 KSP Residual norm 1.003602434219e-01 11 KSP Residual norm 3.672888202885e-02 12 KSP Residual norm 1.507335431855e-02 13 KSP Residual norm 5.173703311608e-03 14 KSP Residual norm 1.790275893894e-03 15 KSP Residual norm 7.404648758403e-04 16 KSP Residual norm 2.680075804731e-04 17 KSP Residual norm 8.634630565112e-05 18 KSP Residual norm 3.225359397362e-05 19 KSP Residual norm 1.167243078174e-05 20 KSP Residual norm 4.458961777061e-06 21 KSP Residual norm 1.594766734525e-06 22 KSP Residual norm 5.754511374130e-07 23 KSP Residual norm 2.293699449300e-07 24 KSP Residual norm 8.730195361024e-08 Linear solve converged due to CONVERGED_RTOL iterations 24 1 SNES Function norm 9.330488561693e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 18556605 global equations, 6185535 vertices [0] 18556605 equations in vector, 6185535 vertices 0 SNES Function norm 3.273111572912e-01 0 KSP Residual norm 2.769364995953e+04 1 KSP Residual norm 2.718189843137e+03 2 KSP Residual norm 1.965257522392e+03 3 KSP Residual norm 6.886523094821e+02 4 KSP Residual norm 1.864811918079e+02 5 KSP Residual norm 7.147911795926e+01 6 KSP Residual norm 2.980735154257e+01 7 KSP Residual norm 8.801365501644e+00 8 KSP Residual norm 2.834327560601e+00 9 KSP Residual norm 1.118948223693e+00 10 KSP Residual norm 4.703795062853e-01 11 KSP Residual norm 1.538789841903e-01 12 KSP Residual norm 5.461782561959e-02 13 KSP Residual norm 2.208270205458e-02 14 KSP Residual norm 7.700831351232e-03 15 KSP Residual norm 2.785114821181e-03 16 KSP Residual norm 1.095685589743e-03 17 KSP Residual norm 4.198170622173e-04 18 KSP Residual norm 1.610203197638e-04 19 KSP Residual norm 5.986257029593e-05 20 KSP Residual norm 2.356078846370e-05 21 KSP Residual norm 8.478713338203e-06 22 KSP Residual norm 3.177828727263e-06 23 KSP Residual norm 1.214287535457e-06 24 KSP Residual norm 4.715869508084e-07 25 KSP Residual norm 1.791054537704e-07 Linear solve converged due to CONVERGED_RTOL iterations 25 1 SNES Function norm 7.172038599195e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 1) N= 275373, max displ=5.9965999e+01, disp diff= 2.20e-01, error=9.209e-03, rate=4.6 [0] 2) N= 2280285, max displ=5.9969946e+01, disp diff= 3.95e-03, error=5.262e-03, rate=0.81 [0] 3) N= 18556605, max displ=5.9974959e+01, disp diff= 5.01e-03, error=2.493e-04, rate=4.4 ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./ex56 on a arch-summit-opt64-pgi-cuda named e33n06 with 192 processors, by adams Wed Aug 14 10:47:50 2019 Using Petsc Development GIT revision: v3.11.3-1683-gb35a45d GIT Date: 2019-08-12 14:17:22 -0400 Max Max/Min Avg Total Time (sec): 2.836e+02 1.000 2.836e+02 Objects: 6.853e+03 1.097 6.254e+03 Flop: 1.690e+10 1.305 1.624e+10 3.118e+12 Flop/sec: 5.958e+07 1.305 5.727e+07 1.099e+10 MPI Messages: 6.730e+04 9.320 4.278e+04 8.214e+06 MPI Message Lengths: 8.934e+08 2.639 1.801e+04 1.479e+11 MPI Reductions: 3.235e+03 1.005 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 4.2379e-01 0.1% 0.0000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% 6.000e+00 0.2% 1: Mesh Setup: 6.4297e+01 22.7% 1.3192e+12 42.3% 3.656e+06 44.5% 3.350e+04 82.8% 2.515e+03 77.9% 2: Solve 0: 4.3925e-01 0.2% 2.0591e+09 0.1% 1.985e+05 2.4% 1.252e+03 0.2% 1.450e+02 4.5% 3: Solve 1: 3.2003e+00 1.1% 2.1912e+10 0.7% 7.557e+05 9.2% 1.664e+03 0.8% 1.600e+02 5.0% 4: Solve 2: 2.4240e+01 8.5% 1.8675e+11 6.0% 7.734e+05 9.4% 6.136e+03 3.2% 1.940e+02 6.0% 5: Solve 3: 1.9099e+02 67.3% 1.5881e+12 50.9% 2.830e+06 34.5% 6.796e+03 13.0% 1.970e+02 6.1% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage VecNorm 4 1.0 6.3303e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 1 0 0 0 67 0 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 1: Mesh Setup PetscBarrier 6 1.0 1.5360e-02 1.1 0.00e+00 0.0 1.7e+04 2.1e+01 2.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSided 159 1.0 4.3175e-01 8.1 0.00e+00 0.0 1.5e+05 8.0e+00 0.0e+00 0 0 2 0 0 0 0 4 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 436 1.0 1.1256e+01 7.8 0.00e+00 0.0 7.4e+04 3.3e+05 0.0e+00 1 0 1 16 0 5 0 2 20 0 0 0 0 0.00e+00 0 0.00e+00 0 DMCreateMat 4 1.0 6.8325e+00 1.0 0.00e+00 0.0 5.7e+04 6.8e+05 5.2e+01 2 0 1 26 2 10 0 2 32 2 0 0 8 2.49e+02 0 0.00e+00 0 Mesh Partition 1 1.0 2.7971e-0120.0 0.00e+00 0.0 1.1e+03 1.2e+03 8.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 Mesh Migration 1 1.0 1.1088e-02 1.0 0.00e+00 0.0 6.2e+03 8.7e+02 2.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartSelf 1 1.0 6.7555e-03794.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblInv 1 1.0 8.0907e-03 6.2 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblSF 1 1.0 2.7132e-03 1.7 0.00e+00 0.0 4.8e+02 9.8e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartStrtSF 1 1.0 9.2384e-04 5.1 0.00e+00 0.0 1.9e+02 1.2e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPointSF 1 1.0 8.3116e-04 1.4 0.00e+00 0.0 3.8e+02 2.4e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 32 1.0 3.1737e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 1 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistribute 1 1.0 2.9166e-0111.3 0.00e+00 0.0 7.7e+03 1.0e+03 3.2e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistCones 1 1.0 2.2236e-03 1.1 0.00e+00 0.0 1.2e+03 2.1e+03 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistLabels 1 1.0 4.6750e-03 1.0 0.00e+00 0.0 3.2e+03 4.9e+02 2.1e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistField 1 1.0 3.2568e-03 1.1 0.00e+00 0.0 1.4e+03 6.2e+02 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 58 1.0 5.8357e-0111.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.8e+01 0 0 0 0 2 1 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 58 1.0 1.1045e-0314.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPrealloc 4 1.0 4.6035e+00 1.0 0.00e+00 0.0 5.7e+04 6.8e+05 4.4e+01 2 0 1 26 1 7 0 2 32 2 0 0 8 2.49e+02 0 0.00e+00 0 SFSetGraph 175 1.0 5.7989e-0315.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 159 1.0 5.1652e-01 2.2 0.00e+00 0.0 7.3e+05 2.7e+04 0.0e+00 0 0 9 14 0 0 0 20 16 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 723 1.0 2.5251e-02 4.6 0.00e+00 0.0 2.1e+06 3.1e+03 0.0e+00 0 0 25 4 0 0 0 56 5 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 723 1.0 8.6300e-02 3.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 37 1.0 1.8815e-0238.3 0.00e+00 0.0 1.9e+04 6.9e+05 0.0e+00 0 0 0 9 0 0 0 1 11 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 29 1.0 1.8136e-01 5.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpBegin 8 1.0 5.4382e-03281.3 0.00e+00 0.0 4.2e+03 7.8e+05 0.0e+00 0 0 0 2 0 0 0 0 3 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpEnd 8 1.0 5.5167e-02 3.1 0.00e+00 0.0 4.2e+03 7.8e+05 0.0e+00 0 0 0 2 0 0 0 0 3 0 0 0 0 0.00e+00 0 0.00e+00 0 SFDistSection 13 1.0 6.6239e-03 1.4 0.00e+00 0.0 1.6e+04 3.3e+03 1.3e+01 0 0 0 0 0 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 SFSectionSF 21 1.0 8.6745e-02 1.2 0.00e+00 0.0 2.3e+04 2.8e+05 0.0e+00 0 0 0 4 0 0 0 1 5 0 0 0 0 0.00e+00 0 0.00e+00 0 SFRemoteOff 8 1.0 5.2108e-0214.8 0.00e+00 0.0 8.3e+03 7.9e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 100 1.0 4.6161e-02 1.8 5.18e+08 1.3 3.2e+05 3.6e+03 0.0e+00 0 3 4 1 0 0 7 9 1 0 2075867 7512595 60 5.45e+00 70 9.74e+00 99 MatConvert 88 1.0 1.2214e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 3.2e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatScale 30 1.0 2.4196e-02 1.4 1.75e+07 1.3 3.2e+04 1.0e+03 0.0e+00 0 0 0 0 0 0 0 1 0 0 134281 0 0 0.00e+00 10 1.67e-01 0 MatAssemblyBegin 317 1.0 1.1371e+01 6.1 0.00e+00 0.0 7.4e+04 3.3e+05 0.0e+00 1 0 1 16 0 5 0 2 20 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 317 1.0 4.3090e+00 1.1 6.40e+06 3.5 5.9e+05 8.9e+02 3.5e+02 1 0 7 0 11 7 0 16 0 14 193 0 252 7.54e+02 0 0.00e+00 0 MatCreateSubMat 16 1.0 6.6810e-01 1.0 0.00e+00 0.0 1.3e+05 1.2e+04 1.9e+02 0 0 2 1 6 1 0 4 1 8 0 0 48 1.88e+01 0 0.00e+00 0 MatPartitioning 8 1.0 1.0417e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 2.6e+01 0 0 0 0 1 2 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatCoarsen 10 1.0 2.0813e-02 1.0 0.00e+00 0.0 6.0e+05 9.3e+02 1.4e+02 0 0 7 0 4 0 0 16 0 6 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 20 1.0 1.4174e-02 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAXPY 10 1.0 4.6125e-01 1.6 6.99e+05 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 287 0 20 7.48e+01 0 0.00e+00 0 MatTranspose 20 1.0 6.8976e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMatMult 10 1.0 1.6324e+00 1.0 3.11e+08 1.3 3.0e+05 1.5e+04 8.1e+01 1 2 4 3 3 3 4 8 4 3 35221 0 20 7.48e+01 0 0.00e+00 0 MatMatMultSym 10 1.0 1.2070e+00 1.0 0.00e+00 0.0 2.4e+05 1.3e+04 8.0e+01 0 0 3 2 2 2 0 7 2 3 0 0 20 7.48e+01 0 0.00e+00 0 MatMatMultNum 10 1.0 4.0581e-01 1.0 3.11e+08 1.3 6.4e+04 2.2e+04 0.0e+00 0 2 1 1 0 1 4 2 1 0 141678 0 0 0.00e+00 0 0.00e+00 0 MatPtAP 10 1.0 4.1448e+01 1.0 6.24e+09 1.5 4.5e+05 1.5e+05 1.1e+02 15 36 5 45 3 64 85 12 54 4 27110 0 40 1.49e+02 0 0.00e+00 0 MatPtAPSymbolic 10 1.0 1.8442e+01 1.0 0.00e+00 0.0 3.1e+05 1.5e+05 7.0e+01 6 0 4 32 2 29 0 9 38 3 0 0 0 0.00e+00 0 0.00e+00 0 MatPtAPNumeric 10 1.0 2.3054e+01 1.0 6.24e+09 1.5 1.4e+05 1.4e+05 4.0e+01 8 36 2 13 1 36 85 4 16 2 48742 0 40 1.49e+02 0 0.00e+00 0 MatTrnMatMult 10 1.0 1.5475e+00 1.0 4.94e+07 1.3 2.3e+05 3.0e+04 1.1e+02 1 0 3 5 4 2 1 6 6 4 5976 0 40 1.37e+02 0 0.00e+00 0 MatTrnMatMultSym 10 1.0 6.1765e-01 1.0 0.00e+00 0.0 1.3e+05 2.2e+04 7.3e+01 0 0 2 2 2 1 0 3 2 3 0 0 0 0.00e+00 0 0.00e+00 0 MatTrnMatMultNum 10 1.0 9.2990e-01 1.0 4.94e+07 1.3 1.1e+05 3.9e+04 4.0e+01 0 0 1 3 1 1 1 3 3 2 9945 0 40 1.37e+02 0 0.00e+00 0 MatGetLocalMat 40 1.0 5.4465e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetBrAoCol 30 1.0 2.6076e-01 2.5 0.00e+00 0.0 4.5e+05 8.5e+04 0.0e+00 0 0 5 26 0 0 0 12 31 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 252 1.0 2.4112e+00 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 3 0 0 0 0 0 0 252 7.54e+02 0 0.00e+00 0 VecMDot 12 1.0 7.9273e-04 1.1 2.67e+06 1.2 0.0e+00 0.0e+00 1.2e+01 0 0 0 0 0 0 0 0 0 0 640139 0 0 0.00e+00 0 0.00e+00 0 VecTDot 210 1.0 5.0898e-02 2.3 4.90e+06 1.2 0.0e+00 0.0e+00 2.1e+02 0 0 0 0 7 0 0 0 0 8 18207 93229 0 0.00e+00 0 0.00e+00 100 VecNorm 24 1.0 8.6797e-0223.7 1.34e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 2923 0 0 0.00e+00 0 0.00e+00 0 VecScale 24 1.0 3.3042e-04 1.3 6.68e+05 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 383954 0 0 0.00e+00 0 0.00e+00 0 VecCopy 20 1.0 7.0838e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 6 9.18e-01 0 VecSet 718 1.0 1.8886e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 200 1.0 4.1248e-03 1.3 4.66e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 213976 217834 0 0.00e+00 0 0.00e+00 100 VecAYPX 90 1.0 6.0022e-03 2.2 2.10e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 66172 66525 0 0.00e+00 0 0.00e+00 100 VecMAXPY 12 1.0 9.6654e-04 1.2 2.67e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 525031 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyBegin 346 1.0 3.9982e-02 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 346 1.0 7.0484e-04 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 99 0.00e+00 0 VecPointwiseMult 110 1.0 2.5829e-03 1.2 1.28e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 93972 115997 12 1.84e+00 0 0.00e+00 100 VecScatterBegin 466 1.0 2.8239e-02 2.0 0.00e+00 0.0 1.5e+06 1.7e+03 0.0e+00 0 0 18 2 0 0 0 41 2 0 0 0 0 0.00e+00 130 1.12e+01 0 VecScatterEnd 466 1.0 2.6326e-02 2.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSetRandom 10 1.0 5.6850e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 6 9.18e-01 0 VecNormalize 24 1.0 8.7094e-0221.9 2.00e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 4370 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 72 1.0 2.1359e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 72 7.29e+00 0 0.00e+00 0 VecCUDACopyFrom 408 1.0 1.1420e-02 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 408 1.03e+01 0 VecCopyFromSome 60 1.0 1.2899e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 60 9.14e+00 0 KSPSetUp 28 1.0 7.1477e-0111.0 0.00e+00 0.0 0.0e+00 0.0e+00 2.8e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 PCGAMGGraph_AGG 10 1.0 3.3486e+00 1.0 2.84e+07 1.3 1.6e+05 8.7e+02 1.6e+02 1 0 2 0 5 5 0 5 0 6 1569 0 40 4.06e+01 10 1.67e-01 0 PCGAMGCoarse_AGG 10 1.0 1.6367e+00 1.0 4.94e+07 1.3 9.7e+05 8.0e+03 3.0e+02 1 0 12 5 9 3 1 27 6 12 5650 0 40 1.37e+02 70 1.88e+00 0 PCGAMGProl_AGG 10 1.0 2.9282e-01 1.1 0.00e+00 0.0 1.0e+06 1.5e+03 6.8e+02 0 0 12 1 21 0 0 28 1 27 0 0 20 9.65e+00 298 5.82e+00 0 PCGAMGPOpt_AGG 10 1.0 2.3186e+00 1.1 8.55e+08 1.3 6.2e+05 9.0e+03 3.7e+02 1 5 8 4 11 4 12 17 5 15 68241 2786373 112 1.57e+02 82 1.16e+01 62 GAMG: createProl 10 1.0 7.6575e+00 1.0 9.33e+08 1.3 2.8e+06 5.4e+03 1.5e+03 3 6 34 10 47 12 13 76 12 60 22557 2116519 212 3.44e+02 460 1.94e+01 56 Graph 20 1.0 3.3147e+00 1.0 2.84e+07 1.3 1.6e+05 8.7e+02 1.6e+02 1 0 2 0 5 5 0 5 0 6 1585 0 40 4.06e+01 10 1.67e-01 0 MIS/Agg 10 1.0 2.0936e-02 1.0 0.00e+00 0.0 6.0e+05 9.3e+02 1.4e+02 0 0 7 0 4 0 0 16 0 6 0 0 0 0.00e+00 0 0.00e+00 0 SA: col data 10 1.0 1.0322e-01 1.0 0.00e+00 0.0 9.9e+05 1.2e+03 6.0e+02 0 0 12 1 18 0 0 27 1 24 0 0 0 0.00e+00 298 5.82e+00 0 SA: frmProl0 10 1.0 1.5743e-01 1.0 0.00e+00 0.0 3.3e+04 1.3e+04 4.0e+01 0 0 0 0 1 0 0 1 0 2 0 0 20 9.65e+00 0 0.00e+00 0 SA: smooth 10 1.0 2.1393e+00 1.1 3.24e+08 1.3 3.0e+05 1.5e+04 1.0e+02 1 2 4 3 3 3 5 8 4 4 28023 0 40 1.50e+02 0 0.00e+00 0 GAMG: partLevel 10 1.0 4.3304e+01 1.0 6.24e+09 1.5 7.2e+05 9.4e+04 5.9e+02 15 36 9 46 18 67 85 20 56 24 25949 0 104 1.68e+02 0 0.00e+00 0 repartition 8 1.0 1.1253e+00 1.0 2.99e+05 3.3 9.6e+04 3.8e+01 1.8e+02 0 0 1 0 6 2 0 3 0 7 41 0 16 8.42e-02 0 0.00e+00 0 Invert-Sort 8 1.0 3.5200e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 3.2e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 Move A 8 1.0 5.0127e-01 1.1 0.00e+00 0.0 9.8e+04 1.6e+04 1.0e+02 0 0 1 1 3 1 0 3 1 4 0 0 24 5.97e+00 0 0.00e+00 0 Move P 8 1.0 2.6089e-01 1.2 0.00e+00 0.0 3.5e+04 2.0e+02 1.0e+02 0 0 0 0 3 0 0 1 0 4 0 0 24 1.28e+01 0 0.00e+00 0 PCSetUp 4 1.0 5.1199e+01 1.0 7.17e+09 1.5 3.5e+06 2.4e+04 2.2e+03 18 42 43 56 67 80 98 96 68 86 25322 2027919 316 5.12e+02 468 1.94e+01 8 --- Event Stage 2: Solve 0 BuildTwoSided 1 1.0 1.0141e-04 1.9 0.00e+00 0.0 2.6e+02 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 5.0009e-0325.7 0.00e+00 0.0 7.8e+02 1.2e+05 0.0e+00 0 0 0 0 0 1 0 0 38 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 3.2740e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.9632e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 5 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 9.4140e-06 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 5.6996e-03 1.9 1.60e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 15 0 0 0 54055 0 0 0.00e+00 2 7.34e-03 0 DMPlexJacobianFE 1 1.0 3.7159e-01 1.0 1.63e+06 1.0 7.8e+02 1.2e+05 0.0e+00 0 0 0 0 0 84 15 0 38 0 837 0 2 3.24e-01 0 0.00e+00 0 SFSetGraph 1 1.0 1.3500e-06 2.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.3106e-04 1.7 0.00e+00 0.0 1.3e+03 4.7e+02 0.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 242 1.0 2.5626e-03 5.7 0.00e+00 0.0 1.8e+05 8.3e+02 0.0e+00 0 0 2 0 0 0 0 90 60 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 242 1.0 1.6312e-02 6.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 42 1.0 2.9131e-04 4.8 0.00e+00 0.0 1.8e+04 2.9e+02 0.0e+00 0 0 0 0 0 0 0 9 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 42 1.0 3.3713e-03103.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 199 1.0 1.9796e-02 2.0 2.01e+0715.5 1.6e+05 9.0e+02 0.0e+00 0 0 2 0 0 3 62 80 57 0 64338 170469 129 7.24e-01 89 1.19e-01 88 MatMultAdd 40 1.0 1.3087e-02 6.8 4.46e+05 8.1 1.7e+04 2.7e+02 0.0e+00 0 0 0 0 0 3 3 9 2 0 4632 0 0 0.00e+00 20 2.67e-02 0 MatMultTranspose 40 1.0 5.5681e-03 3.2 4.46e+05 8.1 1.7e+04 2.7e+02 0.0e+00 0 0 0 0 0 0 3 9 2 0 10887 0 0 0.00e+00 60 5.16e-02 0 MatSolve 20 0.0 1.0105e-04 0.0 2.81e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2776 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 1.3112e-0411.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 2.7689e-04447.3 3.92e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1415 0 0 0.00e+00 0 0.00e+00 0 MatResidual 40 1.0 5.0930e-03 1.9 4.41e+0618.3 3.0e+04 9.0e+02 0.0e+00 0 0 0 0 0 1 12 15 11 0 47335 104899 20 1.28e-01 20 2.67e-02 86 MatAssemblyBegin 1 1.0 5.4283e-03 2.9 0.00e+00 0.0 7.8e+02 1.2e+05 0.0e+00 0 0 0 0 0 1 0 0 38 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 4.0168e-03 4.1 2.23e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 886 0 2 3.24e-01 0 0.00e+00 0 MatGetRowIJ 1 0.0 4.0155e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 8.2927e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 1.9354e-0520.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.1723e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 3.24e-01 0 0.00e+00 0 VecTDot 80 1.0 9.5140e-03 1.1 2.12e+04 2.0 0.0e+00 0.0e+00 8.0e+01 0 0 0 0 2 2 0 0 0 55 404 719 0 0.00e+00 0 0.00e+00 98 VecNorm 44 1.0 9.1983e-03 1.8 1.18e+04 2.0 0.0e+00 0.0e+00 4.4e+01 0 0 0 0 1 1 0 0 0 30 234 665 0 0.00e+00 0 0.00e+00 98 VecCopy 126 1.0 1.5928e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.34e-03 0 VecSet 208 1.0 1.6521e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 81 1.0 2.1194e-03 1.4 2.20e+04 2.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1879 1901 2 2.67e-03 0 0.00e+00 98 VecAYPX 276 1.0 6.9411e-03 1.2 5.42e+04 2.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 1403 1373 0 0.00e+00 0 0.00e+00 97 VecAXPBYCZ 80 1.0 2.9534e-03 1.2 7.20e+04 2.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 1 0 0 0 4462 4810 0 0.00e+00 0 0.00e+00 97 VecPointwiseMult 182 1.0 3.2223e-03 1.2 2.24e+04 2.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 955 936 3 4.01e-03 0 0.00e+00 95 VecScatterBegin 279 1.0 5.1198e-03 1.8 0.00e+00 0.0 1.9e+05 7.9e+02 0.0e+00 0 0 2 0 0 1 0 98 61 0 0 0 0 0.00e+00 89 1.19e-01 0 VecScatterEnd 279 1.0 1.6441e-02 3.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 134 1.0 3.4663e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 134 7.31e-01 0 0.00e+00 0 VecCUDACopyFrom 90 1.0 2.1392e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 90 1.03e-01 0 VecCopyFromSome 89 1.0 2.3399e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 89 1.19e-01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 9.7799e-01 1.0 4.13e+07 7.5 5.0e+05 2.0e+03 6.1e+02 0 0 6 1 19 223165253412423 3484 30341 200 2.46e+00 267 2.79e-01 37 SNESSetUp 1 1.0 6.9724e-05 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 1.0045e-02 1.4 1.67e+06 1.0 3.4e+03 5.4e+02 1.7e+01 0 0 0 0 1 2 15 2 1 12 31236 0 0 0.00e+00 8 2.00e-02 0 SNESJacobianEval 1 1.0 3.7262e-01 1.0 1.65e+06 1.0 1.3e+03 7.2e+04 0.0e+00 0 0 0 0 0 85 15 1 38 0 842 0 2 3.24e-01 1 3.67e-03 0 KSPSetUp 3 1.0 2.5503e-04 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 5.7053e-02 1.0 2.12e+0714.1 1.9e+05 7.9e+02 1.3e+02 0 0 2 0 4 13 70 98 61 87 25086 39547 132 7.28e-01 170 1.99e-01 80 PCSetUp 1 1.0 5.1865e-0411.3 3.92e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 755 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 20 1.0 5.2414e-0410.0 3.92e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 747 0 0 0.00e+00 0 0.00e+00 0 PCApply 20 1.0 4.5044e-02 1.1 2.09e+0716.6 1.7e+05 7.7e+02 6.8e+01 0 0 2 0 2 10 60 85 52 47 27288 45419 113 6.07e-01 151 1.73e-01 77 --- Event Stage 3: Solve 1 BuildTwoSided 1 1.0 1.3634e-04 3.0 0.00e+00 0.0 2.6e+02 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 3.4673e-02169.9 0.00e+00 0.0 7.8e+02 5.4e+05 0.0e+00 0 0 0 0 0 1 0 0 34 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 3.2718e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 3.1634e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 9.0180e-06 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 2.4969e-02 1.1 1.28e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 11 0 0 0 98712 0 0 0.00e+00 2 3.96e-02 0 DMPlexJacobianFE 1 1.0 3.0088e+00 1.0 1.30e+07 1.0 7.8e+02 5.4e+05 0.0e+00 1 0 0 0 0 93 11 0 34 0 831 0 2 3.06e+00 0 0.00e+00 0 SFSetGraph 1 1.0 4.2050e-06 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.9292e-04 1.5 0.00e+00 0.0 1.3e+03 1.8e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 297 1.0 8.2540e-0311.8 0.00e+00 0.0 6.7e+05 1.2e+03 0.0e+00 0 0 8 1 0 0 0 89 64 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 297 1.0 1.1599e-0111.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 52 1.0 7.8447e-04 4.2 0.00e+00 0.0 8.2e+04 3.0e+02 0.0e+00 0 0 1 0 0 0 0 11 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 52 1.0 9.0737e-03108.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 244 1.0 4.4477e-02 2.4 1.06e+08 2.9 5.9e+05 1.3e+03 0.0e+00 0 0 7 1 0 1 69 78 62 0 338140 1466102 159 3.24e+00 109 1.25e+00 86 MatMultAdd 50 1.0 1.1173e-0119.3 4.55e+06 2.5 8.1e+04 2.8e+02 0.0e+00 0 0 1 0 0 3 3 11 2 0 6337 0 0 0.00e+00 25 2.87e-01 0 MatMultTranspose 50 1.0 1.2744e-02 3.8 4.55e+06 2.5 8.1e+04 2.8e+02 0.0e+00 0 0 1 0 0 0 3 11 2 0 55555 0 0 0.00e+00 75 4.03e-01 0 MatSolve 25 0.0 3.9348e-03 0.0 1.15e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2924 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 3.9489e-025729.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 3.4293e-0259024.3 6.86e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2000 0 0 0.00e+00 0 0.00e+00 0 MatResidual 50 1.0 1.0273e-02 2.3 2.11e+07 3.1 1.3e+05 1.2e+03 0.0e+00 0 0 2 0 0 0 13 17 12 0 282697 951932 25 5.50e-01 25 2.86e-01 84 MatAssemblyBegin 1 1.0 3.6323e-02 3.8 0.00e+00 0.0 7.8e+02 5.4e+05 0.0e+00 0 0 0 0 0 1 0 0 34 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 6.9149e-0247.1 9.96e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 246 0 2 3.06e+00 0 0.00e+00 0 MatGetRowIJ 1 0.0 9.4935e-04 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 1.7659e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 3.3767e-04 9.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 5.9421e-0241.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 2 3.06e+00 0 0.00e+00 0 VecTDot 90 1.0 1.1746e-02 1.3 2.12e+05 1.7 0.0e+00 0.0e+00 9.0e+01 0 0 0 0 3 0 0 0 0 56 3281 6464 0 0.00e+00 0 0.00e+00 99 VecNorm 49 1.0 1.3144e-02 2.0 1.16e+05 1.7 0.0e+00 0.0e+00 4.9e+01 0 0 0 0 2 0 0 0 0 31 1614 5408 0 0.00e+00 0 0.00e+00 99 VecCopy 156 1.0 2.0780e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.15e-02 0 VecSet 253 1.0 2.0856e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 91 1.0 2.4404e-03 1.3 2.17e+05 1.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 16239 16439 2 2.29e-02 0 0.00e+00 99 VecAYPX 341 1.0 7.5848e-03 1.2 5.74e+05 1.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 13594 13501 0 0.00e+00 0 0.00e+00 97 VecAXPBYCZ 100 1.0 3.5630e-03 1.2 7.82e+05 1.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 39569 44014 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 222 1.0 3.8305e-03 1.3 1.82e+05 1.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 8362 8356 3 3.44e-02 0 0.00e+00 95 VecScatterBegin 344 1.0 1.2602e-02 2.8 0.00e+00 0.0 7.5e+05 1.1e+03 0.0e+00 0 0 9 1 0 0 0 99 66 0 0 0 0 0.00e+00 109 1.25e+00 0 VecScatterEnd 344 1.0 1.1437e-01 6.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 164 1.0 3.6137e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 164 3.29e+00 0 0.00e+00 0 VecCUDACopyFrom 110 1.0 2.8374e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 110 8.46e-01 0 VecCopyFromSome 109 1.0 3.7012e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 109 1.25e+00 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 4.4990e+00 1.0 2.56e+08 2.7 1.3e+06 4.0e+03 6.1e+02 2 1 16 4 19 141165172414379 8035 315516 230 1.70e+01 307 2.43e+00 40 SNESSetUp 1 1.0 6.9174e-05 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 3.3681e-02 1.2 1.32e+07 1.0 3.4e+03 2.1e+03 1.7e+01 0 0 0 0 1 1 11 0 1 11 73903 0 0 0.00e+00 8 1.25e-01 0 SNESJacobianEval 1 1.0 3.0103e+00 1.0 1.32e+07 1.0 1.3e+03 3.3e+05 0.0e+00 1 0 0 0 0 93 11 0 34 0 834 0 2 3.06e+00 1 1.98e-02 0 KSPSetUp 3 1.0 1.0776e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 1.8367e-01 1.0 1.27e+08 3.1 7.5e+05 1.1e+03 1.4e+02 0 1 9 1 4 6 77 99 66 88 92061 352793 162 3.27e+00 210 1.95e+00 79 PCSetUp 1 1.0 7.5576e-021958.7 6.86e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 907 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 25 1.0 7.5584e-021590.3 6.86e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 907 0 0 0.00e+00 0 0.00e+00 0 PCApply 25 1.0 1.6722e-01 1.0 1.23e+08 3.5 7.2e+05 1.0e+03 6.8e+01 0 0 9 0 2 5 66 95 57 42 86747 407101 138 2.74e+00 186 1.67e+00 75 --- Event Stage 4: Solve 2 BuildTwoSided 1 1.0 3.2060e-04 7.0 0.00e+00 0.0 2.6e+02 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 2.3701e-01392.1 0.00e+00 0.0 7.8e+02 2.3e+06 0.0e+00 0 0 0 1 0 1 0 0 38 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 3.6931e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 3.0274e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.0856e-05 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.7607e-01 1.0 1.03e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 1 11 0 0 0 111993 0 0 0.00e+00 2 2.53e-01 0 DMPlexJacobianFE 1 1.0 2.3691e+01 1.0 1.05e+08 1.0 7.8e+02 2.3e+06 0.0e+00 8 1 0 1 0 98 11 0 38 0 846 0 2 2.64e+01 0 0.00e+00 0 SFSetGraph 1 1.0 2.5093e-05 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 5.9755e-04 1.3 0.00e+00 0.0 1.3e+03 6.9e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 432 1.0 1.2027e-02 4.4 0.00e+00 0.0 6.9e+05 4.1e+03 0.0e+00 0 0 8 2 0 0 0 90 60 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 432 1.0 6.0557e-02 4.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 77 1.0 9.4024e-04 3.5 0.00e+00 0.0 7.7e+04 9.9e+02 0.0e+00 0 0 1 0 0 0 0 10 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 77 1.0 6.7950e-0294.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 354 1.0 7.3721e-02 1.6 7.55e+08 1.7 6.2e+05 4.5e+03 0.0e+00 0 4 8 2 0 0 70 80 59 0 1782625 10150206 269 1.44e+01 219 1.30e+01 99 MatMultAdd 75 1.0 3.6965e-02 4.4 3.42e+07 1.5 7.6e+04 8.9e+02 0.0e+00 0 0 1 0 0 0 3 10 1 0 167353 1965473 25 2.78e-01 75 4.86e-01 92 MatMultTranspose 75 1.0 1.9374e-01 1.5 3.36e+07 1.5 7.6e+04 8.9e+02 0.0e+00 0 0 1 0 0 1 3 10 1 0 31389 1566697 2 7.23e+00 125 5.56e-01 92 MatSolve 25 0.0 4.2642e-04 0.0 7.17e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1681 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.3310e-0431.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 7.1943e-041120.6 1.14e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1591 0 0 0.00e+00 0 0.00e+00 0 MatResidual 75 1.0 1.7607e-02 1.5 1.47e+08 1.7 1.3e+05 4.1e+03 0.0e+00 0 1 2 0 0 0 14 17 12 0 1443337 5514277 50 2.82e+00 50 2.47e+00 99 MatAssemblyBegin 1 1.0 2.5252e-01 5.5 0.00e+00 0.0 7.8e+02 2.3e+06 0.0e+00 0 0 0 1 0 1 0 0 38 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 1.8343e-0120.2 4.20e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 400 0 2 2.64e+01 0 0.00e+00 0 MatGetRowIJ 1 0.0 7.0818e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 1.2238e-04 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.4487e-03 4.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.4295e-0115.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 2 2.64e+01 0 0.00e+00 0 VecTDot 111 1.0 1.5389e-02 1.3 1.70e+06 1.3 0.0e+00 0.0e+00 1.1e+02 0 0 0 0 3 0 0 0 0 57 20729 41491 0 0.00e+00 0 0.00e+00 100 VecNorm 60 1.0 2.4531e-02 2.3 9.35e+05 1.3 0.0e+00 0.0e+00 6.0e+01 0 0 0 0 2 0 0 0 0 31 7157 34976 0 0.00e+00 0 0.00e+00 100 VecCopy 233 1.0 4.0863e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 27 2.03e-01 0 VecSet 283 1.0 2.6923e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 111 1.0 3.1198e-03 1.3 1.75e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 105112 108454 2 1.90e-01 0 0.00e+00 100 VecAYPX 500 1.0 1.6056e-02 1.2 4.62e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 53716 59121 25 1.04e-01 0 0.00e+00 100 VecAXPBYCZ 150 1.0 6.8074e-03 1.1 6.39e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 174933 195464 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 333 1.0 7.7011e-03 1.1 1.42e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 34355 36815 31 4.01e-01 0 0.00e+00 100 VecScatterBegin 504 1.0 3.2234e-02 1.5 0.00e+00 0.0 7.7e+05 3.8e+03 0.0e+00 0 0 9 2 0 0 0 99 62 0 0 0 0 0.00e+00 319 1.38e+01 0 VecScatterEnd 504 1.0 1.0878e-01 7.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 352 1.0 9.1851e-03 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 352 1.54e+01 0 0.00e+00 0 VecCUDACopyFrom 186 1.0 4.6177e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 186 1.87e+00 0 VecCopyFromSome 269 1.0 1.8271e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 269 1.34e+01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.9987e+01 1.0 1.82e+09 1.6 1.5e+06 1.4e+04 8.4e+02 11 10 18 14 26 124172190424431 10734 2043943 450 1.08e+02 601 1.76e+01 48 SNESSetUp 1 1.0 6.9708e-05 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 2.0562e-01 1.1 1.05e+08 1.0 3.4e+03 8.0e+03 1.7e+01 0 1 0 0 1 1 11 0 1 9 96390 0 0 0.00e+00 8 8.85e-01 0 SNESJacobianEval 1 1.0 2.3695e+01 1.0 1.05e+08 1.0 1.3e+03 1.4e+06 0.0e+00 8 1 0 1 0 98 11 0 38 0 848 0 2 2.64e+01 1 1.26e-01 0 KSPSetUp 4 1.0 1.2282e-0216.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 3.6275e-01 1.0 8.40e+08 1.7 7.7e+05 3.8e+03 1.8e+02 0 5 9 2 5 1 79 99 62 90 404698 2263430 352 2.24e+01 446 1.43e+01 99 PCSetUp 1 1.0 1.1008e-0327.5 1.14e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1040 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 25 1.0 1.1092e-0321.8 1.14e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1032 0 0 0.00e+00 0 0.00e+00 0 PCApply 25 1.0 3.4355e-01 1.0 7.27e+08 1.7 7.4e+05 3.5e+03 1.0e+02 0 4 9 2 3 1 67 95 54 53 366821 2330269 328 2.05e+01 422 1.20e+01 99 --- Event Stage 5: Solve 3 BuildTwoSided 1 1.0 2.7739e-0356.9 0.00e+00 0.0 2.6e+02 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 1.8626e+003409.1 0.00e+00 0.0 7.8e+02 9.4e+06 0.0e+00 1 0 0 5 0 1 0 0 38 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 3.6285e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 2.9044e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.0526e-05 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.4140e+00 1.0 8.22e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 5 0 0 0 1 10 0 0 0 111561 0 0 0.00e+00 2 1.79e+00 0 DMPlexJacobianFE 1 1.0 1.8861e+02 1.0 8.37e+08 1.0 7.8e+02 9.4e+06 0.0e+00 66 5 0 5 0 99 10 0 38 0 852 0 2 2.20e+02 0 0.00e+00 0 SFSetGraph 1 1.0 1.8572e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 4.5328e-03 2.0 0.00e+00 0.0 1.3e+03 2.7e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 448 1.0 3.7395e-02 7.9 0.00e+00 0.0 2.6e+06 4.5e+03 0.0e+00 0 0 31 8 0 0 0 91 60 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 448 1.0 3.8483e-01 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 80 1.0 2.4736e-03 2.1 0.00e+00 0.0 2.5e+05 1.1e+03 0.0e+00 0 0 3 0 0 0 0 9 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 80 1.0 6.7832e-0216.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 367 1.0 2.9649e-01 1.4 6.09e+09 1.3 2.3e+06 4.9e+03 0.0e+00 0 36 28 8 0 0 72 82 59 0 3834503 30668857 279 5.43e+01 227 1.10e+02 99 MatMultAdd 78 1.0 2.6977e-01 7.8 2.85e+08 1.2 2.5e+05 9.4e+02 0.0e+00 0 2 3 0 0 0 3 9 1 0 196993 1982378 26 9.86e-01 78 2.67e+00 93 MatMultTranspose 78 1.0 2.7023e-01 1.2 2.81e+08 1.2 2.5e+05 9.4e+02 0.0e+00 0 2 3 0 0 0 3 9 1 0 193964 4588869 2 5.99e+01 130 2.93e+00 92 MatSolve 26 0.0 7.1992e-03 0.0 2.01e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2793 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 6.9023e-029352.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 7.3687e-02116225.9 1.53e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2077 0 0 0.00e+00 0 0.00e+00 0 MatResidual 78 1.0 6.1878e-02 1.5 1.18e+09 1.3 5.2e+05 4.3e+03 0.0e+00 0 7 6 2 0 0 14 18 12 0 3563921 26252556 52 1.05e+01 52 2.09e+01 99 MatAssemblyBegin 1 1.0 1.9036e+00 8.9 0.00e+00 0.0 7.8e+02 9.4e+06 0.0e+00 1 0 0 5 0 1 0 0 38 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 5.0554e-01 7.1 1.72e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 601 0 2 2.20e+02 0 0.00e+00 0 MatGetRowIJ 1 0.0 1.6434e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 2.4523e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 1.8852e-02 2.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 3.3710e-01 4.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 2.20e+02 0 0.00e+00 0 VecTDot 113 1.0 2.8311e-02 1.9 1.40e+07 1.1 0.0e+00 0.0e+00 1.1e+02 0 0 0 0 4 0 0 0 0 57 94266 305859 0 0.00e+00 0 0.00e+00 100 VecNorm 61 1.0 9.7698e-02 3.4 7.71e+06 1.1 0.0e+00 0.0e+00 6.1e+01 0 0 0 0 2 0 0 0 0 31 14996 285792 0 0.00e+00 0 0.00e+00 100 VecCopy 242 1.0 1.1019e-02 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 28 1.65e+00 0 VecSet 293 1.0 3.5142e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 113 1.0 3.6284e-03 1.3 1.44e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 755541 824237 2 1.55e+00 0 0.00e+00 100 VecAYPX 519 1.0 3.6909e-02 2.1 3.84e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 197158 210721 26 8.44e-01 0 0.00e+00 100 VecAXPBYCZ 156 1.0 1.2747e-02 2.0 5.31e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 789264 841983 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 345 1.0 1.2282e-02 1.6 1.17e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 181267 196372 32 3.26e+00 0 0.00e+00 100 VecScatterBegin 523 1.0 1.5935e-01 1.6 0.00e+00 0.0 2.8e+06 4.2e+03 0.0e+00 0 0 34 8 0 0 0100 61 0 0 0 0 0.00e+00 331 1.13e+02 0 VecScatterEnd 523 1.0 3.4463e-01 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 365 1.0 1.5543e-02 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 365 6.09e+01 0 0.00e+00 0 VecCUDACopyFrom 193 1.0 7.2766e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 193 1.30e+01 0 VecCopyFromSome 279 1.0 1.2059e-01 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 279 1.12e+02 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.3473e+02 1.0 1.48e+10 1.3 4.8e+06 1.7e+04 8.1e+02 83 88 58 56 25 123172169427409 11647 9224075 463 7.82e+02 618 1.41e+02 49 SNESSetUp 1 1.0 7.6248e-03186.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 1.5381e+00 1.1 8.30e+08 1.0 3.4e+03 3.2e+04 1.7e+01 1 5 0 0 1 1 10 0 1 9 102826 0 0 0.00e+00 8 6.67e+00 0 SNESJacobianEval 1 1.0 1.8864e+02 1.0 8.40e+08 1.0 1.3e+03 5.7e+06 0.0e+00 66 5 0 5 0 99 10 0 38 0 853 0 2 2.20e+02 1 8.95e-01 0 KSPSetUp 4 1.0 1.3221e-0231.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 8.9060e-01 1.0 6.79e+09 1.2 2.8e+06 4.2e+03 1.8e+02 0 41 34 8 6 0 80100 61 90 1424751 9677127 365 1.19e+02 463 1.17e+02 99 PCSetUp 1 1.0 1.4524e-013517.8 1.53e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1054 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 26 1.0 1.4526e-012602.1 1.53e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1053 0 0 0.00e+00 0 0.00e+00 0 PCApply 26 1.0 8.3604e-01 1.1 5.84e+09 1.2 2.8e+06 3.7e+03 1.0e+02 0 35 34 7 3 0 69 99 54 52 1302488 9500029 340 1.12e+02 438 9.78e+01 99 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Object 0 680 446080 0. Container 0 56 34944 0. Distributed Mesh 0 114 578416 0. DM Label 0 48 33408 0. GraphPartitioner 0 36 26240 0. Index Set 0 190 897288 0. IS L to G Mapping 0 6 550176 0. Section 0 204 159936 0. Star Forest Graph 0 186 180864 0. Discrete System 0 97 97808 0. Matrix 0 114 451173792 0. Matrix Null Space 0 4 2976 0. Vector 0 244 14891064 0. SNES 0 4 6128 0. DMSNES 0 4 2880 0. Krylov Solver 0 32 67552 0. DMKSP interface 0 4 2816 0. Preconditioner 0 22 26016 0. Linear Space 0 8 5952 0. Dual Space 0 32 26624 0. FE Space 0 8 6976 0. Vec Scatter 0 24 20544 0. Field over DM 0 4 3040 0. Viewer 1 1 896 0. --- Event Stage 1: Mesh Setup Object 704 212 139072 0. Container 60 32 19968 0. Distributed Mesh 208 146 740976 0. DM Label 98 66 45936 0. GraphPartitioner 64 44 32064 0. Index Set 1602 1484 3103728 0. IS L to G Mapping 15 9 172344 0. Section 416 292 228928 0. Star Forest Graph 573 459 448832 0. Discrete System 272 219 220752 0. Matrix 495 385 241973728 0. Matrix Partitioning 8 8 5952 0. Matrix Coarsen 10 10 6840 0. Matrix Null Space 4 0 0 0. Vector 828 664 13004512 0. SNES 4 0 0 0. DMSNES 4 0 0 0. Krylov Solver 42 10 19520 0. Preconditioner 32 10 9120 0. Linear Space 8 4 2976 0. Dual Space 32 16 13312 0. FE Space 8 4 3488 0. Vec Scatter 96 72 61632 0. Field over DM 4 4 3040 0. Viewer 1 0 0 0. PetscRandom 20 20 13880 0. --- Event Stage 2: Solve 0 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 54720 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 18 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 3: Solve 1 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 68064 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 18 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 4: Solve 2 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 120672 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 5: Solve 3 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 329568 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. ======================================================================================================================== Average time to get PetscTime(): 3.79e-08 Average time for MPI_Barrier(): 6.5522e-06 Average time for zero size MPI_Send(): 6.76328e-06 #PETSc Option Table entries: -bmat_view :bmcpu.m:ascii_matlab -cells 8,12,16 -check_pointer_intensity 0 -ex56_dm_mat_type aijcusparse -ex56_dm_refine 3 -ex56_dm_vec_type cuda -gamg_est_ksp_max_it 10 -gamg_est_ksp_type cg -ksp_atol 1.e-71 -ksp_converged_reason -ksp_max_it 100 -ksp_monitor -ksp_norm_type preconditioned -ksp_rtol 1.e-11 -ksp_type cg -log_view -lvec_view :lvcpu.m:ascii_matlab -mat_block_size 3 -matptap_via scalable -max_conv_its 4 -mg_levels_esteig_ksp_max_it 10 -mg_levels_esteig_ksp_type cg -mg_levels_ksp_chebyshev_esteig 0,0.05,0,1.05 -mg_levels_ksp_max_it 2 -mg_levels_ksp_type chebyshev -mg_levels_pc_type jacobi -pc_gamg_agg_nsmooths 1 -pc_gamg_coarse_eq_limit 1000 -pc_gamg_process_eq_limit 150 -pc_gamg_repartition true -pc_gamg_reuse_interpolation true -pc_gamg_square_graph 10 -pc_gamg_threshold 0.05 -pc_gamg_threshold_scale .5 -pc_gamg_type agg -pc_type gamg -petscpartitioner_type simple -petscspace_degree 2 -run_type 1 -snes_converged_reason -snes_max_it 2 -snes_monitor -snes_rtol 1.e-10 -snes_type ksponly -use_mat_nearnullspace true -xvec_view :xvcpu.m:ascii_matlab #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with 64 bit PetscInt Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 8 Configure options: --with-cc=mpicc --with-cxx=mpiCC --with-fc=mpif90 COPTFLAGS="-g -fast" CXXOPTFLAGS="-g -fast" FOPTFLAGS="-g -fast" --with-ssl=0 --with-batch=0 --with-mpiexec="jsrun -g 1" --with-cuda=1 --with-cudac=nvcc CUDAFLAGS="-ccbin pgc++" --download-metis --download-viennacl --download-parmetis --download-fblaslapack --with-x=0 --with-64-bit-indices=1 --with-debugging=0 PETSC_ARCH=arch-summit-opt64-pgi-cuda ----------------------------------------- Libraries compiled on 2019-08-13 01:26:30 on login5 Machine characteristics: Linux-4.14.0-115.8.1.el7a.ppc64le-ppc64le-with-redhat-7.6-Maipo Using PETSc directory: /ccs/home/adams/petsc Using PETSc arch: arch-summit-opt64-pgi-cuda ----------------------------------------- Using C compiler: mpicc -g -fast -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include Using Fortran compiler: mpif90 -g -fast -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include ----------------------------------------- Using include paths: -I/ccs/home/adams/petsc/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/sw/summit/cuda/10.1.168/include ----------------------------------------- Using C linker: mpicc Using Fortran linker: mpif90 Using libraries: -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -lpetsc -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -Wl,-rpath,/sw/summit/cuda/10.1.168/lib64 -L/sw/summit/cuda/10.1.168/lib64 /autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib/pgi.ld -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -L/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -L/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -Wl,-rpath,/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -L/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -lflapack -lfblas -lparmetis -lmetis -lcufft -lcublas -lcudart -lcusparse -lcusolver -lstdc++ -ldl -lpthread -lmpiprofilesupport -lmpi_ibm_usempi -lmpi_ibm_mpifh -lmpi_ibm -lpgf90rtl -lpgf90 -lpgf90_rpm1 -lpgf902 -lpgftnrtl -latomic -lpgkomp -lomp -lomptarget -lpgmath -lpgc -lrt -lmass_simdp9 -lmassvp9 -lmassp9 -lm -lgcc_s -lstdc++ -ldl -----------------------------------------