[0] 275373 global equations, 91791 vertices [0] 275373 equations in vector, 91791 vertices 0 SNES Function norm 2.615842974236e+00 0 KSP Residual norm 4.893363371925e+03 1 KSP Residual norm 5.285544617825e+02 2 KSP Residual norm 1.813953617805e+02 3 KSP Residual norm 4.512787397424e+01 4 KSP Residual norm 1.213923133932e+01 5 KSP Residual norm 3.016216968404e+00 6 KSP Residual norm 9.543596029375e-01 7 KSP Residual norm 2.718366430936e-01 8 KSP Residual norm 6.934042194539e-02 9 KSP Residual norm 2.272757651759e-02 10 KSP Residual norm 6.718361794302e-03 11 KSP Residual norm 1.806377705839e-03 12 KSP Residual norm 6.155874869965e-04 13 KSP Residual norm 1.694251865653e-04 14 KSP Residual norm 5.256574624260e-05 15 KSP Residual norm 1.802562819609e-05 16 KSP Residual norm 5.902778275067e-06 17 KSP Residual norm 1.817944385698e-06 18 KSP Residual norm 5.412987503226e-07 19 KSP Residual norm 1.649307005981e-07 20 KSP Residual norm 4.990910946275e-08 21 KSP Residual norm 1.491004630633e-08 Linear solve converged due to CONVERGED_RTOL iterations 21 1 SNES Function norm 5.511924495104e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 2280285 global equations, 760095 vertices [0] 2280285 equations in vector, 760095 vertices 0 SNES Function norm 9.255869095573e-01 0 KSP Residual norm 1.193608519545e+04 1 KSP Residual norm 1.108901146134e+03 2 KSP Residual norm 5.971445407605e+02 3 KSP Residual norm 1.787687112588e+02 4 KSP Residual norm 7.591464821799e+01 5 KSP Residual norm 3.599192091715e+01 6 KSP Residual norm 1.226475625351e+01 7 KSP Residual norm 4.760403299206e+00 8 KSP Residual norm 2.294959492715e+00 9 KSP Residual norm 9.414963860709e-01 10 KSP Residual norm 4.496416168022e-01 11 KSP Residual norm 1.875641388771e-01 12 KSP Residual norm 7.449799370699e-02 13 KSP Residual norm 3.342233390288e-02 14 KSP Residual norm 1.210550602370e-02 15 KSP Residual norm 5.516787473983e-03 16 KSP Residual norm 2.274495309953e-03 17 KSP Residual norm 9.215113298948e-04 18 KSP Residual norm 4.092213984072e-04 19 KSP Residual norm 1.823068237263e-04 20 KSP Residual norm 6.722843831839e-05 21 KSP Residual norm 2.942354457195e-05 22 KSP Residual norm 1.316414171131e-05 23 KSP Residual norm 5.659853381786e-06 24 KSP Residual norm 2.479084587893e-06 25 KSP Residual norm 9.865472969455e-07 26 KSP Residual norm 3.901497873772e-07 27 KSP Residual norm 1.778096650627e-07 28 KSP Residual norm 7.510111206598e-08 Linear solve converged due to CONVERGED_RTOL iterations 28 1 SNES Function norm 9.135775309725e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 18556605 global equations, 6185535 vertices [0] 18556605 equations in vector, 6185535 vertices 0 SNES Function norm 3.273111572912e-01 0 KSP Residual norm 2.850037855767e+04 1 KSP Residual norm 2.908686545838e+03 2 KSP Residual norm 1.988145766702e+03 3 KSP Residual norm 6.352468879259e+02 4 KSP Residual norm 1.931078940058e+02 5 KSP Residual norm 7.306723092276e+01 6 KSP Residual norm 3.193049889585e+01 7 KSP Residual norm 8.598740601849e+00 8 KSP Residual norm 3.154390494696e+00 9 KSP Residual norm 1.354041620852e+00 10 KSP Residual norm 4.999509757008e-01 11 KSP Residual norm 1.572917617359e-01 12 KSP Residual norm 5.768356261071e-02 13 KSP Residual norm 2.247005220923e-02 14 KSP Residual norm 7.838244438909e-03 15 KSP Residual norm 3.196860964478e-03 16 KSP Residual norm 1.263838875947e-03 17 KSP Residual norm 4.678636073358e-04 18 KSP Residual norm 1.906374548847e-04 19 KSP Residual norm 7.529682552859e-05 20 KSP Residual norm 2.823928234485e-05 21 KSP Residual norm 1.032296614240e-05 22 KSP Residual norm 3.934123476054e-06 23 KSP Residual norm 1.511022310992e-06 24 KSP Residual norm 5.818914873099e-07 25 KSP Residual norm 2.324856357904e-07 Linear solve converged due to CONVERGED_RTOL iterations 25 1 SNES Function norm 9.183049943276e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 149720445 global equations, 49906815 vertices [0] 149720445 equations in vector, 49906815 vertices 0 SNES Function norm 1.157278881750e-01 0 KSP Residual norm 6.922758548206e+04 1 KSP Residual norm 6.026176111227e+03 2 KSP Residual norm 5.289926559238e+03 3 KSP Residual norm 2.134026576015e+03 4 KSP Residual norm 5.977935729535e+02 5 KSP Residual norm 2.264375602816e+02 6 KSP Residual norm 1.001701901923e+02 7 KSP Residual norm 3.579201833443e+01 8 KSP Residual norm 1.305457399086e+01 9 KSP Residual norm 5.524945390280e+00 10 KSP Residual norm 2.492400136974e+00 11 KSP Residual norm 9.300922807682e-01 12 KSP Residual norm 3.348063963193e-01 13 KSP Residual norm 1.323388652514e-01 14 KSP Residual norm 5.474456573490e-02 15 KSP Residual norm 2.254385559633e-02 16 KSP Residual norm 9.494681673593e-03 17 KSP Residual norm 4.005623254321e-03 18 KSP Residual norm 1.654335606747e-03 19 KSP Residual norm 7.466575257129e-04 20 KSP Residual norm 3.224684651220e-04 21 KSP Residual norm 1.342559095042e-04 22 KSP Residual norm 5.810095031835e-05 23 KSP Residual norm 2.474268679638e-05 24 KSP Residual norm 1.025693281363e-05 25 KSP Residual norm 4.172439985712e-06 26 KSP Residual norm 1.761745730137e-06 27 KSP Residual norm 7.219657070662e-07 28 KSP Residual norm 3.038681503879e-07 Linear solve converged due to CONVERGED_RTOL iterations 28 1 SNES Function norm 2.618850079506e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 1) N= 2280285, max displ=5.9969946e+01, disp diff= 3.95e-03, error=5.262e-03, rate=0.81 [0] 2) N= 18556605, max displ=5.9974959e+01, disp diff= 5.01e-03, error=2.493e-04, rate=4.4 [0] 3) N= 149720445, max displ=5.9975171e+01, disp diff= 2.12e-04, error=3.740e-05, rate=2.7 ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./ex56 on a arch-summit-opt64-pgi-cuda named e33n06 with 1536 processors, by adams Wed Aug 14 10:53:58 2019 Using Petsc Development GIT revision: v3.11.3-1683-gb35a45d GIT Date: 2019-08-12 14:17:22 -0400 Max Max/Min Avg Total Time (sec): 3.478e+02 1.000 3.478e+02 Objects: 1.124e+04 1.702 6.611e+03 Flop: 1.817e+10 1.354 1.754e+10 2.693e+13 Flop/sec: 5.226e+07 1.354 5.042e+07 7.744e+10 MPI Messages: 1.550e+05 9.360 6.862e+04 1.054e+08 MPI Message Lengths: 1.017e+09 2.765 1.263e+04 1.332e+12 MPI Reductions: 4.037e+03 1.006 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 7.1634e-01 0.2% 0.0000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% 6.000e+00 0.1% 1: Mesh Setup: 7.8326e+01 22.5% 1.1068e+13 41.1% 4.963e+07 47.1% 2.209e+04 82.3% 3.215e+03 80.0% 2: Solve 0: 6.5740e-01 0.2% 2.0455e+10 0.1% 4.350e+06 4.1% 6.323e+02 0.2% 1.510e+02 3.8% 3: Solve 1: 4.0234e+00 1.2% 2.1066e+11 0.8% 1.583e+07 15.0% 8.708e+02 1.0% 2.060e+02 5.1% 4: Solve 2: 4.1859e+01 12.0% 1.5881e+12 5.9% 1.291e+07 12.3% 3.374e+03 3.3% 1.970e+02 4.9% 5: Solve 3: 2.2221e+02 63.9% 1.4048e+13 52.2% 2.268e+07 21.5% 7.727e+03 13.2% 2.400e+02 6.0% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage VecNorm 4 1.0 2.5001e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 35 0 0 0 67 0 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 1: Mesh Setup PetscBarrier 6 1.0 2.0791e-02 1.1 0.00e+00 0.0 2.4e+05 2.1e+01 2.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSided 181 1.0 9.8416e-01 3.2 0.00e+00 0.0 1.9e+06 8.0e+00 0.0e+00 0 0 2 0 0 1 0 4 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 543 1.0 1.4481e+01 7.1 0.00e+00 0.0 6.6e+05 2.9e+05 0.0e+00 1 0 1 14 0 6 0 1 17 0 0 0 0 0.00e+00 0 0.00e+00 0 DMCreateMat 4 1.0 7.5231e+00 1.1 0.00e+00 0.0 8.6e+05 3.9e+05 5.2e+01 2 0 1 26 1 9 0 2 31 2 0 0 8 2.55e+02 0 0.00e+00 0 Mesh Partition 1 1.0 6.3463e-01 2.2 0.00e+00 0.0 9.2e+03 1.2e+03 8.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 Mesh Migration 1 1.0 9.5854e-02 1.0 0.00e+00 0.0 5.0e+04 8.6e+02 2.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartSelf 1 1.0 5.3835e-023394.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblInv 1 1.0 5.9241e-0211.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblSF 1 1.0 1.5600e-02 2.2 0.00e+00 0.0 3.8e+03 9.8e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartStrtSF 1 1.0 2.1614e-01269.1 0.00e+00 0.0 1.5e+03 1.2e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPointSF 1 1.0 5.5842e-03 1.2 0.00e+00 0.0 3.1e+03 2.4e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 32 1.0 4.1323e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistribute 1 1.0 7.3712e-01 1.9 0.00e+00 0.0 6.2e+04 9.9e+02 3.2e+01 0 0 0 0 1 1 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistCones 1 1.0 1.9213e-02 1.1 0.00e+00 0.0 1.0e+04 2.1e+03 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistLabels 1 1.0 3.8978e-02 1.0 0.00e+00 0.0 2.5e+04 4.7e+02 2.1e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistField 1 1.0 3.2217e-02 1.1 0.00e+00 0.0 1.2e+04 6.2e+02 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 58 1.0 6.4329e-0120.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.8e+01 0 0 0 0 1 1 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 58 1.0 6.5770e-0385.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPrealloc 4 1.0 5.3245e+00 1.0 0.00e+00 0.0 8.6e+05 3.9e+05 4.4e+01 2 0 1 26 1 7 0 2 31 1 0 0 8 2.55e+02 0 0.00e+00 0 SFSetGraph 197 1.0 6.1685e-0314.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 181 1.0 1.1256e+00 2.1 0.00e+00 0.0 9.5e+06 1.9e+04 0.0e+00 0 0 9 13 0 1 0 19 16 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 1080 1.0 6.1165e-02 7.4 0.00e+00 0.0 3.1e+07 1.9e+03 0.0e+00 0 0 29 4 0 0 0 62 5 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 1080 1.0 3.7472e-01 4.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 37 1.0 2.0741e-0247.7 0.00e+00 0.0 2.7e+05 4.2e+05 0.0e+00 0 0 0 8 0 0 0 1 10 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 29 1.0 1.7436e-01 3.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpBegin 8 1.0 5.0815e-03258.3 0.00e+00 0.0 5.9e+04 4.8e+05 0.0e+00 0 0 0 2 0 0 0 0 3 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpEnd 8 1.0 8.5315e-02 3.2 0.00e+00 0.0 5.9e+04 4.8e+05 0.0e+00 0 0 0 2 0 0 0 0 3 0 0 0 0 0.00e+00 0 0.00e+00 0 SFDistSection 13 1.0 4.1359e-02 1.2 0.00e+00 0.0 2.1e+05 2.1e+03 1.3e+01 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSectionSF 21 1.0 1.9144e-01 1.2 0.00e+00 0.0 2.6e+05 2.2e+05 0.0e+00 0 0 0 4 0 0 0 1 5 0 0 0 0 0.00e+00 0 0.00e+00 0 SFRemoteOff 8 1.0 6.4699e-0217.4 0.00e+00 0.0 1.2e+05 4.8e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 120 1.0 2.7748e-01 8.6 5.34e+08 1.3 3.5e+06 2.9e+03 0.0e+00 0 3 3 1 0 0 7 7 1 0 2836371 3190769 60 6.05e+00 72 9.89e+00 99 MatConvert 96 1.0 3.2465e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatScale 36 1.0 2.5933e-02 1.5 1.77e+07 1.3 3.5e+05 8.1e+02 0.0e+00 0 0 0 0 0 0 0 1 0 0 1025230 0 0 0.00e+00 12 1.84e-01 0 MatAssemblyBegin 367 1.0 1.4546e+01 6.1 0.00e+00 0.0 6.6e+05 2.9e+05 0.0e+00 1 0 1 14 0 7 0 1 17 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 367 1.0 5.1090e+00 1.1 8.08e+06 5.4 7.8e+06 6.0e+02 4.2e+02 1 0 7 0 11 6 0 16 0 13 1340 0 294 7.10e+02 0 0.00e+00 0 MatCreateSubMat 20 1.0 1.4456e+00 1.0 0.00e+00 0.0 1.1e+06 1.4e+04 2.4e+02 0 0 1 1 6 2 0 2 1 7 0 0 60 2.11e+01 0 0.00e+00 0 MatPartitioning 10 1.0 5.7970e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+01 2 0 0 0 1 7 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatCoarsen 12 1.0 5.8211e-02 1.1 0.00e+00 0.0 1.6e+07 5.5e+02 3.9e+02 0 0 15 1 10 0 0 32 1 12 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 19 1.0 5.1682e-03 3.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAXPY 12 1.0 4.9929e-01 1.6 7.06e+05 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 2140 0 24 7.64e+01 0 0.00e+00 0 MatTranspose 24 1.0 6.9880e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMatMult 12 1.0 1.9287e+00 1.0 3.20e+08 1.3 3.4e+06 1.1e+04 1.0e+02 1 2 3 3 2 2 4 7 4 3 244838 0 24 7.64e+01 0 0.00e+00 0 MatMatMultSym 12 1.0 1.4620e+00 1.0 0.00e+00 0.0 2.7e+06 9.7e+03 9.6e+01 0 0 3 2 2 2 0 6 2 3 0 0 24 7.64e+01 0 0.00e+00 0 MatMatMultNum 12 1.0 4.4523e-01 1.0 3.20e+08 1.3 7.0e+05 1.7e+04 0.0e+00 0 2 1 1 0 1 4 1 1 0 1060642 0 0 0.00e+00 0 0.00e+00 0 MatPtAP 12 1.0 4.5685e+01 1.0 6.55e+09 1.6 6.0e+06 1.0e+05 1.3e+02 13 35 6 46 3 58 86 12 56 4 207383 0 48 1.62e+02 0 0.00e+00 0 MatPtAPSymbolic 12 1.0 2.0426e+01 1.0 0.00e+00 0.0 3.7e+06 1.2e+05 8.4e+01 6 0 3 32 2 26 0 7 39 3 0 0 0 0.00e+00 0 0.00e+00 0 MatPtAPNumeric 12 1.0 2.5288e+01 1.0 6.55e+09 1.6 2.3e+06 8.0e+04 4.8e+01 7 35 2 14 1 32 86 5 17 1 374658 0 48 1.62e+02 0 0.00e+00 0 MatTrnMatMult 12 1.0 1.8451e+00 1.0 4.54e+07 1.3 2.3e+06 2.1e+04 1.4e+02 1 0 2 4 3 2 1 5 4 4 36995 0 38 6.70e+01 0 0.00e+00 0 MatTrnMatMultSym 12 1.0 1.1952e+00 1.0 0.00e+00 0.0 1.5e+06 1.7e+04 1.1e+02 0 0 1 2 3 2 0 3 2 3 0 0 10 6.65e+01 0 0.00e+00 0 MatTrnMatMultNum 12 1.0 6.5017e-01 1.0 4.54e+07 1.3 7.8e+05 3.1e+04 2.8e+01 0 0 1 2 1 1 1 2 2 1 104985 0 28 4.81e-01 0 0.00e+00 0 MatGetLocalMat 53 1.0 5.7634e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetBrAoCol 36 1.0 3.8208e-01 2.3 0.00e+00 0.0 4.9e+06 7.0e+04 0.0e+00 0 0 5 26 0 0 0 10 31 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 294 1.0 2.3130e+00 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 3 0 0 0 0 0 0 294 7.10e+02 0 0.00e+00 0 VecMDot 12 1.0 1.1192e-03 1.1 2.70e+06 1.2 0.0e+00 0.0e+00 1.2e+01 0 0 0 0 0 0 0 0 0 0 3663212 0 0 0.00e+00 0 0.00e+00 0 VecTDot 252 1.0 3.0092e-01 6.8 4.94e+06 1.2 0.0e+00 0.0e+00 2.5e+02 0 0 0 0 6 0 0 0 0 8 24860 743144 0 0.00e+00 0 0.00e+00 100 VecNorm 24 1.0 2.8507e-0129.2 1.35e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 7191 0 0 0.00e+00 0 0.00e+00 0 VecScale 24 1.0 3.4293e-04 1.3 6.74e+05 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2988955 0 0 0.00e+00 0 0.00e+00 0 VecCopy 24 1.0 7.2472e-04 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 6 9.26e-01 0 VecSet 856 1.0 1.6747e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 240 1.0 4.1865e-03 1.3 4.71e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1701835 1733697 0 0.00e+00 0 0.00e+00 100 VecAYPX 108 1.0 7.0768e-03 2.7 2.12e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 453045 455369 0 0.00e+00 0 0.00e+00 100 VecMAXPY 12 1.0 1.1299e-03 1.5 2.70e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 3628472 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyBegin 430 1.0 1.0846e-01 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 430 1.0 9.3794e-04 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 176 0.00e+00 0 VecPointwiseMult 132 1.0 2.6347e-03 1.2 1.29e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 743644 917364 12 1.85e+00 0 0.00e+00 100 VecScatterBegin 574 1.0 3.3984e-02 2.5 0.00e+00 0.0 1.5e+07 1.5e+03 0.0e+00 0 0 14 2 0 0 0 30 2 0 0 0 0 0.00e+00 144 1.15e+01 0 VecScatterEnd 574 1.0 2.6322e-0121.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSetRandom 12 1.0 5.7849e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 6 9.26e-01 0 VecNormalize 24 1.0 2.8538e-0128.3 2.02e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 0 0 0 1 10775 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 72 1.0 2.3955e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 72 7.90e+00 0 0.00e+00 0 VecCUDACopyFrom 500 1.0 1.3896e-02 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 500 1.06e+01 0 VecCopyFromSome 60 1.0 1.2987e-02 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 60 9.23e+00 0 KSPSetUp 32 1.0 7.5338e-01 7.5 0.00e+00 0.0 0.0e+00 0.0e+00 3.2e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 PCGAMGGraph_AGG 12 1.0 4.6632e+00 1.0 2.92e+07 1.3 1.7e+06 7.4e+02 1.9e+02 1 0 2 0 5 6 0 3 0 6 9252 0 48 4.15e+01 12 1.84e-01 0 PCGAMGCoarse_AGG 12 1.0 1.9723e+00 1.0 4.54e+07 1.3 2.0e+07 3.0e+03 5.7e+02 1 0 19 5 14 2 1 40 5 18 34609 0 38 6.70e+01 84 2.03e+00 0 PCGAMGProl_AGG 12 1.0 4.5771e-01 1.1 0.00e+00 0.0 1.0e+07 1.4e+03 8.4e+02 0 0 10 1 21 1 0 20 1 26 0 0 24 9.74e+00 372 5.87e+00 0 PCGAMGPOpt_AGG 12 1.0 2.9409e+00 1.1 8.80e+08 1.3 6.9e+06 7.1e+03 4.5e+02 1 5 7 4 11 4 12 14 4 14 441738 2997377 120 1.61e+02 84 1.17e+01 61 GAMG: createProl 12 1.0 1.0038e+01 1.0 9.55e+08 1.3 3.8e+07 3.2e+03 2.1e+03 3 5 36 9 51 13 13 77 11 64 140514 2891041 230 2.79e+02 552 1.98e+01 57 Graph 24 1.0 4.6208e+00 1.0 2.92e+07 1.3 1.7e+06 7.4e+02 1.9e+02 1 0 2 0 5 6 0 3 0 6 9337 0 48 4.15e+01 12 1.84e-01 0 MIS/Agg 12 1.0 5.8360e-02 1.1 0.00e+00 0.0 1.6e+07 5.5e+02 3.9e+02 0 0 15 1 10 0 0 32 1 12 0 0 0 0.00e+00 0 0.00e+00 0 SA: col data 12 1.0 2.1869e-01 1.0 0.00e+00 0.0 9.8e+06 1.1e+03 7.4e+02 0 0 9 1 19 0 0 20 1 23 0 0 0 0.00e+00 372 5.87e+00 0 SA: frmProl0 12 1.0 2.0194e-01 1.0 0.00e+00 0.0 3.4e+05 1.1e+04 4.8e+01 0 0 0 0 1 0 0 1 0 1 0 0 24 9.74e+00 0 0.00e+00 0 SA: smooth 12 1.0 2.4887e+00 1.1 3.34e+08 1.3 3.4e+06 1.1e+04 1.2e+02 1 2 3 3 3 3 4 7 4 4 197810 0 48 1.53e+02 0 0.00e+00 0 GAMG: partLevel 12 1.0 5.3295e+01 1.0 6.55e+09 1.6 9.2e+06 6.9e+04 7.3e+02 15 35 9 47 18 68 86 18 58 23 177778 0 128 1.83e+02 0 0.00e+00 0 repartition 10 1.0 5.9511e+00 1.0 4.31e+05 4.6 1.8e+06 2.6e+01 2.2e+02 2 0 2 0 5 8 0 4 0 7 78 0 20 1.04e-01 0 0.00e+00 0 Invert-Sort 10 1.0 4.3070e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 Move A 10 1.0 1.1510e+00 1.1 0.00e+00 0.0 7.5e+05 2.0e+04 1.3e+02 0 0 1 1 3 1 0 2 1 4 0 0 30 7.42e+00 0 0.00e+00 0 Move P 10 1.0 5.4505e-01 1.2 0.00e+00 0.0 3.8e+05 1.8e+02 1.3e+02 0 0 0 0 3 1 0 1 0 4 0 0 30 1.37e+01 0 0.00e+00 0 PCSetUp 4 1.0 6.3659e+01 1.0 7.49e+09 1.6 4.8e+07 1.6e+04 2.9e+03 18 40 45 57 71 81 98 96 69 89 170991 2870514 358 4.62e+02 560 1.98e+01 7 --- Event Stage 2: Solve 0 BuildTwoSided 1 1.0 2.5101e-04 2.2 0.00e+00 0.0 3.7e+03 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 4.1915e-02117.2 0.00e+00 0.0 1.1e+04 7.9e+04 0.0e+00 0 0 0 0 0 6 0 0 32 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 4.4060e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 4.6634e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 5 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 6.7271e-05 9.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 8.0658e-03 2.6 1.60e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 12 0 0 0 305582 0 0 0.00e+00 2 7.34e-03 0 DMPlexJacobianFE 1 1.0 4.0877e-01 1.0 1.63e+06 1.0 1.1e+04 7.9e+04 0.0e+00 0 0 0 0 0 62 12 0 32 0 6113 0 2 3.83e-01 0 0.00e+00 0 SFSetGraph 1 1.0 1.4360e-06 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 3.1727e-04 1.9 0.00e+00 0.0 1.8e+04 3.1e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 264 1.0 1.1892e-0216.5 0.00e+00 0.0 3.9e+06 4.6e+02 0.0e+00 0 0 4 0 0 0 0 90 66 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 264 1.0 1.8640e-0112.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 28 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 46 1.0 1.0611e-0310.7 0.00e+00 0.0 4.2e+05 1.5e+02 0.0e+00 0 0 0 0 0 0 0 10 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 46 1.0 9.5685e-03252.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 217 1.0 3.9232e-02 3.2 3.73e+0725.5 3.5e+06 5.0e+02 0.0e+00 0 0 3 0 0 2 67 80 63 0 348113 1649899 141 9.88e-01 97 1.39e-01 84 MatMultAdd 44 1.0 1.8268e-0129.8 1.15e+0613.9 4.1e+05 1.4e+02 0.0e+00 0 0 0 0 0 27 3 9 2 0 3653 0 0 0.00e+00 22 3.16e-02 0 MatMultTranspose 44 1.0 1.2148e-02 6.5 1.15e+0613.9 4.1e+05 1.4e+02 0.0e+00 0 0 0 0 0 1 3 9 2 0 54936 0 0 0.00e+00 66 6.90e-02 0 MatSolve 22 0.0 4.7409e-03 0.0 1.40e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2951 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 5.8252e-024884.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 8.0834e-02137007.0 1.13e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 1398 0 0 0.00e+00 0 0.00e+00 0 MatResidual 44 1.0 9.1725e-03 2.8 8.10e+0629.5 6.6e+05 5.0e+02 0.0e+00 0 0 1 0 0 1 13 15 12 0 285845 964361 22 1.77e-01 22 3.15e-02 82 MatAssemblyBegin 1 1.0 4.2146e-0216.0 0.00e+00 0.0 1.1e+04 7.9e+04 0.0e+00 0 0 0 0 0 6 0 0 32 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 4.5273e-03 4.4 2.65e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 7691 0 2 3.83e-01 0 0.00e+00 0 MatGetRowIJ 1 0.0 1.3391e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 2.5603e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 3.3525e-0538.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.2174e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 3.83e-01 0 0.00e+00 0 VecTDot 84 1.0 1.2968e-02 1.4 3.04e+04 2.7 0.0e+00 0.0e+00 8.4e+01 0 0 0 0 2 2 0 0 0 56 2714 5988 0 0.00e+00 0 0.00e+00 98 VecNorm 46 1.0 1.4264e-02 2.4 1.67e+04 2.7 0.0e+00 0.0e+00 4.6e+01 0 0 0 0 1 1 0 0 0 30 1370 5691 0 0.00e+00 0 0.00e+00 98 VecCopy 138 1.0 1.7930e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.43e-03 0 VecSet 226 1.0 1.7358e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 85 1.0 2.3348e-03 1.5 3.10e+04 2.6 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 15577 15720 2 2.87e-03 0 0.00e+00 98 VecAYPX 302 1.0 7.5676e-03 1.4 9.09e+04 3.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 12083 11842 0 0.00e+00 0 0.00e+00 97 VecAXPBYCZ 88 1.0 3.2583e-03 1.3 1.17e+05 3.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 38150 41156 0 0.00e+00 0 0.00e+00 97 VecPointwiseMult 198 1.0 3.6520e-03 1.3 3.39e+04 3.8 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 7852 7653 3 4.30e-03 0 0.00e+00 95 VecScatterBegin 305 1.0 1.5588e-02 4.6 0.00e+00 0.0 4.3e+06 4.3e+02 0.0e+00 0 0 4 0 0 1 0 98 67 0 0 0 0 0.00e+00 97 1.39e-01 0 VecScatterEnd 305 1.0 1.8706e-01 7.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 28 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 146 1.0 3.5939e-03 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 146 9.95e-01 0 0.00e+00 0 VecCUDACopyFrom 98 1.0 2.3838e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 98 1.26e-01 0 VecCopyFromSome 97 1.0 2.5875e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 97 1.39e-01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.4982e+00 1.0 1.57e+0826.5 1.2e+07 1.1e+03 6.9e+02 1 0 12 1 17 380179282495454 14658 46846 212 3.41e+00 283 3.34e-01 35 SNESSetUp 1 1.0 1.0366e-04 2.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 1.2809e-02 1.7 1.67e+06 1.0 4.8e+04 3.6e+02 1.7e+01 0 0 0 0 0 2 12 1 1 11 194401 0 0 0.00e+00 8 2.04e-02 0 SNESJacobianEval 1 1.0 4.0976e-01 1.0 1.65e+06 1.0 1.8e+04 4.8e+04 0.0e+00 0 0 0 0 0 62 12 0 32 0 6127 0 2 3.83e-01 1 3.67e-03 0 KSPSetUp 3 1.0 2.6056e-04 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 2.3522e-01 1.0 1.41e+0881.5 4.3e+06 4.3e+02 1.3e+02 0 0 4 0 3 36 76 98 67 87 65692 373833 144 9.92e-01 186 2.41e-01 77 PCSetUp 1 1.0 1.4170e-012878.5 1.13e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 797 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 22 1.0 1.4171e-012445.5 1.13e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 797 0 0 0.00e+00 0 0.00e+00 0 PCApply 22 1.0 2.2059e-01 1.0 1.41e+0897.2 3.8e+06 4.2e+02 6.8e+01 0 0 4 0 2 33 65 87 58 45 60517 433157 123 8.23e-01 165 2.11e-01 73 --- Event Stage 3: Solve 1 BuildTwoSided 1 1.0 2.9641e-04 3.4 0.00e+00 0.0 3.7e+03 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 8.1399e-011946.1 0.00e+00 0.0 1.1e+04 3.4e+05 0.0e+00 0 0 0 0 0 20 0 0 27 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 4.6199e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 5.5347e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.6688e-05 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 2.2889e-02 1.0 1.28e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 9 0 0 0 861477 0 0 0.00e+00 2 3.96e-02 0 DMPlexJacobianFE 1 1.0 3.7820e+00 1.0 1.31e+07 1.0 1.1e+04 3.4e+05 0.0e+00 1 0 0 0 0 94 10 0 27 0 5298 0 2 3.31e+00 0 0.00e+00 0 SFSetGraph 1 1.0 6.7220e-06 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 3.6637e-04 1.4 0.00e+00 0.0 1.8e+04 1.1e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 496 1.0 2.9489e-0224.2 0.00e+00 0.0 1.4e+07 6.8e+02 0.0e+00 0 0 14 1 0 0 0 91 70 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 496 1.0 1.0483e-01 4.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 89 1.0 2.1941e-03 8.4 0.00e+00 0.0 1.5e+06 1.9e+02 0.0e+00 0 0 1 0 0 0 0 9 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 89 1.0 1.8074e-02188.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 406 1.0 9.5787e-02 4.1 1.29e+08 3.1 1.3e+07 7.3e+02 0.0e+00 0 1 12 1 0 1 73 81 68 0 1594862 12743830 183 4.25e+00 125 1.48e+00 85 MatMultAdd 87 1.0 9.9476e-02 8.6 5.68e+06 2.3 1.4e+06 1.8e+02 0.0e+00 0 0 1 0 0 2 3 9 2 0 72507 0 0 0.00e+00 29 3.44e-01 0 MatMultTranspose 87 1.0 2.5102e-02 5.6 5.68e+06 2.3 1.4e+06 1.8e+02 0.0e+00 0 0 1 0 0 0 3 9 2 0 287333 0 0 0.00e+00 116 5.13e-01 0 MatSolve 29 0.0 6.0155e-04 0.0 1.01e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1674 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.7914e-0439.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 9.2200e-041664.3 1.52e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1654 0 0 0.00e+00 0 0.00e+00 0 MatResidual 87 1.0 2.2582e-02 4.0 2.69e+07 3.4 2.8e+06 6.8e+02 0.0e+00 0 0 3 0 0 0 14 18 14 0 1323712 8120403 29 7.35e-01 29 3.44e-01 82 MatAssemblyBegin 1 1.0 8.1504e-01162.4 0.00e+00 0.0 1.1e+04 3.4e+05 0.0e+00 0 0 0 0 0 20 0 0 27 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 6.4468e-0244.4 1.12e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 2396 0 2 3.31e+00 0 0.00e+00 0 MatGetRowIJ 1 0.0 8.5250e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 1.4495e-04 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 3.6172e-0410.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 5.3516e-0239.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 2 3.31e+00 0 0.00e+00 0 VecTDot 119 1.0 1.9850e-02 1.4 2.43e+05 1.7 0.0e+00 0.0e+00 1.2e+02 0 0 0 0 3 0 0 0 0 58 17915 54082 0 0.00e+00 0 0.00e+00 99 VecNorm 64 1.0 1.7402e-02 1.8 1.32e+05 1.7 0.0e+00 0.0e+00 6.4e+01 0 0 0 0 2 0 0 0 0 31 11141 42440 0 0.00e+00 0 0.00e+00 99 VecCopy 269 1.0 2.3369e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.19e-02 0 VecSet 381 1.0 2.9907e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 119 1.0 2.7456e-03 1.4 2.49e+05 1.7 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 132808 135131 2 2.38e-02 0 0.00e+00 99 VecAYPX 576 1.0 8.9013e-03 1.4 6.83e+05 1.6 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 110646 110333 0 0.00e+00 0 0.00e+00 97 VecAXPBYCZ 174 1.0 4.1357e-03 1.2 9.34e+05 1.6 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 327416 357183 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 381 1.0 4.3332e-03 1.3 2.14e+05 1.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 70018 70919 3 3.56e-02 0 0.00e+00 95 VecScatterBegin 580 1.0 3.5643e-02 6.1 0.00e+00 0.0 1.6e+07 6.3e+02 0.0e+00 0 0 15 1 0 0 0100 72 0 0 0 0 0.00e+00 125 1.48e+00 0 VecScatterEnd 580 1.0 1.0403e-01 3.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 188 1.0 4.5455e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 188 4.30e+00 0 0.00e+00 0 VecCUDACopyFrom 155 1.0 4.2689e-03 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 155 1.02e+00 0 VecCopyFromSome 125 1.0 4.3387e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 125 1.48e+00 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 9.7474e+00 1.0 3.00e+08 2.9 2.6e+07 2.3e+03 9.0e+02 3 1 25 4 22 242165164432437 35612 2820295 278 1.92e+01 414 2.87e+00 41 SNESSetUp 1 1.0 9.1383e-05 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 3.1967e-02 1.1 1.32e+07 1.0 4.8e+04 1.3e+03 1.7e+01 0 0 0 0 0 1 9 0 0 8 620034 0 0 0.00e+00 8 1.27e-01 0 SNESJacobianEval 1 1.0 3.7836e+00 1.0 1.32e+07 1.0 1.8e+04 2.1e+05 0.0e+00 1 0 0 0 0 94 10 0 28 0 5309 0 2 3.31e+00 1 1.98e-02 0 KSPSetUp 4 1.0 4.6147e-02 6.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 2.2706e-01 1.0 1.43e+08 2.9 1.6e+07 6.3e+02 1.9e+02 0 1 15 1 5 6 81100 72 91 751924 3104118 186 4.28e+00 271 2.35e+00 78 PCSetUp 1 1.0 1.3716e-0334.2 1.52e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1112 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 29 1.0 1.3854e-0325.7 1.52e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1101 0 0 0.00e+00 0 0.00e+00 0 PCApply 29 1.0 2.0617e-01 1.0 1.26e+08 3.1 1.5e+07 5.9e+02 1.0e+02 0 1 14 1 3 5 70 95 64 50 710501 3575964 158 3.57e+00 243 2.02e+00 74 --- Event Stage 4: Solve 2 BuildTwoSided 1 1.0 7.3010e-04 9.0 0.00e+00 0.0 3.7e+03 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 1.7349e+0113612.0 0.00e+00 0.0 1.1e+04 1.4e+06 0.0e+00 5 0 0 1 0 41 0 0 36 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 5.4741e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 5.6429e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 2.0672e-05 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.7954e-01 1.0 1.03e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 10 0 0 0 878615 0 0 0.00e+00 2 2.53e-01 0 DMPlexJacobianFE 1 1.0 4.0821e+01 1.0 1.05e+08 1.0 1.1e+04 1.4e+06 0.0e+00 12 1 0 1 0 97 10 0 36 0 3933 0 2 2.75e+01 0 0.00e+00 0 SFSetGraph 1 1.0 3.8135e-05 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.0648e-03 1.6 0.00e+00 0.0 1.8e+04 4.3e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 448 1.0 2.3231e-02 7.3 0.00e+00 0.0 1.2e+07 2.3e+03 0.0e+00 0 0 11 2 0 0 0 90 62 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 448 1.0 2.5150e-01 5.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 80 1.0 1.7508e-03 5.1 0.00e+00 0.0 1.3e+06 5.5e+02 0.0e+00 0 0 1 0 0 0 0 10 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 80 1.0 3.6652e-01251.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 367 1.0 1.1274e-01 2.0 8.26e+08 1.8 1.0e+07 2.5e+03 0.0e+00 0 4 10 2 0 0 72 80 61 0 10083175 77302688 279 1.68e+01 227 1.37e+01 99 MatMultAdd 78 1.0 2.2151e-0114.7 3.72e+07 1.7 1.2e+06 5.0e+02 0.0e+00 0 0 1 0 0 1 3 10 1 0 240955 15745891 26 3.16e-01 78 5.24e-01 92 MatMultTranspose 78 1.0 5.0148e-01 3.6 3.66e+07 1.7 1.2e+06 5.0e+02 0.0e+00 0 0 1 0 0 1 3 10 1 0 104642 12442990 2 7.49e+00 130 6.13e-01 92 MatSolve 26 0.0 6.5604e-03 0.0 1.90e+07 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2900 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 7.2138e-029854.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 6.8157e-02115520.6 1.42e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2078 0 0 0.00e+00 0 0.00e+00 0 MatResidual 78 1.0 2.6505e-02 2.1 1.62e+08 1.8 2.2e+06 2.4e+03 0.0e+00 0 1 2 0 0 0 14 17 12 0 8318819 42236564 52 3.32e+00 52 2.61e+00 99 MatAssemblyBegin 1 1.0 1.7358e+01339.4 0.00e+00 0.0 1.1e+04 1.4e+06 0.0e+00 5 0 0 1 0 41 0 0 36 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 2.0901e-0117.7 4.58e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 3093 0 2 2.75e+01 0 0.00e+00 0 MatGetRowIJ 1 0.0 1.5278e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 2.8262e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.8093e-03 4.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.6388e-0116.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 2.75e+01 0 0.00e+00 0 VecTDot 113 1.0 2.1204e-02 1.6 1.78e+06 1.3 0.0e+00 0.0e+00 1.1e+02 0 0 0 0 3 0 0 0 0 57 125841 344366 0 0.00e+00 0 0.00e+00 100 VecNorm 61 1.0 3.4501e-02 2.3 9.75e+05 1.3 0.0e+00 0.0e+00 6.1e+01 0 0 0 0 2 0 0 0 0 31 42458 285125 0 0.00e+00 0 0.00e+00 100 VecCopy 242 1.0 4.4179e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 28 2.05e-01 0 VecSet 293 1.0 2.8574e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 113 1.0 3.2902e-03 1.4 1.82e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 833107 860340 2 1.93e-01 0 0.00e+00 100 VecAYPX 519 1.0 1.7451e-02 1.3 4.87e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 416848 454145 26 1.04e-01 0 0.00e+00 100 VecAXPBYCZ 156 1.0 7.1510e-03 1.2 6.75e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 1406356 1574616 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 345 1.0 8.0263e-03 1.2 1.50e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 277290 299457 32 4.06e-01 0 0.00e+00 100 VecScatterBegin 523 1.0 4.5314e-02 1.9 0.00e+00 0.0 1.3e+07 2.2e+03 0.0e+00 0 0 12 2 0 0 0 99 63 0 0 0 0 0.00e+00 331 1.46e+01 0 VecScatterEnd 523 1.0 5.9242e-01 8.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 365 1.0 1.0560e-02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 365 1.79e+01 0 0.00e+00 0 VecCUDACopyFrom 193 1.0 4.9951e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 193 1.94e+00 0 VecCopyFromSome 279 1.0 1.9843e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 279 1.42e+01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 4.9847e+01 1.0 2.00e+09 1.8 2.6e+07 7.3e+03 8.9e+02 14 10 24 14 22 119173198430454 55089 16823548 459 1.07e+02 618 1.85e+01 49 SNESSetUp 1 1.0 8.1480e-05 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 2.0454e-01 1.1 1.05e+08 1.0 4.8e+04 5.0e+03 1.7e+01 0 1 0 0 0 0 10 0 1 9 773249 0 0 0.00e+00 8 8.92e-01 0 SNESJacobianEval 1 1.0 4.0825e+01 1.0 1.05e+08 1.0 1.8e+04 8.6e+05 0.0e+00 12 1 0 1 0 97 10 0 36 0 3938 0 2 2.75e+01 1 1.26e-01 0 KSPSetUp 4 1.0 1.6198e-03 6.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 8.5536e-01 1.0 9.16e+08 1.7 1.3e+07 2.2e+03 1.8e+02 0 5 12 2 4 2 80 99 63 90 1483592 18201583 365 2.52e+01 463 1.51e+01 99 PCSetUp 1 1.0 1.4316e-013461.9 1.42e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 990 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 26 1.0 1.4317e-012643.4 1.42e+08 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 989 0 0 0.00e+00 0 0.00e+00 0 PCApply 26 1.0 8.3308e-01 1.0 7.95e+08 1.7 1.2e+07 2.0e+03 1.0e+02 0 4 12 2 3 2 69 95 56 52 1307259 18718834 340 2.30e+01 438 1.27e+01 98 --- Event Stage 5: Solve 3 BuildTwoSided 1 1.0 2.2131e-0321.5 0.00e+00 0.0 3.7e+03 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 3.2958e+0110865.7 0.00e+00 0.0 1.1e+04 5.8e+06 0.0e+00 9 0 0 5 0 15 0 0 36 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 5.8596e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 6.0260e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.3144e-05 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.4393e+00 1.0 8.22e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 5 0 0 0 1 9 0 0 0 876758 0 0 0.00e+00 2 1.79e+00 0 DMPlexJacobianFE 1 1.0 2.1979e+02 1.0 8.38e+08 1.0 1.1e+04 5.8e+06 0.0e+00 63 5 0 5 0 99 9 0 36 0 5850 0 2 2.24e+02 0 0.00e+00 0 SFSetGraph 1 1.0 2.0229e-04 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 4.1288e-03 1.6 0.00e+00 0.0 1.8e+04 1.7e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 651 1.0 5.5845e-02 8.2 0.00e+00 0.0 2.0e+07 5.4e+03 0.0e+00 0 0 19 8 0 0 0 89 62 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 651 1.0 3.5299e-01 3.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 118 1.0 4.4491e-03 4.4 0.00e+00 0.0 2.4e+06 1.1e+03 0.0e+00 0 0 2 0 0 0 0 11 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 118 1.0 1.0080e-0138.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 532 1.0 3.8120e-01 1.6 6.88e+09 1.3 1.8e+07 5.9e+03 0.0e+00 0 38 17 8 0 0 73 79 60 0 27023917 313620490 309 6.58e+01 251 1.23e+02 99 MatMultAdd 116 1.0 2.0601e-01 4.6 3.21e+08 1.3 2.4e+06 9.7e+02 0.0e+00 0 2 2 0 0 0 3 10 1 0 2346621 19066057 29 1.20e+00 87 3.06e+00 92 MatMultTranspose 116 1.0 3.2012e-01 1.4 3.16e+08 1.3 2.4e+06 9.7e+02 0.0e+00 0 2 2 0 0 0 3 10 1 0 1489385 35186017 2 6.09e+01 174 3.37e+00 92 MatSolve 29 0.0 4.5260e-04 0.0 6.00e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1327 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 1.7475e-0423.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 6.8059e-041075.2 7.02e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1032 0 0 0.00e+00 0 0.00e+00 0 MatResidual 116 1.0 8.2991e-02 1.8 1.35e+09 1.3 3.9e+06 5.4e+03 0.0e+00 0 7 4 2 0 0 14 17 12 0 24261042 192336276 58 1.29e+01 58 2.35e+01 99 MatAssemblyBegin 1 1.0 3.3021e+01145.2 0.00e+00 0.0 1.1e+04 5.8e+06 0.0e+00 9 0 0 5 0 15 0 0 36 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 5.7964e-01 3.9 1.86e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 4562 0 2 2.24e+02 0 0.00e+00 0 MatGetRowIJ 1 0.0 5.2455e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 9.9940e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.1957e-02 3.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 4.1037e-01 4.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 2.24e+02 0 0.00e+00 0 VecTDot 140 1.0 3.7939e-02 1.7 1.53e+07 1.1 0.0e+00 0.0e+00 1.4e+02 0 0 0 0 3 0 0 0 0 58 614784 2453034 0 0.00e+00 0 0.00e+00 100 VecNorm 75 1.0 1.1519e-01 2.4 8.36e+06 1.1 0.0e+00 0.0e+00 7.5e+01 0 0 0 0 2 0 0 0 0 31 110395 2204881 0 0.00e+00 0 0.00e+00 100 VecCopy 358 1.0 1.5142e-02 3.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 31 1.74e+00 0 VecSet 415 1.0 4.4218e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 139 1.0 3.8406e-03 1.4 1.57e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 6225788 6767274 2 1.56e+00 0 0.00e+00 100 VecAYPX 759 1.0 5.1061e-02 2.6 4.30e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1276718 1377135 29 9.32e-01 0 0.00e+00 100 VecAXPBYCZ 232 1.0 1.5100e-02 2.2 5.97e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 5991849 6364398 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 508 1.0 1.5451e-02 1.9 1.31e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1282997 1377140 35 3.37e+00 0 0.00e+00 100 VecScatterBegin 764 1.0 1.8874e-01 1.6 0.00e+00 0.0 2.3e+07 4.9e+03 0.0e+00 0 0 21 8 0 0 0100 63 0 0 0 0 0.00e+00 367 1.27e+02 0 VecScatterEnd 764 1.0 3.3058e-01 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 404 1.0 1.8775e-02 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 404 7.29e+01 0 0.00e+00 0 VecCUDACopyFrom 243 1.0 9.1543e-03 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 243 1.36e+01 0 VecCopyFromSome 309 1.0 1.4142e-01 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 309 1.25e+02 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.7047e+02 1.0 1.58e+10 1.3 4.0e+07 1.8e+04 1.2e+03 78 88 38 55 29 122168175416491 87339 72990549 524 7.52e+02 744 1.56e+02 51 SNESSetUp 1 1.0 8.8474e-03224.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 1.5640e+00 1.1 8.30e+08 1.0 4.8e+04 1.9e+04 1.7e+01 0 5 0 0 0 1 9 0 1 7 807958 0 0 0.00e+00 8 6.70e+00 0 SNESJacobianEval 1 1.0 2.1981e+02 1.0 8.40e+08 1.0 1.8e+04 3.5e+06 0.0e+00 63 5 0 5 0 99 9 0 36 0 5854 0 2 2.24e+02 1 8.95e-01 0 KSPSetUp 5 1.0 4.7184e-0243.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 9.3537e-01 1.0 7.66e+09 1.3 2.3e+07 4.9e+03 2.2e+02 0 43 21 8 6 0 82100 63 92 12290028 75169681 404 1.32e+02 543 1.31e+02 99 PCSetUp 1 1.0 9.8075e-0423.3 7.02e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 716 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 29 1.0 9.9922e-0417.1 7.02e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 703 0 0 0.00e+00 0 0.00e+00 0 PCApply 29 1.0 8.6909e-01 1.1 6.58e+09 1.3 2.2e+07 4.4e+03 1.4e+02 0 37 21 7 3 0 70 97 55 57 11336746 72723150 376 1.23e+02 515 1.09e+02 98 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Object 0 680 446080 0. Container 0 56 34944 0. Distributed Mesh 0 114 578416 0. DM Label 0 48 33408 0. GraphPartitioner 0 36 26240 0. Index Set 0 193 5703608 0. IS L to G Mapping 0 6 558096 0. Section 0 204 159936 0. Star Forest Graph 0 190 184960 0. Discrete System 0 97 97808 0. Matrix 0 130 470387888 0. Matrix Null Space 0 4 2976 0. Vector 0 268 15057064 0. SNES 0 4 6128 0. DMSNES 0 4 2880 0. Krylov Solver 0 36 74752 0. DMKSP interface 0 4 2816 0. Preconditioner 0 24 28192 0. Linear Space 0 8 5952 0. Dual Space 0 32 26624 0. FE Space 0 8 6976 0. Vec Scatter 0 28 23968 0. Field over DM 0 4 3040 0. Viewer 1 1 896 0. --- Event Stage 1: Mesh Setup Object 704 212 139072 0. Container 60 32 19968 0. Distributed Mesh 208 146 740976 0. DM Label 98 66 45936 0. GraphPartitioner 64 44 32064 0. Index Set 5684 5563 13462720 0. IS L to G Mapping 17 11 849432 0. Section 416 292 228928 0. Star Forest Graph 595 477 467264 0. Discrete System 272 219 220752 0. Matrix 573 447 252453136 0. Matrix Partitioning 10 10 7440 0. Matrix Coarsen 12 12 8208 0. Matrix Null Space 4 0 0 0. Vector 986 806 13704560 0. SNES 4 0 0 0. DMSNES 4 0 0 0. Krylov Solver 48 12 23424 0. Preconditioner 36 12 10944 0. Linear Space 8 4 2976 0. Dual Space 32 16 13312 0. FE Space 8 4 3488 0. Vec Scatter 116 88 75328 0. Field over DM 4 4 3040 0. Viewer 1 0 0 0. PetscRandom 24 24 16656 0. --- Event Stage 2: Solve 0 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 54528 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 18 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 3: Solve 1 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 67248 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 4: Solve 2 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 117168 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 5: Solve 3 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 76 58 314928 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 26 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. ======================================================================================================================== Average time to get PetscTime(): 3.91e-08 Average time for MPI_Barrier(): 1.04306e-05 Average time for zero size MPI_Send(): 7.29762e-06 #PETSc Option Table entries: -bmat_view :bmcpu.m:ascii_matlab -cells 16,24,32 -check_pointer_intensity 0 -ex56_dm_mat_type aijcusparse -ex56_dm_refine 3 -ex56_dm_vec_type cuda -gamg_est_ksp_max_it 10 -gamg_est_ksp_type cg -ksp_atol 1.e-71 -ksp_converged_reason -ksp_max_it 100 -ksp_monitor -ksp_norm_type preconditioned -ksp_rtol 1.e-11 -ksp_type cg -log_view -lvec_view :lvcpu.m:ascii_matlab -mat_block_size 3 -matptap_via scalable -max_conv_its 4 -mg_levels_esteig_ksp_max_it 10 -mg_levels_esteig_ksp_type cg -mg_levels_ksp_chebyshev_esteig 0,0.05,0,1.05 -mg_levels_ksp_max_it 2 -mg_levels_ksp_type chebyshev -mg_levels_pc_type jacobi -pc_gamg_agg_nsmooths 1 -pc_gamg_coarse_eq_limit 1000 -pc_gamg_process_eq_limit 150 -pc_gamg_repartition true -pc_gamg_reuse_interpolation true -pc_gamg_square_graph 10 -pc_gamg_threshold 0.05 -pc_gamg_threshold_scale .5 -pc_gamg_type agg -pc_type gamg -petscpartitioner_type simple -petscspace_degree 2 -run_type 1 -snes_converged_reason -snes_max_it 2 -snes_monitor -snes_rtol 1.e-10 -snes_type ksponly -use_mat_nearnullspace true -xvec_view :xvcpu.m:ascii_matlab #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with 64 bit PetscInt Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 8 Configure options: --with-cc=mpicc --with-cxx=mpiCC --with-fc=mpif90 COPTFLAGS="-g -fast" CXXOPTFLAGS="-g -fast" FOPTFLAGS="-g -fast" --with-ssl=0 --with-batch=0 --with-mpiexec="jsrun -g 1" --with-cuda=1 --with-cudac=nvcc CUDAFLAGS="-ccbin pgc++" --download-metis --download-viennacl --download-parmetis --download-fblaslapack --with-x=0 --with-64-bit-indices=1 --with-debugging=0 PETSC_ARCH=arch-summit-opt64-pgi-cuda ----------------------------------------- Libraries compiled on 2019-08-13 01:26:30 on login5 Machine characteristics: Linux-4.14.0-115.8.1.el7a.ppc64le-ppc64le-with-redhat-7.6-Maipo Using PETSc directory: /ccs/home/adams/petsc Using PETSc arch: arch-summit-opt64-pgi-cuda ----------------------------------------- Using C compiler: mpicc -g -fast -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include Using Fortran compiler: mpif90 -g -fast -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include ----------------------------------------- Using include paths: -I/ccs/home/adams/petsc/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/sw/summit/cuda/10.1.168/include ----------------------------------------- Using C linker: mpicc Using Fortran linker: mpif90 Using libraries: -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -lpetsc -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -Wl,-rpath,/sw/summit/cuda/10.1.168/lib64 -L/sw/summit/cuda/10.1.168/lib64 /autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib/pgi.ld -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -L/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -L/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -Wl,-rpath,/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -L/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -lflapack -lfblas -lparmetis -lmetis -lcufft -lcublas -lcudart -lcusparse -lcusolver -lstdc++ -ldl -lpthread -lmpiprofilesupport -lmpi_ibm_usempi -lmpi_ibm_mpifh -lmpi_ibm -lpgf90rtl -lpgf90 -lpgf90_rpm1 -lpgf902 -lpgftnrtl -latomic -lpgkomp -lomp -lomptarget -lpgmath -lpgc -lrt -lmass_simdp9 -lmassvp9 -lmassp9 -lm -lgcc_s -lstdc++ -ldl -----------------------------------------