[0] 275373 global equations, 91791 vertices [0] 275373 equations in vector, 91791 vertices 0 SNES Function norm 2.615842974236e+00 0 KSP Residual norm 4.822444375079e+03 1 KSP Residual norm 5.596848324826e+02 2 KSP Residual norm 1.906663855115e+02 3 KSP Residual norm 4.764211164219e+01 4 KSP Residual norm 1.369366714265e+01 5 KSP Residual norm 4.182605252918e+00 6 KSP Residual norm 1.391751374606e+00 7 KSP Residual norm 3.704074903655e-01 8 KSP Residual norm 1.069177829333e-01 9 KSP Residual norm 3.848042199303e-02 10 KSP Residual norm 1.079128240251e-02 11 KSP Residual norm 3.051175855680e-03 12 KSP Residual norm 1.033365012734e-03 13 KSP Residual norm 2.918602335771e-04 14 KSP Residual norm 1.008734049863e-04 15 KSP Residual norm 3.384946796833e-05 16 KSP Residual norm 1.057601057077e-05 17 KSP Residual norm 3.251619584029e-06 18 KSP Residual norm 9.726221627065e-07 19 KSP Residual norm 2.764511921149e-07 20 KSP Residual norm 7.832625350272e-08 21 KSP Residual norm 2.239360407178e-08 Linear solve converged due to CONVERGED_RTOL iterations 21 1 SNES Function norm 7.572709714536e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 2280285 global equations, 760095 vertices [0] 2280285 equations in vector, 760095 vertices 0 SNES Function norm 9.255869095573e-01 0 KSP Residual norm 1.190088040048e+04 1 KSP Residual norm 1.133739874001e+03 2 KSP Residual norm 5.795546040625e+02 3 KSP Residual norm 1.783684442119e+02 4 KSP Residual norm 7.764754418011e+01 5 KSP Residual norm 3.599958215092e+01 6 KSP Residual norm 1.252905336252e+01 7 KSP Residual norm 5.033276128009e+00 8 KSP Residual norm 2.261273888815e+00 9 KSP Residual norm 9.510458897206e-01 10 KSP Residual norm 4.724310523176e-01 11 KSP Residual norm 1.872117341090e-01 12 KSP Residual norm 7.611798526175e-02 13 KSP Residual norm 3.472118699095e-02 14 KSP Residual norm 1.241564318330e-02 15 KSP Residual norm 5.656316255720e-03 16 KSP Residual norm 2.385737505165e-03 17 KSP Residual norm 9.207376487402e-04 18 KSP Residual norm 3.923130125537e-04 19 KSP Residual norm 1.928824657994e-04 20 KSP Residual norm 7.276744984565e-05 21 KSP Residual norm 3.213139333293e-05 22 KSP Residual norm 1.290102015778e-05 23 KSP Residual norm 5.503019392487e-06 24 KSP Residual norm 2.418896802163e-06 25 KSP Residual norm 9.913357152789e-07 26 KSP Residual norm 4.164803082731e-07 27 KSP Residual norm 1.931026465747e-07 28 KSP Residual norm 8.048056346088e-08 Linear solve converged due to CONVERGED_RTOL iterations 28 1 SNES Function norm 9.328902995900e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 18556605 global equations, 6185535 vertices [0] 18556605 equations in vector, 6185535 vertices 0 SNES Function norm 3.273111572912e-01 0 KSP Residual norm 2.824142688515e+04 1 KSP Residual norm 3.047020907956e+03 2 KSP Residual norm 2.107847243600e+03 3 KSP Residual norm 6.603454628850e+02 4 KSP Residual norm 1.918179979492e+02 5 KSP Residual norm 8.182397382197e+01 6 KSP Residual norm 3.674677522092e+01 7 KSP Residual norm 1.029724511316e+01 8 KSP Residual norm 4.417490157423e+00 9 KSP Residual norm 1.907513755374e+00 10 KSP Residual norm 6.524663558019e-01 11 KSP Residual norm 2.060521110724e-01 12 KSP Residual norm 7.988904382176e-02 13 KSP Residual norm 3.120824309036e-02 14 KSP Residual norm 1.175521047281e-02 15 KSP Residual norm 4.826829370506e-03 16 KSP Residual norm 1.865119102413e-03 17 KSP Residual norm 6.949097449176e-04 18 KSP Residual norm 2.587958879306e-04 19 KSP Residual norm 9.192389230590e-05 20 KSP Residual norm 3.405880324044e-05 21 KSP Residual norm 1.318361251211e-05 22 KSP Residual norm 5.146755777546e-06 23 KSP Residual norm 1.882631725763e-06 24 KSP Residual norm 7.022527850036e-07 25 KSP Residual norm 2.822727404200e-07 Linear solve converged due to CONVERGED_RTOL iterations 25 1 SNES Function norm 9.961880116316e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 149720445 global equations, 49906815 vertices [0] 149720445 equations in vector, 49906815 vertices 0 SNES Function norm 1.157278881750e-01 0 KSP Residual norm 7.015376725208e+04 1 KSP Residual norm 6.469120099953e+03 2 KSP Residual norm 5.513566650961e+03 3 KSP Residual norm 2.147374269692e+03 4 KSP Residual norm 5.757639951264e+02 5 KSP Residual norm 2.290177732449e+02 6 KSP Residual norm 1.044390123091e+02 7 KSP Residual norm 3.531868970097e+01 8 KSP Residual norm 1.192240014380e+01 9 KSP Residual norm 5.060535632987e+00 10 KSP Residual norm 2.262724973505e+00 11 KSP Residual norm 8.249310246995e-01 12 KSP Residual norm 3.049089611958e-01 13 KSP Residual norm 1.239381795249e-01 14 KSP Residual norm 5.205774161297e-02 15 KSP Residual norm 2.166539366138e-02 16 KSP Residual norm 8.963756216365e-03 17 KSP Residual norm 3.607394098584e-03 18 KSP Residual norm 1.412088981101e-03 19 KSP Residual norm 6.019089411329e-04 20 KSP Residual norm 2.540891916453e-04 21 KSP Residual norm 1.030123651339e-04 22 KSP Residual norm 4.414314153624e-05 23 KSP Residual norm 1.946417639161e-05 24 KSP Residual norm 8.514620892793e-06 25 KSP Residual norm 3.625814000575e-06 26 KSP Residual norm 1.577243976173e-06 27 KSP Residual norm 6.638593333719e-07 Linear solve converged due to CONVERGED_RTOL iterations 27 1 SNES Function norm 5.662977219343e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 1) N= 2280285, max displ=5.9969946e+01, disp diff= 3.95e-03, error=5.262e-03, rate=0.81 [0] 2) N= 18556605, max displ=5.9974959e+01, disp diff= 5.01e-03, error=2.493e-04, rate=4.4 [0] 3) N= 149720445, max displ=5.9975171e+01, disp diff= 2.12e-04, error=3.740e-05, rate=2.7 ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./ex56 on a arch-summit-opt64-pgi-cuda named e05n06 with 1536 processors, by adams Mon Jul 29 13:04:44 2019 Using Petsc Development GIT revision: v3.11.3-1493-g3c7a471 GIT Date: 2019-07-27 19:32:11 -0400 Max Max/Min Avg Total Time (sec): 2.896e+02 1.000 2.896e+02 Objects: 1.158e+04 1.671 6.940e+03 Flop: 1.980e+10 1.442 1.727e+10 2.653e+13 Flop/sec: 6.837e+07 1.442 5.965e+07 9.162e+10 MPI Messages: 8.721e+04 7.751 3.091e+04 4.748e+07 MPI Message Lengths: 1.074e+09 2.983 2.682e+04 1.274e+12 MPI Reductions: 4.345e+03 1.007 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 4.2099e-01 0.1% 0.0000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% 6.000e+00 0.1% 1: Mesh Setup: 1.4646e+01 5.1% 1.8247e+11 0.7% 2.004e+06 4.2% 1.703e+05 26.8% 3.510e+02 8.1% 2: Setup: 7.9984e+01 27.6% 1.0883e+13 41.0% 2.223e+07 46.8% 3.202e+04 55.9% 3.095e+03 71.3% 3: Solve 1: 7.8903e-01 0.3% 2.0356e+10 0.1% 3.207e+06 6.8% 7.810e+02 0.2% 1.850e+02 4.3% 4: Solve 2: 3.0844e+00 1.1% 2.1036e+11 0.8% 4.517e+06 9.5% 2.379e+03 0.8% 2.060e+02 4.7% 5: Solve 3: 2.1774e+01 7.5% 1.5859e+12 6.0% 6.336e+06 13.3% 6.304e+03 3.1% 2.310e+02 5.3% 6: Solve 4: 1.6890e+02 58.3% 1.3651e+13 51.4% 9.184e+06 19.3% 1.819e+04 13.1% 2.370e+02 5.5% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage VecNorm 4 1.0 9.6818e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 2 0 0 0 67 0 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 1: Mesh Setup PetscBarrier 6 1.0 1.9874e-02 1.1 0.00e+00 0.0 2.4e+05 2.1e+01 2.4e+01 0 0 1 0 1 0 0 12 0 7 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSided 57 1.0 6.8154e-01 3.3 0.00e+00 0.0 2.1e+05 8.0e+00 0.0e+00 0 0 0 0 0 3 0 11 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 4 1.0 4.8857e-01 8.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMCreateMat 4 1.0 7.6171e+00 1.0 0.00e+00 0.0 8.6e+05 3.9e+05 5.2e+01 3 0 2 27 1 51 0 43100 15 0 0 8 2.55e+02 0 0.00e+00 0 Mesh Partition 1 1.0 4.1671e-01 3.9 0.00e+00 0.0 9.2e+03 1.2e+03 8.0e+00 0 0 0 0 0 2 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 Mesh Migration 1 1.0 9.2437e-02 1.0 0.00e+00 0.0 5.0e+04 8.6e+02 2.4e+01 0 0 0 0 1 1 0 2 0 7 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartSelf 1 1.0 5.3470e-023355.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblInv 1 1.0 5.8852e-0211.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblSF 1 1.0 1.5470e-02 2.5 0.00e+00 0.0 3.8e+03 9.8e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartStrtSF 1 1.0 3.1618e-0236.6 0.00e+00 0.0 1.5e+03 1.2e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPointSF 1 1.0 5.7012e-03 1.2 0.00e+00 0.0 3.1e+03 2.4e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 32 1.0 3.7509e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 1 0 0 0 0 11 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistribute 1 1.0 5.1612e-01 2.5 0.00e+00 0.0 6.2e+04 9.9e+02 3.2e+01 0 0 0 0 1 3 0 3 0 9 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistCones 1 1.0 1.8226e-02 1.1 0.00e+00 0.0 1.0e+04 2.1e+03 1.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistLabels 1 1.0 3.7188e-02 1.0 0.00e+00 0.0 2.5e+04 4.7e+02 2.1e+01 0 0 0 0 0 0 0 1 0 6 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistField 1 1.0 3.1753e-02 1.0 0.00e+00 0.0 1.2e+04 6.2e+02 1.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 58 1.0 8.6699e-01 3.7 0.00e+00 0.0 0.0e+00 0.0e+00 5.8e+01 0 0 0 0 1 4 0 0 0 17 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 58 1.0 7.2485e-0390.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPrealloc 4 1.0 5.2752e+00 1.0 0.00e+00 0.0 8.6e+05 3.9e+05 4.4e+01 2 0 2 27 1 36 0 43100 13 0 0 8 2.55e+02 0 0.00e+00 0 SFSetGraph 73 1.0 5.8790e-0323.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 57 1.0 8.0858e-01 2.0 0.00e+00 0.0 1.1e+06 1.6e+05 0.0e+00 0 0 2 13 0 4 0 53 50 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 95 1.0 4.0681e-0286.6 0.00e+00 0.0 5.5e+05 5.2e+04 0.0e+00 0 0 1 2 0 0 0 28 9 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 95 1.0 1.7183e-01 2.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 37 1.0 2.2864e-0262.1 0.00e+00 0.0 2.7e+05 4.2e+05 0.0e+00 0 0 1 9 0 0 0 13 33 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 29 1.0 1.7509e-01 4.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpBegin 8 1.0 5.1500e-03290.3 0.00e+00 0.0 5.9e+04 4.8e+05 0.0e+00 0 0 0 2 0 0 0 3 8 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpEnd 8 1.0 8.6625e-02 3.1 0.00e+00 0.0 5.9e+04 4.8e+05 0.0e+00 0 0 0 2 0 0 0 3 8 0 0 0 0 0.00e+00 0 0.00e+00 0 SFDistSection 13 1.0 4.1255e-02 1.2 0.00e+00 0.0 2.1e+05 2.1e+03 1.3e+01 0 0 0 0 0 0 0 10 0 4 0 0 0 0.00e+00 0 0.00e+00 0 SFSectionSF 21 1.0 1.5168e-01 1.3 0.00e+00 0.0 2.6e+05 2.2e+05 0.0e+00 0 0 1 4 0 1 0 13 17 0 0 0 0 0.00e+00 0 0.00e+00 0 SFRemoteOff 8 1.0 5.8008e-0215.7 0.00e+00 0.0 1.2e+05 4.8e+03 0.0e+00 0 0 0 0 0 0 0 6 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyBegin 4 1.0 4.8864e-01 8.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 4 1.0 8.0595e-01 1.0 0.00e+00 0.0 2.5e+05 5.5e+03 1.6e+01 0 0 1 0 0 6 0 12 0 5 0 0 8 2.55e+02 0 0.00e+00 0 MatCUSPARSCopyTo 8 1.0 5.6865e-01 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 0 0 8 2.55e+02 0 0.00e+00 0 VecMDot 12 1.0 1.2527e-03 1.1 2.70e+06 1.2 0.0e+00 0.0e+00 1.2e+01 0 0 0 0 0 0 2 0 0 3 3272823 0 0 0.00e+00 0 0.00e+00 0 VecNorm 24 1.0 1.0294e-0134.2 1.35e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 1 0 0 7 19914 0 0 0.00e+00 0 0.00e+00 0 VecScale 24 1.0 3.7614e-04 1.5 6.74e+05 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 2725046 0 0 0.00e+00 0 0.00e+00 0 VecSet 72 1.0 6.9522e-04 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecMAXPY 12 1.0 1.1441e-03 1.5 2.70e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 2 0 0 0 3583621 0 0 0.00e+00 0 0.00e+00 0 VecNormalize 24 1.0 1.0324e-0131.0 2.02e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 1 0 2 0 0 7 29786 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 2: Setup BuildTwoSided 142 1.0 2.1392e-01 2.0 0.00e+00 0.0 9.3e+05 8.0e+00 0.0e+00 0 0 2 0 0 0 0 4 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 638 1.0 2.1115e+01 3.3 0.00e+00 0.0 3.8e+05 4.8e+05 0.0e+00 4 0 1 14 0 15 0 2 25 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetGraph 142 1.0 3.3468e-04 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 142 1.0 2.2425e-01 1.9 0.00e+00 0.0 4.6e+06 9.2e+02 0.0e+00 0 0 10 0 0 0 0 21 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 940 1.0 1.9721e-02 3.6 0.00e+00 0.0 1.3e+07 2.2e+03 0.0e+00 0 0 27 2 0 0 0 59 4 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 940 1.0 7.9004e-02 5.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 140 1.0 5.9162e-01 1.9 5.97e+08 1.4 1.4e+06 6.4e+03 0.0e+00 0 3 3 1 0 0 7 6 1 0 1327331 582383 105 5.40e+01 105 1.90e+01 19 MatConvert 113 1.0 3.7451e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 4.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatScale 42 1.0 2.5864e-02 1.6 1.84e+07 1.3 1.4e+05 1.8e+03 0.0e+00 0 0 0 0 0 0 0 1 0 0 1027973 0 0 0.00e+00 14 1.73e-01 0 MatAssemblyBegin 423 1.0 2.1583e+01 2.4 0.00e+00 0.0 3.8e+05 4.8e+05 0.0e+00 5 0 1 14 0 18 0 2 25 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 423 1.0 5.5925e+00 1.1 5.54e+06 3.5 4.2e+06 7.6e+02 4.7e+02 2 0 9 0 11 7 0 19 0 15 1149 0 368 6.20e+02 0 0.00e+00 0 MatCreateSubMat 22 1.0 4.6836e+00 1.0 0.00e+00 0.0 3.9e+05 9.7e+04 2.6e+02 2 0 1 3 6 6 0 2 5 9 0 0 66 4.71e+01 0 0.00e+00 0 MatPartitioning 11 1.0 2.2333e+00 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 2.8e+01 1 0 0 0 1 3 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatCoarsen 14 1.0 2.0164e-01 2.2 0.00e+00 0.0 7.3e+06 1.0e+03 2.3e+02 0 0 15 1 5 0 0 33 1 7 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 23 1.0 5.3731e-03 3.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAXPY 14 1.0 5.1692e-01 1.5 7.17e+05 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 2067 0 28 7.64e+01 0 0.00e+00 0 MatTranspose 28 1.0 7.1834e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMatMult 14 1.0 2.9304e+00 1.1 3.59e+08 1.4 1.6e+06 2.3e+04 1.2e+02 1 2 3 3 3 4 4 7 5 4 161152 0 56 1.53e+02 0 0.00e+00 0 MatMatMultSym 14 1.0 1.9219e+00 1.0 0.00e+00 0.0 1.3e+06 1.9e+04 1.1e+02 1 0 3 2 3 2 0 6 3 4 0 0 28 7.64e+01 0 0.00e+00 0 MatMatMultNum 14 1.0 9.7787e-01 1.3 3.59e+08 1.4 2.9e+05 3.8e+04 0.0e+00 0 2 1 1 0 1 4 1 2 0 482923 0 28 7.64e+01 0 0.00e+00 0 MatPtAP 14 1.0 5.9070e+01 1.0 7.65e+09 1.8 3.3e+06 1.7e+05 1.5e+02 20 36 7 44 4 74 87 15 78 5 160380 0 56 1.59e+02 0 0.00e+00 0 MatPtAPSymbolic 14 1.0 2.7354e+01 1.0 0.00e+00 0.0 1.8e+06 2.1e+05 9.8e+01 9 0 4 30 2 34 0 8 53 3 0 0 0 0.00e+00 0 0.00e+00 0 MatPtAPNumeric 14 1.0 3.1752e+01 1.0 7.65e+09 1.8 1.5e+06 1.2e+05 5.6e+01 11 36 3 14 1 40 87 7 25 2 298357 0 56 1.59e+02 0 0.00e+00 0 MatTrnMatMult 14 1.0 2.2126e+00 1.1 4.57e+07 1.3 1.3e+06 3.8e+04 1.6e+02 1 0 3 4 4 3 1 6 7 5 30838 0 56 1.33e+02 0 0.00e+00 0 MatTrnMatMultSym 14 1.0 1.2371e+00 1.0 0.00e+00 0.0 9.4e+05 2.7e+04 1.2e+02 0 0 2 2 3 2 0 4 4 4 0 0 10 6.65e+01 0 0.00e+00 0 MatTrnMatMultNum 14 1.0 9.8658e-01 1.1 4.57e+07 1.3 3.2e+05 7.2e+04 3.6e+01 0 0 1 2 1 1 1 1 3 1 69159 0 46 6.69e+01 0 0.00e+00 0 MatGetLocalMat 61 1.0 5.8521e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetBrAoCol 42 1.0 4.0749e-01 2.7 0.00e+00 0.0 2.0e+06 1.5e+05 0.0e+00 0 0 4 23 0 0 0 9 42 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 373 1.0 2.7963e+00 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 3 0 0 0 0 0 0 373 6.60e+02 0 0.00e+00 0 VecTDot 294 1.0 4.5488e-01 2.6 5.02e+06 1.1 0.0e+00 0.0e+00 2.9e+02 0 0 0 0 7 0 0 0 0 9 16446 869652 0 0.00e+00 0 0.00e+00 99 VecCopy 28 1.0 6.8022e-04 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 5 9.22e-01 0 VecSet 918 1.0 1.7066e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 280 1.0 3.6308e-03 1.4 4.78e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1962317 3005333 0 0.00e+00 0 0.00e+00 99 VecAYPX 126 1.0 3.1414e-03 1.4 2.15e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1020599 1225090 0 0.00e+00 0 0.00e+00 99 VecAssemblyBegin 513 1.0 1.6094e-01 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 513 1.0 1.2582e-03 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 323 0.00e+00 0 VecPointwiseMult 154 1.0 2.4156e-03 1.3 1.31e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 811123 1021476 10 1.84e+00 0 0.00e+00 99 VecScatterBegin 681 1.0 1.7555e-02 3.3 0.00e+00 0.0 6.1e+06 3.5e+03 0.0e+00 0 0 13 2 0 0 0 28 3 0 0 0 0 0.00e+00 89 2.13e+00 0 VecScatterEnd 681 1.0 7.4091e-02 7.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSetRandom 14 1.0 5.7706e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 5 9.22e-01 0 VecCUDACopyTo 110 1.0 5.6520e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 110 1.67e+01 0 0.00e+00 0 VecCUDACopyFrom 699 1.0 2.0109e-02 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 699 2.90e+01 0 KSPSetUp 36 1.0 7.4534e-01 5.9 0.00e+00 0.0 0.0e+00 0.0e+00 3.6e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 PCGAMGGraph_AGG 14 1.0 5.4916e+00 1.0 3.23e+07 1.4 7.8e+05 1.5e+03 2.2e+02 2 0 2 0 5 7 0 4 0 7 7857 0 56 4.15e+01 14 1.73e-01 0 PCGAMGCoarse_AGG 14 1.0 2.4858e+00 1.0 4.57e+07 1.3 9.3e+06 6.2e+03 4.5e+02 1 0 20 5 10 3 1 42 8 14 27448 0 56 1.33e+02 98 2.00e+00 0 PCGAMGProl_AGG 14 1.0 5.5704e-01 1.1 0.00e+00 0.0 4.0e+06 3.3e+03 1.0e+03 0 0 9 1 23 1 0 18 2 32 0 0 28 9.74e+00 446 5.87e+00 0 PCGAMGPOpt_AGG 14 1.0 4.5285e+00 1.0 9.81e+08 1.4 3.0e+06 1.5e+04 5.2e+02 2 5 6 3 12 6 12 13 6 17 286484 622013 199 2.85e+02 115 2.08e+01 13 GAMG: createProl 14 1.0 1.3033e+01 1.0 1.05e+09 1.4 1.7e+07 6.8e+03 2.2e+03 4 5 36 9 51 16 13 77 16 71 108091 613511 339 4.70e+02 673 2.89e+01 12 Graph 28 1.0 5.4505e+00 1.0 3.23e+07 1.4 7.8e+05 1.5e+03 2.2e+02 2 0 2 0 5 7 0 4 0 7 7916 0 56 4.15e+01 14 1.73e-01 0 MIS/Agg 14 1.0 2.0185e-01 2.2 0.00e+00 0.0 7.3e+06 1.0e+03 2.3e+02 0 0 15 1 5 0 0 33 1 7 0 0 0 0.00e+00 0 0.00e+00 0 SA: col data 14 1.0 2.3100e-01 1.0 0.00e+00 0.0 3.8e+06 2.6e+03 8.9e+02 0 0 8 1 21 0 0 17 1 29 0 0 0 0.00e+00 446 5.87e+00 0 SA: frmProl0 14 1.0 2.5684e-01 1.0 0.00e+00 0.0 2.7e+05 1.3e+04 5.6e+01 0 0 1 0 1 0 0 1 1 2 0 0 28 9.74e+00 0 0.00e+00 0 SA: smooth 14 1.0 3.6288e+00 1.1 3.72e+08 1.4 1.6e+06 2.3e+04 1.4e+02 1 2 3 3 3 4 5 7 5 5 135668 0 84 2.29e+02 0 0.00e+00 0 GAMG: partLevel 14 1.0 6.6482e+01 1.0 7.65e+09 1.8 5.1e+06 1.2e+05 8.1e+02 23 36 11 47 19 83 87 23 84 26 142516 0 144 2.06e+02 22 6.62e-02 0 repartition 11 1.0 2.4962e+00 1.0 9.04e+05 2.7 1.2e+06 5.0e+01 2.4e+02 1 0 2 0 5 3 0 5 0 8 456 0 22 2.58e-01 0 0.00e+00 0 Invert-Sort 11 1.0 4.8167e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.4e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 Move A 11 1.0 4.0013e+00 1.0 0.00e+00 0.0 2.8e+05 1.4e+05 1.4e+02 1 0 1 3 3 5 0 1 5 5 0 0 33 1.83e+01 0 0.00e+00 0 Move P 11 1.0 9.1345e-01 1.1 0.00e+00 0.0 1.1e+05 9.2e+02 1.4e+02 0 0 0 0 3 1 0 1 0 5 0 0 33 2.87e+01 0 0.00e+00 0 PCSetUp 4 1.0 7.9834e+01 1.0 8.69e+09 1.7 2.2e+07 3.2e+04 3.1e+03 28 41 47 56 71 100100100100100 136327 612033 483 6.76e+02 699 2.90e+01 2 --- Event Stage 3: Solve 1 BuildTwoSided 1 1.0 2.0791e-04 1.9 0.00e+00 0.0 3.7e+03 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 7.2070e-0332.8 0.00e+00 0.0 1.1e+04 7.9e+04 0.0e+00 0 0 0 0 0 0 0 0 35 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 4.1858e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 4.5347e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.0080e-05 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 7.6134e-03 2.5 1.60e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 12 0 0 0 323742 0 0 0.00e+00 2 7.34e-03 0 DMPlexJacobianFE 1 1.0 3.0490e-01 1.0 1.63e+06 1.0 1.1e+04 7.9e+04 0.0e+00 0 0 0 0 0 39 12 0 35 0 8195 0 2 3.83e-01 0 0.00e+00 0 SFSetGraph 1 1.0 1.7580e-06 3.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 2.6984e-04 1.5 0.00e+00 0.0 1.8e+04 3.1e+02 0.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 384 1.0 1.0234e-0214.2 0.00e+00 0.0 3.1e+06 5.1e+02 0.0e+00 0 0 6 0 0 0 0 96 62 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 384 1.0 3.9435e-0133.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 30 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 68 1.0 1.2468e-0320.5 0.00e+00 0.0 1.1e+05 5.7e+02 0.0e+00 0 0 0 0 0 0 0 3 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 68 1.0 1.5909e-02407.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 315 1.0 2.6756e-0118.7 1.93e+08132.8 3.0e+06 5.1e+02 0.0e+00 0 0 6 0 0 15 67 92 60 0 51125 1563380 238 1.13e+00 217 2.80e-01 63 MatMultAdd 66 1.0 1.4657e-0112.7 4.67e+0661.4 9.1e+04 6.0e+02 0.0e+00 0 0 0 0 0 18 3 3 2 0 4573 0 44 6.94e-05 0 0.00e+00 0 MatMultTranspose 66 1.0 2.5362e-01141.8 4.67e+0661.4 9.1e+04 6.0e+02 0.0e+00 0 0 0 0 0 14 3 3 2 0 2643 804 26 3.00e-04 66 3.16e-02 0 MatSolve 22 0.0 8.4983e-05 0.0 2.48e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 292 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 3.0739e-05 3.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 2.2162e-0537.6 8.94e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 403 0 0 0.00e+00 0 0.00e+00 0 MatResidual 66 1.0 3.2465e-02 9.3 4.34e+07159.0 5.5e+05 5.1e+02 0.0e+00 0 0 1 0 0 1 13 17 11 0 80951 1005536 44 2.08e-01 23 3.30e-02 61 MatAssemblyBegin 1 1.0 7.4514e-03 1.7 0.00e+00 0.0 1.1e+04 7.9e+04 0.0e+00 0 0 0 0 0 1 0 0 35 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 4.4166e-03 4.2 2.65e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 7884 0 2 3.83e-01 0 0.00e+00 0 MatGetRowIJ 1 0.0 3.7380e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 5.2893e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 9.3554e-0585.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 4 1.0 1.2663e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 4 3.83e-01 0 0.00e+00 0 VecTDot 105 1.0 2.5992e-02 2.2 7.26e+04 6.4 0.0e+00 0.0e+00 1.0e+02 0 0 0 0 2 3 0 0 0 57 1355 6558 0 0.00e+00 0 0.00e+00 98 VecNorm 57 1.0 2.6891e-0136.8 3.82e+04 6.1 0.0e+00 0.0e+00 5.7e+01 0 0 0 0 1 8 0 0 0 31 73 5834 0 0.00e+00 0 0.00e+00 98 VecCopy 206 1.0 1.7905e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.43e-03 0 VecSet 253 1.0 1.9446e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 105 1.0 2.3934e-03 1.5 6.97e+04 6.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 15206 21410 2 2.87e-03 0 0.00e+00 98 VecAYPX 443 1.0 7.9854e-03 1.4 3.24e+0511.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 11465 14825 22 3.16e-02 0 0.00e+00 97 VecAXPBYCZ 132 1.0 3.2476e-03 1.3 3.71e+05 9.4 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 38316 71190 0 0.00e+00 0 0.00e+00 97 VecPointwiseMult 297 1.0 3.5274e-03 1.3 1.62e+0518.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 8146 7992 3 4.30e-03 0 0.00e+00 95 VecScatterBegin 447 1.0 1.2123e-0211.6 0.00e+00 0.0 3.1e+06 5.1e+02 0.0e+00 0 0 7 0 0 0 0 98 64 0 0 0 0 0.00e+00 66 7.22e-05 0 VecScatterEnd 447 1.0 3.9544e-0114.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 31 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 331 1.0 6.1762e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 331 1.17e+00 0 0.00e+00 0 VecCUDACopyFrom 315 1.1 6.7110e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 315 3.37e-01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 3.7460e+00 1.0 4.79e+0880.8 1.1e+07 1.1e+03 8.8e+02 1 0 22 1 20 475180329484475 9789 34710 436 3.86e+00 459 4.19e-01 27 SNESSetUp 1 1.0 1.2401e-04 3.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 1.2602e-02 1.6 1.67e+06 1.0 4.8e+04 3.6e+02 1.7e+01 0 0 0 0 0 1 12 1 1 9 197592 0 0 0.00e+00 8 2.04e-02 0 SNESJacobianEval 1 1.0 3.0589e-01 1.0 1.65e+06 1.0 1.8e+04 4.8e+04 0.0e+00 0 0 0 0 0 39 12 1 35 0 8208 0 2 3.83e-01 1 3.67e-03 0 KSPSetUp 4 1.0 4.8620e-04 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 4.7235e-01 1.0 2.02e+08117.3 3.1e+06 5.1e+02 1.7e+02 0 0 7 0 4 60 75 98 64 90 32503 380362 333 1.16e+00 306 3.13e-01 59 PCSetUp 1 1.0 1.3155e-04 3.2 8.94e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 68 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 22 1.0 1.5206e-04 3.2 8.94e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 59 0 0 0.00e+00 0 0.00e+00 0 PCApply 22 1.0 4.5657e-01 2.3 2.02e+08139.8 2.6e+06 5.1e+02 1.0e+02 0 0 6 0 2 51 65 82 54 55 29034 461270 291 9.64e-01 264 2.52e-01 56 --- Event Stage 4: Solve 2 BuildTwoSided 1 1.0 2.7982e-04 3.5 0.00e+00 0.0 3.7e+03 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 1.9168e-01362.8 0.00e+00 0.0 1.1e+04 3.4e+05 0.0e+00 0 0 0 0 0 5 0 0 35 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 4.5604e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 4.9697e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.0730e-05 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 2.3417e-02 1.1 1.28e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 9 0 0 0 842056 0 0 0.00e+00 2 3.96e-02 0 DMPlexJacobianFE 1 1.0 2.6109e+00 1.0 1.31e+07 1.0 1.1e+04 3.4e+05 0.0e+00 1 0 0 0 0 84 10 0 35 0 7674 0 2 3.31e+00 0 0.00e+00 0 SFSetGraph 1 1.0 7.3930e-06 3.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 3.4943e-04 1.5 0.00e+00 0.0 1.8e+04 1.1e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 496 1.0 1.5773e-0213.3 0.00e+00 0.0 4.3e+06 1.6e+03 0.0e+00 0 0 9 1 0 0 0 94 62 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 496 1.0 3.3998e-0114.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 10 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 89 1.0 9.7246e-04 8.4 0.00e+00 0.0 2.4e+05 9.9e+02 0.0e+00 0 0 0 0 0 0 0 5 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 89 1.0 3.3767e-02231.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 406 1.0 3.6222e-01 9.3 5.28e+0812.6 4.0e+06 1.6e+03 0.0e+00 0 1 8 1 0 2 72 89 60 0 420889 6996873 308 5.73e+00 251 2.98e+00 37 MatMultAdd 87 1.0 3.2483e-0126.0 1.23e+07 5.0 2.2e+05 9.6e+02 0.0e+00 0 0 0 0 0 10 3 5 2 0 22236 0 0 0.00e+00 0 0.00e+00 0 MatMultTranspose 87 1.0 4.1400e-0216.1 1.23e+07 5.0 2.2e+05 9.6e+02 0.0e+00 0 0 0 0 0 0 3 5 2 0 174467 0 0 0.00e+00 29 3.44e-01 0 MatSolve 29 0.0 4.5044e-04 0.0 6.73e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1495 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 1.9173e-0424.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 4.2928e-04644.6 8.34e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1943 0 0 0.00e+00 0 0.00e+00 0 MatResidual 87 1.0 7.9365e-02 9.8 1.20e+0815.0 7.6e+05 1.6e+03 0.0e+00 0 0 2 0 0 0 14 17 12 0 375912 4610215 58 1.08e+00 30 3.56e-01 36 MatAssemblyBegin 1 1.0 1.9686e-01 8.1 0.00e+00 0.0 1.1e+04 3.4e+05 0.0e+00 0 0 0 0 0 6 0 0 35 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 6.5087e-0241.7 1.12e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 2373 0 2 3.31e+00 0 0.00e+00 0 MatGetRowIJ 1 0.0 9.2280e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 5.4297e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 3.8365e-04 8.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 5.5230e-0241.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 2 3.31e+00 0 0.00e+00 0 VecTDot 119 1.0 4.0501e-02 2.7 2.80e+05 1.6 0.0e+00 0.0e+00 1.2e+02 0 0 0 0 3 1 0 0 0 58 8780 58409 0 0.00e+00 0 0.00e+00 99 VecNorm 64 1.0 3.5526e-02 4.2 1.52e+05 1.6 0.0e+00 0.0e+00 6.4e+01 0 0 0 0 1 1 0 0 0 31 5457 47253 0 0.00e+00 0 0.00e+00 99 VecCopy 269 1.0 2.3297e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.19e-02 0 VecSet 381 1.0 1.4828e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 119 1.0 2.6997e-03 1.5 2.84e+05 1.6 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 135064 196084 2 2.38e-02 0 0.00e+00 99 VecAYPX 576 1.0 9.0475e-03 1.3 9.70e+05 2.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 108860 155067 29 3.44e-01 0 0.00e+00 97 VecAXPBYCZ 174 1.0 4.1392e-03 1.3 1.23e+06 1.9 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 327141 646716 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 381 1.0 4.4277e-03 1.3 3.96e+05 2.8 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 68526 68961 3 3.56e-02 0 0.00e+00 95 VecScatterBegin 580 1.0 1.7258e-0210.8 0.00e+00 0.0 4.5e+06 1.5e+03 0.0e+00 0 0 9 1 0 0 0 99 64 0 0 0 0 0.00e+00 0 0.00e+00 0 VecScatterEnd 580 1.0 3.4039e-01 9.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 10 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 342 1.0 7.7764e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 342 6.13e+00 0 0.00e+00 0 VecCUDACopyFrom 290 1.0 9.9327e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 290 3.48e+00 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 8.5507e+00 1.0 1.08e+0910.5 7.8e+06 5.4e+03 8.9e+02 3 1 17 3 20 277165174395430 40617 1749504 451 2.33e+01 438 3.95e+00 19 SNESSetUp 1 1.0 8.3060e-05 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 3.1397e-02 1.1 1.32e+07 1.0 4.8e+04 1.3e+03 1.7e+01 0 0 0 0 0 1 9 1 1 8 631276 0 0 0.00e+00 8 1.27e-01 0 SNESJacobianEval 1 1.0 2.6123e+00 1.0 1.32e+07 1.0 1.8e+04 2.1e+05 0.0e+00 1 0 0 0 0 84 10 0 35 0 7689 0 2 3.31e+00 1 1.98e-02 0 KSPSetUp 4 1.0 1.1259e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 4.5979e-01 1.0 5.55e+0811.4 4.5e+06 1.5e+03 1.9e+02 0 1 9 1 4 15 81 99 64 91 370676 1880253 340 6.11e+00 281 3.34e+00 35 PCSetUp 1 1.0 7.0172e-0416.4 8.34e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1189 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 29 1.0 7.1986e-0412.2 8.34e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1159 0 0 0.00e+00 0 0.00e+00 0 PCApply 29 1.0 4.3533e-01 1.1 5.46e+0813.4 3.8e+06 1.5e+03 1.0e+02 0 1 8 0 2 14 70 83 54 50 335951 2311035 284 5.07e+00 225 2.67e+00 34 --- Event Stage 5: Solve 3 BuildTwoSided 1 1.0 5.5691e-04 5.8 0.00e+00 0.0 3.7e+03 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 1.4410e+001096.6 0.00e+00 0.0 1.1e+04 1.4e+06 0.0e+00 0 0 0 1 0 6 0 0 39 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 4.9781e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 4.5802e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.2839e-05 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.8236e-01 1.1 1.03e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 1 10 0 0 0 865037 0 0 0.00e+00 2 2.53e-01 0 DMPlexJacobianFE 1 1.0 2.0526e+01 1.0 1.05e+08 1.0 1.1e+04 1.4e+06 0.0e+00 7 1 0 1 0 94 10 0 39 0 7823 0 2 2.75e+01 0 0.00e+00 0 SFSetGraph 1 1.0 5.3734e-05 2.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 8.6219e-04 1.6 0.00e+00 0.0 1.8e+04 4.3e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 588 1.0 2.3392e-02 8.4 0.00e+00 0.0 5.7e+06 4.1e+03 0.0e+00 0 0 12 2 0 0 0 90 59 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 588 1.0 5.5494e-01 4.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 106 1.0 1.5228e-03 5.0 0.00e+00 0.0 5.7e+05 1.4e+03 0.0e+00 0 0 1 0 0 0 0 9 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 106 1.0 6.0280e-02327.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 481 1.0 8.6040e-01 2.1 1.13e+09 2.4 5.2e+06 4.4e+03 0.0e+00 0 4 11 2 0 2 72 81 57 0 1318184 18672688 278 2.55e+01 253 2.19e+01 20 MatMultAdd 104 1.0 5.1137e-0116.1 3.99e+07 1.6 5.6e+05 1.3e+03 0.0e+00 0 0 1 0 0 2 3 9 2 0 104325 0 52 8.86e-05 0 0.00e+00 0 MatMultTranspose 104 1.0 8.9395e-02 4.2 3.99e+07 1.6 5.6e+05 1.3e+03 0.0e+00 0 0 1 0 0 0 3 9 2 0 596780 1357 30 3.96e-04 78 2.51e+00 0 MatSolve 26 0.0 9.7696e-05 0.0 4.60e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 471 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 3.2676e-05 5.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 2.7222e-0547.4 1.76e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 645 0 0 0.00e+00 0 0.00e+00 0 MatResidual 104 1.0 1.7346e-01 2.3 2.39e+08 2.7 1.0e+06 4.2e+03 0.0e+00 0 1 2 0 0 0 14 16 11 0 1268242 13894070 52 4.78e+00 27 2.61e+00 20 MatAssemblyBegin 1 1.0 1.4561e+0013.1 0.00e+00 0.0 1.1e+04 1.4e+06 0.0e+00 0 0 0 1 0 7 0 0 39 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 2.2541e-0119.7 4.58e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 2868 0 2 2.75e+01 0 0.00e+00 0 MatGetRowIJ 1 0.0 3.7250e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 4.7834e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.9057e-03 3.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 4 1.0 1.8008e-0118.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 4 2.75e+01 0 0.00e+00 0 VecTDot 134 1.0 6.3444e-02 2.8 1.79e+06 1.3 0.0e+00 0.0e+00 1.3e+02 0 0 0 0 3 0 0 0 0 58 42059 430090 0 0.00e+00 0 0.00e+00 99 VecNorm 72 1.0 6.7029e-02 3.5 9.82e+05 1.3 0.0e+00 0.0e+00 7.2e+01 0 0 0 0 2 0 0 0 0 31 21854 350046 0 0.00e+00 0 0.00e+00 99 VecCopy 322 1.0 2.5897e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 9.66e-02 0 VecSet 376 1.0 2.5194e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 133 1.0 2.6737e-03 1.5 1.84e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1025231 1540437 2 1.93e-01 0 0.00e+00 99 VecAYPX 684 1.0 8.8295e-03 1.4 4.89e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 814821 1250468 26 2.51e+00 0 0.00e+00 97 VecAXPBYCZ 208 1.0 3.6415e-03 1.2 6.67e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 2706733 6331127 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 460 1.0 4.1915e-03 1.3 1.54e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 530989 560497 3 2.90e-01 0 0.00e+00 96 VecScatterBegin 689 1.0 2.5330e-02 6.8 0.00e+00 0.0 6.3e+06 3.8e+03 0.0e+00 0 0 13 2 0 0 0 99 60 0 0 0 0 0.00e+00 78 9.26e-05 0 VecScatterEnd 689 1.0 5.5514e-01 3.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 387 1.0 1.4617e-02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 387 2.85e+01 0 0.00e+00 0 VecCUDACopyFrom 367 1.1 1.3183e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 367 2.56e+01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 3.6061e+01 1.0 2.84e+09 2.5 1.1e+07 1.7e+04 1.1e+03 12 10 23 14 24 166173169458460 76076 6588719 520 1.56e+02 558 2.88e+01 10 SNESSetUp 1 1.0 7.7110e-05 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 2.0461e-01 1.1 1.05e+08 1.0 4.8e+04 5.0e+03 1.7e+01 0 1 0 0 0 1 10 1 1 7 772979 0 0 0.00e+00 8 8.92e-01 0 SNESJacobianEval 1 1.0 2.0530e+01 1.0 1.05e+08 1.0 1.8e+04 8.6e+05 0.0e+00 7 1 0 1 0 94 10 0 39 0 7831 0 2 2.75e+01 1 1.26e-01 0 KSPSetUp 5 1.0 1.1654e-02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 1.0794e+00 1.0 1.23e+09 2.3 6.3e+06 3.8e+03 2.1e+02 0 5 13 2 5 5 80 99 60 92 1173658 7150124 389 2.83e+01 358 2.45e+01 20 PCSetUp 1 1.0 1.3905e-04 3.7 1.76e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 126 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 26 1.0 1.5838e-04 3.0 1.76e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 111 0 0 0.00e+00 0 0.00e+00 0 PCApply 26 1.0 9.8605e-01 1.1 1.14e+09 2.6 5.6e+06 3.7e+03 1.4e+02 0 4 12 2 3 4 69 89 52 59 1102728 8458468 339 2.38e+01 308 1.97e+01 19 --- Event Stage 6: Solve 4 BuildTwoSided 1 1.0 3.5438e-0329.9 0.00e+00 0.0 3.7e+03 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 1.0080e+012374.1 0.00e+00 0.0 1.1e+04 5.8e+06 0.0e+00 3 0 0 5 0 6 0 0 38 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 6.1169e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 6.3038e-04 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.3191e-05 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.4471e+00 1.0 8.22e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 5 0 0 0 1 9 0 0 0 872084 0 0 0.00e+00 2 1.79e+00 0 DMPlexJacobianFE 1 1.0 1.6164e+02 1.0 8.38e+08 1.0 1.1e+04 5.8e+06 0.0e+00 56 5 0 5 0 96 9 0 38 0 7955 0 2 2.24e+02 0 0.00e+00 0 SFSetGraph 1 1.0 2.0460e-04 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 5.8212e-03 1.4 0.00e+00 0.0 1.8e+04 1.7e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 630 1.0 8.0096e-02 8.7 0.00e+00 0.0 8.2e+06 1.2e+04 0.0e+00 0 0 17 8 0 0 0 89 60 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 630 1.0 1.1114e+00 4.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 114 1.0 2.6679e-03 3.8 0.00e+00 0.0 9.8e+05 2.5e+03 0.0e+00 0 0 2 0 0 0 0 11 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 114 1.0 3.2524e-01141.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 515 1.0 4.5996e+00 1.1 7.10e+09 1.3 7.2e+06 1.4e+04 0.0e+00 1 37 15 8 0 2 73 78 59 0 2162181 54911548 542 1.83e+02 459 2.38e+02 18 MatMultAdd 112 1.0 8.4428e-01 3.7 3.16e+08 1.2 9.7e+05 2.3e+03 0.0e+00 0 2 2 0 0 0 3 11 1 0 552845 23998060 56 2.30e+01 56 2.06e+00 20 MatMultTranspose 112 1.0 5.3909e-01 2.3 3.12e+08 1.2 9.7e+05 2.3e+03 0.0e+00 0 2 2 0 0 0 3 11 1 0 853918 433254373 4 1.01e+02 84 2.96e+00 92 MatSolve 28 0.0 4.1839e-04 0.0 6.50e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1554 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.3250e-0430.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 4.3188e-04626.8 8.34e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1931 0 0 0.00e+00 0 0.00e+00 0 MatResidual 112 1.0 9.0614e-01 1.2 1.40e+09 1.3 1.5e+06 1.3e+04 0.0e+00 0 7 3 2 0 0 14 16 12 0 2140574 46350698 112 3.52e+01 85 4.46e+01 19 MatAssemblyBegin 1 1.0 1.0140e+0121.3 0.00e+00 0.0 1.1e+04 5.8e+06 0.0e+00 3 0 0 5 0 6 0 0 38 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 5.5244e-01 3.4 1.86e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 4787 0 2 2.24e+02 0 0.00e+00 0 MatGetRowIJ 1 0.0 1.0195e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 5.9697e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.2919e-02 2.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 4 1.0 3.8817e-01 4.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 4 2.64e+02 0 0.00e+00 0 VecTDot 138 1.0 1.2725e-01 2.2 1.50e+07 1.1 0.0e+00 0.0e+00 1.4e+02 0 0 0 0 3 0 0 0 0 58 178590 2047917 0 0.00e+00 0 0.00e+00 100 VecNorm 74 1.0 1.8896e-01 3.1 8.18e+06 1.1 0.0e+00 0.0e+00 7.4e+01 0 0 0 0 2 0 0 0 0 31 65714 2019966 0 0.00e+00 0 0.00e+00 100 VecCopy 346 1.0 6.7914e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 30 1.71e+00 0 VecSet 402 1.0 2.3559e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 137 1.0 3.8972e-03 1.3 1.54e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 5981586 10086784 2 1.56e+00 0 0.00e+00 100 VecAYPX 734 1.0 3.3982e-02 2.4 4.17e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1854475 5722762 56 1.80e+00 0 0.00e+00 100 VecAXPBYCZ 224 1.0 1.1771e-02 1.9 5.78e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 7421432 23854575 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 492 1.0 1.2773e-02 1.6 1.28e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1503049 1674518 34 3.34e+00 0 0.00e+00 100 VecScatterBegin 739 1.0 8.5159e-02 6.6 0.00e+00 0.0 9.1e+06 1.1e+04 0.0e+00 0 0 19 8 0 0 0 99 61 0 0 0 0 0.00e+00 84 3.21e+00 0 VecScatterEnd 739 1.0 1.3200e+00 4.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 690 1.0 5.8908e-02 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 690 2.13e+02 0 0.00e+00 0 VecCUDACopyFrom 610 1.0 8.1046e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 610 2.51e+02 0 VecCopyFromSome 28 1.0 1.1659e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 28 1.15e+00 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.2617e+02 1.0 1.67e+10 1.4 1.6e+07 4.2e+04 1.1e+03 78 88 35 55 26 134170178416475 102680 31403689 846 1.10e+03 854 2.77e+02 11 SNESSetUp 1 1.0 1.3801e-02347.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 1.5431e+00 1.1 8.30e+08 1.0 4.8e+04 1.9e+04 1.7e+01 1 5 0 0 0 1 9 1 1 7 818913 0 0 0.00e+00 8 6.70e+00 0 SNESJacobianEval 1 1.0 1.6166e+02 1.0 8.40e+08 1.0 1.8e+04 3.5e+06 0.0e+00 56 5 0 5 0 96 9 0 38 0 7959 0 2 2.24e+02 1 8.95e-01 0 KSPSetUp 5 1.0 1.3713e-0234.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 5.7560e+00 1.0 7.88e+09 1.3 9.1e+06 1.1e+04 2.2e+02 2 42 19 8 5 3 81 99 61 92 1928212 33918366 692 3.12e+02 629 2.44e+02 23 PCSetUp 1 1.0 7.5145e-0416.0 8.34e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1110 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 28 1.0 7.7845e-0411.2 8.34e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1071 0 0 0.00e+00 0 0.00e+00 0 PCApply 28 1.0 5.0070e+00 1.0 6.83e+09 1.3 8.4e+06 1.1e+04 1.4e+02 2 36 18 7 3 3 70 92 53 57 1901026 37639336 638 2.82e+02 575 2.02e+02 24 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Object 0 680 446080 0. Container 0 56 34944 0. Distributed Mesh 0 114 578416 0. DM Label 0 48 33408 0. GraphPartitioner 0 36 26240 0. Index Set 0 195 17998584 0. IS L to G Mapping 0 7 528448 0. Section 0 204 159936 0. Star Forest Graph 0 194 189056 0. Discrete System 0 97 97808 0. Matrix 0 153 705122496 0. Matrix Null Space 0 4 2976 0. Vector 0 292 17997080 0. SNES 0 4 6128 0. DMSNES 0 4 2880 0. Krylov Solver 0 40 81952 0. DMKSP interface 0 4 2816 0. Preconditioner 0 26 30368 0. Linear Space 0 8 5952 0. Dual Space 0 32 26624 0. FE Space 0 8 6976 0. Vec Scatter 0 32 27392 0. Field over DM 0 4 3040 0. Viewer 1 1 896 0. --- Event Stage 1: Mesh Setup Object 704 212 139072 0. Container 60 32 19968 0. Distributed Mesh 208 146 740976 0. DM Label 98 66 45936 0. GraphPartitioner 64 44 32064 0. Index Set 5354 5257 7046144 0. IS L to G Mapping 5 1 740408 0. Section 416 292 228928 0. Star Forest Graph 471 377 364864 0. Discrete System 272 219 220752 0. Matrix 68 52 158080 0. Matrix Null Space 4 0 0 0. Vector 100 36 1472576 0. SNES 4 0 0 0. DMSNES 4 0 0 0. Krylov Solver 4 0 0 0. Preconditioner 4 0 0 0. Linear Space 8 4 2976 0. Dual Space 32 16 13312 0. FE Space 8 4 3488 0. Vec Scatter 4 0 0 0. Field over DM 4 4 3040 0. Viewer 1 0 0 0. --- Event Stage 2: Setup Index Set 373 347 18987576 0. IS L to G Mapping 14 11 160592 0. Star Forest Graph 142 114 116736 0. Matrix 588 455 319816048 0. Matrix Partitioning 11 11 8184 0. Matrix Coarsen 14 14 9576 0. Vector 1035 903 14506256 0. Krylov Solver 50 14 27328 0. Preconditioner 36 14 12768 0. Vec Scatter 128 100 85600 0. PetscRandom 28 28 19432 0. --- Event Stage 3: Solve 1 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 56304 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 4: Solve 2 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 69296 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 5: Solve 3 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 118960 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 26 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 6: Solve 4 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 316976 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 26 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. ======================================================================================================================== Average time to get PetscTime(): 6.83e-08 Average time for MPI_Barrier(): 1.26596e-05 Average time for zero size MPI_Send(): 6.96137e-06 #PETSc Option Table entries: -bmat_view :bmcpu.m:ascii_matlab -cells 16,24,32 -check_pointer_intensity 0 -ex56_dm_mat_type aijcusparse -ex56_dm_refine 3 -ex56_dm_vec_type cuda -gamg_est_ksp_max_it 10 -gamg_est_ksp_type cg -ksp_atol 1.e-71 -ksp_converged_reason -ksp_max_it 100 -ksp_monitor -ksp_norm_type preconditioned -ksp_rtol 1.e-11 -ksp_type cg -log_view -lvec_view :lvcpu.m:ascii_matlab -mat_block_size 3 -matptap_via scalable -max_conv_its 4 -mg_levels_esteig_ksp_max_it 10 -mg_levels_esteig_ksp_type cg -mg_levels_ksp_chebyshev_esteig 0,0.05,0,1.05 -mg_levels_ksp_max_it 2 -mg_levels_ksp_type chebyshev -mg_levels_pc_type jacobi -pc_gamg_agg_nsmooths 1 -pc_gamg_coarse_eq_limit 150 -pc_gamg_process_eq_limit 1000 -pc_gamg_repartition true -pc_gamg_reuse_interpolation false -pc_gamg_square_graph 10 -pc_gamg_threshold 0.05 -pc_gamg_threshold_scale .5 -pc_gamg_type agg -pc_type gamg -petscpartitioner_type simple -petscspace_degree 2 -run_type 1 -snes_converged_reason -snes_max_it 2 -snes_monitor -snes_rtol 1.e-10 -snes_type ksponly -use_mat_nearnullspace true -xvec_view :xvcpu.m:ascii_matlab #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with 64 bit PetscInt Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 8 Configure options: --with-cc=mpicc --with-cxx=mpiCC --with-fc=mpif90 --COPTFLAGS="-g -fast" --CXXOPTFLAGS="-g -fast" --FOPTFLAGS="-g -fast" --with-ssl=0 --with-batch=0 --with-mpiexec="jsrun -g 1" --with-cuda=1 --with-cudac=nvcc CUDAFLAGS="-ccbin pgc++" --download-metis --download-viennacl --download-parmetis --download-fblaslapack --with-x=0 --with-64-bit-indices=1 --with-debugging=0 PETSC_ARCH=arch-summit-opt64-pgi-cuda ----------------------------------------- Libraries compiled on 2019-07-28 12:54:27 on login4 Machine characteristics: Linux-4.14.0-115.8.1.el7a.ppc64le-ppc64le-with-redhat-7.6-Maipo Using PETSc directory: /ccs/home/adams/petsc Using PETSc arch: arch-summit-opt64-pgi-cuda ----------------------------------------- Using C compiler: mpicc -g -fast Using Fortran compiler: mpif90 -g -fast ----------------------------------------- Using include paths: -I/ccs/home/adams/petsc/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/sw/summit/cuda/10.1.168/include ----------------------------------------- Using C linker: mpicc Using Fortran linker: mpif90 Using libraries: -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -lpetsc -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -Wl,-rpath,/sw/summit/cuda/10.1.168/lib64 -L/sw/summit/cuda/10.1.168/lib64 /autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib/pgi.ld -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -L/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -L/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -Wl,-rpath,/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -L/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -lflapack -lfblas -lparmetis -lmetis -lcufft -lcublas -lcudart -lcusparse -lstdc++ -ldl -lpthread -lmpiprofilesupport -lmpi_ibm_usempi -lmpi_ibm_mpifh -lmpi_ibm -lpgf90rtl -lpgf90 -lpgf90_rpm1 -lpgf902 -lpgftnrtl -latomic -lpgkomp -lomp -lomptarget -lpgmath -lpgc -lrt -lmass_simdp9 -lmassvp9 -lmassp9 -lm -lgcc_s -lstdc++ -ldl -----------------------------------------