[0] 2280285 global equations, 760095 vertices [0] 2280285 equations in vector, 760095 vertices 0 SNES Function norm 9.255869095573e-01 0 KSP Residual norm 1.168905162105e+04 1 KSP Residual norm 1.203213604666e+03 2 KSP Residual norm 5.758930606398e+02 3 KSP Residual norm 1.420951160829e+02 4 KSP Residual norm 3.539341578886e+01 5 KSP Residual norm 1.105956254304e+01 6 KSP Residual norm 4.721956611265e+00 7 KSP Residual norm 1.246269094419e+00 8 KSP Residual norm 3.760602644334e-01 9 KSP Residual norm 1.365007028571e-01 10 KSP Residual norm 4.577528191844e-02 11 KSP Residual norm 1.495596665230e-02 12 KSP Residual norm 5.301056707251e-03 13 KSP Residual norm 1.745809594447e-03 14 KSP Residual norm 5.854908897312e-04 15 KSP Residual norm 1.921202494548e-04 16 KSP Residual norm 6.765263383661e-05 17 KSP Residual norm 2.142839676782e-05 18 KSP Residual norm 7.194824914713e-06 19 KSP Residual norm 2.493966883023e-06 20 KSP Residual norm 8.191732618523e-07 21 KSP Residual norm 2.938904433240e-07 22 KSP Residual norm 1.017182308096e-07 Linear solve converged due to CONVERGED_RTOL iterations 22 1 SNES Function norm 9.514594002497e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 18556605 global equations, 6185535 vertices [0] 18556605 equations in vector, 6185535 vertices 0 SNES Function norm 3.273111572912e-01 0 KSP Residual norm 2.884685083312e+04 1 KSP Residual norm 3.034997429943e+03 2 KSP Residual norm 1.938711417924e+03 3 KSP Residual norm 6.211069953641e+02 4 KSP Residual norm 2.554212567249e+02 5 KSP Residual norm 1.296860160531e+02 6 KSP Residual norm 4.596107734466e+01 7 KSP Residual norm 1.942505024461e+01 8 KSP Residual norm 9.997487095888e+00 9 KSP Residual norm 3.168214294998e+00 10 KSP Residual norm 1.152148280349e+00 11 KSP Residual norm 5.817763577452e-01 12 KSP Residual norm 2.541565831736e-01 13 KSP Residual norm 1.014481459726e-01 14 KSP Residual norm 3.807109297717e-02 15 KSP Residual norm 1.675021268172e-02 16 KSP Residual norm 7.281696220627e-03 17 KSP Residual norm 3.286981149098e-03 18 KSP Residual norm 1.280761472338e-03 19 KSP Residual norm 5.795880135062e-04 20 KSP Residual norm 2.330813888166e-04 21 KSP Residual norm 1.289729437410e-04 22 KSP Residual norm 5.582321691166e-05 23 KSP Residual norm 2.342190356275e-05 24 KSP Residual norm 9.939087627321e-06 25 KSP Residual norm 4.413228710372e-06 26 KSP Residual norm 2.086870762615e-06 27 KSP Residual norm 9.478640602376e-07 28 KSP Residual norm 4.308016831472e-07 29 KSP Residual norm 1.840369101895e-07 Linear solve converged due to CONVERGED_RTOL iterations 29 1 SNES Function norm 7.476235277155e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 149720445 global equations, 49906815 vertices [0] 149720445 equations in vector, 49906815 vertices 0 SNES Function norm 1.157278881750e-01 0 KSP Residual norm 6.841209355066e+04 1 KSP Residual norm 6.457933615904e+03 2 KSP Residual norm 5.518840190761e+03 3 KSP Residual norm 1.995223379516e+03 4 KSP Residual norm 5.713148915554e+02 5 KSP Residual norm 2.087101062378e+02 6 KSP Residual norm 9.458100324963e+01 7 KSP Residual norm 3.205713936258e+01 8 KSP Residual norm 1.146349805880e+01 9 KSP Residual norm 4.776501832384e+00 10 KSP Residual norm 2.185094654467e+00 11 KSP Residual norm 8.564569553486e-01 12 KSP Residual norm 3.160811426127e-01 13 KSP Residual norm 1.320926199707e-01 14 KSP Residual norm 5.335494203266e-02 15 KSP Residual norm 2.125407498573e-02 16 KSP Residual norm 8.842767613468e-03 17 KSP Residual norm 3.802089123728e-03 18 KSP Residual norm 1.486307030774e-03 19 KSP Residual norm 6.517397919555e-04 20 KSP Residual norm 2.631076339742e-04 21 KSP Residual norm 1.058778071890e-04 22 KSP Residual norm 4.620241826813e-05 23 KSP Residual norm 1.949978209296e-05 24 KSP Residual norm 7.893567973794e-06 25 KSP Residual norm 3.230187299075e-06 26 KSP Residual norm 1.366265352545e-06 27 KSP Residual norm 5.578626261005e-07 Linear solve converged due to CONVERGED_RTOL iterations 27 1 SNES Function norm 4.951074689840e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 1202854653 global equations, 400951551 vertices [0] 1202854653 equations in vector, 400951551 vertices 0 SNES Function norm 4.091651078489e-02 0 KSP Residual norm 1.762011494621e+05 1 KSP Residual norm 1.660439817651e+04 2 KSP Residual norm 1.569451986416e+04 3 KSP Residual norm 6.752636481334e+03 4 KSP Residual norm 1.893949306776e+03 5 KSP Residual norm 8.485617600621e+02 6 KSP Residual norm 4.168148076369e+02 7 KSP Residual norm 1.523193584460e+02 8 KSP Residual norm 6.013926426184e+01 9 KSP Residual norm 2.906917925310e+01 10 KSP Residual norm 1.343346908360e+01 11 KSP Residual norm 5.453345876827e+00 12 KSP Residual norm 2.297824010991e+00 13 KSP Residual norm 9.288502221206e-01 14 KSP Residual norm 4.016974921077e-01 15 KSP Residual norm 1.683754506526e-01 16 KSP Residual norm 7.056779222832e-02 17 KSP Residual norm 3.176699187794e-02 18 KSP Residual norm 1.424704454555e-02 19 KSP Residual norm 6.348600541610e-03 20 KSP Residual norm 2.773480226636e-03 21 KSP Residual norm 1.285957460293e-03 22 KSP Residual norm 5.783834246296e-04 23 KSP Residual norm 2.525350407451e-04 24 KSP Residual norm 1.112480932526e-04 25 KSP Residual norm 4.739142073705e-05 26 KSP Residual norm 1.992364813687e-05 27 KSP Residual norm 8.244594094444e-06 28 KSP Residual norm 3.523450465277e-06 29 KSP Residual norm 1.438062812346e-06 Linear solve converged due to CONVERGED_RTOL iterations 29 1 SNES Function norm 3.024550060027e-10 Nonlinear solve converged due to CONVERGED_ITS iterations 1 [0] 1) N= 18556605, max displ=5.9974959e+01, disp diff= 5.01e-03, error=2.493e-04, rate=4.4 [0] 2) N= 149720445, max displ=5.9975171e+01, disp diff= 2.12e-04, error=3.740e-05, rate=2.7 [0] 3) N= 1202854653, max displ=5.9975570e+01, disp diff= 4.00e-04, error=-3.623e-04, rate=nan ************************************************************************************************************************ *** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document *** ************************************************************************************************************************ ---------------------------------------------- PETSc Performance Summary: ---------------------------------------------- ./ex56 on a arch-summit-opt64-pgi-cuda named e05n06 with 12288 processors, by adams Mon Jul 29 13:11:21 2019 Using Petsc Development GIT revision: v3.11.3-1493-g3c7a471 GIT Date: 2019-07-27 19:32:11 -0400 Max Max/Min Avg Total Time (sec): 3.721e+02 1.000 3.721e+02 Objects: 4.422e+04 6.158 7.252e+03 Flop: 2.163e+10 1.526 1.807e+10 2.220e+14 Flop/sec: 5.814e+07 1.526 4.856e+07 5.967e+11 MPI Messages: 3.172e+05 23.803 4.584e+04 5.632e+08 MPI Message Lengths: 1.162e+09 3.198 1.921e+04 1.082e+13 MPI Reductions: 5.102e+03 1.008 Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract) e.g., VecAXPY() for real vectors of length N --> 2N flop and VecAXPY() for complex vectors of length N --> 8N flop Summary of Stages: ----- Time ------ ----- Flop ------ --- Messages --- -- Message Lengths -- -- Reductions -- Avg %Total Avg %Total Count %Total Avg %Total Count %Total 0: Main Stage: 7.6029e-01 0.2% 0.0000e+00 0.0% 0.000e+00 0.0% 0.000e+00 0.0% 6.000e+00 0.1% 1: Mesh Setup: 2.1390e+01 5.7% 1.4602e+12 0.7% 1.894e+07 3.4% 1.498e+05 26.2% 3.510e+02 6.9% 2: Setup: 1.4432e+02 38.8% 8.8722e+13 40.0% 2.937e+08 52.2% 2.063e+04 56.0% 3.758e+03 73.7% 3: Solve 1: 1.0707e+00 0.3% 1.8040e+11 0.1% 3.465e+07 6.2% 6.564e+02 0.2% 1.880e+02 3.7% 4: Solve 2: 3.9396e+00 1.1% 1.7826e+12 0.8% 4.823e+07 8.6% 1.945e+03 0.9% 2.430e+02 4.8% 5: Solve 3: 2.3619e+01 6.3% 1.3666e+13 6.2% 6.650e+07 11.8% 5.280e+03 3.2% 2.370e+02 4.6% 6: Solve 4: 1.7700e+02 47.6% 1.1620e+14 52.3% 1.012e+08 18.0% 1.436e+04 13.4% 2.770e+02 5.4% ------------------------------------------------------------------------------------------------------------------------ See the 'Profiling' chapter of the users' manual for details on interpreting output. Phase summary info: Count: number of times phase was executed Time and Flop: Max - maximum over all processors Ratio - ratio of maximum to minimum over all processors Mess: number of messages sent AvgLen: average message length (bytes) Reduct: number of global reductions Global: entire computation Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop(). %T - percent time in this phase %F - percent flop in this phase %M - percent messages in this phase %L - percent message lengths in this phase %R - percent reductions in this phase Total Mflop/s: 10e-6 * (sum of flop over all processors)/(max time over all processors) GPU Mflop/s: 10e-6 * (sum of flop on GPU over all processors)/(max GPU time over all processors) CpuToGpu Count: total number of CPU to GPU copies per processor CpuToGpu Size (Mbytes): 10e-6 * (total size of CPU to GPU copies per processor) GpuToCpu Count: total number of GPU to CPU copies per processor GpuToCpu Size (Mbytes): 10e-6 * (total size of GPU to CPU copies per processor) GPU %F: percent flops on GPU in this event ------------------------------------------------------------------------------------------------------------------------ Event Count Time (sec) Flop --- Global --- --- Stage ---- Total GPU - CpuToGpu - - GpuToCpu - GPU Max Ratio Max Ratio Max Ratio Mess AvgLen Reduct %T %F %M %L %R %T %F %M %L %R Mflop/s Mflop/s Count Size Count Size %F --------------------------------------------------------------------------------------------------------------------------------------------------------------- --- Event Stage 0: Main Stage VecNorm 4 1.0 3.3228e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 44 0 0 0 67 0 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 1: Mesh Setup PetscBarrier 6 1.0 3.5934e-02 1.1 0.00e+00 0.0 2.4e+06 2.1e+01 2.4e+01 0 0 0 0 0 0 0 13 0 7 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSided 57 1.0 1.3304e+00 2.5 0.00e+00 0.0 2.0e+06 8.0e+00 0.0e+00 0 0 0 0 0 4 0 11 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 4 1.0 1.1551e+00 9.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 4 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMCreateMat 4 1.0 1.1293e+01 1.0 0.00e+00 0.0 8.6e+06 3.3e+05 5.2e+01 3 0 2 26 1 52 0 46100 15 0 0 8 2.58e+02 0 0.00e+00 0 Mesh Partition 1 1.0 1.4064e+00 1.7 0.00e+00 0.0 7.4e+04 1.2e+03 8.0e+00 0 0 0 0 0 5 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 Mesh Migration 1 1.0 8.2773e-01 1.0 0.00e+00 0.0 3.4e+05 1.0e+03 2.4e+01 0 0 0 0 0 4 0 2 0 7 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartSelf 1 1.0 4.3309e-014178.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblInv 1 1.0 4.7639e-0111.3 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00 0 0 0 0 0 2 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartLblSF 1 1.0 1.4963e-01 2.3 0.00e+00 0.0 3.1e+04 9.8e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPartStrtSF 1 1.0 1.8699e-0132.2 0.00e+00 0.0 1.2e+04 1.2e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPointSF 1 1.0 5.6470e-02 1.3 0.00e+00 0.0 2.5e+04 2.4e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 32 1.0 5.2912e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 1 0 0 0 0 11 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistribute 1 1.0 2.2918e+00 1.4 0.00e+00 0.0 4.4e+05 1.1e+03 3.2e+01 1 0 0 0 1 9 0 2 0 9 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistCones 1 1.0 1.8876e-01 1.1 0.00e+00 0.0 8.0e+04 2.1e+03 1.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistLabels 1 1.0 2.5949e-01 1.0 0.00e+00 0.0 1.4e+05 6.5e+02 2.1e+01 0 0 0 0 0 1 0 1 0 6 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexDistField 1 1.0 3.2208e-01 1.0 0.00e+00 0.0 9.2e+04 6.2e+02 1.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 58 1.0 1.3648e+00 4.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.8e+01 0 0 0 0 1 4 0 0 0 17 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 58 1.0 5.9312e-02748.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexPrealloc 4 1.0 6.2160e+00 1.0 0.00e+00 0.0 8.6e+06 3.3e+05 4.4e+01 2 0 2 26 1 29 0 46100 13 0 0 8 2.58e+02 0 0.00e+00 0 SFSetGraph 73 1.0 7.0455e-0328.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 57 1.0 1.5039e+00 1.9 0.00e+00 0.0 1.0e+07 1.4e+05 0.0e+00 0 0 2 13 0 6 0 53 50 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 95 1.0 3.6832e-01739.6 0.00e+00 0.0 5.2e+06 4.7e+04 0.0e+00 0 0 1 2 0 0 0 27 9 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 95 1.0 7.5957e-01 5.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 37 1.0 2.4691e-0245.6 0.00e+00 0.0 2.6e+06 3.6e+05 0.0e+00 0 0 0 9 0 0 0 14 33 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 29 1.0 1.7352e-01 4.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpBegin 8 1.0 5.1884e-03250.0 0.00e+00 0.0 5.8e+05 4.1e+05 0.0e+00 0 0 0 2 0 0 0 3 8 0 0 0 0 0.00e+00 0 0.00e+00 0 SFFetchOpEnd 8 1.0 9.5255e-02 3.7 0.00e+00 0.0 5.8e+05 4.1e+05 0.0e+00 0 0 0 2 0 0 0 3 8 0 0 0 0 0.00e+00 0 0.00e+00 0 SFDistSection 13 1.0 3.8008e-01 1.2 0.00e+00 0.0 2.0e+06 1.8e+03 1.3e+01 0 0 0 0 0 2 0 11 0 4 0 0 0 0.00e+00 0 0.00e+00 0 SFSectionSF 21 1.0 4.8588e-01 1.3 0.00e+00 0.0 1.9e+06 2.4e+05 0.0e+00 0 0 0 4 0 2 0 10 17 0 0 0 0 0.00e+00 0 0.00e+00 0 SFRemoteOff 8 1.0 5.3147e-0213.8 0.00e+00 0.0 1.2e+06 4.0e+03 0.0e+00 0 0 0 0 0 0 0 6 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyBegin 4 1.0 1.1553e+00 9.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 4 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 4 1.0 8.7071e-01 1.0 0.00e+00 0.0 2.6e+06 4.4e+03 1.6e+01 0 0 0 0 0 4 0 14 0 5 0 0 8 2.58e+02 0 0.00e+00 0 MatCUSPARSCopyTo 8 1.0 6.0327e-01 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 0 0 0 0 0 0 8 2.58e+02 0 0.00e+00 0 VecMDot 12 1.0 1.7048e-03 1.2 2.70e+06 1.2 0.0e+00 0.0e+00 1.2e+01 0 0 0 0 0 0 2 0 0 3 19334124 0 0 0.00e+00 0 0.00e+00 0 VecNorm 24 1.0 2.5603e-01 3.5 1.35e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 0 1 1 0 0 7 64371 0 0 0.00e+00 0 0.00e+00 0 VecScale 24 1.0 4.0167e-04 1.6 6.74e+05 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 20515527 0 0 0.00e+00 0 0.00e+00 0 VecSet 72 1.0 7.4599e-04 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecMAXPY 12 1.0 1.9381e-03 2.6 2.70e+06 1.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 2 0 0 0 17006961 0 0 0.00e+00 0 0.00e+00 0 VecNormalize 24 1.0 2.5635e-01 3.5 2.02e+06 1.2 0.0e+00 0.0e+00 2.4e+01 0 0 0 0 0 1 2 0 0 7 96434 0 0 0.00e+00 0 0.00e+00 0 --- Event Stage 2: Setup BuildTwoSided 164 1.0 4.2006e-01 1.6 0.00e+00 0.0 9.5e+06 8.0e+00 0.0e+00 0 0 2 0 0 0 0 3 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 743 1.0 2.9851e+01 2.2 0.00e+00 0.0 3.3e+06 4.6e+05 0.0e+00 5 0 1 14 0 14 0 1 25 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetGraph 164 1.0 4.6174e-04 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 164 1.0 4.5709e-01 1.5 0.00e+00 0.0 4.8e+07 7.6e+02 0.0e+00 0 0 8 0 0 0 0 16 1 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 1260 1.0 2.8252e-02 3.8 0.00e+00 0.0 2.0e+08 1.3e+03 0.0e+00 0 0 36 2 0 0 0 68 4 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 1260 1.0 1.0849e-01 4.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 160 1.0 6.9380e-01 2.2 6.50e+08 1.6 1.5e+07 5.2e+03 0.0e+00 0 3 3 1 0 0 7 5 1 0 9176939 3492402 105 5.59e+01 105 1.91e+01 20 MatConvert 125 1.0 3.8062e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.2e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatScale 48 1.0 2.6887e-02 1.5 1.86e+07 1.3 1.5e+06 1.5e+03 0.0e+00 0 0 0 0 0 0 0 1 0 0 7996920 0 0 0.00e+00 16 1.82e-01 0 MatAssemblyBegin 480 1.0 2.9922e+01 1.9 0.00e+00 0.0 3.3e+06 4.6e+05 0.0e+00 6 0 1 14 0 15 0 1 25 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 480 1.0 7.8487e+00 1.1 6.48e+06 4.1 4.3e+07 6.3e+02 5.4e+02 2 0 8 0 11 5 0 15 0 14 6956 0 424 6.32e+02 0 0.00e+00 0 MatCreateSubMat 26 1.0 1.0841e+01 1.0 0.00e+00 0.0 3.5e+06 8.9e+04 3.1e+02 3 0 1 3 6 8 0 1 5 8 0 0 78 4.82e+01 0 0.00e+00 0 MatPartitioning 13 1.0 3.6874e+01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 3.2e+01 10 0 0 0 1 26 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 MatCoarsen 16 1.0 2.8224e-01 1.9 0.00e+00 0.0 1.4e+08 6.7e+02 4.4e+02 0 0 25 1 9 0 0 48 2 12 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 24 1.0 6.2389e-03 3.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAXPY 16 1.0 5.6572e-01 1.9 7.22e+05 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 15183 0 32 7.72e+01 0 0.00e+00 0 MatTranspose 32 1.0 7.4496e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMatMult 16 1.0 6.4561e+00 1.0 3.91e+08 1.6 1.6e+07 1.9e+04 1.3e+02 2 2 3 3 3 4 4 5 5 4 593044 0 64 1.54e+02 0 0.00e+00 0 MatMatMultSym 16 1.0 4.0575e+00 1.0 0.00e+00 0.0 1.3e+07 1.6e+04 1.3e+02 1 0 2 2 3 3 0 4 3 3 0 0 32 7.72e+01 0 0.00e+00 0 MatMatMultNum 16 1.0 2.3312e+00 1.1 3.91e+08 1.6 3.0e+06 3.1e+04 0.0e+00 1 2 1 1 0 2 4 1 2 0 1642421 0 32 7.72e+01 0 0.00e+00 0 MatPtAP 16 1.0 7.4118e+01 1.0 8.23e+09 1.9 3.4e+07 1.4e+05 1.8e+02 20 35 6 44 3 51 87 12 78 5 1042840 0 64 1.65e+02 0 0.00e+00 0 MatPtAPSymbolic 16 1.0 3.5697e+01 1.0 0.00e+00 0.0 1.8e+07 1.8e+05 1.1e+02 10 0 3 30 2 25 0 6 53 3 0 0 0 0.00e+00 0 0.00e+00 0 MatPtAPNumeric 16 1.0 3.8422e+01 1.0 8.23e+09 1.9 1.6e+07 9.7e+04 6.4e+01 10 35 3 14 1 27 87 5 25 2 2011693 0 64 1.65e+02 0 0.00e+00 0 MatTrnMatMult 16 1.0 2.9414e+00 1.0 4.62e+07 1.3 1.3e+07 3.2e+04 1.8e+02 1 0 2 4 4 2 1 4 7 5 187821 0 64 1.35e+02 0 0.00e+00 0 MatTrnMatMultSym 16 1.0 1.8998e+00 1.0 0.00e+00 0.0 1.0e+07 2.0e+04 1.5e+02 1 0 2 2 3 1 0 4 3 4 0 0 16 6.74e+01 0 0.00e+00 0 MatTrnMatMultNum 16 1.0 1.0537e+00 1.2 4.62e+07 1.3 2.2e+06 9.0e+04 3.2e+01 0 0 0 2 1 1 1 1 3 1 524301 0 48 6.74e+01 0 0.00e+00 0 MatGetLocalMat 72 1.0 5.9936e-02 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetBrAoCol 48 1.0 5.5014e-01 3.8 0.00e+00 0.0 2.1e+07 1.2e+05 0.0e+00 0 0 4 23 0 0 0 7 42 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 429 1.0 3.1718e+00 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 1 0 0 0 0 2 0 0 0 0 0 0 429 6.72e+02 0 0.00e+00 0 VecTDot 336 1.0 6.8175e-01 2.4 5.05e+06 1.1 0.0e+00 0.0e+00 3.4e+02 0 0 0 0 7 0 0 0 0 9 88192 6897511 0 0.00e+00 0 0.00e+00 99 VecCopy 32 1.0 6.8541e-04 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 5 9.26e-01 0 VecSet 1056 1.0 1.9121e-02 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 320 1.0 3.7493e-03 1.5 4.81e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 15273186 22783783 0 0.00e+00 0 0.00e+00 99 VecAYPX 144 1.0 3.2719e-03 1.6 2.17e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 7875644 9516716 0 0.00e+00 0 0.00e+00 99 VecAssemblyBegin 597 1.0 6.0630e-01 1.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAssemblyEnd 597 1.0 1.7077e-03 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 401 0.00e+00 0 VecPointwiseMult 176 1.0 2.4138e-03 1.3 1.32e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 6523857 8228826 10 1.85e+00 0 0.00e+00 99 VecScatterBegin 789 1.0 1.9784e-02 3.4 0.00e+00 0.0 6.3e+07 2.9e+03 0.0e+00 0 0 11 2 0 0 0 21 3 0 0 0 0 0.00e+00 101 2.24e+00 0 VecScatterEnd 789 1.0 9.8427e-02 6.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecSetRandom 16 1.0 8.0112e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 5 9.26e-01 0 VecCUDACopyTo 110 1.0 5.8171e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 110 1.70e+01 0 0.00e+00 0 VecCUDACopyFrom 793 1.0 2.2544e-02 2.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 793 2.92e+01 0 KSPSetUp 40 1.0 8.8571e-01 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+01 0 0 0 0 1 0 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 PCGAMGGraph_AGG 16 1.0 6.8601e+00 1.0 3.50e+07 1.5 7.9e+06 1.3e+03 2.6e+02 2 0 1 0 5 5 0 3 0 7 50985 0 64 4.20e+01 16 1.82e-01 0 PCGAMGCoarse_AGG 16 1.0 3.3400e+00 1.0 4.62e+07 1.3 1.6e+08 3.2e+03 6.9e+02 1 0 29 5 13 2 1 55 9 18 165408 0 64 1.35e+02 112 2.07e+00 0 PCGAMGProl_AGG 16 1.0 1.4072e+00 1.1 0.00e+00 0.0 4.1e+07 2.8e+03 1.2e+03 0 0 7 1 23 1 0 14 2 31 0 0 32 9.79e+00 520 5.90e+00 0 PCGAMGPOpt_AGG 16 1.0 8.5214e+00 1.0 1.07e+09 1.6 3.1e+07 1.2e+04 6.0e+02 2 5 5 3 12 6 12 10 6 16 1234165 3779798 211 2.89e+02 115 2.10e+01 13 GAMG: createProl 16 1.0 2.0054e+01 1.0 1.14e+09 1.5 2.4e+08 4.2e+03 2.7e+03 5 5 43 9 53 14 13 82 17 72 569402 3757738 371 4.76e+02 763 2.91e+01 12 Graph 32 1.0 6.7886e+00 1.0 3.50e+07 1.5 7.9e+06 1.3e+03 2.6e+02 2 0 1 0 5 5 0 3 0 7 51523 0 64 4.20e+01 16 1.82e-01 0 MIS/Agg 16 1.0 2.8247e-01 1.9 0.00e+00 0.0 1.4e+08 6.7e+02 4.4e+02 0 0 25 1 9 0 0 48 2 12 0 0 0 0.00e+00 0 0.00e+00 0 SA: col data 16 1.0 8.9423e-01 1.0 0.00e+00 0.0 3.8e+07 2.2e+03 1.0e+03 0 0 7 1 20 1 0 13 1 28 0 0 0 0.00e+00 520 5.90e+00 0 SA: frmProl0 16 1.0 3.8637e-01 1.0 0.00e+00 0.0 2.5e+06 1.2e+04 6.4e+01 0 0 0 0 1 0 0 1 0 2 0 0 32 9.79e+00 0 0.00e+00 0 SA: smooth 16 1.0 7.3454e+00 1.0 4.04e+08 1.6 1.6e+07 1.9e+04 1.7e+02 2 2 3 3 3 5 4 5 5 4 543322 0 96 2.32e+02 0 0.00e+00 0 GAMG: partLevel 16 1.0 1.2365e+02 1.0 8.23e+09 1.9 5.2e+07 9.8e+04 9.5e+02 33 35 9 47 19 86 87 18 83 25 625197 0 168 2.13e+02 26 7.19e-02 0 repartition 13 1.0 3.7381e+01 1.0 1.06e+06 2.8 1.3e+07 4.3e+01 2.8e+02 10 0 2 0 5 26 0 4 0 7 253 0 26 2.68e-01 0 0.00e+00 0 Invert-Sort 13 1.0 8.9648e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 5.2e+01 0 0 0 0 1 1 0 0 0 1 0 0 0 0.00e+00 0 0.00e+00 0 Move A 13 1.0 8.8821e+00 1.0 0.00e+00 0.0 2.5e+06 1.3e+05 1.7e+02 2 0 0 3 3 6 0 1 5 4 0 0 39 1.91e+01 0 0.00e+00 0 Move P 13 1.0 2.3794e+00 1.1 0.00e+00 0.0 1.1e+06 8.2e+02 1.7e+02 1 0 0 0 3 2 0 0 0 4 0 0 39 2.92e+01 0 0.00e+00 0 PCSetUp 4 1.0 1.4410e+02 1.0 9.36e+09 1.9 2.9e+08 2.1e+04 3.8e+03 39 40 52 56 74 100100100100100 615699 3751911 539 6.89e+02 793 2.92e+01 2 --- Event Stage 3: Solve 1 BuildTwoSided 1 1.0 1.6435e-03 3.0 0.00e+00 0.0 3.6e+04 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 3.9822e-0270.4 0.00e+00 0.0 1.1e+05 6.9e+04 0.0e+00 0 0 0 0 0 3 0 0 33 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 6.0450e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 7.5273e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 4 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.9871e-05 2.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 3.1342e-01102.4 1.60e+06 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 2 11 0 0 0 62914 0 0 0.00e+00 2 7.34e-03 0 DMPlexJacobianFE 1 1.0 3.3871e-01 1.0 1.63e+06 1.0 1.1e+05 6.9e+04 0.0e+00 0 0 0 0 0 31 11 0 33 0 59145 0 2 4.14e-01 0 0.00e+00 0 SFSetGraph 1 1.0 1.0215e-0520.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.7353e-03 1.7 0.00e+00 0.0 1.8e+05 2.7e+02 0.0e+00 0 0 0 0 0 0 0 1 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 400 1.0 1.6814e-0222.0 0.00e+00 0.0 3.3e+07 4.4e+02 0.0e+00 0 0 6 0 0 0 0 96 64 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 400 1.0 2.9738e-0114.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 26 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 71 1.0 1.8969e-0331.9 0.00e+00 0.0 1.1e+06 5.1e+02 0.0e+00 0 0 0 0 0 0 0 3 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 71 1.0 3.0929e-011427.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 328 1.0 2.8957e-0117.9 4.05e+08267.3 3.2e+07 4.4e+02 0.0e+00 0 0 6 0 0 2 70 93 62 0 433139 12176298 248 1.29e+00 203 3.01e-01 63 MatMultAdd 69 1.0 2.9041e-0117.3 7.72e+06116.6 9.5e+05 5.3e+02 0.0e+00 0 0 0 0 0 25 3 3 2 0 20951 0 0 0.00e+00 0 0.00e+00 0 MatMultTranspose 69 1.0 4.2869e-0239.0 7.72e+06116.6 9.5e+05 5.3e+02 0.0e+00 0 0 0 0 0 1 3 3 2 0 141932 0 0 0.00e+00 23 3.41e-02 0 MatSolve 23 0.0 4.4303e-04 0.0 7.27e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1642 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.5425e-0426.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 6.2983e-04923.5 1.33e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2105 0 0 0.00e+00 0 0.00e+00 0 MatResidual 69 1.0 6.3033e-0217.7 9.14e+07320.3 6.0e+06 4.4e+02 0.0e+00 0 0 1 0 0 0 13 17 12 0 384563 8731718 46 2.39e-01 24 3.56e-02 61 MatAssemblyBegin 1 1.0 4.0515e-02 8.6 0.00e+00 0.0 1.1e+05 6.9e+04 0.0e+00 0 0 0 0 0 4 0 0 33 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 5.0159e-03 4.8 2.73e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 61049 0 2 4.14e-01 0 0.00e+00 0 MatGetRowIJ 1 0.0 1.2423e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 7.2831e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 4.6352e-0530.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 1.3057e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 2 4.14e-01 0 0.00e+00 0 VecTDot 107 1.0 4.2260e-02 2.7 9.16e+04 7.9 0.0e+00 0.0e+00 1.1e+02 0 0 0 0 2 4 0 0 0 57 7111 52234 0 0.00e+00 0 0.00e+00 98 VecNorm 58 1.0 3.5140e-0132.1 4.82e+04 7.5 0.0e+00 0.0e+00 5.8e+01 0 0 0 0 1 28 0 0 0 31 473 49330 0 0.00e+00 0 0.00e+00 98 VecCopy 215 1.0 1.9007e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.48e-03 0 VecSet 309 1.0 1.0592e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 107 1.0 2.4866e-03 1.5 8.78e+04 7.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 124751 172365 2 2.97e-03 0 0.00e+00 99 VecAYPX 462 1.0 8.5426e-03 1.5 4.27e+0514.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 92435 120338 23 3.41e-02 0 0.00e+00 97 VecAXPBYCZ 138 1.0 3.5031e-03 1.4 4.90e+0511.8 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 307052 603217 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 309 1.0 3.6815e-03 1.4 2.14e+0523.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 67047 66303 3 4.45e-03 0 0.00e+00 95 VecScatterBegin 466 1.0 1.8866e-0218.4 0.00e+00 0.0 3.4e+07 4.4e+02 0.0e+00 0 0 6 0 0 0 0 98 66 0 0 0 0 0.00e+00 0 0.00e+00 0 VecScatterEnd 466 1.0 2.9917e-01 6.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 27 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 276 1.0 6.7698e-03 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 276 1.33e+00 0 0.00e+00 0 VecCUDACopyFrom 236 1.0 7.2818e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 236 3.61e-01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 8.3779e+00 1.0 9.10e+08155.1 1.5e+08 7.9e+02 1.0e+03 2 0 27 1 20 782185443533555 39791 232543 385 4.29e+00 384 4.49e-01 26 SNESSetUp 1 1.0 1.4952e-04 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 3.2020e-0132.9 1.67e+06 1.0 4.7e+05 3.1e+02 1.7e+01 0 0 0 0 0 3 11 1 1 9 61927 0 0 0.00e+00 8 2.06e-02 0 SNESJacobianEval 1 1.0 3.3892e-01 1.0 1.65e+06 1.0 1.8e+05 4.2e+04 0.0e+00 0 0 0 0 0 32 11 1 33 0 59257 0 2 4.14e-01 1 3.67e-03 0 KSPSetUp 4 1.0 4.4775e-04 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 4.1459e-01 1.1 4.22e+08238.6 3.4e+07 4.4e+02 1.7e+02 0 0 6 0 3 38 78 98 66 90 338797 3210842 274 1.33e+00 227 3.37e-01 58 PCSetUp 1 1.0 9.8751e-0420.6 1.33e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1342 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 23 1.0 1.0054e-0316.3 1.33e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1319 0 0 0.00e+00 0 0.00e+00 0 PCApply 23 1.0 3.9514e-01 1.1 4.22e+08285.8 2.8e+07 4.5e+02 1.0e+02 0 0 5 0 2 36 67 82 56 54 307382 3870788 230 1.10e+00 183 2.72e-01 55 --- Event Stage 4: Solve 2 BuildTwoSided 1 1.0 1.6614e-03 2.7 0.00e+00 0.0 3.6e+04 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 3.3900e-01390.2 0.00e+00 0.0 1.1e+05 2.9e+05 0.0e+00 0 0 0 0 0 8 0 0 34 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 6.0515e-04 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 6.8618e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.7673e-05 2.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 3.0399e-02 1.4 1.28e+07 1.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 9 0 0 0 5189231 0 0 0.00e+00 2 3.96e-02 0 DMPlexJacobianFE 1 1.0 2.7750e+00 1.0 1.31e+07 1.0 1.1e+05 2.9e+05 0.0e+00 1 0 0 0 0 69 9 0 34 0 57825 0 2 3.44e+00 0 0.00e+00 0 SFSetGraph 1 1.0 1.2733e-05 5.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 1.8504e-03 1.6 0.00e+00 0.0 1.8e+05 9.7e+02 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 672 1.0 2.4258e-0218.8 0.00e+00 0.0 4.5e+07 1.3e+03 0.0e+00 0 0 8 1 0 0 0 94 64 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 672 1.0 9.4466e-0116.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 15 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 122 1.0 1.6786e-0313.1 0.00e+00 0.0 2.5e+06 8.3e+02 0.0e+00 0 0 0 0 0 0 0 5 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 122 1.0 4.6354e-02346.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 549 1.0 5.6954e-0113.4 7.63e+0817.6 4.3e+07 1.3e+03 0.0e+00 0 1 8 1 0 3 74 89 61 0 2301544 56453112 318 6.23e+00 289 3.13e+00 38 MatMultAdd 120 1.0 5.6757e-0113.6 1.72e+07 6.8 2.3e+06 8.1e+02 0.0e+00 0 0 0 0 0 13 3 5 2 0 108423 0 60 1.35e-05 0 0.00e+00 0 MatMultTranspose 120 1.0 4.0681e-01106.9 1.72e+07 6.8 2.3e+06 8.1e+02 0.0e+00 0 0 0 0 0 2 3 5 2 0 151269 708 34 9.00e-05 90 3.62e-01 0 MatSolve 30 0.0 1.0751e-04 0.0 1.89e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 176 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.8165e-05 4.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 2.0505e-0535.5 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 182 0 0 0.00e+00 0 0.00e+00 0 MatResidual 120 1.0 1.2432e-0114.3 1.74e+0821.1 8.2e+06 1.4e+03 0.0e+00 0 0 1 0 0 0 14 17 12 0 2067842 37258946 60 1.17e+00 31 3.75e-01 37 MatAssemblyBegin 1 1.0 3.4059e-0113.8 0.00e+00 0.0 1.1e+05 2.9e+05 0.0e+00 0 0 0 0 0 8 0 0 34 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 8.5021e-0253.3 1.13e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 15437 0 2 3.44e+00 0 0.00e+00 0 MatGetRowIJ 1 0.0 3.1210e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 4.4092e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 3.7864e-04 9.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 4 1.0 7.5113e-0254.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 4 3.44e+00 0 0.00e+00 0 VecTDot 142 1.0 6.3888e-02 2.9 2.86e+05 1.6 0.0e+00 0.0e+00 1.4e+02 0 0 0 0 3 2 0 0 0 58 46428 465536 0 0.00e+00 0 0.00e+00 99 VecNorm 76 1.0 4.3771e-0116.1 1.55e+05 1.6 0.0e+00 0.0e+00 7.6e+01 0 0 0 0 1 8 0 0 0 31 3687 365956 0 0.00e+00 0 0.00e+00 99 VecCopy 370 1.0 2.4791e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 1.21e-02 0 VecSet 428 1.0 2.6785e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 141 1.0 2.8991e-03 1.5 2.90e+05 1.6 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1048486 1498240 2 2.42e-02 0 0.00e+00 99 VecAYPX 784 1.0 9.8006e-03 1.4 1.07e+06 2.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 843818 1189249 30 3.62e-01 0 0.00e+00 97 VecAXPBYCZ 240 1.0 4.3253e-03 1.3 1.33e+06 2.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 2632325 5415910 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 524 1.0 4.7498e-03 1.4 4.70e+05 3.2 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 534915 573347 3 3.62e-02 0 0.00e+00 96 VecScatterBegin 789 1.0 2.6209e-0213.8 0.00e+00 0.0 4.8e+07 1.3e+03 0.0e+00 0 0 8 1 0 0 0 99 65 0 0 0 0 0.00e+00 90 1.38e-05 0 VecScatterEnd 789 1.0 9.4601e-0110.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 15 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 443 1.0 8.7783e-03 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 443 6.65e+00 0 0.00e+00 0 VecCUDACopyFrom 419 1.1 1.0280e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 419 3.65e+00 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.0042e+01 1.0 1.78e+0916.9 8.9e+07 4.2e+03 1.1e+03 5 1 16 3 22 509166185404461 147349 14042350 576 2.46e+01 610 4.14e+00 19 SNESSetUp 1 1.0 9.0658e-05 2.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 3.8587e-02 1.2 1.32e+07 1.0 4.7e+05 1.1e+03 1.7e+01 0 0 0 0 0 1 9 1 1 7 4099003 0 0 0.00e+00 8 1.28e-01 0 SNESJacobianEval 1 1.0 2.7766e+00 1.0 1.32e+07 1.0 1.8e+05 1.8e+05 0.0e+00 1 0 0 0 0 69 9 0 34 0 57867 0 2 3.44e+00 1 1.98e-02 0 KSPSetUp 5 1.0 1.2158e-02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 1.1696e+00 1.0 8.01e+0815.9 4.8e+07 1.3e+03 2.2e+02 0 1 8 1 4 30 82 99 65 92 1251300 15231838 445 6.62e+00 410 3.50e+00 36 PCSetUp 1 1.0 1.1159e-04 2.9 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 33 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 30 1.0 1.7176e-04 3.4 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 22 0 0 0.00e+00 0 0.00e+00 0 PCApply 30 1.0 1.1306e+00 1.6 7.91e+0818.9 4.0e+07 1.3e+03 1.4e+02 0 1 7 0 3 21 70 83 55 56 1110304 18031840 387 5.49e+00 352 2.80e+00 34 --- Event Stage 5: Solve 3 BuildTwoSided 1 1.0 1.7962e-03 3.1 0.00e+00 0.0 3.6e+04 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 2.9057e+001726.4 0.00e+00 0.0 1.1e+05 1.2e+06 0.0e+00 1 0 0 1 0 12 0 0 37 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 6.2298e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 7.7114e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 3.2577e-05 4.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 2.4628e-01 1.4 1.03e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 1 9 0 0 0 5124065 0 0 0.00e+00 2 2.53e-01 0 DMPlexJacobianFE 1 1.0 2.2044e+01 1.0 1.05e+08 1.0 1.1e+05 1.2e+06 0.0e+00 6 1 0 1 0 93 9 0 37 0 58305 0 2 2.80e+01 0 0.00e+00 0 SFSetGraph 1 1.0 5.3185e-05 2.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 2.2102e-03 1.8 0.00e+00 0.0 1.8e+05 3.7e+03 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 630 1.0 3.1348e-02 9.5 0.00e+00 0.0 6.1e+07 3.5e+03 0.0e+00 0 0 11 2 0 0 0 91 61 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 630 1.0 8.2559e-01 4.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 114 1.0 2.1818e-03 6.5 0.00e+00 0.0 5.5e+06 1.3e+03 0.0e+00 0 0 1 0 0 0 0 8 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 114 1.0 9.2755e-02454.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 515 1.0 1.1204e+00 2.6 1.40e+09 2.8 5.5e+07 3.7e+03 0.0e+00 0 4 10 2 0 2 73 83 58 0 8881035 150578117 298 2.82e+01 243 2.37e+01 20 MatMultAdd 112 1.0 7.7060e-0117.8 4.87e+07 1.8 5.4e+06 1.2e+03 0.0e+00 0 0 1 0 0 3 3 8 2 0 610387 0 0 0.00e+00 0 0.00e+00 0 MatMultTranspose 112 1.0 1.2276e-01 5.7 4.87e+07 1.8 5.4e+06 1.2e+03 0.0e+00 0 0 1 0 0 0 3 8 2 0 3831644 0 0 0.00e+00 28 2.73e+00 0 MatSolve 28 0.0 4.7777e-04 0.0 7.25e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1517 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.0980e-0428.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 4.8612e-04699.5 9.81e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 2019 0 0 0.00e+00 0 0.00e+00 0 MatResidual 112 1.0 2.3203e-01 2.8 3.05e+08 3.2 1.1e+07 3.6e+03 0.0e+00 0 1 2 0 0 0 14 17 11 0 8363713 113017776 56 5.30e+00 29 2.83e+00 20 MatAssemblyBegin 1 1.0 2.9279e+0025.3 0.00e+00 0.0 1.1e+05 1.2e+06 0.0e+00 1 0 0 1 0 12 0 0 37 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 2.7259e-0114.6 4.61e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 19879 0 2 2.80e+01 0 0.00e+00 0 MatGetRowIJ 1 0.0 1.1178e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 5.6079e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.8673e-03 4.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 2 1.0 2.2681e-0115.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 2 2.80e+01 0 0.00e+00 0 VecTDot 138 1.0 8.9983e-02 2.5 1.93e+06 1.3 0.0e+00 0.0e+00 1.4e+02 0 0 0 0 3 0 0 0 0 58 252529 3321715 0 0.00e+00 0 0.00e+00 99 VecNorm 74 1.0 1.2495e-01 5.4 1.05e+06 1.3 0.0e+00 0.0e+00 7.4e+01 0 0 0 0 1 0 0 0 0 31 99368 2629405 0 0.00e+00 0 0.00e+00 99 VecCopy 346 1.0 2.8287e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 1 9.75e-02 0 VecSet 458 1.0 1.7274e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 137 1.0 2.8024e-03 1.5 1.97e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 8318038 12482905 2 1.95e-01 0 0.00e+00 99 VecAYPX 734 1.0 1.0292e-02 1.5 5.49e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 6055281 8700193 28 2.73e+00 0 0.00e+00 98 VecAXPBYCZ 224 1.0 4.1702e-03 1.3 7.46e+06 1.3 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 20530908 43053206 0 0.00e+00 0 0.00e+00 98 VecPointwiseMult 492 1.0 4.7212e-03 1.3 1.76e+06 1.4 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 4065855 4439104 3 2.92e-01 0 0.00e+00 96 VecScatterBegin 739 1.0 3.3737e-02 7.7 0.00e+00 0.0 6.6e+07 3.3e+03 0.0e+00 0 0 12 2 0 0 0 99 62 0 0 0 0 0.00e+00 0 0.00e+00 0 VecScatterEnd 739 1.0 8.2545e-01 3.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 3 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 331 1.0 1.6999e-02 2.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 331 3.14e+01 0 0.00e+00 0 VecCUDACopyFrom 281 1.0 1.5993e-02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 281 2.75e+01 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 5.1460e+01 1.0 3.35e+09 2.9 1.1e+08 1.4e+04 1.1e+03 14 11 19 15 22 218171164450479 453551 54053996 468 1.62e+02 476 3.08e+01 10 SNESSetUp 1 1.0 8.5610e-05 2.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 2.6670e-01 1.4 1.05e+08 1.0 4.7e+05 4.2e+03 1.7e+01 0 1 0 0 0 1 9 1 1 7 4737979 0 0 0.00e+00 8 8.95e-01 0 SNESJacobianEval 1 1.0 2.2045e+01 1.0 1.05e+08 1.0 1.8e+05 7.3e+05 0.0e+00 6 1 0 1 0 93 9 0 37 0 58339 0 2 2.80e+01 1 1.26e-01 0 KSPSetUp 5 1.0 8.1854e-04 3.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 1.3903e+00 1.0 1.51e+09 2.7 6.6e+07 3.3e+03 2.2e+02 0 5 12 2 4 6 81 99 62 92 7994755 57264749 329 3.12e+01 272 2.65e+01 20 PCSetUp 1 1.0 7.8294e-0418.4 9.81e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1253 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 28 1.0 7.9943e-0413.0 9.81e+05 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 1227 0 0 0.00e+00 0 0.00e+00 0 PCApply 28 1.0 1.2858e+00 1.0 1.41e+09 3.0 5.9e+07 3.2e+03 1.4e+02 0 4 10 2 3 5 70 89 53 57 7415448 67769972 275 2.61e+01 218 2.12e+01 19 --- Event Stage 6: Solve 4 BuildTwoSided 1 1.0 5.0475e-03 7.9 0.00e+00 0.0 3.6e+04 8.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 BuildTwoSidedF 1 1.0 1.6846e+013715.3 0.00e+00 0.0 1.1e+05 4.9e+06 0.0e+00 4 0 0 5 0 9 0 0 36 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexInterp 4 1.0 6.5575e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 2 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexStratify 7 1.0 7.1074e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 7.0e+00 0 0 0 0 0 0 0 0 0 3 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexSymmetrize 7 1.0 1.5572e-05 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 DMPlexResidualFE 2 1.0 1.9279e+00 1.4 8.22e+08 1.0 0.0e+00 0.0e+00 0.0e+00 0 5 0 0 0 1 9 0 0 0 5236526 0 0 0.00e+00 2 1.79e+00 0 DMPlexJacobianFE 1 1.0 1.6849e+02 1.0 8.38e+08 1.0 1.1e+05 4.9e+06 0.0e+00 45 5 0 5 0 95 9 0 36 0 61069 0 2 2.26e+02 0 0.00e+00 0 SFSetGraph 1 1.0 3.0143e-04 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFSetUp 1 1.0 7.2378e-03 2.7 0.00e+00 0.0 1.8e+05 1.4e+04 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpBegin 832 1.0 8.3305e-02 7.4 0.00e+00 0.0 9.0e+07 1.0e+04 0.0e+00 0 0 16 8 0 0 0 89 62 0 0 0 0 0.00e+00 0 0.00e+00 0 SFBcastOpEnd 832 1.0 1.6314e+00 3.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceBegin 152 1.0 4.3047e-03 4.8 0.00e+00 0.0 1.1e+07 2.1e+03 0.0e+00 0 0 2 0 0 0 0 11 2 0 0 0 0 0.00e+00 0 0.00e+00 0 SFReduceEnd 152 1.0 5.8654e-01336.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatMult 679 1.0 5.2220e+00 1.2 7.58e+09 1.3 8.0e+07 1.1e+04 0.0e+00 1 39 14 8 0 3 74 79 60 0 16438647 438720307 578 1.99e+02 519 2.55e+02 18 MatMultAdd 150 1.0 1.1836e+00 4.7 3.41e+08 1.2 1.0e+07 1.8e+03 0.0e+00 0 2 2 0 0 1 3 10 1 0 3409019 191195194 120 2.48e+01 60 2.25e+00 21 MatMultTranspose 150 1.0 5.7940e-01 2.4 3.37e+08 1.2 1.0e+07 1.8e+03 0.0e+00 0 2 2 0 0 0 3 10 1 0 6867795 2539317196 38 1.02e+02 150 3.22e+00 92 MatSolve 30 0.0 1.0813e-04 0.0 1.89e+04 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 175 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorSym 1 1.0 2.4102e-05 3.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatLUFactorNum 1 1.0 1.9605e-0534.0 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 191 0 0 0.00e+00 0 0.00e+00 0 MatResidual 150 1.0 1.0412e+00 1.3 1.50e+09 1.3 1.7e+07 1.0e+04 0.0e+00 0 8 3 2 0 0 14 16 12 0 16153217 380695492 120 3.84e+01 91 4.80e+01 20 MatAssemblyBegin 1 1.0 1.6966e+0133.9 0.00e+00 0.0 1.1e+05 4.9e+06 0.0e+00 5 0 0 5 0 9 0 0 36 0 0 0 0 0.00e+00 0 0.00e+00 0 MatAssemblyEnd 1 1.0 5.9748e-01 3.6 1.86e+06 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 36853 0 2 2.26e+02 0 0.00e+00 0 MatGetRowIJ 1 0.0 3.8180e-06 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatGetOrdering 1 0.0 4.6338e-05 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatZeroEntries 1 1.0 2.3434e-02 4.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 MatCUSPARSCopyTo 6 1.0 4.3316e-01 4.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 6 2.66e+02 0 0.00e+00 0 VecTDot 163 1.0 1.7555e-01 2.4 1.58e+07 1.1 0.0e+00 0.0e+00 1.6e+02 0 0 0 0 3 0 0 0 0 59 1094768 16656188 0 0.00e+00 0 0.00e+00 100 VecNorm 87 1.0 6.9796e-01 6.6 8.57e+06 1.1 0.0e+00 0.0e+00 8.7e+01 0 0 0 0 2 0 0 0 0 31 149814 15054667 0 0.00e+00 0 0.00e+00 100 VecCopy 462 1.0 6.9684e-03 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 32 1.78e+00 0 VecSet 463 1.0 3.8176e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecAXPY 161 1.0 4.1309e-03 1.4 1.61e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 47664929 80741327 2 1.57e+00 0 0.00e+00 100 VecAYPX 973 1.0 3.3578e-02 2.3 4.46e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 16114497 42405605 60 1.93e+00 0 0.00e+00 100 VecAXPBYCZ 300 1.0 1.2401e-02 1.9 6.19e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 1 0 0 0 60621747 180843181 0 0.00e+00 0 0.00e+00 100 VecPointwiseMult 655 1.0 1.3504e-02 1.6 1.36e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 12162402 13186465 36 3.41e+00 0 0.00e+00 100 VecScatterBegin 979 1.0 9.0892e-02 5.8 0.00e+00 0.0 1.0e+08 9.1e+03 0.0e+00 0 0 18 8 0 0 0 99 63 0 0 0 0 0.00e+00 180 3.54e+00 0 VecScatterEnd 979 1.0 1.8709e+00 3.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 1 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 VecCUDACopyTo 826 1.0 6.7105e-02 2.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 826 2.31e+02 0 0.00e+00 0 VecCUDACopyFrom 770 1.0 8.6886e-02 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 770 2.68e+02 0 VecCopyFromSome 30 1.0 1.4782e-03 1.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 30 1.29e+00 0 Warning -- total time of event greater than time of entire stage -- something is wrong with the timer SNESSolve 1 1.0 2.7007e+02 1.0 1.73e+10 1.4 1.9e+08 3.1e+04 1.4e+03 73 87 34 55 28 153167190406507 718069 251348575 1006 1.13e+03 1059 2.95e+02 12 SNESSetUp 1 1.0 2.7812e-02713.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 SNESFunctionEval 2 1.0 2.0477e+00 1.4 8.30e+08 1.0 4.7e+05 1.6e+04 1.7e+01 0 5 0 0 0 1 9 0 1 6 4933583 0 0 0.00e+00 8 6.71e+00 0 SNESJacobianEval 1 1.0 1.6851e+02 1.0 8.40e+08 1.0 1.8e+05 2.9e+06 0.0e+00 45 5 0 5 0 95 9 0 37 0 61084 0 2 2.26e+02 1 8.95e-01 0 KSPSetUp 6 1.0 4.9602e-0254.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00e+00 0 0.00e+00 0 KSPSolve 1 1.0 6.5593e+00 1.0 8.41e+09 1.3 1.0e+08 9.1e+03 2.6e+02 2 43 18 8 5 4 82 99 63 93 14604691 269594438 832 3.31e+02 791 2.62e+02 23 PCSetUp 1 1.0 1.3246e-04 3.4 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 28 0 0 0.00e+00 0 0.00e+00 0 PCSetUpOnBlocks 30 1.0 1.7374e-04 3.2 3.74e+03 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 21 0 0 0.00e+00 0 0.00e+00 0 PCApply 30 1.0 5.7429e+00 1.0 7.29e+09 1.3 9.3e+07 8.5e+03 1.7e+02 2 37 17 7 3 3 71 92 55 61 14293832 307037092 774 2.98e+02 733 2.16e+02 24 --------------------------------------------------------------------------------------------------------------------------------------------------------------- Memory usage is given in bytes: Object Type Creations Destructions Memory Descendants' Mem. Reports information only for process 0. --- Event Stage 0: Main Stage Object 0 680 446080 0. Container 0 56 34944 0. Distributed Mesh 0 114 578416 0. DM Label 0 48 33408 0. GraphPartitioner 0 36 26240 0. Index Set 0 199 140759144 0. IS L to G Mapping 0 7 528016 0. Section 0 204 159936 0. Star Forest Graph 0 198 193152 0. Discrete System 0 97 97808 0. Matrix 0 169 842222576 0. Matrix Null Space 0 4 2976 0. Vector 0 316 18347976 0. SNES 0 4 6128 0. DMSNES 0 4 2880 0. Krylov Solver 0 44 89152 0. DMKSP interface 0 4 2816 0. Preconditioner 0 28 32544 0. Linear Space 0 8 5952 0. Dual Space 0 32 26624 0. FE Space 0 8 6976 0. Vec Scatter 0 36 30816 0. Field over DM 0 4 3040 0. Viewer 1 1 896 0. --- Event Stage 1: Mesh Setup Object 704 212 139072 0. Container 60 32 19968 0. Distributed Mesh 208 146 740976 0. DM Label 98 66 45936 0. GraphPartitioner 64 44 32064 0. Index Set 37610 37513 49679360 0. IS L to G Mapping 5 1 5701816 0. Section 416 292 228928 0. Star Forest Graph 471 377 364864 0. Discrete System 272 219 220752 0. Matrix 68 52 158080 0. Matrix Null Space 4 0 0 0. Vector 100 36 3658496 0. SNES 4 0 0 0. DMSNES 4 0 0 0. Krylov Solver 4 0 0 0. Preconditioner 4 0 0 0. Linear Space 8 4 2976 0. Dual Space 32 16 13312 0. FE Space 8 4 3488 0. Vec Scatter 4 0 0 0. Field over DM 4 4 3040 0. Viewer 1 0 0 0. --- Event Stage 2: Setup Index Set 433 403 142042392 0. IS L to G Mapping 16 13 227008 0. Star Forest Graph 164 132 135168 0. Matrix 675 526 364656352 0. Matrix Partitioning 13 13 9672 0. Matrix Coarsen 16 16 10944 0. Vector 1193 1045 15225312 0. Krylov Solver 56 16 31232 0. Preconditioner 40 16 14592 0. Vec Scatter 148 116 99296 0. PetscRandom 32 32 22208 0. --- Event Stage 3: Solve 1 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 56640 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 22 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 4: Solve 2 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 69008 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 26 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 5: Solve 3 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 119232 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 26 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. --- Event Stage 6: Solve 4 Object 50 3 1968 0. Container 7 0 0 0. Distributed Mesh 22 9 45648 0. DM Label 7 3 2088 0. GraphPartitioner 7 3 2184 0. Index Set 78 60 316688 0. Section 35 15 11760 0. Star Forest Graph 44 26 24960 0. Discrete System 28 17 17136 0. Matrix 7 6 18240 0. Vector 30 0 0 0. DMKSP interface 1 0 0 0. Linear Space 1 0 0 0. Dual Space 4 0 0 0. FE Space 1 0 0 0. Field over DM 1 0 0 0. ======================================================================================================================== Average time to get PetscTime(): 6.86e-08 Average time for MPI_Barrier(): 3.89642e-05 Average time for zero size MPI_Send(): 7.51763e-06 #PETSc Option Table entries: -bmat_view :bmcpu.m:ascii_matlab -cells 32,48,64 -check_pointer_intensity 0 -ex56_dm_mat_type aijcusparse -ex56_dm_refine 3 -ex56_dm_vec_type cuda -gamg_est_ksp_max_it 10 -gamg_est_ksp_type cg -ksp_atol 1.e-71 -ksp_converged_reason -ksp_max_it 100 -ksp_monitor -ksp_norm_type preconditioned -ksp_rtol 1.e-11 -ksp_type cg -log_view -lvec_view :lvcpu.m:ascii_matlab -mat_block_size 3 -matptap_via scalable -max_conv_its 4 -mg_levels_esteig_ksp_max_it 10 -mg_levels_esteig_ksp_type cg -mg_levels_ksp_chebyshev_esteig 0,0.05,0,1.05 -mg_levels_ksp_max_it 2 -mg_levels_ksp_type chebyshev -mg_levels_pc_type jacobi -pc_gamg_agg_nsmooths 1 -pc_gamg_coarse_eq_limit 150 -pc_gamg_process_eq_limit 1000 -pc_gamg_repartition true -pc_gamg_reuse_interpolation false -pc_gamg_square_graph 10 -pc_gamg_threshold 0.05 -pc_gamg_threshold_scale .5 -pc_gamg_type agg -pc_type gamg -petscpartitioner_type simple -petscspace_degree 2 -run_type 1 -snes_converged_reason -snes_max_it 2 -snes_monitor -snes_rtol 1.e-10 -snes_type ksponly -use_mat_nearnullspace true -xvec_view :xvcpu.m:ascii_matlab #End of PETSc Option Table entries Compiled without FORTRAN kernels Compiled with 64 bit PetscInt Compiled with full precision matrices (default) sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8 sizeof(PetscScalar) 8 sizeof(PetscInt) 8 Configure options: --with-cc=mpicc --with-cxx=mpiCC --with-fc=mpif90 --COPTFLAGS="-g -fast" --CXXOPTFLAGS="-g -fast" --FOPTFLAGS="-g -fast" --with-ssl=0 --with-batch=0 --with-mpiexec="jsrun -g 1" --with-cuda=1 --with-cudac=nvcc CUDAFLAGS="-ccbin pgc++" --download-metis --download-viennacl --download-parmetis --download-fblaslapack --with-x=0 --with-64-bit-indices=1 --with-debugging=0 PETSC_ARCH=arch-summit-opt64-pgi-cuda ----------------------------------------- Libraries compiled on 2019-07-28 12:54:27 on login4 Machine characteristics: Linux-4.14.0-115.8.1.el7a.ppc64le-ppc64le-with-redhat-7.6-Maipo Using PETSc directory: /ccs/home/adams/petsc Using PETSc arch: arch-summit-opt64-pgi-cuda ----------------------------------------- Using C compiler: mpicc -g -fast Using Fortran compiler: mpif90 -g -fast ----------------------------------------- Using include paths: -I/ccs/home/adams/petsc/include -I/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/include -I/sw/summit/cuda/10.1.168/include ----------------------------------------- Using C linker: mpicc Using Fortran linker: mpif90 Using libraries: -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -lpetsc -Wl,-rpath,/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -L/ccs/home/adams/petsc/arch-summit-opt64-pgi-cuda/lib -Wl,-rpath,/sw/summit/cuda/10.1.168/lib64 -L/sw/summit/cuda/10.1.168/lib64 /autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib/pgi.ld -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -L/autofs/nccs-svm1_sw/summit/.swci/1-compute/opt/spack/20180914/linux-rhel7-ppc64le/pgi-19.4/spectrum-mpi-10.3.0.1-20190611-4ymaahbai7ehhw4rves5jjiwon2laz3a/lib -Wl,-rpath,/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -L/autofs/nccs-svm1_sw/summit/.swci/0-core/opt/spack/20180914/linux-rhel7-ppc64le/gcc-4.8.5/pgi-19.4-6acz4xyqjlpoaonjiiqjme2aknrfnzoy/linuxpower/19.4/lib -Wl,-rpath,/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -L/usr/lib/gcc/ppc64le-redhat-linux/4.8.5 -lflapack -lfblas -lparmetis -lmetis -lcufft -lcublas -lcudart -lcusparse -lstdc++ -ldl -lpthread -lmpiprofilesupport -lmpi_ibm_usempi -lmpi_ibm_mpifh -lmpi_ibm -lpgf90rtl -lpgf90 -lpgf90_rpm1 -lpgf902 -lpgftnrtl -latomic -lpgkomp -lomp -lomptarget -lpgmath -lpgc -lrt -lmass_simdp9 -lmassvp9 -lmassp9 -lm -lgcc_s -lstdc++ -ldl -----------------------------------------