[petsc-users] Convergence of AMG

Manav Bhatia bhatiamanav at gmail.com
Mon Oct 29 12:50:35 CDT 2018


Thanks, Jed. 

The description says: “ Square the graph, ie. compute A'*A before aggregating it"

What is A here? 

What is the impact of setting this to 0, which led to a very significant increase in the CPU time in my case? 

-Manav

> On Oct 29, 2018, at 12:21 PM, Jed Brown <jed at jedbrown.org> wrote:
> 
> https://www.mcs.anl.gov/petsc/petsc-current/docs/manualpages/PC/PCGAMGSetSquareGraph.html
> 
> Squaring the graph speeds up coarsening at the expense of convergence
> rate.
> 
> Manav Bhatia <bhatiamanav at gmail.com> writes:
> 
>> Hi, 
>> 
>>  I am trying to understand the meaning of “pc_gamg_square_graph”. I did not find a specific reference to “square” in the tutorial here: http://user.it.uu.se/~maya/Projects/3phase/AMG_parallel_Falgout.pdf <http://user.it.uu.se/~maya/Projects/3phase/AMG_parallel_Falgout.pdf> . 
>> 
>>  What would be a good place to look for some background on this? 
>> 
>> Regards,
>> Manav
>> 
>>> On Oct 29, 2018, at 11:25 AM, Manav Bhatia <bhatiamanav at gmail.com> wrote:
>>> 
>>> Some more results on iterations and CPU time: 
>>> 
>>> 
>>> 1) -pc_mg_levels 2 -pc_gamg_square_graph 0 -mg_levels_ksp_max_it 4 -pc_gamg_threshold 0.04: 9 KSP iterations, 66 secs
>>> 2) -pc_mg_levels 2 -pc_gamg_square_graph 0 -mg_levels_ksp_max_it 4: 9 KSP iterations, 66 secs
>>> 3) -pc_mg_levels 2 -mg_levels_ksp_max_it 4 -pc_gamg_threshold 0.04: 12 KSP iterations, 29 secs
>>> 4) -pc_mg_levels 2 -mg_levels_ksp_max_it 4: 12 KSP iterations, 28 secs
> 
> To reduce costs further, you can try -mg_levels_ksp_type richardson
> and/or reducing the number of iterations, as in -mg_levels_ksp_max_it 2.
> 
>>> So, it appears that “-pc_gamg_square_graph 0” leads to a significant increase in CPU time. 
>>> 
>>> What would be a more reasonable value for “-pc_gamg_square_graph” ? 
> 
> It is 1 by default.  Not squaring the graph leads to a first coarsening
> that is still pretty large (and often sees some stencil growth) so the
> grid complexity can be high.
> 
>>> Regards,
>>> Manav
>>> 
>>> 
>>> 
>>> 1) 
>>> -pc_mg_levels 2 -pc_gamg_square_graph 0 -mg_levels_ksp_max_it 4 -pc_gamg_threshold 0.04
>>> 
>>> Summary of Stages:   ----- Time ------  ----- Flop -----  --- Messages ---  -- Message Lengths --  -- Reductions --
>>>                        Avg     %Total     Avg     %Total   counts   %Total     Avg         %Total   counts   %Total 
>>> 0:      Main Stage: 6.5896e+01 100.0%  1.3377e+11 100.0%  3.138e+03 100.0%  5.425e+04      100.0%  5.120e+02  98.7% 
>>> 
>>> ------------------------------------------------------------------------------------------------------------------------
>>> ------------------------------------------------------------------------------------------------------------------------
>>> Event                Count      Time (sec)     Flop                             --- Global ---  --- Stage ---   Total
>>>                   Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg len Reduct  %T %F %M %L %R  %T %F %M %L %R Mflop/s
>>> ------------------------------------------------------------------------------------------------------------------------
>>> 
>>> --- Event Stage 0: Main Stage
>>> 
>>> BuildTwoSided          1 1.0 1.0610e-04 4.6 0.00e+00 0.0 5.0e+00 4.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> BuildTwoSidedF        69 1.0 3.3554e-01 2.0 0.00e+00 0.0 5.5e+01 1.1e+05 0.0e+00  0  0  2  4  0   0  0  2  4  0     0
>>> VecMDot               34 1.0 6.3575e-02 1.4 4.66e+07 1.0 0.0e+00 0.0e+00 3.4e+01  0  0  0  0  7   0  0  0  0  7  2907
>>> VecNorm               41 1.0 1.3934e-02 1.6 1.12e+07 1.0 0.0e+00 0.0e+00 4.1e+01  0  0  0  0  8   0  0  0  0  8  3199
>>> VecScale              38 1.0 5.5904e-03 1.0 5.20e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  3695
>>> VecCopy               44 1.0 1.1493e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecSet               129 1.0 1.9488e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecAXPY                3 1.0 1.0059e-03 1.2 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  3243
>>> VecAYPX              120 1.0 4.7344e-02 1.2 1.92e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1607
>>> VecAXPBYCZ            80 1.0 3.9797e-02 1.0 5.48e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  5464
>>> VecWAXPY               1 1.0 6.1512e-04 1.3 1.37e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   884
>>> VecMAXPY              37 1.0 5.3887e-02 1.0 5.45e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  4015
>>> VecAssemblyBegin      60 1.0 1.1819e-01 9.8 0.00e+00 0.0 2.5e+01 4.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>>> VecAssemblyEnd        60 1.0 1.5020e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecPointwiseMult      11 1.0 5.6922e-03 1.2 1.51e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1050
>>> VecScatterBegin      226 1.0 1.8359e-02 1.1 0.00e+00 0.0 2.1e+03 2.0e+04 0.0e+00  0  0 66 25  0   0  0 66 25  0     0
>>> VecScatterEnd        226 1.0 4.3040e+01369.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 49  0  0  0  0  49  0  0  0  0     0
>>> VecSetRandom           1 1.0 1.7331e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecReduceArith         3 1.0 4.8590e-04 1.0 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  6713
>>> VecReduceComm          1 1.0 1.5974e-05 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecNormalize          38 1.0 1.9025e-02 1.4 1.56e+07 1.0 0.0e+00 0.0e+00 3.8e+01  0  0  0  0  7   0  0  0  0  7  3257
>>> MatMult              129 1.0 1.9964e+00 1.0 1.88e+09 1.0 1.3e+03 6.9e+03 0.0e+00  3  6 41  5  0   3  6 41  5  0  3742
>>> MatMultAdd            10 1.0 4.2991e+011654.1 5.73e+07 1.0 3.0e+01 2.1e+05 0.0e+00 49  0  1  4  0  49  0  1  4  0     5
>>> MatMultTranspose      10 1.0 6.5614e-02 1.1 5.73e+07 1.0 3.0e+01 2.1e+05 0.0e+00  0  0  1  4  0   0  0  1  4  0  3472
>>> MatSolve              10 0.0 1.0351e+00 0.0 2.19e+09 0.0 0.0e+00 0.0e+00 0.0e+00  0  2  0  0  0   0  2  0  0  0  2112
>>> MatSOR               111 1.0 3.3396e+00 1.0 1.63e+09 1.0 0.0e+00 0.0e+00 0.0e+00  5  5  0  0  0   5  5  0  0  0  1933
>>> MatLUFactorSym         1 1.0 2.3057e+00193417.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  1  0  0  0  0   1  0  0  0  0     0
>>> MatLUFactorNum         1 1.0 3.9508e+018285439.5 1.14e+11 0.0 0.0e+00 0.0e+00 0.0e+00 15 85  0  0  0  15 85  0  0  0  2879
>>> MatScale               3 1.0 1.2049e-02 1.2 6.14e+06 1.0 1.0e+01 1.2e+03 0.0e+00  0  0  0  0  0   0  0  0  0  0  2026
>>> MatResidual           10 1.0 1.6667e-01 1.1 1.47e+08 1.0 1.0e+02 6.9e+03 0.0e+00  0  0  3  0  0   0  0  3  0  0  3507
>>> MatAssemblyBegin      25 1.0 2.2748e-01 3.0 0.00e+00 0.0 3.0e+01 2.0e+05 0.0e+00  0  0  1  3  0   0  0  1  3  0     0
>>> MatAssemblyEnd        25 1.0 2.6301e-01 1.0 0.00e+00 0.0 1.2e+02 3.4e+03 6.4e+01  0  0  4  0 12   0  0  4  0 12     0
>>> MatGetRow         593372 1.0 5.4903e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatGetRowIJ            1 0.0 1.3105e-02 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatCreateSubMat        2 1.0 6.8462e-01 1.0 0.00e+00 0.0 2.1e+01 4.5e+06 3.2e+01  1  0  1 56  6   1  0  1 56  6     0
>>> MatGetOrdering         1 0.0 5.0859e-02 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatCoarsen             1 1.0 1.8659e-03 1.1 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>> MatZeroEntries         9 1.0 1.5140e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatView                5 1.7 1.4541e-03 3.2 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>> MatAXPY                1 1.0 5.6004e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatMatMult             1 1.0 3.1570e-01 1.0 8.75e+07 1.0 6.0e+01 1.8e+04 1.3e+01  0  0  2  1  3   0  0  2  1  3  1101
>>> MatMatMultSym          1 1.0 2.4168e-01 1.0 0.00e+00 0.0 5.0e+01 1.3e+04 1.2e+01  0  0  2  0  2   0  0  2  0  2     0
>>> MatMatMultNum          1 1.0 7.3501e-02 1.0 8.75e+07 1.0 1.0e+01 4.1e+04 0.0e+00  0  0  0  0  0   0  0  0  0  0  4729
>>> MatPtAP                1 1.0 1.3500e+00 1.0 5.79e+08 1.0 9.5e+01 7.0e+04 1.6e+01  2  2  3  4  3   2  2  3  4  3  1706
>>> MatPtAPSymbolic        1 1.0 9.7516e-01 1.0 0.00e+00 0.0 6.0e+01 5.5e+04 7.0e+00  1  0  2  2  1   1  0  2  2  1     0
>>> MatPtAPNumeric         1 1.0 3.7405e-01 1.0 5.79e+08 1.0 3.5e+01 9.7e+04 8.0e+00  1  2  1  2  2   1  2  1  2  2  6157
>>> MatGetLocalMat         3 1.0 5.3542e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatGetBrAoCol          3 1.0 2.5439e-03 1.1 0.00e+00 0.0 7.0e+01 5.0e+04 0.0e+00  0  0  2  2  0   0  0  2  2  0     0
>>> SNESSolve              1 1.0 5.9280e+01 1.0 1.20e+1127.3 3.0e+03 4.9e+04 4.6e+02 90100 97 88 89  90100 97 88 90  2256
>>> SNESFunctionEval       2 1.0 4.4243e+00 1.0 5.48e+05 1.0 9.0e+02 1.5e+04 1.7e+02  7  0 29  8 32   7  0 29  8 33     0
>>> SNESJacobianEval       1 1.0 3.1546e+00 1.0 0.00e+00 0.0 1.1e+02 6.9e+04 1.9e+01  5  0  3  4  4   5  0  3  4  4     0
>>> SNESLineSearch         1 1.0 2.2030e+00 1.0 1.23e+06 1.0 4.5e+02 1.5e+04 8.5e+01  3  0 14  4 16   3  0 14  4 17     2
>>> SFSetGraph             1 1.0 2.1458e-06 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> SFSetUp                1 1.0 1.5092e-04 2.4 0.00e+00 0.0 1.5e+01 3.8e+02 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> SFBcastBegin           4 1.0 4.3154e-05 1.0 0.00e+00 0.0 4.0e+01 5.8e+02 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>>> SFBcastEnd             4 1.0 3.8099e-0432.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> KSPGMRESOrthog        29 1.0 1.0221e-01 1.2 8.49e+07 1.0 0.0e+00 0.0e+00 2.9e+01  0  0  0  0  6   0  0  0  0  6  3298
>>> KSPSetUp               6 1.0 9.9370e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> KSPSolve               1 1.0 5.1697e+01 1.0 1.20e+1127.3 2.0e+03 6.4e+04 2.7e+02 78100 65 76 52  78100 65 76 53  2587
>>> PCGAMGGraph_AGG        1 1.0 4.4754e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  2  0  5   1  0  2  0  5     4
>>> PCGAMGCoarse_AGG       1 1.0 2.5029e-03 1.0 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>> PCGAMGProl_AGG         1 1.0 1.0502e-01 1.0 0.00e+00 0.0 3.9e+02 1.3e+03 8.6e+01  0  0 12  0 17   0  0 12  0 17     0
>>> PCGAMGPOpt_AGG         1 1.0 6.2535e-01 1.0 2.78e+08 1.0 1.6e+02 1.1e+04 4.2e+01  1  1  5  1  8   1  1  5  1  8  1767
>>> GAMG: createProl       1 1.0 1.1819e+00 1.0 2.79e+08 1.0 6.5e+02 3.6e+03 1.5e+02  2  1 21  1 30   2  1 21  1 30   936
>>>  Graph                2 1.0 4.4748e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  2  0  5   1  0  2  0  5     4
>>>  MIS/Agg              1 1.0 1.8790e-03 1.1 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>>  SA: col data         1 1.0 5.0070e-02 1.0 0.00e+00 0.0 3.7e+02 1.2e+03 7.4e+01  0  0 12  0 14   0  0 12  0 14     0
>>>  SA: frmProl0         1 1.0 5.1879e-02 1.0 0.00e+00 0.0 1.8e+01 5.4e+03 8.0e+00  0  0  1  0  2   0  0  1  0  2     0
>>>  SA: smooth           1 1.0 3.9527e-01 1.0 9.33e+07 1.0 6.0e+01 1.8e+04 1.5e+01  1  0  2  1  3   1  0  2  1  3   937
>>> GAMG: partLevel        1 1.0 2.1293e+00 1.0 5.79e+08 1.0 1.2e+02 8.6e+05 6.7e+01  3  2  4 63 13   3  2  4 63 13  1082
>>>  repartition          1 1.0 3.4499e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>>  Invert-Sort          1 1.0 1.0570e-0221.2 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>>  Move A               1 1.0 4.4678e-01 1.0 0.00e+00 0.0 1.5e+01 6.3e+06 1.7e+01  1  0  0 56  3   1  0  0 56  3     0
>>>  Move P               1 1.0 2.8244e-01 1.0 0.00e+00 0.0 6.0e+00 5.2e+04 1.7e+01  0  0  0  0  3   0  0  0  0  3     0
>>> PCSetUp                2 1.0 4.5188e+0113.6 1.15e+11135.8 7.8e+02 1.4e+05 2.3e+02 21 88 25 64 44  21 88 25 64 45  2593
>>> PCSetUpOnBlocks       10 1.0 4.1865e+01570107.9 1.14e+11 0.0 0.0e+00 0.0e+00 0.0e+00 16 85  0  0  0  16 85  0  0  0  2717
>>> PCApply               10 1.0 4.8200e+01 1.0 1.19e+1135.1 1.2e+03 1.7e+04 2.1e+01 73 97 37 12  4  73 97 37 12  4  2690
>>> ------------------------------------------------------------------------------------------------------------------------
>>> 
>>> 
>>> 2) 
>>> -pc_mg_levels 2 -pc_gamg_square_graph 0 -mg_levels_ksp_max_it 4
>>> 
>>> Summary of Stages:   ----- Time ------  ----- Flop -----  --- Messages ---  -- Message Lengths --  -- Reductions --
>>>                        Avg     %Total     Avg     %Total   counts   %Total     Avg         %Total   counts   %Total 
>>> 0:      Main Stage: 6.5760e+01 100.0%  1.3377e+11 100.0%  3.138e+03 100.0%  5.425e+04      100.0%  5.120e+02  98.7% 
>>> 
>>> ------------------------------------------------------------------------------------------------------------------------
>>> ------------------------------------------------------------------------------------------------------------------------
>>> Event                Count      Time (sec)     Flop                             --- Global ---  --- Stage ---   Total
>>>                   Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg len Reduct  %T %F %M %L %R  %T %F %M %L %R Mflop/s
>>> ------------------------------------------------------------------------------------------------------------------------
>>> 
>>> --- Event Stage 0: Main Stage
>>> 
>>> BuildTwoSided          1 1.0 1.9002e-04 8.7 0.00e+00 0.0 5.0e+00 4.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> BuildTwoSidedF        69 1.0 2.6071e-01 4.8 0.00e+00 0.0 5.5e+01 1.1e+05 0.0e+00  0  0  2  4  0   0  0  2  4  0     0
>>> VecMDot               34 1.0 4.7955e-02 1.3 4.66e+07 1.0 0.0e+00 0.0e+00 3.4e+01  0  0  0  0  7   0  0  0  0  7  3854
>>> VecNorm               41 1.0 7.8864e-03 1.4 1.12e+07 1.0 0.0e+00 0.0e+00 4.1e+01  0  0  0  0  8   0  0  0  0  8  5652
>>> VecScale              38 1.0 4.7059e-03 1.0 5.20e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  4390
>>> VecCopy               44 1.0 1.0849e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecSet               129 1.0 1.9698e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecAXPY                3 1.0 1.0378e-03 1.2 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  3143
>>> VecAYPX              120 1.0 4.6406e-02 1.1 1.92e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1640
>>> VecAXPBYCZ            80 1.0 4.0414e-02 1.0 5.48e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  5380
>>> VecWAXPY               1 1.0 7.6008e-04 1.2 1.37e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   715
>>> VecMAXPY              37 1.0 4.8892e-02 1.0 5.45e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  4425
>>> VecAssemblyBegin      60 1.0 5.2444e-02 2.0 0.00e+00 0.0 2.5e+01 4.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>>> VecAssemblyEnd        60 1.0 1.1539e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecPointwiseMult      11 1.0 6.2540e-03 1.2 1.51e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   956
>>> VecScatterBegin      226 1.0 1.7562e-02 1.1 0.00e+00 0.0 2.1e+03 2.0e+04 0.0e+00  0  0 66 25  0   0  0 66 25  0     0
>>> VecScatterEnd        226 1.0 4.3872e+01319.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 50  0  0  0  0  50  0  0  0  0     0
>>> VecSetRandom           1 1.0 1.5719e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecReduceArith         3 1.0 5.7292e-04 1.2 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  5693
>>> VecReduceComm          1 1.0 9.0122e-0515.1 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecNormalize          38 1.0 1.2057e-02 1.2 1.56e+07 1.0 0.0e+00 0.0e+00 3.8e+01  0  0  0  0  7   0  0  0  0  7  5140
>>> MatMult              129 1.0 1.9545e+00 1.0 1.88e+09 1.0 1.3e+03 6.9e+03 0.0e+00  3  6 41  5  0   3  6 41  5  0  3822
>>> MatMultAdd            10 1.0 4.3806e+011689.9 5.73e+07 1.0 3.0e+01 2.1e+05 0.0e+00 50  0  1  4  0  50  0  1  4  0     5
>>> MatMultTranspose      10 1.0 6.7213e-02 1.1 5.73e+07 1.0 3.0e+01 2.1e+05 0.0e+00  0  0  1  4  0   0  0  1  4  0  3390
>>> MatSolve              10 0.0 1.0379e+00 0.0 2.19e+09 0.0 0.0e+00 0.0e+00 0.0e+00  0  2  0  0  0   0  2  0  0  0  2106
>>> MatSOR               111 1.0 3.1935e+00 1.0 1.63e+09 1.0 0.0e+00 0.0e+00 0.0e+00  5  5  0  0  0   5  5  0  0  0  2022
>>> MatLUFactorSym         1 1.0 2.3361e+00288179.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  1  0  0  0  0   1  0  0  0  0     0
>>> MatLUFactorNum         1 1.0 4.0301e+0110564673.9 1.14e+11 0.0 0.0e+00 0.0e+00 0.0e+00 15 85  0  0  0  15 85  0  0  0  2823
>>> MatScale               3 1.0 1.4505e-02 1.0 6.14e+06 1.0 1.0e+01 1.2e+03 0.0e+00  0  0  0  0  0   0  0  0  0  0  1683
>>> MatResidual           10 1.0 1.6052e-01 1.1 1.47e+08 1.0 1.0e+02 6.9e+03 0.0e+00  0  0  3  0  0   0  0  3  0  0  3641
>>> MatAssemblyBegin      25 1.0 2.4469e-01 7.5 0.00e+00 0.0 3.0e+01 2.0e+05 0.0e+00  0  0  1  3  0   0  0  1  3  0     0
>>> MatAssemblyEnd        25 1.0 2.2773e-01 1.0 0.00e+00 0.0 1.2e+02 3.4e+03 6.4e+01  0  0  4  0 12   0  0  4  0 12     0
>>> MatGetRow         593372 1.0 4.2183e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatGetRowIJ            1 0.0 9.4678e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatCreateSubMat        2 1.0 6.3013e-01 1.0 0.00e+00 0.0 2.1e+01 4.5e+06 3.2e+01  1  0  1 56  6   1  0  1 56  6     0
>>> MatGetOrdering         1 0.0 4.1698e-02 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatCoarsen             1 1.0 1.4472e-03 1.1 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>> MatZeroEntries         9 1.0 1.5332e-01 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatView                5 1.7 1.6737e-03 3.4 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>> MatAXPY                1 1.0 3.6167e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatMatMult             1 1.0 2.6676e-01 1.0 8.75e+07 1.0 6.0e+01 1.8e+04 1.3e+01  0  0  2  1  3   0  0  2  1  3  1303
>>> MatMatMultSym          1 1.0 2.0918e-01 1.0 0.00e+00 0.0 5.0e+01 1.3e+04 1.2e+01  0  0  2  0  2   0  0  2  0  2     0
>>> MatMatMultNum          1 1.0 5.7073e-02 1.0 8.75e+07 1.0 1.0e+01 4.1e+04 0.0e+00  0  0  0  0  0   0  0  0  0  0  6090
>>> MatPtAP                1 1.0 1.0664e+00 1.0 5.79e+08 1.0 9.5e+01 7.0e+04 1.6e+01  2  2  3  4  3   2  2  3  4  3  2160
>>> MatPtAPSymbolic        1 1.0 7.2993e-01 1.0 0.00e+00 0.0 6.0e+01 5.5e+04 7.0e+00  1  0  2  2  1   1  0  2  2  1     0
>>> MatPtAPNumeric         1 1.0 3.3595e-01 1.0 5.79e+08 1.0 3.5e+01 9.7e+04 8.0e+00  1  2  1  2  2   1  2  1  2  2  6855
>>> MatGetLocalMat         3 1.0 5.2164e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatGetBrAoCol          3 1.0 2.5141e-03 1.2 0.00e+00 0.0 7.0e+01 5.0e+04 0.0e+00  0  0  2  2  0   0  0  2  2  0     0
>>> SNESSolve              1 1.0 5.8984e+01 1.0 1.20e+1127.3 3.0e+03 4.9e+04 4.6e+02 90100 97 88 89  90100 97 88 90  2267
>>> SNESFunctionEval       2 1.0 4.4220e+00 1.0 5.48e+05 1.0 9.0e+02 1.5e+04 1.7e+02  7  0 29  8 32   7  0 29  8 33     0
>>> SNESJacobianEval       1 1.0 2.7677e+00 1.0 0.00e+00 0.0 1.1e+02 6.9e+04 1.9e+01  4  0  3  4  4   4  0  3  4  4     0
>>> SNESLineSearch         1 1.0 2.3403e+00 1.0 1.23e+06 1.0 4.5e+02 1.5e+04 8.5e+01  4  0 14  4 16   4  0 14  4 17     2
>>> SFSetGraph             1 1.0 1.9073e-06 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> SFSetUp                1 1.0 2.3508e-04 3.9 0.00e+00 0.0 1.5e+01 3.8e+02 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> SFBcastBegin           4 1.0 3.2902e-05 1.1 0.00e+00 0.0 4.0e+01 5.8e+02 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>>> SFBcastEnd             4 1.0 1.2112e-0416.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> KSPGMRESOrthog        29 1.0 8.2165e-02 1.1 8.49e+07 1.0 0.0e+00 0.0e+00 2.9e+01  0  0  0  0  6   0  0  0  0  6  4102
>>> KSPSetUp               6 1.0 8.9242e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> KSPSolve               1 1.0 5.1788e+01 1.0 1.20e+1127.3 2.0e+03 6.4e+04 2.7e+02 79100 65 76 52  79100 65 76 53  2582
>>> PCGAMGGraph_AGG        1 1.0 3.8242e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  2  0  5   1  0  2  0  5     4
>>> PCGAMGCoarse_AGG       1 1.0 2.0711e-03 1.0 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>> PCGAMGProl_AGG         1 1.0 7.1434e-02 1.0 0.00e+00 0.0 3.9e+02 1.3e+03 8.6e+01  0  0 12  0 17   0  0 12  0 17     0
>>> PCGAMGPOpt_AGG         1 1.0 5.3496e-01 1.0 2.78e+08 1.0 1.6e+02 1.1e+04 4.2e+01  1  1  5  1  8   1  1  5  1  8  2065
>>> GAMG: createProl       1 1.0 9.9368e-01 1.0 2.79e+08 1.0 6.5e+02 3.6e+03 1.5e+02  2  1 21  1 30   2  1 21  1 30  1114
>>>  Graph                2 1.0 3.8235e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  2  0  5   1  0  2  0  5     4
>>>  MIS/Agg              1 1.0 1.4579e-03 1.1 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>>  SA: col data         1 1.0 3.0082e-02 1.0 0.00e+00 0.0 3.7e+02 1.2e+03 7.4e+01  0  0 12  0 14   0  0 12  0 14     0
>>>  SA: frmProl0         1 1.0 3.8682e-02 1.0 0.00e+00 0.0 1.8e+01 5.4e+03 8.0e+00  0  0  1  0  2   0  0  1  0  2     0
>>>  SA: smooth           1 1.0 3.2894e-01 1.0 9.33e+07 1.0 6.0e+01 1.8e+04 1.5e+01  0  0  2  1  3   0  0  2  1  3  1126
>>> GAMG: partLevel        1 1.0 1.7867e+00 1.0 5.79e+08 1.0 1.2e+02 8.6e+05 6.7e+01  3  2  4 63 13   3  2  4 63 13  1289
>>>  repartition          1 1.0 2.9397e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>>  Invert-Sort          1 1.0 7.5300e-0316.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>>  Move A               1 1.0 4.5402e-01 1.0 0.00e+00 0.0 1.5e+01 6.3e+06 1.7e+01  1  0  0 56  3   1  0  0 56  3     0
>>>  Move P               1 1.0 2.2056e-01 1.0 0.00e+00 0.0 6.0e+00 5.2e+04 1.7e+01  0  0  0  0  3   0  0  0  0  3     0
>>> PCSetUp                2 1.0 4.5469e+0116.3 1.15e+11135.8 7.8e+02 1.4e+05 2.3e+02 20 88 25 64 44  20 88 25 64 45  2577
>>> PCSetUpOnBlocks       10 1.0 4.2679e+01701992.3 1.14e+11 0.0 0.0e+00 0.0e+00 0.0e+00 16 85  0  0  0  16 85  0  0  0  2665
>>> PCApply               10 1.0 4.8823e+01 1.0 1.19e+1135.1 1.2e+03 1.7e+04 2.1e+01 74 97 37 12  4  74 97 37 12  4  2656
>>> ------------------------------------------------------------------------------------------------------------------------
>>> 
>>> 
>>> 3) 
>>> -pc_mg_levels 2 -mg_levels_ksp_max_it 4 -pc_gamg_threshold 0.04
>>> 
>>> Summary of Stages:   ----- Time ------  ----- Flop -----  --- Messages ---  -- Message Lengths --  -- Reductions --
>>>                        Avg     %Total     Avg     %Total   counts   %Total     Avg         %Total   counts   %Total 
>>> 0:      Main Stage: 2.9122e+01 100.0%  3.4599e+10 100.0%  3.618e+03 100.0%  2.554e+04      100.0%  5.350e+02  98.7% 
>>> 
>>> ------------------------------------------------------------------------------------------------------------------------
>>> ------------------------------------------------------------------------------------------------------------------------
>>> Event                Count      Time (sec)     Flop                             --- Global ---  --- Stage ---   Total
>>>                   Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg len Reduct  %T %F %M %L %R  %T %F %M %L %R Mflop/s
>>> ------------------------------------------------------------------------------------------------------------------------
>>> 
>>> --- Event Stage 0: Main Stage
>>> 
>>> BuildTwoSided          1 1.0 5.1999e-0423.5 0.00e+00 0.0 5.0e+00 4.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> BuildTwoSidedF        74 1.0 1.6531e-01 2.2 0.00e+00 0.0 7.8e+01 5.7e+04 0.0e+00  0  0  2  5  0   0  0  2  5  0     0
>>> VecMDot               37 1.0 7.6608e-02 1.3 5.56e+07 1.0 0.0e+00 0.0e+00 3.7e+01  0  1  0  0  7   0  1  0  0  7  2881
>>> VecNorm               44 1.0 1.9918e-02 2.0 1.21e+07 1.0 0.0e+00 0.0e+00 4.4e+01  0  0  0  0  8   0  0  0  0  8  2402
>>> VecScale              41 1.0 5.9566e-03 1.1 5.61e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  3742
>>> VecCopy               53 1.0 1.3126e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecSet               151 1.0 2.0747e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecAXPY                3 1.0 1.2219e-03 1.6 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  2669
>>> VecAYPX              156 1.0 6.1843e-02 1.2 2.49e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1600
>>> VecAXPBYCZ           104 1.0 5.3596e-02 1.0 7.12e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  1  0  0  0   0  1  0  0  0  5274
>>> VecWAXPY               1 1.0 6.4707e-04 1.3 1.37e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   840
>>> VecMAXPY              40 1.0 6.1941e-02 1.1 6.44e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  1  0  0  0   0  1  0  0  0  4125
>>> VecAssemblyBegin      64 1.0 7.2242e-02 1.3 0.00e+00 0.0 2.5e+01 4.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>>> VecAssemblyEnd        64 1.0 1.4734e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecPointwiseMult      11 1.0 6.0835e-03 1.2 1.51e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   983
>>> VecScatterBegin      270 1.0 1.7434e-02 1.1 0.00e+00 0.0 2.5e+03 1.5e+04 0.0e+00  0  0 69 40  0   0  0 69 40  0     0
>>> VecScatterEnd        270 1.0 5.8946e+0035.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 15  0  0  0  0  15  0  0  0  0     0
>>> VecSetRandom           1 1.0 2.9080e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecReduceArith         3 1.0 6.4564e-04 1.3 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  5052
>>> VecReduceComm          1 1.0 1.6594e-0427.8 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecNormalize          41 1.0 2.5299e-02 1.6 1.68e+07 1.0 0.0e+00 0.0e+00 4.1e+01  0  0  0  0  8   0  0  0  0  8  2643
>>> MatMult              162 1.0 2.5775e+00 1.0 2.36e+09 1.0 1.6e+03 6.9e+03 0.0e+00  9 27 45 12  0   9 27 45 12  0  3640
>>> MatMultAdd            13 1.0 5.7682e+00227.3 5.35e+07 1.0 3.9e+01 8.5e+04 0.0e+00 15  1  1  4  0  15  1  1  4  0    37
>>> MatMultTranspose      13 1.0 6.4702e-02 1.1 5.35e+07 1.0 3.9e+01 8.5e+04 0.0e+00  0  1  1  4  0   0  1  1  4  0  3268
>>> MatSolve              13 0.0 3.4193e-01 0.0 6.33e+08 0.0 0.0e+00 0.0e+00 0.0e+00  0  2  0  0  0   0  2  0  0  0  1850
>>> MatSOR               141 1.0 4.2887e+00 1.0 2.07e+09 1.0 0.0e+00 0.0e+00 0.0e+00 15 24  0  0  0  15 24  0  0  0  1912
>>> MatLUFactorSym         1 1.0 5.2129e-0139753.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatLUFactorNum         1 1.0 4.8021e+00805666.4 1.33e+10 0.0 0.0e+00 0.0e+00 0.0e+00  4 38  0  0  0   4 38  0  0  0  2767
>>> MatScale               3 1.0 1.0527e-02 1.0 4.52e+06 1.0 1.0e+01 1.2e+03 0.0e+00  0  0  0  0  0   0  0  0  0  0  1699
>>> MatResidual           13 1.0 2.1939e-01 1.1 1.91e+08 1.0 1.3e+02 6.9e+03 0.0e+00  1  2  4  1  0   1  2  4  1  0  3463
>>> MatAssemblyBegin      33 1.0 1.1140e-01 5.0 0.00e+00 0.0 5.2e+01 8.2e+04 0.0e+00  0  0  1  5  0   0  0  1  5  0     0
>>> MatAssemblyEnd        33 1.0 1.9615e-01 1.0 0.00e+00 0.0 1.5e+02 1.4e+03 7.2e+01  1  0  4  0 13   1  0  4  0 13     0
>>> MatGetRow         593372 1.0 4.5789e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatGetRowIJ            1 0.0 4.0052e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatCreateSubMat        2 1.0 2.7033e-01 1.0 0.00e+00 0.0 2.1e+01 1.2e+06 3.2e+01  1  0  1 28  6   1  0  1 28  6     0
>>> MatGetOrdering         1 0.0 1.7007e-02 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatCoarsen             1 1.0 2.4688e-03 1.2 0.00e+00 0.0 5.5e+01 1.0e+03 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>> MatZeroEntries        10 1.0 1.4357e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatView                5 1.7 1.7419e-03 3.8 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>> MatAXPY                1 1.0 3.4560e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatMatMult             1 1.0 2.6894e-01 1.0 8.75e+07 1.0 6.0e+01 1.8e+04 1.2e+01  1  1  2  1  2   1  1  2  1  2  1292
>>> MatMatMultSym          1 1.0 2.1331e-01 1.0 0.00e+00 0.0 5.0e+01 1.3e+04 1.2e+01  1  0  1  1  2   1  0  1  1  2     0
>>> MatMatMultNum          1 1.0 5.5709e-02 1.0 8.75e+07 1.0 1.0e+01 4.1e+04 0.0e+00  0  1  0  0  0   0  1  0  0  0  6239
>>> MatPtAP                1 1.0 6.6371e-01 1.0 3.42e+08 1.0 9.5e+01 3.5e+04 1.5e+01  2  4  3  4  3   2  4  3  4  3  2039
>>> MatPtAPSymbolic        1 1.0 4.6951e-01 1.0 0.00e+00 0.0 6.0e+01 3.4e+04 7.0e+00  2  0  2  2  1   2  0  2  2  1     0
>>> MatPtAPNumeric         1 1.0 1.9424e-01 1.0 3.42e+08 1.0 3.5e+01 3.6e+04 8.0e+00  1  4  1  1  1   1  4  1  1  1  6967
>>> MatTrnMatMult          1 1.0 5.6805e-02 1.0 4.18e+06 1.0 6.5e+01 6.6e+03 1.5e+01  0  0  2  0  3   0  0  2  0  3   292
>>> MatTrnMatMultSym       1 1.0 3.4907e-02 1.0 0.00e+00 0.0 3.0e+01 3.1e+03 7.0e+00  0  0  1  0  1   0  0  1  0  1     0
>>> MatTrnMatMultNum       1 1.0 2.2120e-02 1.0 4.18e+06 1.0 3.5e+01 9.7e+03 8.0e+00  0  0  1  0  1   0  0  1  0  1   751
>>> MatGetLocalMat         4 1.0 3.8992e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatGetBrAoCol          3 1.0 2.6469e-03 1.2 0.00e+00 0.0 7.0e+01 4.0e+04 0.0e+00  0  0  2  3  0   0  0  2  3  0     0
>>> SNESSolve              1 1.0 2.2497e+01 1.0 1.91e+10 3.7 3.5e+03 2.1e+04 4.8e+02 77100 97 79 89  77100 97 79 90  1536
>>> SNESFunctionEval       2 1.0 4.5633e+00 1.0 5.48e+05 1.0 9.0e+02 1.5e+04 1.7e+02 16  0 25 14 31  16  0 25 14 31     0
>>> SNESJacobianEval       1 1.0 3.0567e+00 1.0 0.00e+00 0.0 1.1e+02 6.9e+04 1.9e+01 10  0  3  8  4  10  0  3  8  4     0
>>> SNESLineSearch         1 1.0 2.3701e+00 1.0 1.23e+06 1.0 4.5e+02 1.5e+04 8.5e+01  8  0 12  7 16   8  0 12  7 16     2
>>> SFSetGraph             1 1.0 3.0994e-06 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> SFSetUp                1 1.0 5.7101e-04 6.6 0.00e+00 0.0 1.5e+01 7.7e+02 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> SFBcastBegin           4 1.0 5.6982e-05 1.2 0.00e+00 0.0 4.0e+01 1.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>>> SFBcastEnd             4 1.0 1.6999e-04 5.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> KSPGMRESOrthog        32 1.0 1.2112e-01 1.1 1.03e+08 1.0 0.0e+00 0.0e+00 3.2e+01  0  1  0  0  6   0  1  0  0  6  3375
>>> KSPSetUp               6 1.0 9.6612e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> KSPSolve               1 1.0 1.4872e+01 1.0 1.91e+10 3.7 2.5e+03 2.1e+04 2.9e+02 51100 69 56 54  51100 69 56 55  2323
>>> PCGAMGGraph_AGG        1 1.0 4.4312e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  2  0  1  0  4   2  0  1  0  4     4
>>> PCGAMGCoarse_AGG       1 1.0 6.4611e-02 1.0 4.18e+06 1.0 1.7e+02 3.5e+03 2.1e+01  0  0  5  1  4   0  0  5  1  4   257
>>> PCGAMGProl_AGG         1 1.0 9.3410e-02 1.0 0.00e+00 0.0 4.0e+02 2.8e+03 8.6e+01  0  0 11  1 16   0  0 11  1 16     0
>>> PCGAMGPOpt_AGG         1 1.0 5.4947e-01 1.0 2.77e+08 1.0 1.6e+02 1.1e+04 4.1e+01  2  3  4  2  8   2  3  4  2  8  1999
>>> GAMG: createProl       1 1.0 1.1555e+00 1.0 2.81e+08 1.0 7.8e+02 4.5e+03 1.7e+02  4  3 22  4 32   4  3 22  4 32   966
>>>  Graph                2 1.0 4.4305e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  2  0  1  0  4   2  0  1  0  4     4
>>>  MIS/Agg              1 1.0 2.4810e-03 1.2 0.00e+00 0.0 5.5e+01 1.0e+03 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>>  SA: col data         1 1.0 4.5491e-02 1.0 0.00e+00 0.0 3.7e+02 2.3e+03 7.4e+01  0  0 10  1 14   0  0 10  1 14     0
>>>  SA: frmProl0         1 1.0 4.5125e-02 1.0 0.00e+00 0.0 3.5e+01 7.6e+03 8.0e+00  0  0  1  0  1   0  0  1  0  1     0
>>>  SA: smooth           1 1.0 3.2692e-01 1.0 9.16e+07 1.0 6.0e+01 1.8e+04 1.4e+01  1  1  2  1  3   1  1  2  1  3  1113
>>> GAMG: partLevel        1 1.0 9.6929e-01 1.0 3.42e+08 1.0 1.2e+02 2.5e+05 6.6e+01  3  4  3 34 12   3  4  3 34 12  1396
>>>  repartition          1 1.0 1.0109e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>>  Invert-Sort          1 1.0 1.2600e-03 5.7 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>>  Move A               1 1.0 1.2418e-01 1.0 0.00e+00 0.0 1.5e+01 1.7e+06 1.7e+01  0  0  0 28  3   0  0  0 28  3     0
>>>  Move P               1 1.0 1.6575e-01 1.0 0.00e+00 0.0 6.0e+00 2.1e+04 1.7e+01  1  0  0  0  3   1  0  0  0  3     0
>>> PCSetUp                2 1.0 7.4755e+00 3.5 1.39e+1022.7 9.1e+02 3.8e+04 2.5e+02 12 46 25 38 45  12 46 25 38 46  2108
>>> PCSetUpOnBlocks       13 1.0 5.3405e+0062049.0 1.33e+10 0.0 0.0e+00 0.0e+00 0.0e+00  5 38  0  0  0   5 38  0  0  0  2488
>>> PCApply               13 1.0 1.2494e+01 1.0 1.83e+10 4.3 1.5e+03 1.1e+04 2.1e+01 43 90 41 18  4  43 90 41 18  4  2496
>>> ------------------------------------------------------------------------------------------------------------------------
>>> 
>>> 
>>> 
>>> 4) 
>>> -pc_mg_levels 2 -mg_levels_ksp_max_it 4
>>> 
>>> Summary of Stages:   ----- Time ------  ----- Flop -----  --- Messages ---  -- Message Lengths --  -- Reductions --
>>>                        Avg     %Total     Avg     %Total   counts   %Total     Avg         %Total   counts   %Total 
>>> 0:      Main Stage: 2.8086e+01 100.0%  3.4599e+10 100.0%  3.618e+03 100.0%  2.554e+04      100.0%  5.350e+02  98.7% 
>>> 
>>> ------------------------------------------------------------------------------------------------------------------------
>>> ------------------------------------------------------------------------------------------------------------------------
>>> Event                Count      Time (sec)     Flop                             --- Global ---  --- Stage ---   Total
>>>                   Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg len Reduct  %T %F %M %L %R  %T %F %M %L %R Mflop/s
>>> ------------------------------------------------------------------------------------------------------------------------
>>> 
>>> --- Event Stage 0: Main Stage
>>> 
>>> BuildTwoSided          1 1.0 9.6083e-05 5.3 0.00e+00 0.0 5.0e+00 4.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> BuildTwoSidedF        74 1.0 2.0508e-01 2.9 0.00e+00 0.0 7.8e+01 5.7e+04 0.0e+00  1  0  2  5  0   1  0  2  5  0     0
>>> VecMDot               37 1.0 6.2755e-02 1.2 5.56e+07 1.0 0.0e+00 0.0e+00 3.7e+01  0  1  0  0  7   0  1  0  0  7  3517
>>> VecNorm               44 1.0 1.2301e-02 1.5 1.21e+07 1.0 0.0e+00 0.0e+00 4.4e+01  0  0  0  0  8   0  0  0  0  8  3889
>>> VecScale              41 1.0 5.2664e-03 1.0 5.61e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  4232
>>> VecCopy               53 1.0 1.3689e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecSet               151 1.0 1.9269e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecAXPY                3 1.0 1.1799e-03 1.3 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  2764
>>> VecAYPX              156 1.0 6.0851e-02 1.2 2.49e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1626
>>> VecAXPBYCZ           104 1.0 5.3286e-02 1.1 7.12e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  1  0  0  0   0  1  0  0  0  5305
>>> VecWAXPY               1 1.0 7.0786e-04 1.2 1.37e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   768
>>> VecMAXPY              40 1.0 6.2898e-02 1.0 6.44e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  1  0  0  0   0  1  0  0  0  4062
>>> VecAssemblyBegin      64 1.0 1.0848e-01 2.7 0.00e+00 0.0 2.5e+01 4.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>>> VecAssemblyEnd        64 1.0 1.1230e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecPointwiseMult      11 1.0 6.5417e-03 1.1 1.51e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   914
>>> VecScatterBegin      270 1.0 1.6606e-02 1.0 0.00e+00 0.0 2.5e+03 1.5e+04 0.0e+00  0  0 69 40  0   0  0 69 40  0     0
>>> VecScatterEnd        270 1.0 5.5767e+0044.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 15  0  0  0  0  15  0  0  0  0     0
>>> VecSetRandom           1 1.0 1.5750e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecReduceArith         3 1.0 6.3324e-04 1.3 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  5151
>>> VecReduceComm          1 1.0 1.5712e-0431.4 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> VecNormalize          41 1.0 1.7057e-02 1.3 1.68e+07 1.0 0.0e+00 0.0e+00 4.1e+01  0  0  0  0  8   0  0  0  0  8  3920
>>> MatMult              162 1.0 2.5049e+00 1.0 2.36e+09 1.0 1.6e+03 6.9e+03 0.0e+00  9 27 45 12  0   9 27 45 12  0  3745
>>> MatMultAdd            13 1.0 5.5041e+00222.4 5.35e+07 1.0 3.9e+01 8.5e+04 0.0e+00 15  1  1  4  0  15  1  1  4  0    38
>>> MatMultTranspose      13 1.0 6.2563e-02 1.1 5.35e+07 1.0 3.9e+01 8.5e+04 0.0e+00  0  1  1  4  0   0  1  1  4  0  3379
>>> MatSolve              13 0.0 3.4633e-01 0.0 6.33e+08 0.0 0.0e+00 0.0e+00 0.0e+00  0  2  0  0  0   0  2  0  0  0  1827
>>> MatSOR               141 1.0 4.1983e+00 1.0 2.07e+09 1.0 0.0e+00 0.0e+00 0.0e+00 15 24  0  0  0  15 24  0  0  0  1953
>>> MatLUFactorSym         1 1.0 4.5545e-0135375.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatLUFactorNum         1 1.0 4.6021e+00772110.8 1.33e+10 0.0 0.0e+00 0.0e+00 0.0e+00  4 38  0  0  0   4 38  0  0  0  2887
>>> MatScale               3 1.0 1.1058e-02 1.0 4.52e+06 1.0 1.0e+01 1.2e+03 0.0e+00  0  0  0  0  0   0  0  0  0  0  1618
>>> MatResidual           13 1.0 2.1592e-01 1.1 1.91e+08 1.0 1.3e+02 6.9e+03 0.0e+00  1  2  4  1  0   1  2  4  1  0  3519
>>> MatAssemblyBegin      33 1.0 1.1083e-01 3.3 0.00e+00 0.0 5.2e+01 8.2e+04 0.0e+00  0  0  1  5  0   0  0  1  5  0     0
>>> MatAssemblyEnd        33 1.0 1.7722e-01 1.0 0.00e+00 0.0 1.5e+02 1.4e+03 7.2e+01  1  0  4  0 13   1  0  4  0 13     0
>>> MatGetRow         593372 1.0 4.5285e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatGetRowIJ            1 0.0 3.5741e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatCreateSubMat        2 1.0 2.5588e-01 1.0 0.00e+00 0.0 2.1e+01 1.2e+06 3.2e+01  1  0  1 28  6   1  0  1 28  6     0
>>> MatGetOrdering         1 0.0 1.6127e-02 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatCoarsen             1 1.0 1.4122e-03 1.1 0.00e+00 0.0 5.5e+01 1.0e+03 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>> MatZeroEntries        10 1.0 1.5053e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  1  0  0  0  0   1  0  0  0  0     0
>>> MatView                5 1.7 1.6868e-03 3.3 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>> MatAXPY                1 1.0 4.3107e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatMatMult             1 1.0 2.5280e-01 1.0 8.75e+07 1.0 6.0e+01 1.8e+04 1.2e+01  1  1  2  1  2   1  1  2  1  2  1375
>>> MatMatMultSym          1 1.0 1.9445e-01 1.0 0.00e+00 0.0 5.0e+01 1.3e+04 1.2e+01  1  0  1  1  2   1  0  1  1  2     0
>>> MatMatMultNum          1 1.0 5.8333e-02 1.0 8.75e+07 1.0 1.0e+01 4.1e+04 0.0e+00  0  1  0  0  0   0  1  0  0  0  5959
>>> MatPtAP                1 1.0 6.7796e-01 1.0 3.42e+08 1.0 9.5e+01 3.5e+04 1.5e+01  2  4  3  4  3   2  4  3  4  3  1996
>>> MatPtAPSymbolic        1 1.0 4.8317e-01 1.0 0.00e+00 0.0 6.0e+01 3.4e+04 7.0e+00  2  0  2  2  1   2  0  2  2  1     0
>>> MatPtAPNumeric         1 1.0 1.9495e-01 1.0 3.42e+08 1.0 3.5e+01 3.6e+04 8.0e+00  1  4  1  1  1   1  4  1  1  1  6941
>>> MatTrnMatMult          1 1.0 4.1985e-02 1.0 4.18e+06 1.0 6.5e+01 6.6e+03 1.5e+01  0  0  2  0  3   0  0  2  0  3   396
>>> MatTrnMatMultSym       1 1.0 2.3958e-02 1.0 0.00e+00 0.0 3.0e+01 3.1e+03 7.0e+00  0  0  1  0  1   0  0  1  0  1     0
>>> MatTrnMatMultNum       1 1.0 1.8097e-02 1.0 4.18e+06 1.0 3.5e+01 9.7e+03 8.0e+00  0  0  1  0  1   0  0  1  0  1   918
>>> MatGetLocalMat         4 1.0 4.4538e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> MatGetBrAoCol          3 1.0 3.8249e-03 1.6 0.00e+00 0.0 7.0e+01 4.0e+04 0.0e+00  0  0  2  3  0   0  0  2  3  0     0
>>> SNESSolve              1 1.0 2.1417e+01 1.0 1.91e+10 3.7 3.5e+03 2.1e+04 4.8e+02 76100 97 79 89  76100 97 79 90  1614
>>> SNESFunctionEval       2 1.0 4.4048e+00 1.0 5.48e+05 1.0 9.0e+02 1.5e+04 1.7e+02 16  0 25 14 31  16  0 25 14 31     0
>>> SNESJacobianEval       1 1.0 2.6810e+00 1.0 0.00e+00 0.0 1.1e+02 6.9e+04 1.9e+01 10  0  3  8  4  10  0  3  8  4     0
>>> SNESLineSearch         1 1.0 2.2640e+00 1.0 1.23e+06 1.0 4.5e+02 1.5e+04 8.5e+01  8  0 12  7 16   8  0 12  7 16     2
>>> SFSetGraph             1 1.0 2.8610e-06 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> SFSetUp                1 1.0 1.4687e-04 2.3 0.00e+00 0.0 1.5e+01 7.7e+02 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> SFBcastBegin           4 1.0 3.1948e-05 1.1 0.00e+00 0.0 4.0e+01 1.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>>> SFBcastEnd             4 1.0 4.2200e-05 4.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> KSPGMRESOrthog        32 1.0 1.0959e-01 1.1 1.03e+08 1.0 0.0e+00 0.0e+00 3.2e+01  0  1  0  0  6   0  1  0  0  6  3730
>>> KSPSetUp               6 1.0 9.1093e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00  0  0  0  0  0   0  0  0  0  0     0
>>> KSPSolve               1 1.0 1.4326e+01 1.0 1.91e+10 3.7 2.5e+03 2.1e+04 2.9e+02 51100 69 56 54  51100 69 56 55  2412
>>> PCGAMGGraph_AGG        1 1.0 3.8501e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  1  0  4   1  0  1  0  4     4
>>> PCGAMGCoarse_AGG       1 1.0 4.7253e-02 1.0 4.18e+06 1.0 1.7e+02 3.5e+03 2.1e+01  0  0  5  1  4   0  0  5  1  4   352
>>> PCGAMGProl_AGG         1 1.0 6.9987e-02 1.0 0.00e+00 0.0 4.0e+02 2.8e+03 8.6e+01  0  0 11  1 16   0  0 11  1 16     0
>>> PCGAMGPOpt_AGG         1 1.0 5.4272e-01 1.0 2.77e+08 1.0 1.6e+02 1.1e+04 4.1e+01  2  3  4  2  8   2  3  4  2  8  2024
>>> GAMG: createProl       1 1.0 1.0504e+00 1.0 2.81e+08 1.0 7.8e+02 4.5e+03 1.7e+02  4  3 22  4 32   4  3 22  4 32  1063
>>>  Graph                2 1.0 3.8496e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  1  0  4   1  0  1  0  4     4
>>>  MIS/Agg              1 1.0 1.4219e-03 1.1 0.00e+00 0.0 5.5e+01 1.0e+03 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>>  SA: col data         1 1.0 3.1489e-02 1.0 0.00e+00 0.0 3.7e+02 2.3e+03 7.4e+01  0  0 10  1 14   0  0 10  1 14     0
>>>  SA: frmProl0         1 1.0 3.5651e-02 1.0 0.00e+00 0.0 3.5e+01 7.6e+03 8.0e+00  0  0  1  0  1   0  0  1  0  1     0
>>>  SA: smooth           1 1.0 3.2070e-01 1.0 9.16e+07 1.0 6.0e+01 1.8e+04 1.4e+01  1  1  2  1  3   1  1  2  1  3  1135
>>> GAMG: partLevel        1 1.0 9.6892e-01 1.0 3.42e+08 1.0 1.2e+02 2.5e+05 6.6e+01  3  4  3 34 12   3  4  3 34 12  1397
>>>  repartition          1 1.0 1.1492e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>>  Invert-Sort          1 1.0 1.3120e-03 6.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>>  Move A               1 1.0 1.2847e-01 1.0 0.00e+00 0.0 1.5e+01 1.7e+06 1.7e+01  0  0  0 28  3   0  0  0 28  3     0
>>>  Move P               1 1.0 1.4728e-01 1.0 0.00e+00 0.0 6.0e+00 2.1e+04 1.7e+01  1  0  0  0  3   1  0  0  0  3     0
>>> PCSetUp                2 1.0 7.1033e+00 3.5 1.39e+1022.7 9.1e+02 3.8e+04 2.5e+02 12 46 25 38 45  12 46 25 38 46  2218
>>> PCSetUpOnBlocks       13 1.0 5.0738e+0063336.2 1.33e+10 0.0 0.0e+00 0.0e+00 0.0e+00  5 38  0  0  0   5 38  0  0  0  2618
>>> PCApply               13 1.0 1.2059e+01 1.0 1.83e+10 4.3 1.5e+03 1.1e+04 2.1e+01 43 90 41 18  4  43 90 41 18  4  2586
>>> ------------------------------------------------------------------------------------------------------------------------
>>> 
>>> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20181029/6c722205/attachment-0001.html>


More information about the petsc-users mailing list