[petsc-users] Convergence of AMG

Jed Brown jed at jedbrown.org
Mon Oct 29 12:21:17 CDT 2018


https://www.mcs.anl.gov/petsc/petsc-current/docs/manualpages/PC/PCGAMGSetSquareGraph.html

Squaring the graph speeds up coarsening at the expense of convergence
rate.

Manav Bhatia <bhatiamanav at gmail.com> writes:

> Hi, 
>
>   I am trying to understand the meaning of “pc_gamg_square_graph”. I did not find a specific reference to “square” in the tutorial here: http://user.it.uu.se/~maya/Projects/3phase/AMG_parallel_Falgout.pdf <http://user.it.uu.se/~maya/Projects/3phase/AMG_parallel_Falgout.pdf> . 
>
>   What would be a good place to look for some background on this? 
>
> Regards,
> Manav
>
>> On Oct 29, 2018, at 11:25 AM, Manav Bhatia <bhatiamanav at gmail.com> wrote:
>> 
>> Some more results on iterations and CPU time: 
>> 
>> 
>> 1) -pc_mg_levels 2 -pc_gamg_square_graph 0 -mg_levels_ksp_max_it 4 -pc_gamg_threshold 0.04: 9 KSP iterations, 66 secs
>> 2) -pc_mg_levels 2 -pc_gamg_square_graph 0 -mg_levels_ksp_max_it 4: 9 KSP iterations, 66 secs
>> 3) -pc_mg_levels 2 -mg_levels_ksp_max_it 4 -pc_gamg_threshold 0.04: 12 KSP iterations, 29 secs
>> 4) -pc_mg_levels 2 -mg_levels_ksp_max_it 4: 12 KSP iterations, 28 secs

To reduce costs further, you can try -mg_levels_ksp_type richardson
and/or reducing the number of iterations, as in -mg_levels_ksp_max_it 2.

>> So, it appears that “-pc_gamg_square_graph 0” leads to a significant increase in CPU time. 
>> 
>> What would be a more reasonable value for “-pc_gamg_square_graph” ? 

It is 1 by default.  Not squaring the graph leads to a first coarsening
that is still pretty large (and often sees some stencil growth) so the
grid complexity can be high.

>> Regards,
>> Manav
>> 
>> 
>> 
>> 1) 
>> -pc_mg_levels 2 -pc_gamg_square_graph 0 -mg_levels_ksp_max_it 4 -pc_gamg_threshold 0.04
>> 
>> Summary of Stages:   ----- Time ------  ----- Flop -----  --- Messages ---  -- Message Lengths --  -- Reductions --
>>                         Avg     %Total     Avg     %Total   counts   %Total     Avg         %Total   counts   %Total 
>>  0:      Main Stage: 6.5896e+01 100.0%  1.3377e+11 100.0%  3.138e+03 100.0%  5.425e+04      100.0%  5.120e+02  98.7% 
>> 
>> ------------------------------------------------------------------------------------------------------------------------
>> ------------------------------------------------------------------------------------------------------------------------
>> Event                Count      Time (sec)     Flop                             --- Global ---  --- Stage ---   Total
>>                    Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg len Reduct  %T %F %M %L %R  %T %F %M %L %R Mflop/s
>> ------------------------------------------------------------------------------------------------------------------------
>> 
>> --- Event Stage 0: Main Stage
>> 
>> BuildTwoSided          1 1.0 1.0610e-04 4.6 0.00e+00 0.0 5.0e+00 4.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> BuildTwoSidedF        69 1.0 3.3554e-01 2.0 0.00e+00 0.0 5.5e+01 1.1e+05 0.0e+00  0  0  2  4  0   0  0  2  4  0     0
>> VecMDot               34 1.0 6.3575e-02 1.4 4.66e+07 1.0 0.0e+00 0.0e+00 3.4e+01  0  0  0  0  7   0  0  0  0  7  2907
>> VecNorm               41 1.0 1.3934e-02 1.6 1.12e+07 1.0 0.0e+00 0.0e+00 4.1e+01  0  0  0  0  8   0  0  0  0  8  3199
>> VecScale              38 1.0 5.5904e-03 1.0 5.20e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  3695
>> VecCopy               44 1.0 1.1493e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecSet               129 1.0 1.9488e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecAXPY                3 1.0 1.0059e-03 1.2 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  3243
>> VecAYPX              120 1.0 4.7344e-02 1.2 1.92e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1607
>> VecAXPBYCZ            80 1.0 3.9797e-02 1.0 5.48e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  5464
>> VecWAXPY               1 1.0 6.1512e-04 1.3 1.37e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   884
>> VecMAXPY              37 1.0 5.3887e-02 1.0 5.45e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  4015
>> VecAssemblyBegin      60 1.0 1.1819e-01 9.8 0.00e+00 0.0 2.5e+01 4.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>> VecAssemblyEnd        60 1.0 1.5020e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecPointwiseMult      11 1.0 5.6922e-03 1.2 1.51e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1050
>> VecScatterBegin      226 1.0 1.8359e-02 1.1 0.00e+00 0.0 2.1e+03 2.0e+04 0.0e+00  0  0 66 25  0   0  0 66 25  0     0
>> VecScatterEnd        226 1.0 4.3040e+01369.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 49  0  0  0  0  49  0  0  0  0     0
>> VecSetRandom           1 1.0 1.7331e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecReduceArith         3 1.0 4.8590e-04 1.0 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  6713
>> VecReduceComm          1 1.0 1.5974e-05 3.9 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecNormalize          38 1.0 1.9025e-02 1.4 1.56e+07 1.0 0.0e+00 0.0e+00 3.8e+01  0  0  0  0  7   0  0  0  0  7  3257
>> MatMult              129 1.0 1.9964e+00 1.0 1.88e+09 1.0 1.3e+03 6.9e+03 0.0e+00  3  6 41  5  0   3  6 41  5  0  3742
>> MatMultAdd            10 1.0 4.2991e+011654.1 5.73e+07 1.0 3.0e+01 2.1e+05 0.0e+00 49  0  1  4  0  49  0  1  4  0     5
>> MatMultTranspose      10 1.0 6.5614e-02 1.1 5.73e+07 1.0 3.0e+01 2.1e+05 0.0e+00  0  0  1  4  0   0  0  1  4  0  3472
>> MatSolve              10 0.0 1.0351e+00 0.0 2.19e+09 0.0 0.0e+00 0.0e+00 0.0e+00  0  2  0  0  0   0  2  0  0  0  2112
>> MatSOR               111 1.0 3.3396e+00 1.0 1.63e+09 1.0 0.0e+00 0.0e+00 0.0e+00  5  5  0  0  0   5  5  0  0  0  1933
>> MatLUFactorSym         1 1.0 2.3057e+00193417.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  1  0  0  0  0   1  0  0  0  0     0
>> MatLUFactorNum         1 1.0 3.9508e+018285439.5 1.14e+11 0.0 0.0e+00 0.0e+00 0.0e+00 15 85  0  0  0  15 85  0  0  0  2879
>> MatScale               3 1.0 1.2049e-02 1.2 6.14e+06 1.0 1.0e+01 1.2e+03 0.0e+00  0  0  0  0  0   0  0  0  0  0  2026
>> MatResidual           10 1.0 1.6667e-01 1.1 1.47e+08 1.0 1.0e+02 6.9e+03 0.0e+00  0  0  3  0  0   0  0  3  0  0  3507
>> MatAssemblyBegin      25 1.0 2.2748e-01 3.0 0.00e+00 0.0 3.0e+01 2.0e+05 0.0e+00  0  0  1  3  0   0  0  1  3  0     0
>> MatAssemblyEnd        25 1.0 2.6301e-01 1.0 0.00e+00 0.0 1.2e+02 3.4e+03 6.4e+01  0  0  4  0 12   0  0  4  0 12     0
>> MatGetRow         593372 1.0 5.4903e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatGetRowIJ            1 0.0 1.3105e-02 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatCreateSubMat        2 1.0 6.8462e-01 1.0 0.00e+00 0.0 2.1e+01 4.5e+06 3.2e+01  1  0  1 56  6   1  0  1 56  6     0
>> MatGetOrdering         1 0.0 5.0859e-02 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatCoarsen             1 1.0 1.8659e-03 1.1 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>> MatZeroEntries         9 1.0 1.5140e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatView                5 1.7 1.4541e-03 3.2 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+00  0  0  0  0  1   0  0  0  0  1     0
>> MatAXPY                1 1.0 5.6004e-02 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatMatMult             1 1.0 3.1570e-01 1.0 8.75e+07 1.0 6.0e+01 1.8e+04 1.3e+01  0  0  2  1  3   0  0  2  1  3  1101
>> MatMatMultSym          1 1.0 2.4168e-01 1.0 0.00e+00 0.0 5.0e+01 1.3e+04 1.2e+01  0  0  2  0  2   0  0  2  0  2     0
>> MatMatMultNum          1 1.0 7.3501e-02 1.0 8.75e+07 1.0 1.0e+01 4.1e+04 0.0e+00  0  0  0  0  0   0  0  0  0  0  4729
>> MatPtAP                1 1.0 1.3500e+00 1.0 5.79e+08 1.0 9.5e+01 7.0e+04 1.6e+01  2  2  3  4  3   2  2  3  4  3  1706
>> MatPtAPSymbolic        1 1.0 9.7516e-01 1.0 0.00e+00 0.0 6.0e+01 5.5e+04 7.0e+00  1  0  2  2  1   1  0  2  2  1     0
>> MatPtAPNumeric         1 1.0 3.7405e-01 1.0 5.79e+08 1.0 3.5e+01 9.7e+04 8.0e+00  1  2  1  2  2   1  2  1  2  2  6157
>> MatGetLocalMat         3 1.0 5.3542e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatGetBrAoCol          3 1.0 2.5439e-03 1.1 0.00e+00 0.0 7.0e+01 5.0e+04 0.0e+00  0  0  2  2  0   0  0  2  2  0     0
>> SNESSolve              1 1.0 5.9280e+01 1.0 1.20e+1127.3 3.0e+03 4.9e+04 4.6e+02 90100 97 88 89  90100 97 88 90  2256
>> SNESFunctionEval       2 1.0 4.4243e+00 1.0 5.48e+05 1.0 9.0e+02 1.5e+04 1.7e+02  7  0 29  8 32   7  0 29  8 33     0
>> SNESJacobianEval       1 1.0 3.1546e+00 1.0 0.00e+00 0.0 1.1e+02 6.9e+04 1.9e+01  5  0  3  4  4   5  0  3  4  4     0
>> SNESLineSearch         1 1.0 2.2030e+00 1.0 1.23e+06 1.0 4.5e+02 1.5e+04 8.5e+01  3  0 14  4 16   3  0 14  4 17     2
>> SFSetGraph             1 1.0 2.1458e-06 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> SFSetUp                1 1.0 1.5092e-04 2.4 0.00e+00 0.0 1.5e+01 3.8e+02 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> SFBcastBegin           4 1.0 4.3154e-05 1.0 0.00e+00 0.0 4.0e+01 5.8e+02 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>> SFBcastEnd             4 1.0 3.8099e-0432.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> KSPGMRESOrthog        29 1.0 1.0221e-01 1.2 8.49e+07 1.0 0.0e+00 0.0e+00 2.9e+01  0  0  0  0  6   0  0  0  0  6  3298
>> KSPSetUp               6 1.0 9.9370e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> KSPSolve               1 1.0 5.1697e+01 1.0 1.20e+1127.3 2.0e+03 6.4e+04 2.7e+02 78100 65 76 52  78100 65 76 53  2587
>> PCGAMGGraph_AGG        1 1.0 4.4754e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  2  0  5   1  0  2  0  5     4
>> PCGAMGCoarse_AGG       1 1.0 2.5029e-03 1.0 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>> PCGAMGProl_AGG         1 1.0 1.0502e-01 1.0 0.00e+00 0.0 3.9e+02 1.3e+03 8.6e+01  0  0 12  0 17   0  0 12  0 17     0
>> PCGAMGPOpt_AGG         1 1.0 6.2535e-01 1.0 2.78e+08 1.0 1.6e+02 1.1e+04 4.2e+01  1  1  5  1  8   1  1  5  1  8  1767
>> GAMG: createProl       1 1.0 1.1819e+00 1.0 2.79e+08 1.0 6.5e+02 3.6e+03 1.5e+02  2  1 21  1 30   2  1 21  1 30   936
>>   Graph                2 1.0 4.4748e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  2  0  5   1  0  2  0  5     4
>>   MIS/Agg              1 1.0 1.8790e-03 1.1 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>   SA: col data         1 1.0 5.0070e-02 1.0 0.00e+00 0.0 3.7e+02 1.2e+03 7.4e+01  0  0 12  0 14   0  0 12  0 14     0
>>   SA: frmProl0         1 1.0 5.1879e-02 1.0 0.00e+00 0.0 1.8e+01 5.4e+03 8.0e+00  0  0  1  0  2   0  0  1  0  2     0
>>   SA: smooth           1 1.0 3.9527e-01 1.0 9.33e+07 1.0 6.0e+01 1.8e+04 1.5e+01  1  0  2  1  3   1  0  2  1  3   937
>> GAMG: partLevel        1 1.0 2.1293e+00 1.0 5.79e+08 1.0 1.2e+02 8.6e+05 6.7e+01  3  2  4 63 13   3  2  4 63 13  1082
>>   repartition          1 1.0 3.4499e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>   Invert-Sort          1 1.0 1.0570e-0221.2 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>   Move A               1 1.0 4.4678e-01 1.0 0.00e+00 0.0 1.5e+01 6.3e+06 1.7e+01  1  0  0 56  3   1  0  0 56  3     0
>>   Move P               1 1.0 2.8244e-01 1.0 0.00e+00 0.0 6.0e+00 5.2e+04 1.7e+01  0  0  0  0  3   0  0  0  0  3     0
>> PCSetUp                2 1.0 4.5188e+0113.6 1.15e+11135.8 7.8e+02 1.4e+05 2.3e+02 21 88 25 64 44  21 88 25 64 45  2593
>> PCSetUpOnBlocks       10 1.0 4.1865e+01570107.9 1.14e+11 0.0 0.0e+00 0.0e+00 0.0e+00 16 85  0  0  0  16 85  0  0  0  2717
>> PCApply               10 1.0 4.8200e+01 1.0 1.19e+1135.1 1.2e+03 1.7e+04 2.1e+01 73 97 37 12  4  73 97 37 12  4  2690
>> ------------------------------------------------------------------------------------------------------------------------
>> 
>> 
>> 2) 
>> -pc_mg_levels 2 -pc_gamg_square_graph 0 -mg_levels_ksp_max_it 4
>> 
>> Summary of Stages:   ----- Time ------  ----- Flop -----  --- Messages ---  -- Message Lengths --  -- Reductions --
>>                         Avg     %Total     Avg     %Total   counts   %Total     Avg         %Total   counts   %Total 
>>  0:      Main Stage: 6.5760e+01 100.0%  1.3377e+11 100.0%  3.138e+03 100.0%  5.425e+04      100.0%  5.120e+02  98.7% 
>> 
>> ------------------------------------------------------------------------------------------------------------------------
>> ------------------------------------------------------------------------------------------------------------------------
>> Event                Count      Time (sec)     Flop                             --- Global ---  --- Stage ---   Total
>>                    Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg len Reduct  %T %F %M %L %R  %T %F %M %L %R Mflop/s
>> ------------------------------------------------------------------------------------------------------------------------
>> 
>> --- Event Stage 0: Main Stage
>> 
>> BuildTwoSided          1 1.0 1.9002e-04 8.7 0.00e+00 0.0 5.0e+00 4.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> BuildTwoSidedF        69 1.0 2.6071e-01 4.8 0.00e+00 0.0 5.5e+01 1.1e+05 0.0e+00  0  0  2  4  0   0  0  2  4  0     0
>> VecMDot               34 1.0 4.7955e-02 1.3 4.66e+07 1.0 0.0e+00 0.0e+00 3.4e+01  0  0  0  0  7   0  0  0  0  7  3854
>> VecNorm               41 1.0 7.8864e-03 1.4 1.12e+07 1.0 0.0e+00 0.0e+00 4.1e+01  0  0  0  0  8   0  0  0  0  8  5652
>> VecScale              38 1.0 4.7059e-03 1.0 5.20e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  4390
>> VecCopy               44 1.0 1.0849e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecSet               129 1.0 1.9698e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecAXPY                3 1.0 1.0378e-03 1.2 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  3143
>> VecAYPX              120 1.0 4.6406e-02 1.1 1.92e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1640
>> VecAXPBYCZ            80 1.0 4.0414e-02 1.0 5.48e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  5380
>> VecWAXPY               1 1.0 7.6008e-04 1.2 1.37e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   715
>> VecMAXPY              37 1.0 4.8892e-02 1.0 5.45e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  4425
>> VecAssemblyBegin      60 1.0 5.2444e-02 2.0 0.00e+00 0.0 2.5e+01 4.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>> VecAssemblyEnd        60 1.0 1.1539e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecPointwiseMult      11 1.0 6.2540e-03 1.2 1.51e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   956
>> VecScatterBegin      226 1.0 1.7562e-02 1.1 0.00e+00 0.0 2.1e+03 2.0e+04 0.0e+00  0  0 66 25  0   0  0 66 25  0     0
>> VecScatterEnd        226 1.0 4.3872e+01319.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 50  0  0  0  0  50  0  0  0  0     0
>> VecSetRandom           1 1.0 1.5719e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecReduceArith         3 1.0 5.7292e-04 1.2 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  5693
>> VecReduceComm          1 1.0 9.0122e-0515.1 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecNormalize          38 1.0 1.2057e-02 1.2 1.56e+07 1.0 0.0e+00 0.0e+00 3.8e+01  0  0  0  0  7   0  0  0  0  7  5140
>> MatMult              129 1.0 1.9545e+00 1.0 1.88e+09 1.0 1.3e+03 6.9e+03 0.0e+00  3  6 41  5  0   3  6 41  5  0  3822
>> MatMultAdd            10 1.0 4.3806e+011689.9 5.73e+07 1.0 3.0e+01 2.1e+05 0.0e+00 50  0  1  4  0  50  0  1  4  0     5
>> MatMultTranspose      10 1.0 6.7213e-02 1.1 5.73e+07 1.0 3.0e+01 2.1e+05 0.0e+00  0  0  1  4  0   0  0  1  4  0  3390
>> MatSolve              10 0.0 1.0379e+00 0.0 2.19e+09 0.0 0.0e+00 0.0e+00 0.0e+00  0  2  0  0  0   0  2  0  0  0  2106
>> MatSOR               111 1.0 3.1935e+00 1.0 1.63e+09 1.0 0.0e+00 0.0e+00 0.0e+00  5  5  0  0  0   5  5  0  0  0  2022
>> MatLUFactorSym         1 1.0 2.3361e+00288179.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  1  0  0  0  0   1  0  0  0  0     0
>> MatLUFactorNum         1 1.0 4.0301e+0110564673.9 1.14e+11 0.0 0.0e+00 0.0e+00 0.0e+00 15 85  0  0  0  15 85  0  0  0  2823
>> MatScale               3 1.0 1.4505e-02 1.0 6.14e+06 1.0 1.0e+01 1.2e+03 0.0e+00  0  0  0  0  0   0  0  0  0  0  1683
>> MatResidual           10 1.0 1.6052e-01 1.1 1.47e+08 1.0 1.0e+02 6.9e+03 0.0e+00  0  0  3  0  0   0  0  3  0  0  3641
>> MatAssemblyBegin      25 1.0 2.4469e-01 7.5 0.00e+00 0.0 3.0e+01 2.0e+05 0.0e+00  0  0  1  3  0   0  0  1  3  0     0
>> MatAssemblyEnd        25 1.0 2.2773e-01 1.0 0.00e+00 0.0 1.2e+02 3.4e+03 6.4e+01  0  0  4  0 12   0  0  4  0 12     0
>> MatGetRow         593372 1.0 4.2183e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatGetRowIJ            1 0.0 9.4678e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatCreateSubMat        2 1.0 6.3013e-01 1.0 0.00e+00 0.0 2.1e+01 4.5e+06 3.2e+01  1  0  1 56  6   1  0  1 56  6     0
>> MatGetOrdering         1 0.0 4.1698e-02 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatCoarsen             1 1.0 1.4472e-03 1.1 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>> MatZeroEntries         9 1.0 1.5332e-01 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatView                5 1.7 1.6737e-03 3.4 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+00  0  0  0  0  1   0  0  0  0  1     0
>> MatAXPY                1 1.0 3.6167e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatMatMult             1 1.0 2.6676e-01 1.0 8.75e+07 1.0 6.0e+01 1.8e+04 1.3e+01  0  0  2  1  3   0  0  2  1  3  1303
>> MatMatMultSym          1 1.0 2.0918e-01 1.0 0.00e+00 0.0 5.0e+01 1.3e+04 1.2e+01  0  0  2  0  2   0  0  2  0  2     0
>> MatMatMultNum          1 1.0 5.7073e-02 1.0 8.75e+07 1.0 1.0e+01 4.1e+04 0.0e+00  0  0  0  0  0   0  0  0  0  0  6090
>> MatPtAP                1 1.0 1.0664e+00 1.0 5.79e+08 1.0 9.5e+01 7.0e+04 1.6e+01  2  2  3  4  3   2  2  3  4  3  2160
>> MatPtAPSymbolic        1 1.0 7.2993e-01 1.0 0.00e+00 0.0 6.0e+01 5.5e+04 7.0e+00  1  0  2  2  1   1  0  2  2  1     0
>> MatPtAPNumeric         1 1.0 3.3595e-01 1.0 5.79e+08 1.0 3.5e+01 9.7e+04 8.0e+00  1  2  1  2  2   1  2  1  2  2  6855
>> MatGetLocalMat         3 1.0 5.2164e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatGetBrAoCol          3 1.0 2.5141e-03 1.2 0.00e+00 0.0 7.0e+01 5.0e+04 0.0e+00  0  0  2  2  0   0  0  2  2  0     0
>> SNESSolve              1 1.0 5.8984e+01 1.0 1.20e+1127.3 3.0e+03 4.9e+04 4.6e+02 90100 97 88 89  90100 97 88 90  2267
>> SNESFunctionEval       2 1.0 4.4220e+00 1.0 5.48e+05 1.0 9.0e+02 1.5e+04 1.7e+02  7  0 29  8 32   7  0 29  8 33     0
>> SNESJacobianEval       1 1.0 2.7677e+00 1.0 0.00e+00 0.0 1.1e+02 6.9e+04 1.9e+01  4  0  3  4  4   4  0  3  4  4     0
>> SNESLineSearch         1 1.0 2.3403e+00 1.0 1.23e+06 1.0 4.5e+02 1.5e+04 8.5e+01  4  0 14  4 16   4  0 14  4 17     2
>> SFSetGraph             1 1.0 1.9073e-06 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> SFSetUp                1 1.0 2.3508e-04 3.9 0.00e+00 0.0 1.5e+01 3.8e+02 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> SFBcastBegin           4 1.0 3.2902e-05 1.1 0.00e+00 0.0 4.0e+01 5.8e+02 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>> SFBcastEnd             4 1.0 1.2112e-0416.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> KSPGMRESOrthog        29 1.0 8.2165e-02 1.1 8.49e+07 1.0 0.0e+00 0.0e+00 2.9e+01  0  0  0  0  6   0  0  0  0  6  4102
>> KSPSetUp               6 1.0 8.9242e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> KSPSolve               1 1.0 5.1788e+01 1.0 1.20e+1127.3 2.0e+03 6.4e+04 2.7e+02 79100 65 76 52  79100 65 76 53  2582
>> PCGAMGGraph_AGG        1 1.0 3.8242e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  2  0  5   1  0  2  0  5     4
>> PCGAMGCoarse_AGG       1 1.0 2.0711e-03 1.0 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>> PCGAMGProl_AGG         1 1.0 7.1434e-02 1.0 0.00e+00 0.0 3.9e+02 1.3e+03 8.6e+01  0  0 12  0 17   0  0 12  0 17     0
>> PCGAMGPOpt_AGG         1 1.0 5.3496e-01 1.0 2.78e+08 1.0 1.6e+02 1.1e+04 4.2e+01  1  1  5  1  8   1  1  5  1  8  2065
>> GAMG: createProl       1 1.0 9.9368e-01 1.0 2.79e+08 1.0 6.5e+02 3.6e+03 1.5e+02  2  1 21  1 30   2  1 21  1 30  1114
>>   Graph                2 1.0 3.8235e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  2  0  5   1  0  2  0  5     4
>>   MIS/Agg              1 1.0 1.4579e-03 1.1 0.00e+00 0.0 5.5e+01 5.2e+02 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>   SA: col data         1 1.0 3.0082e-02 1.0 0.00e+00 0.0 3.7e+02 1.2e+03 7.4e+01  0  0 12  0 14   0  0 12  0 14     0
>>   SA: frmProl0         1 1.0 3.8682e-02 1.0 0.00e+00 0.0 1.8e+01 5.4e+03 8.0e+00  0  0  1  0  2   0  0  1  0  2     0
>>   SA: smooth           1 1.0 3.2894e-01 1.0 9.33e+07 1.0 6.0e+01 1.8e+04 1.5e+01  0  0  2  1  3   0  0  2  1  3  1126
>> GAMG: partLevel        1 1.0 1.7867e+00 1.0 5.79e+08 1.0 1.2e+02 8.6e+05 6.7e+01  3  2  4 63 13   3  2  4 63 13  1289
>>   repartition          1 1.0 2.9397e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>   Invert-Sort          1 1.0 7.5300e-0316.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>   Move A               1 1.0 4.5402e-01 1.0 0.00e+00 0.0 1.5e+01 6.3e+06 1.7e+01  1  0  0 56  3   1  0  0 56  3     0
>>   Move P               1 1.0 2.2056e-01 1.0 0.00e+00 0.0 6.0e+00 5.2e+04 1.7e+01  0  0  0  0  3   0  0  0  0  3     0
>> PCSetUp                2 1.0 4.5469e+0116.3 1.15e+11135.8 7.8e+02 1.4e+05 2.3e+02 20 88 25 64 44  20 88 25 64 45  2577
>> PCSetUpOnBlocks       10 1.0 4.2679e+01701992.3 1.14e+11 0.0 0.0e+00 0.0e+00 0.0e+00 16 85  0  0  0  16 85  0  0  0  2665
>> PCApply               10 1.0 4.8823e+01 1.0 1.19e+1135.1 1.2e+03 1.7e+04 2.1e+01 74 97 37 12  4  74 97 37 12  4  2656
>> ------------------------------------------------------------------------------------------------------------------------
>> 
>> 
>> 3) 
>> -pc_mg_levels 2 -mg_levels_ksp_max_it 4 -pc_gamg_threshold 0.04
>> 
>> Summary of Stages:   ----- Time ------  ----- Flop -----  --- Messages ---  -- Message Lengths --  -- Reductions --
>>                         Avg     %Total     Avg     %Total   counts   %Total     Avg         %Total   counts   %Total 
>>  0:      Main Stage: 2.9122e+01 100.0%  3.4599e+10 100.0%  3.618e+03 100.0%  2.554e+04      100.0%  5.350e+02  98.7% 
>> 
>> ------------------------------------------------------------------------------------------------------------------------
>> ------------------------------------------------------------------------------------------------------------------------
>> Event                Count      Time (sec)     Flop                             --- Global ---  --- Stage ---   Total
>>                    Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg len Reduct  %T %F %M %L %R  %T %F %M %L %R Mflop/s
>> ------------------------------------------------------------------------------------------------------------------------
>> 
>> --- Event Stage 0: Main Stage
>> 
>> BuildTwoSided          1 1.0 5.1999e-0423.5 0.00e+00 0.0 5.0e+00 4.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> BuildTwoSidedF        74 1.0 1.6531e-01 2.2 0.00e+00 0.0 7.8e+01 5.7e+04 0.0e+00  0  0  2  5  0   0  0  2  5  0     0
>> VecMDot               37 1.0 7.6608e-02 1.3 5.56e+07 1.0 0.0e+00 0.0e+00 3.7e+01  0  1  0  0  7   0  1  0  0  7  2881
>> VecNorm               44 1.0 1.9918e-02 2.0 1.21e+07 1.0 0.0e+00 0.0e+00 4.4e+01  0  0  0  0  8   0  0  0  0  8  2402
>> VecScale              41 1.0 5.9566e-03 1.1 5.61e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  3742
>> VecCopy               53 1.0 1.3126e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecSet               151 1.0 2.0747e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecAXPY                3 1.0 1.2219e-03 1.6 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  2669
>> VecAYPX              156 1.0 6.1843e-02 1.2 2.49e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1600
>> VecAXPBYCZ           104 1.0 5.3596e-02 1.0 7.12e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  1  0  0  0   0  1  0  0  0  5274
>> VecWAXPY               1 1.0 6.4707e-04 1.3 1.37e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   840
>> VecMAXPY              40 1.0 6.1941e-02 1.1 6.44e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  1  0  0  0   0  1  0  0  0  4125
>> VecAssemblyBegin      64 1.0 7.2242e-02 1.3 0.00e+00 0.0 2.5e+01 4.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>> VecAssemblyEnd        64 1.0 1.4734e-04 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecPointwiseMult      11 1.0 6.0835e-03 1.2 1.51e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   983
>> VecScatterBegin      270 1.0 1.7434e-02 1.1 0.00e+00 0.0 2.5e+03 1.5e+04 0.0e+00  0  0 69 40  0   0  0 69 40  0     0
>> VecScatterEnd        270 1.0 5.8946e+0035.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 15  0  0  0  0  15  0  0  0  0     0
>> VecSetRandom           1 1.0 2.9080e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecReduceArith         3 1.0 6.4564e-04 1.3 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  5052
>> VecReduceComm          1 1.0 1.6594e-0427.8 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecNormalize          41 1.0 2.5299e-02 1.6 1.68e+07 1.0 0.0e+00 0.0e+00 4.1e+01  0  0  0  0  8   0  0  0  0  8  2643
>> MatMult              162 1.0 2.5775e+00 1.0 2.36e+09 1.0 1.6e+03 6.9e+03 0.0e+00  9 27 45 12  0   9 27 45 12  0  3640
>> MatMultAdd            13 1.0 5.7682e+00227.3 5.35e+07 1.0 3.9e+01 8.5e+04 0.0e+00 15  1  1  4  0  15  1  1  4  0    37
>> MatMultTranspose      13 1.0 6.4702e-02 1.1 5.35e+07 1.0 3.9e+01 8.5e+04 0.0e+00  0  1  1  4  0   0  1  1  4  0  3268
>> MatSolve              13 0.0 3.4193e-01 0.0 6.33e+08 0.0 0.0e+00 0.0e+00 0.0e+00  0  2  0  0  0   0  2  0  0  0  1850
>> MatSOR               141 1.0 4.2887e+00 1.0 2.07e+09 1.0 0.0e+00 0.0e+00 0.0e+00 15 24  0  0  0  15 24  0  0  0  1912
>> MatLUFactorSym         1 1.0 5.2129e-0139753.9 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatLUFactorNum         1 1.0 4.8021e+00805666.4 1.33e+10 0.0 0.0e+00 0.0e+00 0.0e+00  4 38  0  0  0   4 38  0  0  0  2767
>> MatScale               3 1.0 1.0527e-02 1.0 4.52e+06 1.0 1.0e+01 1.2e+03 0.0e+00  0  0  0  0  0   0  0  0  0  0  1699
>> MatResidual           13 1.0 2.1939e-01 1.1 1.91e+08 1.0 1.3e+02 6.9e+03 0.0e+00  1  2  4  1  0   1  2  4  1  0  3463
>> MatAssemblyBegin      33 1.0 1.1140e-01 5.0 0.00e+00 0.0 5.2e+01 8.2e+04 0.0e+00  0  0  1  5  0   0  0  1  5  0     0
>> MatAssemblyEnd        33 1.0 1.9615e-01 1.0 0.00e+00 0.0 1.5e+02 1.4e+03 7.2e+01  1  0  4  0 13   1  0  4  0 13     0
>> MatGetRow         593372 1.0 4.5789e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatGetRowIJ            1 0.0 4.0052e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatCreateSubMat        2 1.0 2.7033e-01 1.0 0.00e+00 0.0 2.1e+01 1.2e+06 3.2e+01  1  0  1 28  6   1  0  1 28  6     0
>> MatGetOrdering         1 0.0 1.7007e-02 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatCoarsen             1 1.0 2.4688e-03 1.2 0.00e+00 0.0 5.5e+01 1.0e+03 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>> MatZeroEntries        10 1.0 1.4357e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatView                5 1.7 1.7419e-03 3.8 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+00  0  0  0  0  1   0  0  0  0  1     0
>> MatAXPY                1 1.0 3.4560e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatMatMult             1 1.0 2.6894e-01 1.0 8.75e+07 1.0 6.0e+01 1.8e+04 1.2e+01  1  1  2  1  2   1  1  2  1  2  1292
>> MatMatMultSym          1 1.0 2.1331e-01 1.0 0.00e+00 0.0 5.0e+01 1.3e+04 1.2e+01  1  0  1  1  2   1  0  1  1  2     0
>> MatMatMultNum          1 1.0 5.5709e-02 1.0 8.75e+07 1.0 1.0e+01 4.1e+04 0.0e+00  0  1  0  0  0   0  1  0  0  0  6239
>> MatPtAP                1 1.0 6.6371e-01 1.0 3.42e+08 1.0 9.5e+01 3.5e+04 1.5e+01  2  4  3  4  3   2  4  3  4  3  2039
>> MatPtAPSymbolic        1 1.0 4.6951e-01 1.0 0.00e+00 0.0 6.0e+01 3.4e+04 7.0e+00  2  0  2  2  1   2  0  2  2  1     0
>> MatPtAPNumeric         1 1.0 1.9424e-01 1.0 3.42e+08 1.0 3.5e+01 3.6e+04 8.0e+00  1  4  1  1  1   1  4  1  1  1  6967
>> MatTrnMatMult          1 1.0 5.6805e-02 1.0 4.18e+06 1.0 6.5e+01 6.6e+03 1.5e+01  0  0  2  0  3   0  0  2  0  3   292
>> MatTrnMatMultSym       1 1.0 3.4907e-02 1.0 0.00e+00 0.0 3.0e+01 3.1e+03 7.0e+00  0  0  1  0  1   0  0  1  0  1     0
>> MatTrnMatMultNum       1 1.0 2.2120e-02 1.0 4.18e+06 1.0 3.5e+01 9.7e+03 8.0e+00  0  0  1  0  1   0  0  1  0  1   751
>> MatGetLocalMat         4 1.0 3.8992e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatGetBrAoCol          3 1.0 2.6469e-03 1.2 0.00e+00 0.0 7.0e+01 4.0e+04 0.0e+00  0  0  2  3  0   0  0  2  3  0     0
>> SNESSolve              1 1.0 2.2497e+01 1.0 1.91e+10 3.7 3.5e+03 2.1e+04 4.8e+02 77100 97 79 89  77100 97 79 90  1536
>> SNESFunctionEval       2 1.0 4.5633e+00 1.0 5.48e+05 1.0 9.0e+02 1.5e+04 1.7e+02 16  0 25 14 31  16  0 25 14 31     0
>> SNESJacobianEval       1 1.0 3.0567e+00 1.0 0.00e+00 0.0 1.1e+02 6.9e+04 1.9e+01 10  0  3  8  4  10  0  3  8  4     0
>> SNESLineSearch         1 1.0 2.3701e+00 1.0 1.23e+06 1.0 4.5e+02 1.5e+04 8.5e+01  8  0 12  7 16   8  0 12  7 16     2
>> SFSetGraph             1 1.0 3.0994e-06 1.6 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> SFSetUp                1 1.0 5.7101e-04 6.6 0.00e+00 0.0 1.5e+01 7.7e+02 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> SFBcastBegin           4 1.0 5.6982e-05 1.2 0.00e+00 0.0 4.0e+01 1.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>> SFBcastEnd             4 1.0 1.6999e-04 5.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> KSPGMRESOrthog        32 1.0 1.2112e-01 1.1 1.03e+08 1.0 0.0e+00 0.0e+00 3.2e+01  0  1  0  0  6   0  1  0  0  6  3375
>> KSPSetUp               6 1.0 9.6612e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> KSPSolve               1 1.0 1.4872e+01 1.0 1.91e+10 3.7 2.5e+03 2.1e+04 2.9e+02 51100 69 56 54  51100 69 56 55  2323
>> PCGAMGGraph_AGG        1 1.0 4.4312e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  2  0  1  0  4   2  0  1  0  4     4
>> PCGAMGCoarse_AGG       1 1.0 6.4611e-02 1.0 4.18e+06 1.0 1.7e+02 3.5e+03 2.1e+01  0  0  5  1  4   0  0  5  1  4   257
>> PCGAMGProl_AGG         1 1.0 9.3410e-02 1.0 0.00e+00 0.0 4.0e+02 2.8e+03 8.6e+01  0  0 11  1 16   0  0 11  1 16     0
>> PCGAMGPOpt_AGG         1 1.0 5.4947e-01 1.0 2.77e+08 1.0 1.6e+02 1.1e+04 4.1e+01  2  3  4  2  8   2  3  4  2  8  1999
>> GAMG: createProl       1 1.0 1.1555e+00 1.0 2.81e+08 1.0 7.8e+02 4.5e+03 1.7e+02  4  3 22  4 32   4  3 22  4 32   966
>>   Graph                2 1.0 4.4305e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  2  0  1  0  4   2  0  1  0  4     4
>>   MIS/Agg              1 1.0 2.4810e-03 1.2 0.00e+00 0.0 5.5e+01 1.0e+03 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>   SA: col data         1 1.0 4.5491e-02 1.0 0.00e+00 0.0 3.7e+02 2.3e+03 7.4e+01  0  0 10  1 14   0  0 10  1 14     0
>>   SA: frmProl0         1 1.0 4.5125e-02 1.0 0.00e+00 0.0 3.5e+01 7.6e+03 8.0e+00  0  0  1  0  1   0  0  1  0  1     0
>>   SA: smooth           1 1.0 3.2692e-01 1.0 9.16e+07 1.0 6.0e+01 1.8e+04 1.4e+01  1  1  2  1  3   1  1  2  1  3  1113
>> GAMG: partLevel        1 1.0 9.6929e-01 1.0 3.42e+08 1.0 1.2e+02 2.5e+05 6.6e+01  3  4  3 34 12   3  4  3 34 12  1396
>>   repartition          1 1.0 1.0109e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>   Invert-Sort          1 1.0 1.2600e-03 5.7 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>   Move A               1 1.0 1.2418e-01 1.0 0.00e+00 0.0 1.5e+01 1.7e+06 1.7e+01  0  0  0 28  3   0  0  0 28  3     0
>>   Move P               1 1.0 1.6575e-01 1.0 0.00e+00 0.0 6.0e+00 2.1e+04 1.7e+01  1  0  0  0  3   1  0  0  0  3     0
>> PCSetUp                2 1.0 7.4755e+00 3.5 1.39e+1022.7 9.1e+02 3.8e+04 2.5e+02 12 46 25 38 45  12 46 25 38 46  2108
>> PCSetUpOnBlocks       13 1.0 5.3405e+0062049.0 1.33e+10 0.0 0.0e+00 0.0e+00 0.0e+00  5 38  0  0  0   5 38  0  0  0  2488
>> PCApply               13 1.0 1.2494e+01 1.0 1.83e+10 4.3 1.5e+03 1.1e+04 2.1e+01 43 90 41 18  4  43 90 41 18  4  2496
>> ------------------------------------------------------------------------------------------------------------------------
>> 
>> 
>> 
>> 4) 
>> -pc_mg_levels 2 -mg_levels_ksp_max_it 4
>> 
>> Summary of Stages:   ----- Time ------  ----- Flop -----  --- Messages ---  -- Message Lengths --  -- Reductions --
>>                         Avg     %Total     Avg     %Total   counts   %Total     Avg         %Total   counts   %Total 
>>  0:      Main Stage: 2.8086e+01 100.0%  3.4599e+10 100.0%  3.618e+03 100.0%  2.554e+04      100.0%  5.350e+02  98.7% 
>> 
>> ------------------------------------------------------------------------------------------------------------------------
>> ------------------------------------------------------------------------------------------------------------------------
>> Event                Count      Time (sec)     Flop                             --- Global ---  --- Stage ---   Total
>>                    Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg len Reduct  %T %F %M %L %R  %T %F %M %L %R Mflop/s
>> ------------------------------------------------------------------------------------------------------------------------
>> 
>> --- Event Stage 0: Main Stage
>> 
>> BuildTwoSided          1 1.0 9.6083e-05 5.3 0.00e+00 0.0 5.0e+00 4.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> BuildTwoSidedF        74 1.0 2.0508e-01 2.9 0.00e+00 0.0 7.8e+01 5.7e+04 0.0e+00  1  0  2  5  0   1  0  2  5  0     0
>> VecMDot               37 1.0 6.2755e-02 1.2 5.56e+07 1.0 0.0e+00 0.0e+00 3.7e+01  0  1  0  0  7   0  1  0  0  7  3517
>> VecNorm               44 1.0 1.2301e-02 1.5 1.21e+07 1.0 0.0e+00 0.0e+00 4.4e+01  0  0  0  0  8   0  0  0  0  8  3889
>> VecScale              41 1.0 5.2664e-03 1.0 5.61e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  4232
>> VecCopy               53 1.0 1.3689e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecSet               151 1.0 1.9269e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecAXPY                3 1.0 1.1799e-03 1.3 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  2764
>> VecAYPX              156 1.0 6.0851e-02 1.2 2.49e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1626
>> VecAXPBYCZ           104 1.0 5.3286e-02 1.1 7.12e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  1  0  0  0   0  1  0  0  0  5305
>> VecWAXPY               1 1.0 7.0786e-04 1.2 1.37e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   768
>> VecMAXPY              40 1.0 6.2898e-02 1.0 6.44e+07 1.0 0.0e+00 0.0e+00 0.0e+00  0  1  0  0  0   0  1  0  0  0  4062
>> VecAssemblyBegin      64 1.0 1.0848e-01 2.7 0.00e+00 0.0 2.5e+01 4.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>> VecAssemblyEnd        64 1.0 1.1230e-04 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecPointwiseMult      11 1.0 6.5417e-03 1.1 1.51e+06 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0   914
>> VecScatterBegin      270 1.0 1.6606e-02 1.0 0.00e+00 0.0 2.5e+03 1.5e+04 0.0e+00  0  0 69 40  0   0  0 69 40  0     0
>> VecScatterEnd        270 1.0 5.5767e+0044.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 15  0  0  0  0  15  0  0  0  0     0
>> VecSetRandom           1 1.0 1.5750e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecReduceArith         3 1.0 6.3324e-04 1.3 8.22e+05 1.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  5151
>> VecReduceComm          1 1.0 1.5712e-0431.4 0.00e+00 0.0 0.0e+00 0.0e+00 1.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> VecNormalize          41 1.0 1.7057e-02 1.3 1.68e+07 1.0 0.0e+00 0.0e+00 4.1e+01  0  0  0  0  8   0  0  0  0  8  3920
>> MatMult              162 1.0 2.5049e+00 1.0 2.36e+09 1.0 1.6e+03 6.9e+03 0.0e+00  9 27 45 12  0   9 27 45 12  0  3745
>> MatMultAdd            13 1.0 5.5041e+00222.4 5.35e+07 1.0 3.9e+01 8.5e+04 0.0e+00 15  1  1  4  0  15  1  1  4  0    38
>> MatMultTranspose      13 1.0 6.2563e-02 1.1 5.35e+07 1.0 3.9e+01 8.5e+04 0.0e+00  0  1  1  4  0   0  1  1  4  0  3379
>> MatSolve              13 0.0 3.4633e-01 0.0 6.33e+08 0.0 0.0e+00 0.0e+00 0.0e+00  0  2  0  0  0   0  2  0  0  0  1827
>> MatSOR               141 1.0 4.1983e+00 1.0 2.07e+09 1.0 0.0e+00 0.0e+00 0.0e+00 15 24  0  0  0  15 24  0  0  0  1953
>> MatLUFactorSym         1 1.0 4.5545e-0135375.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatLUFactorNum         1 1.0 4.6021e+00772110.8 1.33e+10 0.0 0.0e+00 0.0e+00 0.0e+00  4 38  0  0  0   4 38  0  0  0  2887
>> MatScale               3 1.0 1.1058e-02 1.0 4.52e+06 1.0 1.0e+01 1.2e+03 0.0e+00  0  0  0  0  0   0  0  0  0  0  1618
>> MatResidual           13 1.0 2.1592e-01 1.1 1.91e+08 1.0 1.3e+02 6.9e+03 0.0e+00  1  2  4  1  0   1  2  4  1  0  3519
>> MatAssemblyBegin      33 1.0 1.1083e-01 3.3 0.00e+00 0.0 5.2e+01 8.2e+04 0.0e+00  0  0  1  5  0   0  0  1  5  0     0
>> MatAssemblyEnd        33 1.0 1.7722e-01 1.0 0.00e+00 0.0 1.5e+02 1.4e+03 7.2e+01  1  0  4  0 13   1  0  4  0 13     0
>> MatGetRow         593372 1.0 4.5285e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatGetRowIJ            1 0.0 3.5741e-03 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatCreateSubMat        2 1.0 2.5588e-01 1.0 0.00e+00 0.0 2.1e+01 1.2e+06 3.2e+01  1  0  1 28  6   1  0  1 28  6     0
>> MatGetOrdering         1 0.0 1.6127e-02 0.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatCoarsen             1 1.0 1.4122e-03 1.1 0.00e+00 0.0 5.5e+01 1.0e+03 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>> MatZeroEntries        10 1.0 1.5053e-01 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  1  0  0  0  0   1  0  0  0  0     0
>> MatView                5 1.7 1.6868e-03 3.3 0.00e+00 0.0 0.0e+00 0.0e+00 3.0e+00  0  0  0  0  1   0  0  0  0  1     0
>> MatAXPY                1 1.0 4.3107e-02 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatMatMult             1 1.0 2.5280e-01 1.0 8.75e+07 1.0 6.0e+01 1.8e+04 1.2e+01  1  1  2  1  2   1  1  2  1  2  1375
>> MatMatMultSym          1 1.0 1.9445e-01 1.0 0.00e+00 0.0 5.0e+01 1.3e+04 1.2e+01  1  0  1  1  2   1  0  1  1  2     0
>> MatMatMultNum          1 1.0 5.8333e-02 1.0 8.75e+07 1.0 1.0e+01 4.1e+04 0.0e+00  0  1  0  0  0   0  1  0  0  0  5959
>> MatPtAP                1 1.0 6.7796e-01 1.0 3.42e+08 1.0 9.5e+01 3.5e+04 1.5e+01  2  4  3  4  3   2  4  3  4  3  1996
>> MatPtAPSymbolic        1 1.0 4.8317e-01 1.0 0.00e+00 0.0 6.0e+01 3.4e+04 7.0e+00  2  0  2  2  1   2  0  2  2  1     0
>> MatPtAPNumeric         1 1.0 1.9495e-01 1.0 3.42e+08 1.0 3.5e+01 3.6e+04 8.0e+00  1  4  1  1  1   1  4  1  1  1  6941
>> MatTrnMatMult          1 1.0 4.1985e-02 1.0 4.18e+06 1.0 6.5e+01 6.6e+03 1.5e+01  0  0  2  0  3   0  0  2  0  3   396
>> MatTrnMatMultSym       1 1.0 2.3958e-02 1.0 0.00e+00 0.0 3.0e+01 3.1e+03 7.0e+00  0  0  1  0  1   0  0  1  0  1     0
>> MatTrnMatMultNum       1 1.0 1.8097e-02 1.0 4.18e+06 1.0 3.5e+01 9.7e+03 8.0e+00  0  0  1  0  1   0  0  1  0  1   918
>> MatGetLocalMat         4 1.0 4.4538e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> MatGetBrAoCol          3 1.0 3.8249e-03 1.6 0.00e+00 0.0 7.0e+01 4.0e+04 0.0e+00  0  0  2  3  0   0  0  2  3  0     0
>> SNESSolve              1 1.0 2.1417e+01 1.0 1.91e+10 3.7 3.5e+03 2.1e+04 4.8e+02 76100 97 79 89  76100 97 79 90  1614
>> SNESFunctionEval       2 1.0 4.4048e+00 1.0 5.48e+05 1.0 9.0e+02 1.5e+04 1.7e+02 16  0 25 14 31  16  0 25 14 31     0
>> SNESJacobianEval       1 1.0 2.6810e+00 1.0 0.00e+00 0.0 1.1e+02 6.9e+04 1.9e+01 10  0  3  8  4  10  0  3  8  4     0
>> SNESLineSearch         1 1.0 2.2640e+00 1.0 1.23e+06 1.0 4.5e+02 1.5e+04 8.5e+01  8  0 12  7 16   8  0 12  7 16     2
>> SFSetGraph             1 1.0 2.8610e-06 1.5 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> SFSetUp                1 1.0 1.4687e-04 2.3 0.00e+00 0.0 1.5e+01 7.7e+02 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> SFBcastBegin           4 1.0 3.1948e-05 1.1 0.00e+00 0.0 4.0e+01 1.2e+03 0.0e+00  0  0  1  0  0   0  0  1  0  0     0
>> SFBcastEnd             4 1.0 4.2200e-05 4.7 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> KSPGMRESOrthog        32 1.0 1.0959e-01 1.1 1.03e+08 1.0 0.0e+00 0.0e+00 3.2e+01  0  1  0  0  6   0  1  0  0  6  3730
>> KSPSetUp               6 1.0 9.1093e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00 2.0e+00  0  0  0  0  0   0  0  0  0  0     0
>> KSPSolve               1 1.0 1.4326e+01 1.0 1.91e+10 3.7 2.5e+03 2.1e+04 2.9e+02 51100 69 56 54  51100 69 56 55  2412
>> PCGAMGGraph_AGG        1 1.0 3.8501e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  1  0  4   1  0  1  0  4     4
>> PCGAMGCoarse_AGG       1 1.0 4.7253e-02 1.0 4.18e+06 1.0 1.7e+02 3.5e+03 2.1e+01  0  0  5  1  4   0  0  5  1  4   352
>> PCGAMGProl_AGG         1 1.0 6.9987e-02 1.0 0.00e+00 0.0 4.0e+02 2.8e+03 8.6e+01  0  0 11  1 16   0  0 11  1 16     0
>> PCGAMGPOpt_AGG         1 1.0 5.4272e-01 1.0 2.77e+08 1.0 1.6e+02 1.1e+04 4.1e+01  2  3  4  2  8   2  3  4  2  8  2024
>> GAMG: createProl       1 1.0 1.0504e+00 1.0 2.81e+08 1.0 7.8e+02 4.5e+03 1.7e+02  4  3 22  4 32   4  3 22  4 32  1063
>>   Graph                2 1.0 3.8496e-01 1.0 4.09e+05 1.0 5.0e+01 4.6e+02 2.4e+01  1  0  1  0  4   1  0  1  0  4     4
>>   MIS/Agg              1 1.0 1.4219e-03 1.1 0.00e+00 0.0 5.5e+01 1.0e+03 2.0e+00  0  0  2  0  0   0  0  2  0  0     0
>>   SA: col data         1 1.0 3.1489e-02 1.0 0.00e+00 0.0 3.7e+02 2.3e+03 7.4e+01  0  0 10  1 14   0  0 10  1 14     0
>>   SA: frmProl0         1 1.0 3.5651e-02 1.0 0.00e+00 0.0 3.5e+01 7.6e+03 8.0e+00  0  0  1  0  1   0  0  1  0  1     0
>>   SA: smooth           1 1.0 3.2070e-01 1.0 9.16e+07 1.0 6.0e+01 1.8e+04 1.4e+01  1  1  2  1  3   1  1  2  1  3  1135
>> GAMG: partLevel        1 1.0 9.6892e-01 1.0 3.42e+08 1.0 1.2e+02 2.5e+05 6.6e+01  3  4  3 34 12   3  4  3 34 12  1397
>>   repartition          1 1.0 1.1492e-04 1.0 0.00e+00 0.0 0.0e+00 0.0e+00 6.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>   Invert-Sort          1 1.0 1.3120e-03 6.0 0.00e+00 0.0 0.0e+00 0.0e+00 4.0e+00  0  0  0  0  1   0  0  0  0  1     0
>>   Move A               1 1.0 1.2847e-01 1.0 0.00e+00 0.0 1.5e+01 1.7e+06 1.7e+01  0  0  0 28  3   0  0  0 28  3     0
>>   Move P               1 1.0 1.4728e-01 1.0 0.00e+00 0.0 6.0e+00 2.1e+04 1.7e+01  1  0  0  0  3   1  0  0  0  3     0
>> PCSetUp                2 1.0 7.1033e+00 3.5 1.39e+1022.7 9.1e+02 3.8e+04 2.5e+02 12 46 25 38 45  12 46 25 38 46  2218
>> PCSetUpOnBlocks       13 1.0 5.0738e+0063336.2 1.33e+10 0.0 0.0e+00 0.0e+00 0.0e+00  5 38  0  0  0   5 38  0  0  0  2618
>> PCApply               13 1.0 1.2059e+01 1.0 1.83e+10 4.3 1.5e+03 1.1e+04 2.1e+01 43 90 41 18  4  43 90 41 18  4  2586
>> ------------------------------------------------------------------------------------------------------------------------
>> 
>> 


More information about the petsc-users mailing list