[petsc-users] Scaling/Preconditioners for Poisson equation
Filippo Leonardi
filippo.leonardi at sam.math.ethz.ch
Wed Oct 1 01:01:45 CDT 2014
I am actually having hard time figuring out where I am spending my time.
Reading the report I am spending time on KSPSolve and PCApply (e+02). Since
the number of those operations is well under control. I guess is some
communication that is the bottleneck.
The lines:
VecScatterBegin 4097 1.0 2.5168e+01 3.2 0.00e+00 0.0 2.9e+09 3.7e+01
0.0e+00 3 0 87 39 0 10 0100100 0 0
VecScatterEnd 4097 1.0 1.7736e+02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 25 0 0 0 0 88 0 0 0 0 0
are probably what is slowing down the solution.
Also, times do not add up properly, especially in KSPSolve.
PS: until now I was using outputs in VTK. I guess it is better to output in
PEtsc binary? Is it better to output from PETSC_COMM_SELF (i.e. each processor
individually)?
Using Petsc Release Version 3.3.0, Patch 3, Wed Aug 29 11:26:24 CDT 2012
Max Max/Min Avg Total
Time (sec): 6.719e+02 1.00001 6.719e+02
Objects: 2.456e+03 1.00000 2.456e+03
Flops: 1.251e+10 1.00000 1.251e+10 5.123e+13
Flops/sec: 1.861e+07 1.00001 1.861e+07 7.624e+10
MPI Messages: 9.041e+05 1.09958 8.223e+05 3.368e+09
MPI Message Lengths: 4.299e+10 735.09182 8.386e+01 2.825e+11
MPI Reductions: 4.827e+03 1.00000
Flop counting convention: 1 flop = 1 real number operation of type
(multiply/divide/add/subtract)
e.g., VecAXPY() for real vectors of length N -->
2N flops
and VecAXPY() for complex vectors of length N -->
8N flops
Summary of Stages: ----- Time ------ ----- Flops ----- --- Messages ---
-- Message Lengths -- -- Reductions --
Avg %Total Avg %Total counts %Total
Avg %Total counts %Total
0: Main Stage: 1.0203e+01 1.5% 0.0000e+00 0.0% 0.000e+00 0.0%
0.000e+00 0.0% 0.000e+00 0.0%
1: StepStage: 1.3436e-02 0.0% 1.4496e+10 0.0% 0.000e+00 0.0%
0.000e+00 0.0% 0.000e+00 0.0%
2: ConvStage: 3.3163e-01 0.0% 7.4088e+10 0.1% 2.949e+06 0.1%
7.173e+00 8.6% 0.000e+00 0.0%
3: ProjStage: 9.3354e-02 0.0% 3.7581e+09 0.0% 3.932e+05 0.0%
9.564e-01 1.1% 0.000e+00 0.0%
4: IoStage: 3.6459e+02 54.3% 0.0000e+00 0.0% 4.587e+05 0.0%
2.622e+01 31.3% 1.000e+02 2.1%
5: KspStage: 9.4361e+01 14.0% 4.5060e+13 88.0% 4.444e+08 13.2%
1.667e+01 19.9% 3.081e+03 63.8%
6: SolvAlloc: 2.2626e+00 0.3% 0.0000e+00 0.0% 3.604e+05 0.0%
1.217e-01 0.1% 3.330e+02 6.9%
7: SolvSolve: 1.0235e+01 1.5% 1.7448e+09 0.0% 9.830e+04 0.0%
2.391e-01 0.3% 1.200e+01 0.2%
8: SolvDeall: 1.5842e-02 0.0% 0.0000e+00 0.0% 0.000e+00 0.0%
0.000e+00 0.0% 0.000e+00 0.0%
9: MG Apply: 1.8982e+02 28.3% 6.0759e+12 11.9% 2.919e+09 86.7%
3.249e+01 38.7% 1.300e+03 26.9%
------------------------------------------------------------------------------------------------------------------------
See the 'Profiling' chapter of the users' manual for details on interpreting
output.
Phase summary info:
Count: number of times phase was executed
Time and Flops: Max - maximum over all processors
Ratio - ratio of maximum to minimum over all processors
Mess: number of messages sent
Avg. len: average message length
Reduct: number of global reductions
Global: entire computation
Stage: stages of a computation. Set stages with PetscLogStagePush() and
PetscLogStagePop().
%T - percent time in this phase %f - percent flops in this phase
%M - percent messages in this phase %L - percent message lengths in
this phase
%R - percent reductions in this phase
Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max time over all
processors)
------------------------------------------------------------------------------------------------------------------------
Event Count Time (sec) Flops
--- Global --- --- Stage --- Total
Max Ratio Max Ratio Max Ratio Mess Avg len
Reduct %T %f %M %L %R %T %f %M %L %R Mflop/s
------------------------------------------------------------------------------------------------------------------------
--- Event Stage 0: Main Stage
--- Event Stage 1: StepStage
VecAXPY 48 1.0 1.5407e-02 2.0 3.54e+06 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 99100 0 0 0 940849
--- Event Stage 2: ConvStage
VecCopy 72 1.0 2.6107e-02 1.4 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 7 0 0 0 0 0
VecAXPY 72 1.0 2.2448e-02 1.4 4.72e+06 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 5 26 0 0 0 860999
VecAXPBYCZ 84 1.0 4.1915e-02 1.3 1.10e+07 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 11 61 0 0 0 1075909
VecPointwiseMult 72 1.0 2.5126e-02 1.2 2.36e+06 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 7 13 0 0 0 384609
VecScatterBegin 120 1.0 6.1090e-02 1.9 0.00e+00 0.0 2.9e+06 8.2e+03
0.0e+00 0 0 0 9 0 12 0100100 0 0
VecScatterEnd 120 1.0 1.1047e-01 1.4 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 29 0 0 0 0 0
--- Event Stage 3: ProjStage
VecScale 4 1.0 2.4414e-04 2.2 1.31e+05 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 14 0 0 0 2199023
VecCopy 12 1.0 5.6450e-03 6.1 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 5 0 0 0 0 0
VecAXPY 12 1.0 3.9425e-03 8.0 7.86e+05 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 3 86 0 0 0 817054
VecScatterBegin 16 1.0 7.6387e-03 1.8 0.00e+00 0.0 3.9e+05 8.2e+03
0.0e+00 0 0 0 1 0 6 0100100 0 0
VecScatterEnd 16 1.0 2.1989e-02 3.6 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 13 0 0 0 0 0
--- Event Stage 4: IoStage
VecView 20 1.0 2.6112e+0211197.9 0.00e+00 0.0 0.0e+00 0.0e+00
4.0e+01 21 0 0 0 1 39 0 0 0 40 0
VecCopy 20 1.0 4.1862e-03 1.7 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecScatterBegin 12 1.0 3.5555e-03 1.8 0.00e+00 0.0 2.9e+05 8.2e+03
0.0e+00 0 0 0 1 0 0 0 64 3 0 0
VecScatterEnd 12 1.0 7.5151e+0160547.1 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 3 0 0 0 0 6 0 0 0 0 0
--- Event Stage 5: KspStage
VecMDot 21 1.0 4.4578e-02 2.7 3.67e+06 1.0 0.0e+00 0.0e+00
2.1e+01 0 0 0 0 0 0 0 0 0 1 337210
VecNorm 57 1.0 4.0502e-02 2.6 3.74e+06 1.0 0.0e+00 0.0e+00
5.7e+01 0 0 0 0 1 0 0 0 0 2 377777
VecScale 26 1.0 1.3385e-03 1.1 8.52e+05 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 2607178
VecCopy 31 1.0 7.8409e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecSet 156 1.0 6.1290e-03 1.3 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecAXPY 26 1.0 3.2058e-03 1.7 1.70e+06 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 2177108
VecAYPX 26 1.0 4.8437e-03 1.6 8.52e+05 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 720452
VecMAXPY 47 1.0 1.8381e-02 1.3 8.72e+06 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 1942289
VecScatterBegin 97 1.0 8.3990e-03 1.4 0.00e+00 0.0 1.9e+06 5.2e+03
0.0e+00 0 0 0 3 0 0 0 0 17 0 0
VecScatterEnd 97 1.0 5.4450e-02 3.4 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecNormalize 26 1.0 1.4583e-02 2.5 2.56e+06 1.0 0.0e+00 0.0e+00
2.6e+01 0 0 0 0 1 0 0 0 0 1 717896
MatMult 47 1.0 1.6683e-01 1.3 2.16e+07 1.0 1.2e+06 8.2e+03
0.0e+00 0 0 0 3 0 0 0 0 17 0 529370
MatMultTranspose 25 1.0 7.7603e-03 1.2 1.26e+06 1.0 7.2e+05 2.6e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 667090
MatLUFactorSym 5 1.0 9.5924e-01 1.2 0.00e+00 0.0 0.0e+00 0.0e+00
1.5e+01 0 0 0 0 0 1 0 0 0 0 0
MatLUFactorNum 5 1.0 3.3532e+01 1.0 1.09e+10 1.0 0.0e+00 0.0e+00
0.0e+00 5 87 0 0 0 35 99 0 0 0 1333065
MatAssemblyBegin 130 1.0 7.9255e-01 4.5 0.00e+00 0.0 0.0e+00 0.0e+00
1.5e+02 0 0 0 0 3 1 0 0 0 5 0
MatAssemblyEnd 130 1.0 1.9086e-01 1.3 0.00e+00 0.0 6.8e+06 4.5e+01
4.0e+02 0 0 0 0 8 0 0 2 1 13 0
MatGetRowIJ 5 1.0 6.3694e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatGetOrdering 5 1.0 4.2130e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
1.0e+01 0 0 0 0 0 0 0 0 0 0 0
MatView 70 1.2 2.7097e-02 2.5 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+01 0 0 0 0 1 0 0 0 0 2 0
MatPtAP 25 1.0 3.6540e+00 1.0 4.55e+07 1.0 1.5e+07 8.7e+02
6.8e+02 1 0 0 5 14 4 0 3 23 22 51010
MatPtAPSymbolic 25 1.0 8.0998e-01 1.0 0.00e+00 0.0 1.4e+07 6.9e+02
6.2e+02 0 0 0 3 13 1 0 3 17 20 0
MatPtAPNumeric 25 1.0 2.8595e+00 1.0 4.55e+07 1.0 7.2e+05 4.5e+03
5.0e+01 0 0 0 1 1 3 0 0 6 2 65182
MatGetRedundant 5 1.0 6.1452e+00 1.1 0.00e+00 0.0 2.5e+08 1.2e+02
2.0e+01 1 0 7 10 0 6 0 57 52 1 0
MatGetLocalMat 25 1.0 6.3210e-02 2.6 0.00e+00 0.0 0.0e+00 0.0e+00
5.0e+01 0 0 0 0 1 0 0 0 0 2 0
MatGetBrAoCol 25 1.0 1.1783e-01 1.9 0.00e+00 0.0 6.8e+06 1.2e+03
5.0e+01 0 0 0 3 1 0 0 2 14 2 0
MatGetSymTrans 50 1.0 9.1975e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 0
KSPGMRESOrthog 21 1.0 4.8957e-02 2.3 7.34e+06 1.0 0.0e+00 0.0e+00
2.1e+01 0 0 0 0 0 0 0 0 0 1 614106
KSPSetUp 40 1.0 1.0306e-01 1.4 0.00e+00 0.0 0.0e+00 0.0e+00
2.0e+02 0 0 0 0 4 0 0 0 0 6 0
KSPSolve 5 1.0 2.8417e+02 1.0 1.25e+10 1.0 3.4e+09 4.9e+01
4.3e+03 42100100 59 90 301113757295140 179947
PCSetUp 5 1.0 9.4727e+01 1.0 1.10e+10 1.0 4.4e+08 1.1e+02
2.7e+03 14 88 13 17 56 100100100 83 87 473904
PCApply 26 1.0 1.9041e+02 1.0 1.48e+09 1.0 2.9e+09 3.7e+01
1.3e+03 28 12 87 39 27 201 13657195 42 31910
MGSetup Level 0 1 1.0 5.4520e+01 1.0 2.18e+09 1.0 8.4e+07 7.3e+01
2.7e+01 8 17 2 2 1 58 20 19 11 1 163977
MGSetup Level 1 1 1.0 1.5559e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 2 1 1.0 1.3490e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 3 1 1.0 1.4379e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 4 1 1.0 2.0809e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 5 1 1.0 2.0609e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 0 1 1.0 8.8773e+00 1.0 2.18e+09 1.0 8.4e+07 7.3e+01
2.7e+01 1 17 2 2 1 9 20 19 11 1 1007064
MGSetup Level 1 1 1.0 1.1740e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 2 1 1.0 1.1399e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 3 1 1.0 1.2438e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 4 1 1.0 1.1642e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 5 1 1.0 1.8711e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 0 1 1.0 8.8315e+00 1.0 2.18e+09 1.0 8.4e+07 7.3e+01
2.7e+01 1 17 2 2 1 9 20 19 11 1 1012286
MGSetup Level 1 1 1.0 2.6200e-03 1.4 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 2 1 1.0 1.3020e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 3 1 1.0 1.1592e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 4 1 1.0 1.1511e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 5 1 1.0 1.7359e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 0 1 1.0 9.0600e+00 1.0 2.18e+09 1.0 8.4e+07 7.3e+01
2.7e+01 1 17 2 2 1 9 20 19 11 1 986750
MGSetup Level 1 1 1.0 1.3521e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 2 1 1.0 1.0810e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 3 1 1.0 1.3070e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 4 1 1.0 1.2069e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 5 1 1.0 1.9269e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 0 1 1.0 9.1177e+00 1.0 2.18e+09 1.0 8.4e+07 7.3e+01
2.7e+01 1 17 2 2 1 10 20 19 11 1 980513
MGSetup Level 1 1 1.0 1.4212e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 2 1 1.0 1.2362e-03 1.2 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 3 1 1.0 1.2891e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 4 1 1.0 1.1790e-03 1.0 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
MGSetup Level 5 1 1.0 1.7860e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
6.0e+00 0 0 0 0 0 0 0 0 0 0 0
--- Event Stage 6: SolvAlloc
VecSet 50 1.0 1.4619e-01 7.3 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 4 0 0 0 0 0
MatAssemblyBegin 4 1.0 5.9544e-02 6.1 0.00e+00 0.0 0.0e+00 0.0e+00
8.0e+00 0 0 0 0 0 1 0 0 0 2 0
MatAssemblyEnd 4 1.0 3.3315e-02 1.1 0.00e+00 0.0 9.8e+04 2.0e+03
1.6e+01 0 0 0 0 0 1 0 27 49 5 0
--- Event Stage 7: SolvSolve
VecNorm 12 1.0 2.0508e+013529.3 0.00e+00 0.0 0.0e+00 0.0e+00
1.2e+01 2 0 0 0 0 100 0 0 0100 0
VecScale 1 1.0 8.3923e-05 2.9 3.28e+04 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 8 0 0 0 1599290
VecCopy 6 1.0 2.3437e-03 6.2 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecAXPY 6 1.0 2.1067e-03 6.7 3.93e+05 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 92 0 0 0 764531
VecScatterBegin 4 1.0 3.1297e-03 1.8 0.00e+00 0.0 9.8e+04 8.2e+03
0.0e+00 0 0 0 0 0 0 0100100 0 0
VecScatterEnd 4 1.0 5.5318e-03 5.3 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 0
--- Event Stage 8: SolvDeall
--- Event Stage 9: MG Apply
VecMDot 250 1.0 2.0555e-01 2.2 2.06e+07 1.0 0.0e+00 0.0e+00
2.5e+02 0 0 0 0 5 0 1 0 0 19 410404
VecNorm 275 1.0 4.2012e-02 1.6 4.12e+06 1.0 0.0e+00 0.0e+00
2.8e+02 0 0 0 0 6 0 0 0 0 21 401611
VecScale 1835 1.0 1.5452e-02 1.3 6.51e+06 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 1725703
VecCopy 285 1.0 2.6994e-03 1.8 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecSet 1793 1.0 7.0033e-03 1.5 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecAXPY 3170 1.0 3.3056e-02 1.3 1.86e+07 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 1 0 0 0 2298583
VecAYPX 3250 1.0 5.5980e-02 1.2 1.21e+07 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 1 0 0 0 885314
VecMAXPY 275 1.0 3.9382e-02 1.1 2.43e+07 1.0 0.0e+00 0.0e+00
0.0e+00 0 0 0 0 0 0 2 0 0 0 2531654
VecScatterBegin 4097 1.0 2.5168e+01 3.2 0.00e+00 0.0 2.9e+09 3.7e+01
0.0e+00 3 0 87 39 0 10 0100100 0 0
VecScatterEnd 4097 1.0 1.7736e+02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00
0.0e+00 25 0 0 0 0 88 0 0 0 0 0
VecNormalize 275 1.0 4.6273e-02 1.5 6.18e+06 1.0 0.0e+00 0.0e+00
2.8e+02 0 0 0 0 6 0 0 0 0 21 546952
MatMult 2875 1.0 1.8335e+01 3.4 2.20e+08 1.0 2.8e+08 3.1e+02
0.0e+00 1 2 8 30 0 5 15 9 78 0 49193
MatMultAdd 390 1.0 9.9083e+0018.4 7.51e+06 1.0 1.1e+07 1.2e+02
0.0e+00 1 0 0 0 0 2 1 0 1 0 3105
MatMultTranspose 520 1.0 1.5965e+0010.4 1.41e+07 1.0 1.5e+07 1.5e+02
0.0e+00 0 0 0 1 0 0 1 1 2 0 36130
MatSolve 156 1.0 2.1702e+00 1.6 9.77e+08 1.0 0.0e+00 0.0e+00
0.0e+00 0 8 0 0 0 1 66 0 0 0 1844070
MatSOR 2615 1.0 1.1141e+00 1.1 1.78e+08 1.0 0.0e+00 0.0e+00
0.0e+00 0 1 0 0 0 1 12 0 0 0 655558
MatView 25 1.0 5.5473e-03 2.0 0.00e+00 0.0 0.0e+00 0.0e+00
2.5e+01 0 0 0 0 1 0 0 0 0 2 0
KSPGMRESOrthog 250 1.0 2.3644e-01 1.9 4.12e+07 1.0 0.0e+00 0.0e+00
2.5e+02 0 0 0 0 5 0 3 0 0 19 713578
KSPSetUp 25 1.0 9.4339e-01 4.7 0.00e+00 0.0 0.0e+00 0.0e+00
2.5e+02 0 0 0 0 5 0 0 0 0 19 0
KSPSolve 936 1.0 1.8826e+02 1.1 1.43e+09 1.0 2.9e+09 3.3e+01
1.3e+03 27 11 85 34 27 97 96 98 87100 31071
PCApply 2771 1.0 1.8160e+02 1.1 1.16e+09 1.0 2.6e+09 8.0e+00
0.0e+00 26 9 78 7 0 92 78 90 19 0 26058
MGSmooth Level 0 24 1.0 2.5841e+01 1.1 1.50e+08 1.0 4.0e+08 8.0e+00
0.0e+00 4 1 12 1 0 13 10 14 3 0 23826
MGSmooth Level 1 40 1.0 2.3332e+0016.6 7.33e+04 1.0 1.2e+07 1.7e+01
5.2e+01 0 0 0 0 1 0 0 0 0 4 129
MGResid Level 1 20 1.0 8.2547e-0217.7 8.80e+03 1.0 2.1e+06 1.7e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 437
MGInterp Level 1 48 1.0 2.4154e+00221.0 2.59e+03 1.0 1.4e+06 8.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 4
MGSmooth Level 2 32 1.0 6.3778e-0112.5 5.90e+05 1.0 1.0e+07 4.7e+01
5.2e+01 0 0 0 0 1 0 0 0 0 4 3789
MGResid Level 2 16 1.0 5.0234e-0213.1 5.63e+04 1.0 1.7e+06 4.7e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 4592
MGInterp Level 2 40 1.0 4.2881e-01131.6 1.73e+04 1.0 1.1e+06 2.2e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 165
MGSmooth Level 3 24 1.0 5.3460e-02 1.2 4.16e+06 1.0 8.0e+06 1.5e+02
5.2e+01 0 0 0 0 1 0 0 0 1 4 319012
MGResid Level 3 12 1.0 6.1336e-03 2.1 3.38e+05 1.0 1.3e+06 1.5e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 225664
MGInterp Level 3 32 1.0 2.5873e-0180.0 1.11e+05 1.0 9.2e+05 7.0e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 1751
MGSmooth Level 4 16 1.0 1.0150e-01 1.1 2.58e+07 1.0 5.9e+06 5.3e+02
5.2e+01 0 0 0 1 1 0 2 0 3 4 1039338
MGResid Level 4 8 1.0 5.6934e-03 1.4 1.80e+06 1.0 8.5e+05 5.3e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 1296577
MGInterp Level 4 24 1.0 2.4087e-0152.2 6.64e+05 1.0 6.9e+05 2.5e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 11283
MGSmooth Level 5 8 1.0 3.3459e-01 1.0 4.47e+07 1.0 8.6e+05 8.2e+03
5.2e+01 0 0 0 2 1 0 3 0 6 4 547503
MGResid Level 5 4 1.0 1.2396e-02 1.3 1.97e+06 1.0 9.8e+04 8.2e+03
0.0e+00 0 0 0 0 0 0 0 0 1 0 649658
MGInterp Level 5 16 1.0 3.7598e-0119.2 3.54e+06 1.0 4.6e+05 9.3e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 38554
MGSmooth Level 0 30 1.0 3.2777e+01 1.1 1.88e+08 1.0 5.0e+08 8.0e+00
0.0e+00 5 2 15 1 0 16 13 17 4 0 23480
MGSmooth Level 1 50 1.0 3.3483e+0019.5 8.95e+04 1.0 1.5e+07 1.7e+01
5.2e+01 0 0 0 0 1 1 0 1 0 4 110
MGResid Level 1 25 1.0 1.6569e-0130.9 1.10e+04 1.0 2.7e+06 1.7e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 272
MGInterp Level 1 60 1.0 3.3231e+00680.2 3.24e+03 1.0 1.7e+06 8.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 4
MGSmooth Level 2 40 1.0 7.9050e-0114.3 7.18e+05 1.0 1.2e+07 4.7e+01
5.2e+01 0 0 0 0 1 0 0 0 1 4 3721
MGResid Level 2 20 1.0 3.5753e-02 7.5 7.04e+04 1.0 2.1e+06 4.7e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 8065
MGInterp Level 2 50 1.0 5.5985e-01146.2 2.16e+04 1.0 1.4e+06 2.2e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 158
MGSmooth Level 3 30 1.0 6.2155e-02 1.3 5.03e+06 1.0 9.7e+06 1.5e+02
5.2e+01 0 0 0 1 1 0 0 0 1 4 331765
MGResid Level 3 15 1.0 1.1305e-02 3.7 4.22e+05 1.0 1.6e+06 1.5e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 153048
MGInterp Level 3 40 1.0 3.8209e-01101.7 1.38e+05 1.0 1.1e+06 7.0e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 1482
MGSmooth Level 4 20 1.0 1.1585e-01 1.1 3.08e+07 1.0 7.0e+06 5.3e+02
5.2e+01 0 0 0 1 1 0 2 0 3 4 1087811
MGResid Level 4 10 1.0 6.8018e-03 1.3 2.25e+06 1.0 1.1e+06 5.3e+02
0.0e+00 0 0 0 0 0 0 0 0 1 0 1356613
MGInterp Level 4 30 1.0 1.5521e-0128.1 8.29e+05 1.0 8.6e+05 2.5e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 21889
MGSmooth Level 5 10 1.0 3.2689e-01 1.0 5.11e+07 1.0 1.0e+06 8.2e+03
5.2e+01 0 0 0 3 1 0 3 0 8 4 640367
MGResid Level 5 5 1.0 1.6725e-02 1.4 2.46e+06 1.0 1.2e+05 8.2e+03
0.0e+00 0 0 0 0 0 0 0 0 1 0 601888
MGInterp Level 5 20 1.0 2.4798e-0110.0 4.42e+06 1.0 5.7e+05 9.3e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 73069
MGSmooth Level 0 30 1.0 3.5707e+01 1.1 1.88e+08 1.0 5.0e+08 8.0e+00
0.0e+00 5 2 15 1 0 18 13 17 4 0 21554
MGSmooth Level 1 50 1.0 3.3039e+0011.8 8.95e+04 1.0 1.5e+07 1.7e+01
5.2e+01 0 0 0 0 1 1 0 1 0 4 111
MGResid Level 1 25 1.0 1.3634e-0121.7 1.10e+04 1.0 2.7e+06 1.7e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 330
MGInterp Level 1 60 1.0 2.7394e+00527.8 3.24e+03 1.0 1.7e+06 8.0e+00
0.0e+00 0 0 0 0 0 0 0 0 0 0 5
MGSmooth Level 2 40 1.0 9.1679e-0111.0 7.18e+05 1.0 1.2e+07 4.7e+01
5.2e+01 0 0 0 0 1 0 0 0 1 4 3208
MGResid Level 2 20 1.0 7.1785e-0214.7 7.04e+04 1.0 2.1e+06 4.7e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 4017
MGInterp Level 2 50 1.0 5.1115e-01147.6 2.16e+04 1.0 1.4e+06 2.2e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 173
MGSmooth Level 3 30 1.0 6.1442e-02 1.2 5.03e+06 1.0 9.7e+06 1.5e+02
5.2e+01 0 0 0 1 1 0 0 0 1 4 335617
MGResid Level 3 15 1.0 7.9360e-03 2.5 4.22e+05 1.0 1.6e+06 1.5e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 218013
MGInterp Level 3 40 1.0 2.6162e-0167.2 1.38e+05 1.0 1.1e+06 7.0e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 2164
MGSmooth Level 4 20 1.0 1.1088e-01 1.1 3.08e+07 1.0 7.0e+06 5.3e+02
5.2e+01 0 0 0 1 1 0 2 0 3 4 1136519
MGResid Level 4 10 1.0 6.8250e-03 1.3 2.25e+06 1.0 1.1e+06 5.3e+02
0.0e+00 0 0 0 0 0 0 0 0 1 0 1352016
MGInterp Level 4 30 1.0 2.2836e-0138.8 8.29e+05 1.0 8.6e+05 2.5e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 14878
MGSmooth Level 5 10 1.0 3.2905e-01 1.0 5.11e+07 1.0 1.0e+06 8.2e+03
5.2e+01 0 0 0 3 1 0 3 0 8 4 636160
MGResid Level 5 5 1.0 1.5521e-02 1.3 2.46e+06 1.0 1.2e+05 8.2e+03
0.0e+00 0 0 0 0 0 0 0 0 1 0 648570
MGInterp Level 5 20 1.0 2.9873e-0112.1 4.42e+06 1.0 5.7e+05 9.3e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 60654
MGSmooth Level 0 36 1.0 4.3941e+01 1.1 2.25e+08 1.0 6.0e+08 8.0e+00
0.0e+00 6 2 18 2 0 22 15 21 4 0 21018
MGSmooth Level 1 60 1.0 3.7174e+0013.1 1.06e+05 1.0 1.8e+07 1.7e+01
5.2e+01 0 0 1 0 1 1 0 1 0 4 117
MGResid Level 1 30 1.0 1.6295e-0120.9 1.32e+04 1.0 3.2e+06 1.7e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 332
MGInterp Level 1 72 1.0 3.5079e+00490.6 3.89e+03 1.0 2.1e+06 8.0e+00
0.0e+00 0 0 0 0 0 1 0 0 0 0 5
MGSmooth Level 2 48 1.0 1.2006e+0017.2 8.46e+05 1.0 1.5e+07 4.7e+01
5.2e+01 0 0 0 0 1 0 0 0 1 4 2887
MGResid Level 2 24 1.0 6.0709e-02 9.8 8.45e+04 1.0 2.6e+06 4.7e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 5700
MGInterp Level 2 60 1.0 8.0356e-01207.5 2.59e+04 1.0 1.7e+06 2.2e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 132
MGSmooth Level 3 36 1.0 7.0747e-02 1.2 5.91e+06 1.0 1.1e+07 1.5e+02
5.2e+01 0 0 0 1 1 0 0 0 2 4 341890
MGResid Level 3 18 1.0 9.8090e-03 2.2 5.07e+05 1.0 1.9e+06 1.5e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 211660
MGInterp Level 3 48 1.0 2.5153e-0147.9 1.66e+05 1.0 1.4e+06 7.0e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 2701
MGSmooth Level 4 24 1.0 1.2681e-01 1.1 3.58e+07 1.0 8.2e+06 5.3e+02
5.2e+01 0 0 0 2 1 0 2 0 4 4 1155582
MGResid Level 4 12 1.0 7.9920e-03 1.2 2.70e+06 1.0 1.3e+06 5.3e+02
0.0e+00 0 0 0 0 0 0 0 0 1 0 1385501
MGInterp Level 4 36 1.0 1.6041e-0122.1 9.95e+05 1.0 1.0e+06 2.5e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 25416
MGSmooth Level 5 12 1.0 3.6647e-01 1.0 5.75e+07 1.0 1.2e+06 8.2e+03
5.2e+01 0 0 0 3 1 0 4 0 9 4 642901
MGResid Level 5 6 1.0 1.9434e-02 1.4 2.95e+06 1.0 1.5e+05 8.2e+03
0.0e+00 0 0 0 0 0 0 0 0 1 0 621563
MGInterp Level 5 24 1.0 2.6055e-01 8.5 5.31e+06 1.0 6.9e+05 9.3e+02
0.0e+00 0 0 0 0 0 0 0 0 1 0 83451
MGSmooth Level 0 36 1.0 4.5240e+01 1.2 2.25e+08 1.0 6.0e+08 8.0e+00
0.0e+00 6 2 18 2 0 23 15 21 4 0 20414
MGSmooth Level 1 60 1.0 4.3619e+0020.0 1.06e+05 1.0 1.8e+07 1.7e+01
5.2e+01 0 0 1 0 1 1 0 1 0 4 99
MGResid Level 1 30 1.0 1.4730e-0120.5 1.32e+04 1.0 3.2e+06 1.7e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 367
MGInterp Level 1 72 1.0 3.5583e+00610.7 3.89e+03 1.0 2.1e+06 8.0e+00
0.0e+00 0 0 0 0 0 1 0 0 0 0 4
MGSmooth Level 2 48 1.0 8.7782e-0110.1 8.46e+05 1.0 1.5e+07 4.7e+01
5.2e+01 0 0 0 0 1 0 0 0 1 4 3948
MGResid Level 2 24 1.0 4.1538e-02 6.8 8.45e+04 1.0 2.6e+06 4.7e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 8330
MGInterp Level 2 60 1.0 4.0416e-0178.0 2.59e+04 1.0 1.7e+06 2.2e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 263
MGSmooth Level 3 36 1.0 7.2884e-02 1.3 5.91e+06 1.0 1.1e+07 1.5e+02
5.2e+01 0 0 0 1 1 0 0 0 2 4 331863
MGResid Level 3 18 1.0 1.1254e-02 2.6 5.07e+05 1.0 1.9e+06 1.5e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 184487
MGInterp Level 3 48 1.0 2.9326e-0165.5 1.66e+05 1.0 1.4e+06 7.0e+01
0.0e+00 0 0 0 0 0 0 0 0 0 0 2317
MGSmooth Level 4 24 1.0 1.2857e-01 1.1 3.58e+07 1.0 8.2e+06 5.3e+02
5.2e+01 0 0 0 2 1 0 2 0 4 4 1139850
MGResid Level 4 12 1.0 1.0152e-02 1.6 2.70e+06 1.0 1.3e+06 5.3e+02
0.0e+00 0 0 0 0 0 0 0 0 1 0 1090681
MGInterp Level 4 36 1.0 1.6758e-0124.0 9.95e+05 1.0 1.0e+06 2.5e+02
0.0e+00 0 0 0 0 0 0 0 0 0 0 24328
MGSmooth Level 5 12 1.0 3.6468e-01 1.0 5.75e+07 1.0 1.2e+06 8.2e+03
5.2e+01 0 0 0 3 1 0 4 0 9 4 646050
MGResid Level 5 6 1.0 1.8821e-02 1.4 2.95e+06 1.0 1.5e+05 8.2e+03
0.0e+00 0 0 0 0 0 0 0 0 1 0 641815
MGInterp Level 5 24 1.0 2.4655e-01 8.2 5.31e+06 1.0 6.9e+05 9.3e+02
0.0e+00 0 0 0 0 0 0 0 0 1 0 88189
------------------------------------------------------------------------------------------------------------------------
Memory usage is given in bytes:
Object Type Creations Destructions Memory Descendants' Mem.
Reports information only for process 0.
--- Event Stage 0: Main Stage
Viewer 1 0 0 0
--- Event Stage 1: StepStage
--- Event Stage 2: ConvStage
--- Event Stage 3: ProjStage
Container 0 24 13152 0
Vector 0 616 41290592 0
Vector Scatter 0 128 132608 0
Matrix 0 168 175179360 0
Distributed Mesh 0 40 886464 0
Bipartite Graph 0 80 54720 0
Index Set 0 12 140000 0
IS L to G Mapping 0 60 490736 0
Krylov Solver 28 52 708640 0
Preconditioner 28 52 44640 0
--- Event Stage 4: IoStage
Vector 20 20 5272800 0
Viewer 20 20 13760 0
--- Event Stage 5: KspStage
Container 30 0 0 0
Vector 629 232 15473320 0
Vector Scatter 185 25 25900 0
Matrix 210 0 0 0
Distributed Mesh 50 0 0 0
Bipartite Graph 100 0 0 0
Index Set 435 420 824140 0
IS L to G Mapping 75 0 0 0
Krylov Solver 30 0 0 0
Preconditioner 30 0 0 0
Viewer 5 5 3560 0
--- Event Stage 6: SolvAlloc
Vector 140 6 8848 0
Vector Scatter 6 0 0 0
Matrix 6 0 0 0
Matrix Null Space 1 0 0 0
Distributed Mesh 2 0 0 0
Bipartite Graph 4 0 0 0
Index Set 14 14 372400 0
IS L to G Mapping 3 0 0 0
Krylov Solver 7 0 0 0
Preconditioner 7 0 0 0
Viewer 1 0 0 0
--- Event Stage 7: SolvSolve
Matrix Null Space 0 1 580 0
Krylov Solver 7 7 8192 0
Preconditioner 7 7 6416 0
--- Event Stage 8: SolvDeall
Container 0 6 3288 0
Vector 0 282 46205592 0
Vector Scatter 0 33 34188 0
Matrix 0 45 48414516 0
Distributed Mesh 0 10 221616 0
Bipartite Graph 0 20 13680 0
Index Set 0 3 35000 0
IS L to G Mapping 0 15 122684 0
Krylov Solver 0 13 177160 0
Preconditioner 0 13 11160 0
--- Event Stage 9: MG Apply
Vector 375 0 0 0
========================================================================================================================
Average time to get PetscTime(): 1.90735e-07
Average time for MPI_Barrier(): 4.88281e-05
Average time for zero size MPI_Send(): 1.68436e-06
#PETSc Option Table entries:
-ksp_converged_reason
-ksp_monitor
-ksp_monitor_true_residual
-ksp_view
-log_summary
-options_left
-pc_mg_galerkin
-pc_mg_levels 6
-pc_mg_type full
-pc_type mg
On Tuesday 30 September 2014 02:13:55 Barry Smith wrote:
> http://lmgtfy.com/?q=HPGMG
...
>
> On Sep 30, 2014, at 1:59 AM, Filippo Leonardi
<filippo.leonardi at sam.math.ethz.ch> wrote:
> > Thank you everybody, number of iterations seems now to be under control,
> > I'll run some scaling test and hope for the best.
> >
> > Now I am intrigued, is there, by any chance, any reference I can look up
> > for this?
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ETHZ.vcf
Type: text/vcard
Size: 594 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20141001/4cdd8a75/attachment-0001.bin>
More information about the petsc-users
mailing list