[petsc-users] How to investigate the reason for slow convergence rate?
Bao Kai
paeanball at gmail.com
Sun Jul 22 09:22:59 CDT 2012
Hi, Jed,
The following is the output. Two equations are solved during each
time steps. One is using bicgstab is already very fast, the other one
is using gmres+ml.
The log_summary output can found in the end of the output.
Best Regards,
Kai
> Message: 6
> Date: Sun, 22 Jul 2012 07:16:07 -0500
> From: Jed Brown <jedbrown at mcs.anl.gov>
> To: PETSc users list <petsc-users at mcs.anl.gov>
> Subject: Re: [petsc-users] How to investigate the reason for slow
> convergence rate?
> Message-ID:
> <CAM9tzSkxKz5FwFJJPZz0UO5eN-S45QsdQxmo7xnH345R1EdTEQ at mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Please send -log_summary output with performance questions.
>
> On Sun, Jul 22, 2012 at 4:01 AM, Bao Kai <paeanball at gmail.com> wrote:
>
>> Hi, Matt,
>>
>> I tried ML6.2 with petsc3.3 with default parameters by only specifying
>> the preconditioner to be PCML. The KSP solver is gmres.
>>
>> The convergence rate is much faster, while it still took much longer
>> time in total.
>>
>> For example, for the problem with 500^3 mesh ( 125 million unknowns )
>> with 512nodes(4 processors per node) on bluegene/P , it tooks about
>> ten iterations to get convergent while the total time used is about
>> 400 seconds.
>>
>> 506 the KSP type is gmres
>> 507 the PC type is ml
>> 508 KSP rtol = 0.100000000000000008E-04 abstol =
>> 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
>> 509 SNES rtol = 0.100000000000000002E-07 abstol =
>> 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit =
>> 50 maxf= 10000
>> 510 0 SNES Function norm 5.859593121800e+02
>> 511 0 KSP Residual norm 8.340827070202e+06
>> 512 1 KSP Residual norm 7.980806572332e+05
>> 513 2 KSP Residual norm 1.870896731234e+05
>> 514 3 KSP Residual norm 6.790580947452e+04
>> 515 4 KSP Residual norm 2.665552335248e+04
>> 516 5 KSP Residual norm 1.130212349885e+04
>> 517 6 KSP Residual norm 4.053599972292e+03
>> 518 7 KSP Residual norm 1.786770710693e+03
>> 519 8 KSP Residual norm 7.313571654931e+02
>> 520 9 KSP Residual norm 3.205683714450e+02
>> 521 10 KSP Residual norm 1.263243312734e+02
>> 522 11 KSP Residual norm 3.945082815178e+01
>> 523 1 SNES Function norm 9.378772067642e-02
>> 524 0 KSP Residual norm 5.413489711800e+01
>> 525 1 KSP Residual norm 1.442598710609e+01
>> 526 2 KSP Residual norm 4.073537172140e+00
>> 527 3 KSP Residual norm 1.157455598705e+00
>> 528 4 KSP Residual norm 3.509855901968e-01
>> 529 5 KSP Residual norm 1.160625342728e-01
>> 530 6 KSP Residual norm 3.209351890216e-02
>> 531 7 KSP Residual norm 7.780869881329e-03
>> 532 8 KSP Residual norm 1.820828886636e-03
>> 533 9 KSP Residual norm 4.172544590190e-04
>> 534 2 SNES Function norm 6.747963806680e-07
>> 535 Number of KSP iteration is 9
>> 536 SNES solve takes time 406.724867261176314
>>
>> But with bcgs and bjacobi, it tooks about 550 KSP iterations ( 2 snes
>> iterations ) and 69 seconds to get the result.
>>
>> For much smaller problems, benefiting from the fast convergence, it
>> did takes less time to get the result. It seems that the ml can not be
>> scaled, or I used it in a wrong way.
>>
>> Best Regards,
>> Kai
>>
>>
>> > Message: 2
>> > Date: Sat, 21 Jul 2012 08:47:10 -0500
>> > From: Matthew Knepley <knepley at gmail.com>
>> > To: PETSc users list <petsc-users at mcs.anl.gov>
>> > Subject: Re: [petsc-users] How to investigate the reason for slow
>> > convergence rate?
>> > Message-ID:
>> > <
>> CAMYG4GkfV6kmTFEKXUadOv+2CrKHk9hRY7UR-cFWf+vcRxCv5g at mail.gmail.com>
>> > Content-Type: text/plain; charset="iso-8859-1"
>> >
>> > On Sat, Jul 21, 2012 at 4:30 AM, Bao Kai <paeanball at gmail.com> wrote:
>> >
>> >>
>> >>> HI, all,
>> >>
>> >> I am still suffering from the slow convergence rate of the KSP
>> >> solution.
>> >>
>> >> I changed the code to use Petsc3.3 and then try the gamg
>> >> precoditioner,
>> >> the convergence rate is better, while it took more total time because
>> >> it
>> >> took much more time for each iteration and some extra time for
>> >> pre-processing.
>> >>
>> >
>> > Try ML to see if it has better defaults for your problem. If not, you
>> will
>> > have to start experimenting with the solver
>> > parameters.
>> >
>> >
>> >> I am wondering if there are some ways that can help me to investigate
>> the
>> >> slow convergence rate for KSP solution so that I can do some
>> improvement.
>> >> Is DMMG will be a good solution?
>> >>
>> >
>> > No.
>> >
>> > Matt
>> >
>> >
>> >> Thank you very much.
>> >>
>> >> Best Regards,
>> >> Kai
>> >>
>> >>>
>> >>> Message: 2
>> >>> Date: Wed, 11 Jul 2012 15:17:15 -0500
>> >>> From: Matthew Knepley <knepley at gmail.com>
>> >>> To: PETSc users list <petsc-users at mcs.anl.gov>
>> >>> Subject: Re: [petsc-users] Does this mean the matrix is
>> >>> ill-conditioned?
>> >>> Message-ID:
>> >>> <CAMYG4Gk7T=
>> >>> q+w1PKO7G_TW07iDzux90Sncbv9K7d0FD-MDrLRg at mail.gmail.com>
>> >>> Content-Type: text/plain; charset="iso-8859-1"
>> >>>
>> >>> On Wed, Jul 11, 2012 at 12:40 PM, Bao Kai <paeanball at gmail.com>
>> >>> wrote:
>> >>>
>> >>> > Hi, all,
>> >>> >
>> >>> > The following is the output from the solution of a Poisson equation
>> >>> > from Darcy's law.
>> >>> >
>> >>> > To compute the condition number of matrix, I did not use PC and use
>> >>> > GMRES KSP to do the test.
>> >>> >
>> >>> > It seems like that the condition number keep increasing during the
>> >>> > iterative solution. Does this mean the matrix is ill-conditioned?
>> >>> >
>> >>>
>> >>> Generally yes. Krylov methods take a long time to resolve the
>> >>> smallest
>> >>> eigenvalues, so this approximation is not great.
>> >>>
>> >>>
>> >>> > For this test, it did not achieve convergence with 10000
>> >>> > iterations.
>> >>> >
>> >>> > When I use BJOCABI PC and BICGSTAB KSP, it generally takes about
>> >>> > 600
>> >>> > times iteration to get the iteration convergent.
>> >>> >
>> >>> > Any suggestion for improving the convergence rate will be much
>> >>> > appreciated. The solution of this equation has been the bottleneck
>> of
>> >>> > my code, it takes more than 90% of the total time.
>> >>> >
>> >>>
>> >>> Try ML or GAMG.
>> >>>
>> >>> Matt
>> >>>
>> >>>
>> >>> > Thank you very much.
>> >>> >
>> >>> > Best Regards,
>> >>> > Kai
>> >>> >
>> >>>
>> >>>
>> >>>
>> >
>> >
>> > --
>> > What most experimenters take for granted before they begin their
>> > experiments is infinitely more interesting than any results to which
>> their
>> > experiments lead.
>> > -- Norbert Wiener
>> > -------------- next part --------------
>> > An HTML attachment was scrubbed...
>> > URL:
>> > <
>> http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20120721/eaf7b2ee/attachment-0001.html
>> >
>> >
>> > ------------------------------
>> >
>>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL:
> <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20120722/7f782dd6/attachment.html>
>
> ------------------------------
>
> _______________________________________________
> petsc-users mailing list
> petsc-users at mcs.anl.gov
> https://lists.mcs.anl.gov/mailman/listinfo/petsc-users
>
>
> End of petsc-users Digest, Vol 43, Issue 61
> *******************************************
>
-------------- next part --------------
RST runs on 2048 processors.
Calculating the coloring takes time 76.9829076376470596
Start the simulation of RST_advection on a 3D rectanguluar mesh of size 500x500x500.
call solve_CO2(conc) ...
solve_CO2 starts iT = 1 (tCurr= 0.000000000000000000E+00 , tNext= 360.000000000000000 ) using backwardEuler
the memory used initially in SolveNE_option is 780578816.000000000 in 0 th processor
Calculating the Jacobian matrix using multi-coloring finite difference
Calculating the Jacobian matrix using multi-coloring finite difference, end
Calculating the Jacobian matrix takes time 0.362482352898041427E-04
the KSP type is bcgs
the PC type is bjacobi
KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000
0 SNES Function norm 2.027142332274e+05
0 KSP Residual norm 1.329836410984e+05
1 KSP Residual norm 2.003138625439e+02
2 KSP Residual norm 1.080655908195e+00
1 SNES Function norm 2.603715471664e+00
0 KSP Residual norm 1.821752606793e+00
1 KSP Residual norm 2.261877896690e-02
2 KSP Residual norm 5.689587885989e-04
3 KSP Residual norm 7.904719695607e-06
2 SNES Function norm 1.303262560403e-05
Number of KSP iteration is 3
SNES solve takes time 6.39838860470588600
Number of Newton iterations = 2
the SNES Converged Reason is 3
the memory used finally in SolveNE_option is 928034816.000000000 in 0 th processor
solve_NE for concentration equations took time 6.40435670941175772
the memory used initially in SolveNE_option is 928034816.000000000 in 0 th processor
Calculating the Jacobian matrix using multi-coloring finite difference
Calculating the Jacobian matrix using multi-coloring finite difference, end
Calculating the Jacobian matrix takes time 0.465729411871507182E-04
the KSP type is gmres
the PC type is ml
KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000
0 SNES Function norm 6.854305936118e+02
0 KSP Residual norm 8.373098135096e+06
1 KSP Residual norm 7.298874883063e+05
2 KSP Residual norm 1.312057861504e+05
3 KSP Residual norm 2.940040817676e+04
4 KSP Residual norm 5.550730454363e+03
5 KSP Residual norm 9.403163430181e+02
6 KSP Residual norm 1.989882957671e+02
7 KSP Residual norm 3.776734457069e+01
1 SNES Function norm 1.128845203882e-01
0 KSP Residual norm 3.642500285026e+01
1 KSP Residual norm 1.088628928189e+01
2 KSP Residual norm 2.261263906033e+00
3 KSP Residual norm 5.225048266035e-01
4 KSP Residual norm 1.744244938506e-01
5 KSP Residual norm 5.392736524647e-02
6 KSP Residual norm 1.561840513585e-02
7 KSP Residual norm 3.216915891215e-03
8 KSP Residual norm 8.352256776033e-04
9 KSP Residual norm 2.616795560745e-04
2 SNES Function norm 4.222128984457e-07
Number of KSP iteration is 9
SNES solve takes time 396.688963249411700
Number of Newton iterations = 2
the SNES Converged Reason is 3
the memory used finally in SolveNE_option is 1108242432.00000000 in 0 th processor
solve_NE for flow equations took time 396.693956828235287
solve_CO2 starts iT = 2 (tCurr= 360.000000000000000 , tNext= 720.000000000000000 ) using backwardEuler
the memory used initially in SolveNE_option is 1108242432.00000000 in 0 th processor
Calculating the Jacobian matrix using multi-coloring finite difference
Calculating the Jacobian matrix using multi-coloring finite difference, end
Calculating the Jacobian matrix takes time 0.738905881689788657E-04
the KSP type is bcgs
the PC type is bjacobi
KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000
0 SNES Function norm 1.744975811532e+07
0 KSP Residual norm 6.042616216530e+06
1 KSP Residual norm 2.411229464574e+06
2 KSP Residual norm 9.384253591517e+05
3 KSP Residual norm 8.172654250461e+05
4 KSP Residual norm 3.278806775039e+05
5 KSP Residual norm 1.892646740749e+05
6 KSP Residual norm 1.688085534614e+05
7 KSP Residual norm 1.070929112445e+05
8 KSP Residual norm 8.894975127847e+04
9 KSP Residual norm 8.439037109644e+04
10 KSP Residual norm 2.210751081503e+05
11 KSP Residual norm 8.018906048020e+05
12 KSP Residual norm 2.463740463795e+05
13 KSP Residual norm 4.701709773936e+05
14 KSP Residual norm 2.572534693760e+05
15 KSP Residual norm 1.400576861591e+06
16 KSP Residual norm 6.843908357621e+04
17 KSP Residual norm 6.835423406956e+04
18 KSP Residual norm 3.306744876360e+05
19 KSP Residual norm 1.274200720122e+05
20 KSP Residual norm 2.864430197567e+05
21 KSP Residual norm 6.303052018354e+04
22 KSP Residual norm 1.040766852733e+04
23 KSP Residual norm 1.403019031174e+04
24 KSP Residual norm 8.304296941412e+03
25 KSP Residual norm 5.063990038197e+03
26 KSP Residual norm 2.072491899897e+04
27 KSP Residual norm 2.833725405550e+04
28 KSP Residual norm 6.025326846882e+02
29 KSP Residual norm 2.012835940363e+02
30 KSP Residual norm 9.871182569019e+01
31 KSP Residual norm 7.994364942410e+01
32 KSP Residual norm 8.722846666516e+01
33 KSP Residual norm 3.278037987095e+01
1 SNES Function norm 5.359315696689e+02
0 KSP Residual norm 3.278037984348e+01
1 KSP Residual norm 5.111266391765e+01
2 KSP Residual norm 1.548643476480e+01
3 KSP Residual norm 1.155495193877e+01
4 KSP Residual norm 7.125481575618e+00
5 KSP Residual norm 9.024848561174e+00
6 KSP Residual norm 2.257573584187e+00
7 KSP Residual norm 5.418784129233e-01
8 KSP Residual norm 3.719657020252e-01
9 KSP Residual norm 1.205608997222e-01
10 KSP Residual norm 3.615255985887e+00
11 KSP Residual norm 2.894677555372e-02
12 KSP Residual norm 1.376453957581e-03
13 KSP Residual norm 4.166968255993e-04
14 KSP Residual norm 4.913433524474e-04
15 KSP Residual norm 9.839518905020e-05
2 SNES Function norm 2.253731138673e-03
Number of KSP iteration is 15
SNES solve takes time 11.2357833341176274
Number of Newton iterations = 2
the SNES Converged Reason is 3
the memory used finally in SolveNE_option is 1092841472.00000000 in 0 th processor
solve_NE for concentration equations took time 11.2626100023528579
the memory used initially in SolveNE_option is 1092841472.00000000 in 0 th processor
Calculating the Jacobian matrix using multi-coloring finite difference
Calculating the Jacobian matrix using multi-coloring finite difference, end
Calculating the Jacobian matrix takes time 0.392435293861126411E-04
the KSP type is gmres
the PC type is ml
KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000
0 SNES Function norm 6.168715721071e+02
0 KSP Residual norm 7.978767835480e+06
1 KSP Residual norm 8.728618105505e+05
2 KSP Residual norm 4.558368047941e+05
3 KSP Residual norm 4.346984519871e+05
4 KSP Residual norm 2.286709358986e+05
5 KSP Residual norm 1.332498617875e+05
6 KSP Residual norm 1.264578916032e+05
7 KSP Residual norm 1.058066886132e+05
8 KSP Residual norm 4.688543293468e+04
9 KSP Residual norm 1.706033347392e+04
10 KSP Residual norm 7.798848104292e+03
11 KSP Residual norm 5.313346550965e+03
12 KSP Residual norm 4.267989536057e+03
13 KSP Residual norm 4.104126803381e+03
14 KSP Residual norm 4.082103088618e+03
15 KSP Residual norm 3.730866428917e+03
16 KSP Residual norm 2.662009656165e+03
17 KSP Residual norm 1.507688407744e+03
18 KSP Residual norm 1.117001235096e+03
19 KSP Residual norm 1.019680471256e+03
20 KSP Residual norm 1.008960551221e+03
21 KSP Residual norm 1.007162979788e+03
22 KSP Residual norm 9.787062543248e+02
23 KSP Residual norm 8.700126671308e+02
24 KSP Residual norm 5.076825476614e+02
25 KSP Residual norm 1.697222557097e+02
26 KSP Residual norm 5.606185528901e+01
1 SNES Function norm 1.303677605733e-01
0 KSP Residual norm 1.275643534800e+02
1 KSP Residual norm 1.755473787471e+01
2 KSP Residual norm 4.019549783414e+00
3 KSP Residual norm 7.944360565021e-01
4 KSP Residual norm 1.499573425904e-01
5 KSP Residual norm 2.452264940057e-02
6 KSP Residual norm 5.066981841293e-03
7 KSP Residual norm 9.904807389870e-04
2 SNES Function norm 3.389130418502e-06
Number of KSP iteration is 7
SNES solve takes time 433.673481138823490
Number of Newton iterations = 2
the SNES Converged Reason is 3
the memory used finally in SolveNE_option is 1161392128.00000000 in 0 th processor
solve_NE for flow equations took time 433.678236383529452
solve_CO2 starts iT = 3 (tCurr= 720.000000000000000 , tNext= 1080.00000000000000 ) using backwardEuler
the memory used initially in SolveNE_option is 1161392128.00000000 in 0 th processor
Calculating the Jacobian matrix using multi-coloring finite difference
Calculating the Jacobian matrix using multi-coloring finite difference, end
Calculating the Jacobian matrix takes time 0.611341175726920483E-04
the KSP type is bcgs
the PC type is bjacobi
KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000
0 SNES Function norm 1.746230911748e+07
0 KSP Residual norm 6.056016610516e+06
1 KSP Residual norm 2.410588606648e+06
2 KSP Residual norm 9.456442885758e+05
3 KSP Residual norm 8.094818865575e+05
4 KSP Residual norm 3.287134485841e+05
5 KSP Residual norm 1.896118306005e+05
6 KSP Residual norm 1.754760017003e+05
7 KSP Residual norm 1.074211675332e+05
8 KSP Residual norm 8.892934191703e+04
9 KSP Residual norm 8.425895560687e+04
10 KSP Residual norm 2.210542597785e+05
11 KSP Residual norm 7.832399341096e+05
12 KSP Residual norm 2.473533515058e+05
13 KSP Residual norm 4.614685234415e+05
14 KSP Residual norm 2.551240693195e+05
15 KSP Residual norm 1.373194764628e+06
16 KSP Residual norm 6.869917844180e+04
17 KSP Residual norm 6.827906464339e+04
18 KSP Residual norm 3.315401022229e+05
19 KSP Residual norm 1.282764833555e+05
20 KSP Residual norm 2.897981334419e+05
21 KSP Residual norm 6.308627435161e+04
22 KSP Residual norm 1.045231001236e+04
23 KSP Residual norm 1.491143524048e+04
24 KSP Residual norm 8.656791195722e+03
25 KSP Residual norm 5.045336356514e+03
26 KSP Residual norm 2.166365912996e+04
27 KSP Residual norm 3.094664062274e+04
28 KSP Residual norm 6.117301214046e+02
29 KSP Residual norm 2.012060974502e+02
30 KSP Residual norm 9.900282227487e+01
31 KSP Residual norm 8.011585552510e+01
32 KSP Residual norm 8.686592920308e+01
33 KSP Residual norm 3.278618019592e+01
1 SNES Function norm 5.356912110054e+02
0 KSP Residual norm 3.278618016861e+01
1 KSP Residual norm 5.118173917522e+01
2 KSP Residual norm 1.548726082616e+01
3 KSP Residual norm 1.156812789566e+01
4 KSP Residual norm 7.149486136715e+00
5 KSP Residual norm 7.980447622207e+00
6 KSP Residual norm 2.184234814452e+00
7 KSP Residual norm 5.474499778219e-01
8 KSP Residual norm 3.733409066648e-01
9 KSP Residual norm 1.199274608307e-01
10 KSP Residual norm 3.099768217390e-01
11 KSP Residual norm 2.932626926870e-02
12 KSP Residual norm 1.398491373209e-03
13 KSP Residual norm 4.172815233796e-04
14 KSP Residual norm 6.539192013676e-04
15 KSP Residual norm 9.719451000433e-05
2 SNES Function norm 2.224809336173e-03
Number of KSP iteration is 15
SNES solve takes time 11.2320685176470079
Number of Newton iterations = 2
the SNES Converged Reason is 3
the memory used finally in SolveNE_option is 1145991168.00000000 in 0 th processor
solve_NE for concentration equations took time 11.2598186258823034
the memory used initially in SolveNE_option is 1145991168.00000000 in 0 th processor
Calculating the Jacobian matrix using multi-coloring finite difference
Calculating the Jacobian matrix using multi-coloring finite difference, end
Calculating the Jacobian matrix takes time 0.531258823457392282E-04
the KSP type is gmres
the PC type is ml
KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000
0 SNES Function norm 5.906457664566e+02
0 KSP Residual norm 7.912814686693e+06
1 KSP Residual norm 9.645782297768e+05
2 KSP Residual norm 8.861064046254e+05
3 KSP Residual norm 4.897630000578e+05
4 KSP Residual norm 3.166880917820e+05
5 KSP Residual norm 3.069992066317e+05
6 KSP Residual norm 1.923010666939e+05
7 KSP Residual norm 9.534057223926e+04
8 KSP Residual norm 5.617225030104e+04
9 KSP Residual norm 5.000967170570e+04
10 KSP Residual norm 4.988510808219e+04
11 KSP Residual norm 4.377142165464e+04
12 KSP Residual norm 3.537339493753e+04
13 KSP Residual norm 3.444119180522e+04
14 KSP Residual norm 3.140632281962e+04
15 KSP Residual norm 2.387794289515e+04
16 KSP Residual norm 2.029305730532e+04
17 KSP Residual norm 1.944823332521e+04
18 KSP Residual norm 1.926082773332e+04
19 KSP Residual norm 1.604520680206e+04
20 KSP Residual norm 1.083092031672e+04
21 KSP Residual norm 5.980890172430e+03
22 KSP Residual norm 4.230302343358e+03
23 KSP Residual norm 3.473716174483e+03
24 KSP Residual norm 2.539150935402e+03
25 KSP Residual norm 1.225826890173e+03
26 KSP Residual norm 3.869466816538e+02
27 KSP Residual norm 1.166013359601e+02
28 KSP Residual norm 3.948921651246e+01
1 SNES Function norm 9.374214140858e-02
0 KSP Residual norm 4.314990451734e+01
1 KSP Residual norm 3.515946386829e+01
2 KSP Residual norm 2.695621438095e+01
3 KSP Residual norm 1.390235007360e+01
4 KSP Residual norm 1.386211256871e+01
5 KSP Residual norm 7.834323161908e+00
6 KSP Residual norm 5.517283406603e+00
7 KSP Residual norm 5.426656354145e+00
8 KSP Residual norm 3.458546275824e+00
9 KSP Residual norm 2.340650733306e+00
10 KSP Residual norm 2.308443591276e+00
11 KSP Residual norm 1.978019536730e+00
12 KSP Residual norm 1.751838848414e+00
13 KSP Residual norm 1.748423642827e+00
14 KSP Residual norm 1.558995531050e+00
15 KSP Residual norm 1.434334333026e+00
16 KSP Residual norm 1.429581841785e+00
17 KSP Residual norm 1.234896777884e+00
18 KSP Residual norm 1.113705072932e+00
19 KSP Residual norm 1.113002183375e+00
20 KSP Residual norm 1.000636547921e+00
21 KSP Residual norm 7.666212672065e-01
22 KSP Residual norm 4.954697001390e-01
23 KSP Residual norm 3.763741385658e-01
24 KSP Residual norm 3.061802852706e-01
25 KSP Residual norm 2.172246927676e-01
26 KSP Residual norm 1.263551553515e-01
27 KSP Residual norm 8.065653452946e-02
28 KSP Residual norm 6.666958151528e-02
29 KSP Residual norm 5.969554338215e-02
30 KSP Residual norm 4.701119423782e-02
31 KSP Residual norm 3.880526060321e-02
32 KSP Residual norm 3.550352775410e-02
33 KSP Residual norm 3.518508431556e-02
34 KSP Residual norm 3.365882337676e-02
35 KSP Residual norm 2.990974854198e-02
36 KSP Residual norm 2.960135454716e-02
37 KSP Residual norm 2.642485998975e-02
38 KSP Residual norm 2.207970762270e-02
39 KSP Residual norm 2.207627751574e-02
40 KSP Residual norm 1.939485668126e-02
41 KSP Residual norm 1.826512902599e-02
42 KSP Residual norm 1.776217373211e-02
43 KSP Residual norm 1.494313801753e-02
44 KSP Residual norm 1.491723533996e-02
45 KSP Residual norm 1.294925018292e-02
46 KSP Residual norm 1.031091165182e-02
47 KSP Residual norm 9.274721439823e-03
48 KSP Residual norm 9.199144088117e-03
49 KSP Residual norm 7.380758295213e-03
50 KSP Residual norm 5.312928096668e-03
51 KSP Residual norm 3.590846812049e-03
52 KSP Residual norm 3.453458627238e-03
53 KSP Residual norm 2.682574287054e-03
54 KSP Residual norm 1.535180831843e-03
55 KSP Residual norm 1.124868394925e-03
56 KSP Residual norm 9.042295611229e-04
57 KSP Residual norm 6.864456305576e-04
58 KSP Residual norm 4.500332684970e-04
59 KSP Residual norm 2.315845183804e-04
2 SNES Function norm 5.750728763041e-07
Number of KSP iteration is 59
SNES solve takes time 577.862047618823453
Number of Newton iterations = 2
the SNES Converged Reason is 3
the memory used finally in SolveNE_option is 1161392128.00000000 in 0 th processor
solve_NE for flow equations took time 577.867189442352810
solve_CO2 starts iT = 4 (tCurr= 1080.00000000000000 , tNext= 1440.00000000000000 ) using backwardEuler
the memory used initially in SolveNE_option is 1161392128.00000000 in 0 th processor
Calculating the Jacobian matrix using multi-coloring finite difference
Calculating the Jacobian matrix using multi-coloring finite difference, end
Calculating the Jacobian matrix takes time 0.689435294134455035E-04
the KSP type is bcgs
the PC type is bjacobi
KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000
0 SNES Function norm 1.747595578968e+07
0 KSP Residual norm 6.070738647764e+06
1 KSP Residual norm 2.410071228327e+06
2 KSP Residual norm 9.549253739214e+05
3 KSP Residual norm 7.981187668861e+05
4 KSP Residual norm 3.291532237393e+05
5 KSP Residual norm 1.900364740271e+05
6 KSP Residual norm 1.808298981550e+05
7 KSP Residual norm 1.077099555482e+05
8 KSP Residual norm 8.894381121663e+04
9 KSP Residual norm 8.417853266785e+04
10 KSP Residual norm 2.201981533464e+05
11 KSP Residual norm 7.709268659791e+05
12 KSP Residual norm 2.479014722435e+05
13 KSP Residual norm 4.666147266566e+05
14 KSP Residual norm 2.558241680066e+05
15 KSP Residual norm 1.373629431710e+06
16 KSP Residual norm 6.911910203172e+04
17 KSP Residual norm 6.842401632722e+04
18 KSP Residual norm 3.306049474142e+05
19 KSP Residual norm 1.283124304691e+05
20 KSP Residual norm 2.909356471676e+05
21 KSP Residual norm 6.322781226246e+04
22 KSP Residual norm 1.055406528283e+04
23 KSP Residual norm 1.769757469826e+04
24 KSP Residual norm 9.622138538562e+03
25 KSP Residual norm 5.002105247328e+03
26 KSP Residual norm 2.226851519086e+04
27 KSP Residual norm 3.333932229927e+04
28 KSP Residual norm 6.154801922084e+02
29 KSP Residual norm 2.017271873264e+02
30 KSP Residual norm 9.927125290556e+01
31 KSP Residual norm 8.026861874655e+01
32 KSP Residual norm 8.676016243921e+01
33 KSP Residual norm 3.299156885807e+01
1 SNES Function norm 5.386668000559e+02
0 KSP Residual norm 3.299156885877e+01
1 KSP Residual norm 5.156932987442e+01
2 KSP Residual norm 1.559190093665e+01
3 KSP Residual norm 1.166013674890e+01
4 KSP Residual norm 7.234093208644e+00
5 KSP Residual norm 7.150545499500e+00
6 KSP Residual norm 2.129440698767e+00
7 KSP Residual norm 5.576694756879e-01
8 KSP Residual norm 3.788441553969e-01
9 KSP Residual norm 1.193654283561e-01
10 KSP Residual norm 1.595986614454e-01
11 KSP Residual norm 2.993377362791e-02
12 KSP Residual norm 1.432762216316e-03
13 KSP Residual norm 4.171238217969e-04
14 KSP Residual norm 9.270694825671e-04
15 KSP Residual norm 9.451948560740e-05
2 SNES Function norm 2.164055274017e-03
Number of KSP iteration is 15
SNES solve takes time 11.2357321717647665
Number of Newton iterations = 2
the SNES Converged Reason is 3
the memory used finally in SolveNE_option is 1145991168.00000000 in 0 th processor
solve_NE for concentration equations took time 11.2634957200000372
the memory used initially in SolveNE_option is 1145991168.00000000 in 0 th processor
Calculating the Jacobian matrix using multi-coloring finite difference
Calculating the Jacobian matrix using multi-coloring finite difference, end
Calculating the Jacobian matrix takes time 0.580552941755740903E-04
the KSP type is gmres
the PC type is ml
KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000
0 SNES Function norm 5.637544127911e+02
0 KSP Residual norm 8.074132757094e+06
1 KSP Residual norm 8.162289267400e+05
2 KSP Residual norm 2.485691052163e+05
3 KSP Residual norm 1.694979473006e+05
4 KSP Residual norm 1.692597553909e+05
5 KSP Residual norm 1.141369714739e+05
6 KSP Residual norm 5.411385565863e+04
7 KSP Residual norm 2.907568800779e+04
8 KSP Residual norm 2.195670663729e+04
9 KSP Residual norm 1.987662933665e+04
10 KSP Residual norm 1.984128544322e+04
11 KSP Residual norm 1.896159506872e+04
12 KSP Residual norm 1.529241417387e+04
13 KSP Residual norm 1.159676508149e+04
14 KSP Residual norm 8.386589100387e+03
15 KSP Residual norm 6.545195108415e+03
16 KSP Residual norm 4.670526409709e+03
17 KSP Residual norm 2.616131111174e+03
18 KSP Residual norm 1.340432005158e+03
19 KSP Residual norm 6.930110261487e+02
20 KSP Residual norm 3.501481900693e+02
21 KSP Residual norm 1.624612621900e+02
22 KSP Residual norm 8.693046524046e+01
23 KSP Residual norm 6.266502671985e+01
1 SNES Function norm 6.161796268733e-02
0 KSP Residual norm 6.116148118636e+02
1 KSP Residual norm 5.230020822749e+01
2 KSP Residual norm 8.211943951986e+00
3 KSP Residual norm 1.666142209341e+00
4 KSP Residual norm 3.507550432364e-01
5 KSP Residual norm 6.165808645033e-02
6 KSP Residual norm 1.202676243967e-02
7 KSP Residual norm 2.481833379192e-03
2 SNES Function norm 8.769102970782e-06
0 KSP Residual norm 2.228753345052e-03
1 KSP Residual norm 7.086547861298e-04
2 KSP Residual norm 2.208481325117e-04
3 KSP Residual norm 1.451575632052e-04
4 KSP Residual norm 1.418274746815e-04
5 KSP Residual norm 9.951896679242e-05
6 KSP Residual norm 6.710322416550e-05
7 KSP Residual norm 4.951304989493e-05
8 KSP Residual norm 4.517130650698e-05
9 KSP Residual norm 4.516237226608e-05
10 KSP Residual norm 4.204281863840e-05
11 KSP Residual norm 3.107532296876e-05
12 KSP Residual norm 2.213892288359e-05
13 KSP Residual norm 1.311130661770e-05
14 KSP Residual norm 7.469402767238e-06
15 KSP Residual norm 4.676669974107e-06
16 KSP Residual norm 3.240876159844e-06
17 KSP Residual norm 3.034954224512e-06
18 KSP Residual norm 3.032806716269e-06
19 KSP Residual norm 2.969785088371e-06
20 KSP Residual norm 2.538694624997e-06
21 KSP Residual norm 1.879982074346e-06
22 KSP Residual norm 1.255296471142e-06
23 KSP Residual norm 7.489364422265e-07
24 KSP Residual norm 5.322075248129e-07
25 KSP Residual norm 4.222735297804e-07
26 KSP Residual norm 3.111446552243e-07
27 KSP Residual norm 1.943375346943e-07
28 KSP Residual norm 1.065696516704e-07
29 KSP Residual norm 5.044714108566e-08
30 KSP Residual norm 2.083483747171e-08
3 SNES Function norm 5.372515919004e-11
Number of KSP iteration is 30
SNES solve takes time 690.774282409411626
Number of Newton iterations = 3
the SNES Converged Reason is 3
the memory used finally in SolveNE_option is 1161392128.00000000 in 0 th processor
solve_NE for flow equations took time 690.779385967058715
solve_CO2 starts iT = 5 (tCurr= 1440.00000000000000 , tNext= 1800.00000000000000 ) using backwardEuler
the memory used initially in SolveNE_option is 1161392128.00000000 in 0 th processor
Calculating the Jacobian matrix using multi-coloring finite difference
Calculating the Jacobian matrix using multi-coloring finite difference, end
Calculating the Jacobian matrix takes time 0.581070585212728474E-04
the KSP type is bcgs
the PC type is bjacobi
KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000
0 SNES Function norm 1.748870969739e+07
0 KSP Residual norm 6.086246201886e+06
1 KSP Residual norm 2.409389735394e+06
2 KSP Residual norm 9.622200928047e+05
3 KSP Residual norm 7.845100008720e+05
4 KSP Residual norm 3.296569920221e+05
5 KSP Residual norm 1.904589431018e+05
6 KSP Residual norm 1.844373287795e+05
7 KSP Residual norm 1.079285086282e+05
8 KSP Residual norm 8.891984486588e+04
9 KSP Residual norm 8.405179802744e+04
10 KSP Residual norm 2.194780141626e+05
11 KSP Residual norm 7.570843689971e+05
12 KSP Residual norm 2.482349011189e+05
13 KSP Residual norm 4.706092657967e+05
14 KSP Residual norm 2.563244095318e+05
15 KSP Residual norm 1.372950386269e+06
16 KSP Residual norm 6.944283147672e+04
17 KSP Residual norm 6.854632103265e+04
18 KSP Residual norm 3.267800586436e+05
19 KSP Residual norm 1.276852156441e+05
20 KSP Residual norm 2.929806690176e+05
21 KSP Residual norm 6.332255447748e+04
22 KSP Residual norm 1.065666927107e+04
23 KSP Residual norm 2.179427377587e+04
24 KSP Residual norm 1.090989269498e+04
25 KSP Residual norm 4.954750321830e+03
26 KSP Residual norm 2.290314834484e+04
27 KSP Residual norm 3.659049402840e+04
28 KSP Residual norm 6.198874437352e+02
29 KSP Residual norm 2.022064043710e+02
30 KSP Residual norm 9.950110754634e+01
31 KSP Residual norm 8.035889596931e+01
32 KSP Residual norm 8.653039748403e+01
33 KSP Residual norm 3.313695971119e+01
1 SNES Function norm 5.407716079365e+02
0 KSP Residual norm 3.313695972687e+01
1 KSP Residual norm 5.184734109949e+01
2 KSP Residual norm 1.566968138836e+01
3 KSP Residual norm 1.172734056613e+01
4 KSP Residual norm 7.295499990009e+00
5 KSP Residual norm 6.644562948205e+00
6 KSP Residual norm 2.090067616380e+00
7 KSP Residual norm 5.650798874604e-01
8 KSP Residual norm 3.828248875064e-01
9 KSP Residual norm 1.188237451760e-01
10 KSP Residual norm 1.219837906646e-01
11 KSP Residual norm 3.044197530806e-02
12 KSP Residual norm 1.437855652708e-03
13 KSP Residual norm 4.252496839951e-04
14 KSP Residual norm 1.998111152480e-04
2 SNES Function norm 4.503925443016e-03
Number of KSP iteration is 14
SNES solve takes time 11.1125425270588494
Number of Newton iterations = 2
the SNES Converged Reason is 3
the memory used finally in SolveNE_option is 1145991168.00000000 in 0 th processor
solve_NE for concentration equations took time 11.1403631105881686
the memory used initially in SolveNE_option is 1145991168.00000000 in 0 th processor
Calculating the Jacobian matrix using multi-coloring finite difference
Calculating the Jacobian matrix using multi-coloring finite difference, end
Calculating the Jacobian matrix takes time 0.470929412585974205E-04
the KSP type is gmres
the PC type is ml
KSP rtol = 0.100000000000000008E-04 abstol = 0.100000000000000001E-49 dtol = 10000.0000000000000 maxit = 10000
SNES rtol = 0.100000000000000002E-07 abstol = 0.100000000000000001E-49 stol = 0.100000000000000002E-07 maxit = 50 maxf= 10000
0 SNES Function norm 5.419004356488e+02
0 KSP Residual norm 8.261643592794e+06
1 KSP Residual norm 7.386189854719e+05
2 KSP Residual norm 1.584330883846e+05
3 KSP Residual norm 3.364196291575e+04
4 KSP Residual norm 7.368389136171e+03
5 KSP Residual norm 1.543727655193e+03
6 KSP Residual norm 3.911584281708e+02
7 KSP Residual norm 7.263753586758e+01
1 SNES Function norm 2.079911111668e-01
0 KSP Residual norm 6.479513763967e+01
1 KSP Residual norm 2.048884277583e+01
2 KSP Residual norm 1.594847809383e+01
3 KSP Residual norm 1.364588964425e+01
4 KSP Residual norm 6.269501761207e+00
5 KSP Residual norm 4.035896337551e+00
6 KSP Residual norm 4.031872117187e+00
7 KSP Residual norm 2.768850078744e+00
8 KSP Residual norm 1.403725412629e+00
9 KSP Residual norm 7.626536014837e-01
10 KSP Residual norm 6.202328834215e-01
11 KSP Residual norm 5.350435338368e-01
12 KSP Residual norm 4.666283999150e-01
13 KSP Residual norm 3.994738205585e-01
14 KSP Residual norm 2.771523168855e-01
15 KSP Residual norm 2.055070828125e-01
16 KSP Residual norm 1.791698744783e-01
17 KSP Residual norm 1.461949045869e-01
18 KSP Residual norm 9.828913420095e-02
19 KSP Residual norm 5.776184245190e-02
20 KSP Residual norm 3.376848313794e-02
21 KSP Residual norm 2.191994279649e-02
22 KSP Residual norm 1.907722095018e-02
23 KSP Residual norm 1.857170395786e-02
24 KSP Residual norm 1.828402291612e-02
25 KSP Residual norm 1.788622756769e-02
26 KSP Residual norm 1.688091022039e-02
27 KSP Residual norm 1.340769361306e-02
28 KSP Residual norm 7.135059196478e-03
29 KSP Residual norm 2.447119579046e-03
30 KSP Residual norm 7.151815788560e-04
31 KSP Residual norm 2.848411909092e-04
2 SNES Function norm 8.677875468083e-07
Number of KSP iteration is 31
SNES solve takes time 447.630811501176595
Number of Newton iterations = 2
the SNES Converged Reason is 3
the memory used finally in SolveNE_option is 1161392128.00000000 in 0 th processor
solve_NE for flow equations took time 447.635830009412075
The simulation takes time (no initialization and finalization) 2598.08699473647039
The time for the flow equation solving (SNES) is 2546.65459863058823
The time for the concentration equation solving (SNES) is 51.3306441682352670
The total time for SNES is 2597.98524279882349
solve_CO2(conc) done.
************************************************************************************************************************
*** WIDEN YOUR WINDOW TO 120 CHARACTERS. Use 'enscript -r -fCourier9' to print this document ***
************************************************************************************************************************
---------------------------------------------- PETSc Performance Summary: ----------------------------------------------
./rst on a arch-shah named ionode65 with 2048 processors, by Unknown Sun Jul 22 16:50:55 2012
Using Petsc Release Version 3.3.0, Patch 2, Fri Jul 13 15:42:00 CDT 2012
Max Max/Min Avg Total
Time (sec): 2.675e+03 1.00001 2.675e+03
Objects: 4.818e+03 1.00000 4.818e+03
Flops: 1.466e+10 1.11589 1.377e+10 2.820e+13
Flops/sec: 5.478e+06 1.11589 5.148e+06 1.054e+10
MPI Messages: 2.549e+06 18.36763 1.762e+06 3.609e+09
MPI Message Lengths: 3.313e+08 2.11656 1.667e+02 6.017e+11
MPI Reductions: 5.812e+03 1.00000
Flop counting convention: 1 flop = 1 real number operation of type (multiply/divide/add/subtract)
e.g., VecAXPY() for real vectors of length N --> 2N flops
and VecAXPY() for complex vectors of length N --> 8N flops
Summary of Stages: ----- Time ------ ----- Flops ----- --- Messages --- -- Message Lengths -- -- Reductions --
Avg %Total Avg %Total counts %Total Avg %Total counts %Total
0: Main Stage: 2.6754e+03 100.0% 2.8204e+13 100.0% 3.609e+09 100.0% 1.667e+02 100.0% 5.811e+03 100.0%
------------------------------------------------------------------------------------------------------------------------
See the 'Profiling' chapter of the users' manual for details on interpreting output.
Phase summary info:
Count: number of times phase was executed
Time and Flops: Max - maximum over all processors
Ratio - ratio of maximum to minimum over all processors
Mess: number of messages sent
Avg. len: average message length
Reduct: number of global reductions
Global: entire computation
Stage: stages of a computation. Set stages with PetscLogStagePush() and PetscLogStagePop().
%T - percent time in this phase %f - percent flops in this phase
%M - percent messages in this phase %L - percent message lengths in this phase
%R - percent reductions in this phase
Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max time over all processors)
------------------------------------------------------------------------------------------------------------------------
Event Count Time (sec) Flops --- Global --- --- Stage --- Total
Max Ratio Max Ratio Max Ratio Mess Avg len Reduct %T %f %M %L %R %T %f %M %L %R Mflop/s
------------------------------------------------------------------------------------------------------------------------
--- Event Stage 0: Main Stage
PetscBarrier 10 1.0 1.1748e-0211.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
SNESSolve 10 1.0 2.5979e+03 1.0 1.47e+10 1.1 3.6e+09 1.7e+02 5.7e+03 97100100100 98 97100100100 98 10857
SNESFunctionEval 31 1.0 9.2333e-01 1.2 0.00e+00 0.0 1.4e+06 3.5e+03 2.0e+00 0 0 0 1 0 0 0 0 1 0 0
SNESJacobianEval 21 1.0 5.0506e+01 1.0 7.33e+07 1.1 2.7e+07 3.5e+03 4.5e+01 2 1 1 16 1 2 1 1 16 1 2812
SNESLineSearch 21 1.0 1.2610e+00 1.0 8.81e+07 1.1 1.9e+06 3.5e+03 8.4e+01 0 1 0 1 1 0 1 0 1 1 134858
VecDot 413 1.0 1.4155e+00 4.7 5.33e+07 1.1 0.0e+00 0.0e+00 4.1e+02 0 0 0 0 7 0 0 0 0 7 72941
VecDotNorm2 196 1.0 1.1593e+00 9.0 5.06e+07 1.1 0.0e+00 0.0e+00 2.0e+02 0 0 0 0 3 0 0 0 0 3 84533
VecMDot 234 1.0 3.7595e+00 2.4 3.90e+08 1.1 0.0e+00 0.0e+00 2.3e+02 0 3 0 0 4 0 3 0 0 4 200889
VecNorm 496 1.0 1.1166e+00 2.5 6.40e+07 1.1 0.0e+00 0.0e+00 5.0e+02 0 0 0 0 9 0 0 0 0 9 111056
VecScale 4693 1.0 2.9463e-01 1.4 3.52e+07 1.5 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 224870
VecCopy 642 1.0 2.3825e-01 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecSet 2769 1.0 1.2421e-01 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
VecAXPY 2064 1.0 7.9276e-01 1.4 1.15e+08 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 280230
VecAYPX 1482 1.0 4.0547e-01 1.2 1.98e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 94524
VecAXPBYCZ 392 1.0 7.8397e-01 1.3 1.01e+08 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 250009
VecWAXPY 413 1.0 2.6542e-01 1.3 5.19e+07 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 379120
VecMAXPY 247 1.0 1.4193e+00 1.2 4.20e+08 1.1 0.0e+00 0.0e+00 0.0e+00 0 3 0 0 0 0 3 0 0 0 573348
VecScatterBegin 7853 1.0 4.9287e+0127.9 0.00e+00 0.0 3.4e+09 1.8e+02 0.0e+00 0 0 94100 0 0 0 94100 0 0
VecScatterEnd 7853 1.0 4.1848e+02 1.8 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 13 0 0 0 0 13 0 0 0 0 0
VecReduceArith 52 1.0 2.3512e-02 1.1 6.71e+06 1.1 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 552907
VecReduceComm 31 1.0 9.8284e-02 5.7 0.00e+00 0.0 0.0e+00 0.0e+00 3.1e+01 0 0 0 0 1 0 0 0 0 1 0
VecNormalize 247 1.0 6.7727e-01 1.8 4.78e+07 1.1 0.0e+00 0.0e+00 2.5e+02 0 0 0 0 4 0 0 0 0 4 136762
MatMult 3723 1.0 1.7651e+02 5.4 3.85e+09 1.1 8.6e+08 2.3e+02 0.0e+00 5 26 24 32 0 5 26 24 32 0 42048
MatMultAdd 1482 1.0 2.3328e+0211.6 3.97e+07 1.1 0.0e+00 0.0e+00 2.2e+01 3 0 0 0 0 3 0 0 0 0 329
MatSolve 649 1.0 1.0815e+01 1.1 1.30e+09 1.1 0.0e+00 0.0e+00 0.0e+00 0 9 0 0 0 0 9 0 0 0 233096
MatSOR 2964 1.0 3.9407e+02 3.9 8.07e+09 1.1 2.5e+09 1.1e+02 9.9e+02 11 55 69 47 17 11 55 69 47 17 39298
MatLUFactorSym 11 1.0 1.1463e-03 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 3.3e+01 0 0 0 0 1 0 0 0 0 1 0
MatLUFactorNum 21 1.0 2.4922e+00 1.1 1.45e+08 1.1 0.0e+00 0.0e+00 0.0e+00 0 1 0 0 0 0 1 0 0 0 112406
MatILUFactorSym 5 1.0 2.2485e-01 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 5.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatAssemblyBegin 110 1.0 2.6155e+00 5.1 0.00e+00 0.0 0.0e+00 0.0e+00 1.8e+02 0 0 0 0 3 0 0 0 0 3 0
MatAssemblyEnd 110 1.0 4.2814e+00 2.7 0.00e+00 0.0 7.1e+07 2.1e+01 5.4e+02 0 0 2 0 9 0 0 2 0 9 0
MatGetRowIJ 16 1.0 1.3113e-04 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatGetOrdering 16 1.0 1.4726e-02 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 3.2e+01 0 0 0 0 1 0 0 0 0 1 0
MatZeroEntries 21 1.0 1.0455e-01 1.1 0.00e+00 0.0 0.0e+00 0.0e+00 0.0e+00 0 0 0 0 0 0 0 0 0 0 0
MatFDColorCreate 1 1.0 7.6147e+01 1.0 0.00e+00 0.0 8.9e+04 8.7e+02 9.2e+01 3 0 0 0 2 3 0 0 0 2 0
MatFDColorApply 21 1.0 5.0506e+01 1.0 7.33e+07 1.1 2.7e+07 3.5e+03 4.5e+01 2 1 1 16 1 2 1 1 16 1 2812
MatFDColorFunc 588 1.0 1.8813e+01 1.2 0.00e+00 0.0 2.6e+07 3.5e+03 0.0e+00 1 0 1 15 0 1 0 1 15 0 0
MatGetRedundant 11 1.0 1.0325e+01 1.3 0.00e+00 0.0 1.4e+08 6.0e+00 4.4e+01 0 0 4 0 1 0 0 4 0 1 0
KSPGMRESOrthog 234 1.0 4.9073e+00 1.7 7.80e+08 1.1 0.0e+00 0.0e+00 2.3e+02 0 5 0 0 4 0 5 0 0 4 307807
KSPSetUp 119 1.0 8.7377e-02 1.3 0.00e+00 0.0 0.0e+00 0.0e+00 2.4e+02 0 0 0 0 4 0 0 0 0 4 0
KSPSolve 21 1.0 2.5458e+03 1.0 1.45e+10 1.1 3.6e+09 1.4e+02 5.5e+03 95 99 99 83 95 95 99 99 83 95 10955
PCSetUp 31 1.0 1.9466e+03 1.0 5.28e+08 1.1 2.2e+08 1.1e+02 2.9e+03 73 4 6 4 50 73 4 6 4 50 524
PCSetUpOnBlocks 10 1.0 2.7321e+00 1.1 1.45e+08 1.1 0.0e+00 0.0e+00 1.5e+01 0 1 0 0 0 0 1 0 0 0 102534
PCApply 649 1.0 5.8003e+02 1.0 1.06e+10 1.1 3.3e+09 1.1e+02 1.0e+03 22 72 92 63 17 22 72 92 63 17 35241
------------------------------------------------------------------------------------------------------------------------
Memory usage is given in bytes:
Object Type Creations Destructions Memory Descendants' Mem.
Reports information only for process 0.
--- Event Stage 0: Main Stage
Container 13 13 4212 0
SNES 1 1 812 0
SNESLineSearch 1 1 536 0
Vector 3975 3975 476579708 0
Vector Scatter 92 92 58512 0
Matrix 371 371 223370840 0
Matrix FD Coloring 1 1 13832832 0
Distributed Mesh 3 3 608136 0
Bipartite Graph 6 6 2424 0
Index Set 260 260 2533560 0
IS L to G Mapping 2 2 301224 0
Viewer 1 0 0 0
Krylov Solver 46 46 118572 0
Preconditioner 46 46 27124 0
========================================================================================================================
Average time to get PetscTime(): 3.50475e-06
Average time for MPI_Barrier(): 3.76701e-06
Average time for zero size MPI_Send(): 1.35483e-05
#PETSc Option Table entries:
-ksp_monitor
-log_summary
-snes_monitor
#End of PETSc Option Table entries
Compiled with FORTRAN kernels
Compiled with full precision matrices (default)
sizeof(short) 2 sizeof(int) 4 sizeof(long) 4 sizeof(void*) 4 sizeof(PetscScalar) 8 sizeof(PetscInt) 4
Configure run at: Sat Jul 21 18:38:13 2012
Configure options: --known-bits-per-byte=8 --known-level1-dcache-assoc=0 --known-level1-dcache-linesize=32 --known-level1-dcache-size=32768 --known-memcmp-ok --known-mpi-long-double=1 --known-mpi-shared-libraries=0 --known-sizeof-MPI_Comm=4 --known-sizeof-MPI_Fint=4 --known-sizeof-char=1 --known-sizeof-double=8 --known-sizeof-float=4 --known-sizeof-int=4 --known-sizeof-long-long=8 --known-sizeof-long=4 --known-sizeof-short=2 --known-sizeof-size_t=4 --known-sizeof-void-p=4 --with-batch=1 --download-f-blas-lapack=1 --with-cc=mpixlc_r --with-cxx=mpixlcxx_r --with-debugging=0 --with-fc="mpixlf77_r -qnosave" --with-fortran-kernels=1 --with-is-color-value-type=short --with-shared-libraries=0 --with-x=0 -COPTFLAGS="-O3 -qarch=450d -qtune=450 -qmaxmem=-1" -CXXOPTFLAGS="-O3 -qarch=450d -qtune=450 -qmaxmem=-1" -FOPTFLAGS="-O3 -qarch=450d -qtune=450 -qmaxmem=-1" --download-ml=1 PETSC_ARCH=arch-shaheen-bgp-opt
-----------------------------------------
Libraries compiled on Sat Jul 21 18:38:13 2012 on fen1
Machine characteristics: Linux-2.6.16.60-0.93.1-ppc64-ppc64-with-SuSE-10-ppc
Using PETSc directory: /home/kaibao/petsc-3.3-p2
Using PETSc arch: arch-shaheen-bgp-opt
-----------------------------------------
Using C compiler: mpixlc_r -O3 -qarch=450d -qtune=450 -qmaxmem=-1 ${COPTFLAGS} ${CFLAGS}
Using Fortran compiler: mpixlf77_r -qnosave -O3 -qarch=450d -qtune=450 -qmaxmem=-1 ${FOPTFLAGS} ${FFLAGS}
-----------------------------------------
Using include paths: -I/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/include -I/home/kaibao/petsc-3.3-p2/include -I/home/kaibao/petsc-3.3-p2/include -I/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/include -I/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/default/include -I/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/sys/include
-----------------------------------------
Using C linker: mpixlc_r
Using Fortran linker: mpixlf77_r -qnosave
Using libraries: -Wl,-rpath,/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/lib -L/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/lib -lpetsc -lpthread -Wl,-rpath,/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/lib -L/home/kaibao/petsc-3.3-p2/arch-shaheen-bgp-opt/lib -lml -L/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/default/lib -L/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/sys/lib -L/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/runtime/SPI -L/opt/ibmcmp/xlsmp/bg/1.7/bglib -L/opt/ibmcmp/xlmass/bg/4.4/bglib -L/opt/ibmcmp/vac/bg/9.0/bglib -L/opt/ibmcmp/vacpp/bg/9.0/bglib -L/bgsys/drivers/ppcfloor/gnu-linux/lib/gcc/powerpc-bgp-linux/4.1.2 -L/bgsys/drivers/ppcfloor/gnu-linux/powerpc-bgp-linux/lib -Wl,-rpath,/opt/ibmcmp/lib/bg/bglib -Wl,-rpath,/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/default/lib -Wl,-rpath,/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/comm/sys/lib -Wl,-rpath,/bgsys/drivers/V1R4M2_200_2010-100508P/ppc/runtime/SPI -lcxxmpich.cnk -libmc++ -lstdc++ -lflapack -lfblas -L/opt/ibmcmp/xlf/bg/11.1/bglib -lxlf90_r -lxlomp_ser -lxlfmath -lm -lcxxmpich.cnk -libmc++ -lstdc++ -lcxxmpich.cnk -libmc++ -lstdc++ -ldl -lmpich.cnk -lopa -ldcmf.cnk -ldcmfcoll.cnk -lpthread -lSPI.cna -lrt -lxlopt -lxl -lgcc_eh -ldl
-----------------------------------------
Finish RST_CO2.
Finish interpreting the file infile_RSTi.m by RST.
after mpi_finalize: ierr = 0
More information about the petsc-users
mailing list