Multigrid Questions

Barry Smith bsmith at mcs.anl.gov
Wed Aug 26 15:49:39 CDT 2009


   No, I want it on the nonworking two-level case. Isn't that your  
goal to do multigrid? If one level is working and you are happy with  
it then why send the email?

    Barry

On Aug 26, 2009, at 3:45 PM, Hal Finkel wrote:

> Barry,
>
> Here is the output with those options in the (working) 1-level case  
> on 1 cpu. Is that what you wanted?
>
>  0 SNES Function norm 6.643976542462e-01
>    0 KSP preconditioned resid norm 6.643976542462e-01 true resid  
> norm 6.643976542462e-01 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.438911631652e-03 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.438911631652e-03 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 5.141505633982e-04 true resid  
> norm 1.970012522193e-01 ||Ae||/||Ax|| 1.970012522193e-01
>      1 KSP preconditioned resid norm 5.141505633982e-04 true resid  
> norm 1.970012522193e-01 ||Ae||/||Ax|| 1.970012522193e-01
>    1 KSP preconditioned resid norm 4.790430472989e-02 true resid  
> norm 4.790430472989e-02 ||Ae||/||Ax|| 7.210185710881e-02
>      0 KSP preconditioned resid norm 8.314136308720e-03 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 8.314136308720e-03 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.510029589596e-03 true resid  
> norm 5.934134865465e-01 ||Ae||/||Ax|| 5.934134865465e-01
>      1 KSP preconditioned resid norm 4.510029589596e-03 true resid  
> norm 5.934134865465e-01 ||Ae||/||Ax|| 5.934134865465e-01
>    2 KSP preconditioned resid norm 8.487458086567e-03 true resid  
> norm 8.487458086567e-03 ||Ae||/||Ax|| 1.277466594339e-02
>      0 KSP preconditioned resid norm 6.119493660032e-02 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 6.119493660032e-02 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.236002849750e-02 true resid  
> norm 7.814908146189e-01 ||Ae||/||Ax|| 7.814908146189e-01
>      1 KSP preconditioned resid norm 2.236002849750e-02 true resid  
> norm 7.814908146189e-01 ||Ae||/||Ax|| 7.814908146189e-01
>    3 KSP preconditioned resid norm 5.965466932886e-03 true resid  
> norm 5.965466932886e-03 ||Ae||/||Ax|| 8.978759775506e-03
>      0 KSP preconditioned resid norm 1.765708232662e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.765708232662e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.422901024605e-02 true resid  
> norm 6.919985015683e-01 ||Ae||/||Ax|| 6.919985015683e-01
>      1 KSP preconditioned resid norm 2.422901024605e-02 true resid  
> norm 6.919985015683e-01 ||Ae||/||Ax|| 6.919985015683e-01
>    4 KSP preconditioned resid norm 4.622977909431e-03 true resid  
> norm 4.622977909431e-03 ||Ae||/||Ax|| 6.958149054087e-03
>      0 KSP preconditioned resid norm 8.428635776507e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 8.428635776507e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.071459298111e-02 true resid  
> norm 4.423943234439e-01 ||Ae||/||Ax|| 4.423943234439e-01
>      1 KSP preconditioned resid norm 1.071459298111e-02 true resid  
> norm 4.423943234439e-01 ||Ae||/||Ax|| 4.423943234439e-01
>    5 KSP preconditioned resid norm 2.949006884559e-03 true resid  
> norm 2.949006884560e-03 ||Ae||/||Ax|| 4.438617243322e-03
>      0 KSP preconditioned resid norm 4.221520918573e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 4.221520918573e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.795668593850e-02 true resid  
> norm 8.064343336541e-01 ||Ae||/||Ax|| 8.064343336541e-01
>      1 KSP preconditioned resid norm 1.795668593850e-02 true resid  
> norm 8.064343336541e-01 ||Ae||/||Ax|| 8.064343336541e-01
>    6 KSP preconditioned resid norm 1.327402359192e-03 true resid  
> norm 1.327402359192e-03 ||Ae||/||Ax|| 1.997903440370e-03
>      0 KSP preconditioned resid norm 3.239330680409e-02 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.239330680409e-02 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.103583195381e-02 true resid  
> norm 5.910503837805e-01 ||Ae||/||Ax|| 5.910503837805e-01
>      1 KSP preconditioned resid norm 1.103583195381e-02 true resid  
> norm 5.910503837805e-01 ||Ae||/||Ax|| 5.910503837805e-01
>    7 KSP preconditioned resid norm 5.579319891254e-04 true resid  
> norm 5.579319891255e-04 ||Ae||/||Ax|| 8.397561092512e-04
>      0 KSP preconditioned resid norm 2.166256693843e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.166256693843e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.527142494434e-02 true resid  
> norm 3.938455942305e-01 ||Ae||/||Ax|| 3.938455942305e-01
>      1 KSP preconditioned resid norm 2.527142494434e-02 true resid  
> norm 3.938455942305e-01 ||Ae||/||Ax|| 3.938455942305e-01
>    8 KSP preconditioned resid norm 1.841437265702e-04 true resid  
> norm 1.841437265703e-04 ||Ae||/||Ax|| 2.771589053535e-04
>      0 KSP preconditioned resid norm 1.097958713832e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.097958713832e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.070826208815e-02 true resid  
> norm 5.960016421595e-01 ||Ae||/||Ax|| 5.960016421595e-01
>      1 KSP preconditioned resid norm 4.070826208815e-02 true resid  
> norm 5.960016421595e-01 ||Ae||/||Ax|| 5.960016421595e-01
>    9 KSP preconditioned resid norm 6.545738966234e-05 true resid  
> norm 6.545738966232e-05 ||Ae||/||Ax|| 9.852140392726e-05
>      0 KSP preconditioned resid norm 9.668719808206e-02 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 9.668719808206e-02 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 7.944112488019e-02 true resid  
> norm 7.461779305230e-01 ||Ae||/||Ax|| 7.461779305230e-01
>      1 KSP preconditioned resid norm 7.944112488019e-02 true resid  
> norm 7.461779305230e-01 ||Ae||/||Ax|| 7.461779305230e-01
>   10 KSP preconditioned resid norm 4.125461342831e-05 true resid  
> norm 4.125461342821e-05 ||Ae||/||Ax|| 6.209325569492e-05
>      0 KSP preconditioned resid norm 3.008151203349e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.008151203349e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 7.247738676584e-02 true resid  
> norm 7.832960673267e-01 ||Ae||/||Ax|| 7.832960673267e-01
>      1 KSP preconditioned resid norm 7.247738676584e-02 true resid  
> norm 7.832960673267e-01 ||Ae||/||Ax|| 7.832960673267e-01
>   11 KSP preconditioned resid norm 3.280778128691e-05 true resid  
> norm 3.280778128689e-05 ||Ae||/||Ax|| 4.937973678446e-05
>      0 KSP preconditioned resid norm 9.091470733399e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 9.091470733399e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.215403990109e-01 true resid  
> norm 7.059207029764e-01 ||Ae||/||Ax|| 7.059207029764e-01
>      1 KSP preconditioned resid norm 1.215403990109e-01 true resid  
> norm 7.059207029764e-01 ||Ae||/||Ax|| 7.059207029764e-01
>   12 KSP preconditioned resid norm 2.968550831459e-05 true resid  
> norm 2.968550831435e-05 ||Ae||/||Ax|| 4.468033281669e-05
>      0 KSP preconditioned resid norm 1.024246289230e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.024246289230e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 9.302673603327e-02 true resid  
> norm 5.985130004903e-01 ||Ae||/||Ax|| 5.985130004903e-01
>      1 KSP preconditioned resid norm 9.302673603327e-02 true resid  
> norm 5.985130004903e-01 ||Ae||/||Ax|| 5.985130004903e-01
>   13 KSP preconditioned resid norm 2.521514028222e-05 true resid  
> norm 2.521514028196e-05 ||Ae||/||Ax|| 3.795188035479e-05
>      0 KSP preconditioned resid norm 5.990912160630e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 5.990912160630e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 9.781990197263e-02 true resid  
> norm 5.480521896855e-01 ||Ae||/||Ax|| 5.480521896855e-01
>      1 KSP preconditioned resid norm 9.781990197263e-02 true resid  
> norm 5.480521896855e-01 ||Ae||/||Ax|| 5.480521896855e-01
>   14 KSP preconditioned resid norm 1.978375072845e-05 true resid  
> norm 1.978375072804e-05 ||Ae||/||Ax|| 2.977697257298e-05
>      0 KSP preconditioned resid norm 1.008331187053e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.008331187053e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.294954965258e-01 true resid  
> norm 6.339103426898e-01 ||Ae||/||Ax|| 6.339103426898e-01
>      1 KSP preconditioned resid norm 2.294954965258e-01 true resid  
> norm 6.339103426898e-01 ||Ae||/||Ax|| 6.339103426898e-01
>   15 KSP preconditioned resid norm 1.488645974384e-05 true resid  
> norm 1.488645974344e-05 ||Ae||/||Ax|| 2.240594867893e-05
>      0 KSP preconditioned resid norm 1.849227047229e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.849227047229e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.919984907088e-01 true resid  
> norm 5.183188121423e-01 ||Ae||/||Ax|| 5.183188121423e-01
>      1 KSP preconditioned resid norm 2.919984907088e-01 true resid  
> norm 5.183188121423e-01 ||Ae||/||Ax|| 5.183188121423e-01
>   16 KSP preconditioned resid norm 7.094849419546e-06 true resid  
> norm 7.094849419588e-06 ||Ae||/||Ax|| 1.067861900813e-05
>      0 KSP preconditioned resid norm 1.388766130430e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.388766130430e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.878119571370e-01 true resid  
> norm 7.032718519224e-01 ||Ae||/||Ax|| 7.032718519224e-01
>      1 KSP preconditioned resid norm 3.878119571370e-01 true resid  
> norm 7.032718519224e-01 ||Ae||/||Ax|| 7.032718519224e-01
>   17 KSP preconditioned resid norm 4.097305136804e-06 true resid  
> norm 4.097305136552e-06 ||Ae||/||Ax|| 6.166947023919e-06
>  1 SNES Function norm 5.850920566283e-06
>    0 KSP preconditioned resid norm 5.850920566283e-06 true resid  
> norm 5.850920566283e-06 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 8.276021960717e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 8.276021960717e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.809774037292e-01 true resid  
> norm 7.868108837109e-01 ||Ae||/||Ax|| 7.868108837109e-01
>      1 KSP preconditioned resid norm 3.809774037292e-01 true resid  
> norm 7.868108837109e-01 ||Ae||/||Ax|| 7.868108837109e-01
>    1 KSP preconditioned resid norm 3.947856942305e-06 true resid  
> norm 3.947856942305e-06 ||Ae||/||Ax|| 6.747411621096e-01
>      0 KSP preconditioned resid norm 2.497905632896e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.497905632896e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 5.608088417629e-01 true resid  
> norm 8.391706412367e-01 ||Ae||/||Ax|| 8.391706412367e-01
>      1 KSP preconditioned resid norm 5.608088417629e-01 true resid  
> norm 8.391706412367e-01 ||Ae||/||Ax|| 8.391706412367e-01
>    2 KSP preconditioned resid norm 3.305771768709e-06 true resid  
> norm 3.305771768709e-06 ||Ae||/||Ax|| 5.650002817948e-01
>      0 KSP preconditioned resid norm 7.301425383804e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 7.301425383804e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.476223530528e-01 true resid  
> norm 5.563009832684e-01 ||Ae||/||Ax|| 5.563009832684e-01
>      1 KSP preconditioned resid norm 3.476223530528e-01 true resid  
> norm 5.563009832684e-01 ||Ae||/||Ax|| 5.563009832684e-01
>    3 KSP preconditioned resid norm 3.007329187251e-06 true resid  
> norm 3.007329187251e-06 ||Ae||/||Ax|| 5.139924825815e-01
>      0 KSP preconditioned resid norm 2.880397337024e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.880397337024e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.471977831965e-01 true resid  
> norm 7.798621978217e-01 ||Ae||/||Ax|| 7.798621978217e-01
>      1 KSP preconditioned resid norm 4.471977831965e-01 true resid  
> norm 7.798621978217e-01 ||Ae||/||Ax|| 7.798621978217e-01
>    4 KSP preconditioned resid norm 3.001204159469e-06 true resid  
> norm 3.001204159469e-06 ||Ae||/||Ax|| 5.129456340194e-01
>      0 KSP preconditioned resid norm 4.619989941290e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 4.619989941290e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.243648576810e-01 true resid  
> norm 1.108094778155e+00 ||Ae||/||Ax|| 1.108094778155e+00
>      1 KSP preconditioned resid norm 3.243648576810e-01 true resid  
> norm 1.108094778155e+00 ||Ae||/||Ax|| 1.108094778155e+00
>    5 KSP preconditioned resid norm 3.001115709599e-06 true resid  
> norm 3.001115709599e-06 ||Ae||/||Ax|| 5.129305167624e-01
>      0 KSP preconditioned resid norm 4.829994865746e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 4.829994865746e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.325734548745e-01 true resid  
> norm 1.088867367033e+00 ||Ae||/||Ax|| 1.088867367033e+00
>      1 KSP preconditioned resid norm 4.325734548745e-01 true resid  
> norm 1.088867367033e+00 ||Ae||/||Ax|| 1.088867367033e+00
>    6 KSP preconditioned resid norm 2.974277803753e-06 true resid  
> norm 2.974277803753e-06 ||Ae||/||Ax|| 5.083435623606e-01
>      0 KSP preconditioned resid norm 1.381129102428e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.381129102428e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.098881160663e-01 true resid  
> norm 6.431427158439e-01 ||Ae||/||Ax|| 6.431427158439e-01
>      1 KSP preconditioned resid norm 3.098881160663e-01 true resid  
> norm 6.431427158439e-01 ||Ae||/||Ax|| 6.431427158439e-01
>    7 KSP preconditioned resid norm 2.816838388951e-06 true resid  
> norm 2.816838388951e-06 ||Ae||/||Ax|| 4.814350762483e-01
>      0 KSP preconditioned resid norm 1.559573417426e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.559573417426e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.532723445272e-01 true resid  
> norm 8.138557633078e-01 ||Ae||/||Ax|| 8.138557633078e-01
>      1 KSP preconditioned resid norm 2.532723445272e-01 true resid  
> norm 8.138557633078e-01 ||Ae||/||Ax|| 8.138557633078e-01
>    8 KSP preconditioned resid norm 2.572324455447e-06 true resid  
> norm 2.572324455447e-06 ||Ae||/||Ax|| 4.396443989123e-01
>      0 KSP preconditioned resid norm 5.946831260059e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 5.946831260059e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.929968207615e-01 true resid  
> norm 1.354756640752e+00 ||Ae||/||Ax|| 1.354756640752e+00
>      1 KSP preconditioned resid norm 3.929968207615e-01 true resid  
> norm 1.354756640752e+00 ||Ae||/||Ax|| 1.354756640752e+00
>    9 KSP preconditioned resid norm 2.177455315353e-06 true resid  
> norm 2.177455315353e-06 ||Ae||/||Ax|| 3.721560206954e-01
>      0 KSP preconditioned resid norm 5.315723299063e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 5.315723299063e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.628504511585e-01 true resid  
> norm 1.244733734536e+00 ||Ae||/||Ax|| 1.244733734536e+00
>      1 KSP preconditioned resid norm 3.628504511585e-01 true resid  
> norm 1.244733734536e+00 ||Ae||/||Ax|| 1.244733734536e+00
>   10 KSP preconditioned resid norm 1.409067985559e-06 true resid  
> norm 1.409067985559e-06 ||Ae||/||Ax|| 2.408284251334e-01
>      0 KSP preconditioned resid norm 1.522258580690e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.522258580690e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.414238177111e-01 true resid  
> norm 8.091416034904e-01 ||Ae||/||Ax|| 8.091416034904e-01
>      1 KSP preconditioned resid norm 2.414238177111e-01 true resid  
> norm 8.091416034904e-01 ||Ae||/||Ax|| 8.091416034904e-01
>   11 KSP preconditioned resid norm 1.001503517728e-06 true resid  
> norm 1.001503517728e-06 ||Ae||/||Ax|| 1.711702468667e-01
>      0 KSP preconditioned resid norm 8.244553153983e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 8.244553153983e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.244218748685e-01 true resid  
> norm 6.292257324755e-01 ||Ae||/||Ax|| 6.292257324755e-01
>      1 KSP preconditioned resid norm 2.244218748685e-01 true resid  
> norm 6.292257324755e-01 ||Ae||/||Ax|| 6.292257324755e-01
>   12 KSP preconditioned resid norm 7.556215980081e-07 true resid  
> norm 7.556215980082e-07 ||Ae||/||Ax|| 1.291457625254e-01
>      0 KSP preconditioned resid norm 1.857974243745e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.857974243745e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.451523414794e-01 true resid  
> norm 6.449941313821e-01 ||Ae||/||Ax|| 6.449941313821e-01
>      1 KSP preconditioned resid norm 3.451523414794e-01 true resid  
> norm 6.449941313821e-01 ||Ae||/||Ax|| 6.449941313821e-01
>   13 KSP preconditioned resid norm 5.872140840954e-07 true resid  
> norm 5.872140840955e-07 ||Ae||/||Ax|| 1.003626826656e-01
>      0 KSP preconditioned resid norm 2.611648570586e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.611648570586e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.740043981340e-01 true resid  
> norm 6.369784579675e-01 ||Ae||/||Ax|| 6.369784579675e-01
>      1 KSP preconditioned resid norm 2.740043981340e-01 true resid  
> norm 6.369784579675e-01 ||Ae||/||Ax|| 6.369784579675e-01
>   14 KSP preconditioned resid norm 4.352350316840e-07 true resid  
> norm 4.352350316841e-07 ||Ae||/||Ax|| 7.438744497613e-02
>      0 KSP preconditioned resid norm 2.003016340281e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.003016340281e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.073409352245e-01 true resid  
> norm 6.562979155542e-01 ||Ae||/||Ax|| 6.562979155542e-01
>      1 KSP preconditioned resid norm 4.073409352245e-01 true resid  
> norm 6.562979155542e-01 ||Ae||/||Ax|| 6.562979155542e-01
>   15 KSP preconditioned resid norm 3.052867274622e-07 true resid  
> norm 3.052867274624e-07 ||Ae||/||Ax|| 5.217755462648e-02
>      0 KSP preconditioned resid norm 1.286639096168e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.286639096168e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.656621503377e-01 true resid  
> norm 6.308753365212e-01 ||Ae||/||Ax|| 6.308753365212e-01
>      1 KSP preconditioned resid norm 3.656621503377e-01 true resid  
> norm 6.308753365212e-01 ||Ae||/||Ax|| 6.308753365212e-01
>   16 KSP preconditioned resid norm 1.955997188783e-07 true resid  
> norm 1.955997188782e-07 ||Ae||/||Ax|| 3.343058868468e-02
>      0 KSP preconditioned resid norm 1.335903581256e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.335903581256e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.001895431683e-01 true resid  
> norm 6.789558143016e-01 ||Ae||/||Ax|| 6.789558143016e-01
>      1 KSP preconditioned resid norm 3.001895431683e-01 true resid  
> norm 6.789558143016e-01 ||Ae||/||Ax|| 6.789558143016e-01
>   17 KSP preconditioned resid norm 1.567782688997e-07 true resid  
> norm 1.567782688996e-07 ||Ae||/||Ax|| 2.679548750039e-02
>      0 KSP preconditioned resid norm 1.651696143482e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.651696143482e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.713972348795e-01 true resid  
> norm 5.033537683058e-01 ||Ae||/||Ax|| 5.033537683058e-01
>      1 KSP preconditioned resid norm 2.713972348795e-01 true resid  
> norm 5.033537683058e-01 ||Ae||/||Ax|| 5.033537683058e-01
>   18 KSP preconditioned resid norm 1.010718356377e-07 true resid  
> norm 1.010718356378e-07 ||Ae||/||Ax|| 1.727451851256e-02
>      0 KSP preconditioned resid norm 1.011081720758e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.011081720758e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 5.527570671391e-01 true resid  
> norm 7.947330071383e-01 ||Ae||/||Ax|| 7.947330071383e-01
>      1 KSP preconditioned resid norm 5.527570671391e-01 true resid  
> norm 7.947330071383e-01 ||Ae||/||Ax|| 7.947330071383e-01
>   19 KSP preconditioned resid norm 8.997938714701e-08 true resid  
> norm 8.997938714709e-08 ||Ae||/||Ax|| 1.537867180519e-02
>      0 KSP preconditioned resid norm 1.537108246495e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.537108246495e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.298772065070e-01 true resid  
> norm 5.876338587223e-01 ||Ae||/||Ax|| 5.876338587223e-01
>      1 KSP preconditioned resid norm 4.298772065070e-01 true resid  
> norm 5.876338587223e-01 ||Ae||/||Ax|| 5.876338587223e-01
>   20 KSP preconditioned resid norm 8.711914509357e-08 true resid  
> norm 8.711914509361e-08 ||Ae||/||Ax|| 1.488981846646e-02
>      0 KSP preconditioned resid norm 1.923097362850e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.923097362850e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.075948671586e-01 true resid  
> norm 4.631591237704e-01 ||Ae||/||Ax|| 4.631591237704e-01
>      1 KSP preconditioned resid norm 3.075948671586e-01 true resid  
> norm 4.631591237704e-01 ||Ae||/||Ax|| 4.631591237704e-01
>   21 KSP preconditioned resid norm 8.323067409578e-08 true resid  
> norm 8.323067409577e-08 ||Ae||/||Ax|| 1.422522715065e-02
>      0 KSP preconditioned resid norm 9.819276869885e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 9.819276869885e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.279383354509e-01 true resid  
> norm 6.842834730228e-01 ||Ae||/||Ax|| 6.842834730228e-01
>      1 KSP preconditioned resid norm 4.279383354509e-01 true resid  
> norm 6.842834730228e-01 ||Ae||/||Ax|| 6.842834730228e-01
>   22 KSP preconditioned resid norm 7.909034553981e-08 true resid  
> norm 7.909034553913e-08 ||Ae||/||Ax|| 1.351759003445e-02
>      0 KSP preconditioned resid norm 9.582482498733e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 9.582482498733e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.872542232901e-01 true resid  
> norm 6.520743487433e-01 ||Ae||/||Ax|| 6.520743487433e-01
>      1 KSP preconditioned resid norm 4.872542232901e-01 true resid  
> norm 6.520743487433e-01 ||Ae||/||Ax|| 6.520743487433e-01
>   23 KSP preconditioned resid norm 7.583943619887e-08 true resid  
> norm 7.583943619831e-08 ||Ae||/||Ax|| 1.296196646992e-02
>      0 KSP preconditioned resid norm 1.129055084162e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.129055084162e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.940290407027e-01 true resid  
> norm 5.533623127492e-01 ||Ae||/||Ax|| 5.533623127492e-01
>      1 KSP preconditioned resid norm 3.940290407027e-01 true resid  
> norm 5.533623127492e-01 ||Ae||/||Ax|| 5.533623127492e-01
>   24 KSP preconditioned resid norm 7.198974227007e-08 true resid  
> norm 7.198974226927e-08 ||Ae||/||Ax|| 1.230400266996e-02
>      0 KSP preconditioned resid norm 7.922461164088e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 7.922461164088e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.568631157402e-01 true resid  
> norm 6.784746707201e-01 ||Ae||/||Ax|| 6.784746707201e-01
>      1 KSP preconditioned resid norm 3.568631157402e-01 true resid  
> norm 6.784746707201e-01 ||Ae||/||Ax|| 6.784746707201e-01
>   25 KSP preconditioned resid norm 6.969681693595e-08 true resid  
> norm 6.969681693509e-08 ||Ae||/||Ax|| 1.191211129010e-02
>      0 KSP preconditioned resid norm 8.506106408028e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 8.506106408028e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.674832821714e-01 true resid  
> norm 5.592992824796e-01 ||Ae||/||Ax|| 5.592992824796e-01
>      1 KSP preconditioned resid norm 2.674832821714e-01 true resid  
> norm 5.592992824796e-01 ||Ae||/||Ax|| 5.592992824796e-01
>   26 KSP preconditioned resid norm 6.713093474885e-08 true resid  
> norm 6.713093474791e-08 ||Ae||/||Ax|| 1.147356796036e-02
>      0 KSP preconditioned resid norm 7.107668950850e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 7.107668950850e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.080542740675e-01 true resid  
> norm 6.120847770454e-01 ||Ae||/||Ax|| 6.120847770454e-01
>      1 KSP preconditioned resid norm 3.080542740675e-01 true resid  
> norm 6.120847770454e-01 ||Ae||/||Ax|| 6.120847770454e-01
>   27 KSP preconditioned resid norm 6.316951623357e-08 true resid  
> norm 6.316951623251e-08 ||Ae||/||Ax|| 1.079650894537e-02
>      0 KSP preconditioned resid norm 9.816834307897e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 9.816834307897e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.035636714372e-01 true resid  
> norm 5.561308623772e-01 ||Ae||/||Ax|| 5.561308623772e-01
>      1 KSP preconditioned resid norm 3.035636714372e-01 true resid  
> norm 5.561308623772e-01 ||Ae||/||Ax|| 5.561308623772e-01
>   28 KSP preconditioned resid norm 5.685161562141e-08 true resid  
> norm 5.685161562024e-08 ||Ae||/||Ax|| 9.716695856008e-03
>      0 KSP preconditioned resid norm 1.017862349675e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.017862349675e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.438638918414e-01 true resid  
> norm 6.483000200066e-01 ||Ae||/||Ax|| 6.483000200066e-01
>      1 KSP preconditioned resid norm 3.438638918414e-01 true resid  
> norm 6.483000200066e-01 ||Ae||/||Ax|| 6.483000200066e-01
>   29 KSP preconditioned resid norm 5.170566864610e-08 true resid  
> norm 5.170566864501e-08 ||Ae||/||Ax|| 8.837185201757e-03
>      0 KSP preconditioned resid norm 8.897697988733e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 8.897697988733e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.213181899588e-01 true resid  
> norm 6.348471232738e-01 ||Ae||/||Ax|| 6.348471232738e-01
>      1 KSP preconditioned resid norm 3.213181899588e-01 true resid  
> norm 6.348471232738e-01 ||Ae||/||Ax|| 6.348471232738e-01
>   30 KSP preconditioned resid norm 4.885061460285e-08 true resid  
> norm 4.885061460285e-08 ||Ae||/||Ax|| 8.349218563034e-03
>      0 KSP preconditioned resid norm 7.100457326024e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 7.100457326024e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 6.955812925302e-01 true resid  
> norm 9.726932992087e-01 ||Ae||/||Ax|| 9.726932992087e-01
>      1 KSP preconditioned resid norm 6.955812925302e-01 true resid  
> norm 9.726932992087e-01 ||Ae||/||Ax|| 9.726932992087e-01
>   31 KSP preconditioned resid norm 4.725291213013e-08 true resid  
> norm 4.725291213007e-08 ||Ae||/||Ax|| 8.076149999775e-03
>      0 KSP preconditioned resid norm 4.185203199010e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 4.185203199010e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.196403938530e-01 true resid  
> norm 4.016140042970e-01 ||Ae||/||Ax|| 4.016140042970e-01
>      1 KSP preconditioned resid norm 2.196403938530e-01 true resid  
> norm 4.016140042970e-01 ||Ae||/||Ax|| 4.016140042970e-01
>   32 KSP preconditioned resid norm 4.547823851359e-08 true resid  
> norm 4.547823851362e-08 ||Ae||/||Ax|| 7.772834718641e-03
>      0 KSP preconditioned resid norm 6.581109982585e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 6.581109982585e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.128181724937e-01 true resid  
> norm 7.298286188824e-01 ||Ae||/||Ax|| 7.298286188824e-01
>      1 KSP preconditioned resid norm 3.128181724937e-01 true resid  
> norm 7.298286188824e-01 ||Ae||/||Ax|| 7.298286188824e-01
>   33 KSP preconditioned resid norm 4.468618222477e-08 true resid  
> norm 4.468618222483e-08 ||Ae||/||Ax|| 7.637461783764e-03
>      0 KSP preconditioned resid norm 8.120341282592e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 8.120341282592e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.218250119940e-01 true resid  
> norm 4.572201876132e-01 ||Ae||/||Ax|| 4.572201876132e-01
>      1 KSP preconditioned resid norm 2.218250119940e-01 true resid  
> norm 4.572201876132e-01 ||Ae||/||Ax|| 4.572201876132e-01
>   34 KSP preconditioned resid norm 4.314354409778e-08 true resid  
> norm 4.314354409782e-08 ||Ae||/||Ax|| 7.373804448217e-03
>      0 KSP preconditioned resid norm 5.778947005677e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 5.778947005677e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.877938034235e-01 true resid  
> norm 6.868568173397e-01 ||Ae||/||Ax|| 6.868568173397e-01
>      1 KSP preconditioned resid norm 3.877938034235e-01 true resid  
> norm 6.868568173397e-01 ||Ae||/||Ax|| 6.868568173397e-01
>   35 KSP preconditioned resid norm 4.111383309670e-08 true resid  
> norm 4.111383309672e-08 ||Ae||/||Ax|| 7.026899892239e-03
>      0 KSP preconditioned resid norm 7.589832929724e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 7.589832929724e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.735429451288e-01 true resid  
> norm 6.133540321550e-01 ||Ae||/||Ax|| 6.133540321550e-01
>      1 KSP preconditioned resid norm 2.735429451288e-01 true resid  
> norm 6.133540321550e-01 ||Ae||/||Ax|| 6.133540321550e-01
>   36 KSP preconditioned resid norm 3.896413302095e-08 true resid  
> norm 3.896413302095e-08 ||Ae||/||Ax|| 6.659487610460e-03
>      0 KSP preconditioned resid norm 9.173185113175e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 9.173185113175e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.052187383165e-01 true resid  
> norm 6.655288549919e-01 ||Ae||/||Ax|| 6.655288549919e-01
>      1 KSP preconditioned resid norm 3.052187383165e-01 true resid  
> norm 6.655288549919e-01 ||Ae||/||Ax|| 6.655288549919e-01
>   37 KSP preconditioned resid norm 3.770537943429e-08 true resid  
> norm 3.770537943431e-08 ||Ae||/||Ax|| 6.444349911635e-03
>      0 KSP preconditioned resid norm 1.137492649970e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.137492649970e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.044329763751e-01 true resid  
> norm 6.147370239994e-01 ||Ae||/||Ax|| 6.147370239994e-01
>      1 KSP preconditioned resid norm 3.044329763751e-01 true resid  
> norm 6.147370239994e-01 ||Ae||/||Ax|| 6.147370239994e-01
>   38 KSP preconditioned resid norm 3.694716763304e-08 true resid  
> norm 3.694716763306e-08 ||Ae||/||Ax|| 6.314761448988e-03
>      0 KSP preconditioned resid norm 1.223189932062e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.223189932062e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.107514686273e-01 true resid  
> norm 5.789372321326e-01 ||Ae||/||Ax|| 5.789372321326e-01
>      1 KSP preconditioned resid norm 2.107514686273e-01 true resid  
> norm 5.789372321326e-01 ||Ae||/||Ax|| 5.789372321326e-01
>   39 KSP preconditioned resid norm 3.634742486594e-08 true resid  
> norm 3.634742486593e-08 ||Ae||/||Ax|| 6.212257448064e-03
>      0 KSP preconditioned resid norm 1.192363148419e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.192363148419e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.860271918718e-01 true resid  
> norm 5.850260965540e-01 ||Ae||/||Ax|| 5.850260965540e-01
>      1 KSP preconditioned resid norm 2.860271918718e-01 true resid  
> norm 5.850260965540e-01 ||Ae||/||Ax|| 5.850260965540e-01
>   40 KSP preconditioned resid norm 3.561782722372e-08 true resid  
> norm 3.561782722374e-08 ||Ae||/||Ax|| 6.087559525075e-03
>      0 KSP preconditioned resid norm 8.881324685300e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 8.881324685300e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.642271412468e-01 true resid  
> norm 6.637278122540e-01 ||Ae||/||Ax|| 6.637278122540e-01
>      1 KSP preconditioned resid norm 2.642271412468e-01 true resid  
> norm 6.637278122540e-01 ||Ae||/||Ax|| 6.637278122540e-01
>   41 KSP preconditioned resid norm 3.506823410956e-08 true resid  
> norm 3.506823410956e-08 ||Ae||/||Ax|| 5.993626765614e-03
>      0 KSP preconditioned resid norm 9.513827527161e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 9.513827527161e-01 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.263980500382e-01 true resid  
> norm 6.267230897905e-01 ||Ae||/||Ax|| 6.267230897905e-01
>      1 KSP preconditioned resid norm 2.263980500382e-01 true resid  
> norm 6.267230897905e-01 ||Ae||/||Ax|| 6.267230897905e-01
>   42 KSP preconditioned resid norm 3.466236527477e-08 true resid  
> norm 3.466236527477e-08 ||Ae||/||Ax|| 5.924258393546e-03
>      0 KSP preconditioned resid norm 1.407625976444e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.407625976444e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.841824427477e-01 true resid  
> norm 5.311814594204e-01 ||Ae||/||Ax|| 5.311814594204e-01
>      1 KSP preconditioned resid norm 1.841824427477e-01 true resid  
> norm 5.311814594204e-01 ||Ae||/||Ax|| 5.311814594204e-01
>   43 KSP preconditioned resid norm 3.394294635279e-08 true resid  
> norm 3.394294635284e-08 ||Ae||/||Ax|| 5.801300148978e-03
>      0 KSP preconditioned resid norm 1.536263909707e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.536263909707e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.972519671057e-01 true resid  
> norm 5.927201357618e-01 ||Ae||/||Ax|| 5.927201357618e-01
>      1 KSP preconditioned resid norm 2.972519671057e-01 true resid  
> norm 5.927201357618e-01 ||Ae||/||Ax|| 5.927201357618e-01
>   44 KSP preconditioned resid norm 3.248296724023e-08 true resid  
> norm 3.248296724025e-08 ||Ae||/||Ax|| 5.551770336352e-03
>      0 KSP preconditioned resid norm 1.783804105384e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.783804105384e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.722881763352e-01 true resid  
> norm 5.786098812309e-01 ||Ae||/||Ax|| 5.786098812309e-01
>      1 KSP preconditioned resid norm 3.722881763352e-01 true resid  
> norm 5.786098812309e-01 ||Ae||/||Ax|| 5.786098812309e-01
>   45 KSP preconditioned resid norm 2.950320556254e-08 true resid  
> norm 2.950320556258e-08 ||Ae||/||Ax|| 5.042489507138e-03
>      0 KSP preconditioned resid norm 2.201496546447e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.201496546447e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.087649817784e-01 true resid  
> norm 5.074174843604e-01 ||Ae||/||Ax|| 5.074174843604e-01
>      1 KSP preconditioned resid norm 4.087649817784e-01 true resid  
> norm 5.074174843604e-01 ||Ae||/||Ax|| 5.074174843604e-01
>   46 KSP preconditioned resid norm 2.319584580786e-08 true resid  
> norm 2.319584580791e-08 ||Ae||/||Ax|| 3.964477990280e-03
>      0 KSP preconditioned resid norm 1.736355434315e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.736355434315e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 6.867386399797e-01 true resid  
> norm 7.098722583695e-01 ||Ae||/||Ax|| 7.098722583695e-01
>      1 KSP preconditioned resid norm 6.867386399797e-01 true resid  
> norm 7.098722583695e-01 ||Ae||/||Ax|| 7.098722583695e-01
>   47 KSP preconditioned resid norm 2.008430277340e-08 true resid  
> norm 2.008430277343e-08 ||Ae||/||Ax|| 3.432673977693e-03
>      0 KSP preconditioned resid norm 1.488127968937e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.488127968937e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 5.516786708506e-01 true resid  
> norm 6.355423307226e-01 ||Ae||/||Ax|| 6.355423307226e-01
>      1 KSP preconditioned resid norm 5.516786708506e-01 true resid  
> norm 6.355423307226e-01 ||Ae||/||Ax|| 6.355423307226e-01
>   48 KSP preconditioned resid norm 1.854206408497e-08 true resid  
> norm 1.854206408497e-08 ||Ae||/||Ax|| 3.169084911497e-03
>      0 KSP preconditioned resid norm 1.380328436388e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.380328436388e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.575661767087e-01 true resid  
> norm 6.487066138646e-01 ||Ae||/||Ax|| 6.487066138646e-01
>      1 KSP preconditioned resid norm 4.575661767087e-01 true resid  
> norm 6.487066138646e-01 ||Ae||/||Ax|| 6.487066138646e-01
>   49 KSP preconditioned resid norm 1.665547510085e-08 true resid  
> norm 1.665547510085e-08 ||Ae||/||Ax|| 2.846641808270e-03
>      0 KSP preconditioned resid norm 2.313536103290e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.313536103290e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 5.305138630648e-01 true resid  
> norm 7.334968078908e-01 ||Ae||/||Ax|| 7.334968078908e-01
>      1 KSP preconditioned resid norm 5.305138630648e-01 true resid  
> norm 7.334968078908e-01 ||Ae||/||Ax|| 7.334968078908e-01
>   50 KSP preconditioned resid norm 1.462283172240e-08 true resid  
> norm 1.462283172247e-08 ||Ae||/||Ax|| 2.499236070088e-03
>      0 KSP preconditioned resid norm 3.213123410447e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.213123410447e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 5.224884980518e-01 true resid  
> norm 7.561756407001e-01 ||Ae||/||Ax|| 7.561756407001e-01
>      1 KSP preconditioned resid norm 5.224884980518e-01 true resid  
> norm 7.561756407001e-01 ||Ae||/||Ax|| 7.561756407001e-01
>   51 KSP preconditioned resid norm 1.223657774649e-08 true resid  
> norm 1.223657774655e-08 ||Ae||/||Ax|| 2.091393586347e-03
>      0 KSP preconditioned resid norm 2.023552916685e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.023552916685e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 5.574715128775e-01 true resid  
> norm 6.980817617824e-01 ||Ae||/||Ax|| 6.980817617824e-01
>      1 KSP preconditioned resid norm 5.574715128775e-01 true resid  
> norm 6.980817617824e-01 ||Ae||/||Ax|| 6.980817617824e-01
>   52 KSP preconditioned resid norm 9.853979905043e-09 true resid  
> norm 9.853979905046e-09 ||Ae||/||Ax|| 1.684175984516e-03
>      0 KSP preconditioned resid norm 1.170745734096e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.170745734096e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 4.134603323396e-01 true resid  
> norm 6.348912278346e-01 ||Ae||/||Ax|| 6.348912278346e-01
>      1 KSP preconditioned resid norm 4.134603323396e-01 true resid  
> norm 6.348912278346e-01 ||Ae||/||Ax|| 6.348912278346e-01
>   53 KSP preconditioned resid norm 8.181596904133e-09 true resid  
> norm 8.181596904190e-09 ||Ae||/||Ax|| 1.398343527570e-03
>      0 KSP preconditioned resid norm 2.385292955090e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.385292955090e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 5.286979495932e-01 true resid  
> norm 7.984208016570e-01 ||Ae||/||Ax|| 7.984208016570e-01
>      1 KSP preconditioned resid norm 5.286979495932e-01 true resid  
> norm 7.984208016570e-01 ||Ae||/||Ax|| 7.984208016570e-01
>   54 KSP preconditioned resid norm 6.409203469073e-09 true resid  
> norm 6.409203469062e-09 ||Ae||/||Ax|| 1.095417959696e-03
>      0 KSP preconditioned resid norm 5.707419973376e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 5.707419973376e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 6.431212555078e-01 true resid  
> norm 1.319769139913e+00 ||Ae||/||Ax|| 1.319769139913e+00
>      1 KSP preconditioned resid norm 6.431212555078e-01 true resid  
> norm 1.319769139913e+00 ||Ae||/||Ax|| 1.319769139913e+00
>   55 KSP preconditioned resid norm 4.450638029919e-09 true resid  
> norm 4.450638029969e-09 ||Ae||/||Ax|| 7.606731247757e-04
>      0 KSP preconditioned resid norm 7.199725849178e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 7.199725849178e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 8.820447922491e-01 true resid  
> norm 1.569220175230e+00 ||Ae||/||Ax|| 1.569220175230e+00
>      1 KSP preconditioned resid norm 8.820447922491e-01 true resid  
> norm 1.569220175230e+00 ||Ae||/||Ax|| 1.569220175230e+00
>   56 KSP preconditioned resid norm 2.820717192827e-09 true resid  
> norm 2.820717192685e-09 ||Ae||/||Ax|| 4.820980153004e-04
>      0 KSP preconditioned resid norm 3.954316557881e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.954316557881e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.174082394688e+00 true resid  
> norm 1.017969498279e+00 ||Ae||/||Ax|| 1.017969498279e+00
>      1 KSP preconditioned resid norm 1.174082394688e+00 true resid  
> norm 1.017969498279e+00 ||Ae||/||Ax|| 1.017969498279e+00
>   57 KSP preconditioned resid norm 1.751635661806e-09 true resid  
> norm 1.751635661897e-09 ||Ae||/||Ax|| 2.993777888545e-04
>      0 KSP preconditioned resid norm 1.876208896020e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.876208896020e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.566896137837e+00 true resid  
> norm 6.914905383075e-01 ||Ae||/||Ax|| 6.914905383075e-01
>      1 KSP preconditioned resid norm 1.566896137837e+00 true resid  
> norm 6.914905383075e-01 ||Ae||/||Ax|| 6.914905383075e-01
>   58 KSP preconditioned resid norm 1.207891841472e-09 true resid  
> norm 1.207891841440e-09 ||Ae||/||Ax|| 2.064447513440e-04
>      0 KSP preconditioned resid norm 2.297261201903e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.297261201903e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.961454513785e+00 true resid  
> norm 7.361082716350e-01 ||Ae||/||Ax|| 7.361082716350e-01
>      1 KSP preconditioned resid norm 1.961454513785e+00 true resid  
> norm 7.361082716350e-01 ||Ae||/||Ax|| 7.361082716350e-01
>   59 KSP preconditioned resid norm 1.016539279879e-09 true resid  
> norm 1.016539279925e-09 ||Ae||/||Ax|| 1.737400582368e-04
>      0 KSP preconditioned resid norm 3.254668263088e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.254668263088e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.640547979130e+00 true resid  
> norm 7.473445815641e-01 ||Ae||/||Ax|| 7.473445815641e-01
>      1 KSP preconditioned resid norm 1.640547979130e+00 true resid  
> norm 7.473445815641e-01 ||Ae||/||Ax|| 7.473445815641e-01
>   60 KSP preconditioned resid norm 8.558459393246e-10 true resid  
> norm 8.558459393246e-10 ||Ae||/||Ax|| 1.462754330073e-04
>      0 KSP preconditioned resid norm 3.699188433787e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.699188433787e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 3.641405579973e+00 true resid  
> norm 9.275791982055e-01 ||Ae||/||Ax|| 9.275791982055e-01
>      1 KSP preconditioned resid norm 3.641405579973e+00 true resid  
> norm 9.275791982055e-01 ||Ae||/||Ax|| 9.275791982055e-01
>   61 KSP preconditioned resid norm 7.891395315495e-10 true resid  
> norm 7.891395315494e-10 ||Ae||/||Ax|| 1.348744223425e-04
>      0 KSP preconditioned resid norm 2.675881805310e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.675881805310e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.453713947810e+00 true resid  
> norm 7.138367623914e-01 ||Ae||/||Ax|| 7.138367623914e-01
>      1 KSP preconditioned resid norm 1.453713947810e+00 true resid  
> norm 7.138367623914e-01 ||Ae||/||Ax|| 7.138367623914e-01
>   62 KSP preconditioned resid norm 7.510552985484e-10 true resid  
> norm 7.510552985213e-10 ||Ae||/||Ax|| 1.283653213221e-04
>      0 KSP preconditioned resid norm 1.338840353148e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.338840353148e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.146220467265e+00 true resid  
> norm 4.297177669038e-01 ||Ae||/||Ax|| 4.297177669038e-01
>      1 KSP preconditioned resid norm 1.146220467265e+00 true resid  
> norm 4.297177669038e-01 ||Ae||/||Ax|| 4.297177669038e-01
>   63 KSP preconditioned resid norm 6.832740701908e-10 true resid  
> norm 6.832740702025e-10 ||Ae||/||Ax|| 1.167806095574e-04
>      0 KSP preconditioned resid norm 2.478031412327e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.478031412327e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.547561676965e+00 true resid  
> norm 7.067319359604e-01 ||Ae||/||Ax|| 7.067319359604e-01
>      1 KSP preconditioned resid norm 1.547561676965e+00 true resid  
> norm 7.067319359604e-01 ||Ae||/||Ax|| 7.067319359604e-01
>   64 KSP preconditioned resid norm 6.312416928849e-10 true resid  
> norm 6.312416928420e-10 ||Ae||/||Ax|| 1.078875854989e-04
>      0 KSP preconditioned resid norm 2.510304348429e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.510304348429e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.470709935588e+00 true resid  
> norm 6.572137642951e-01 ||Ae||/||Ax|| 6.572137642951e-01
>      1 KSP preconditioned resid norm 1.470709935588e+00 true resid  
> norm 6.572137642951e-01 ||Ae||/||Ax|| 6.572137642951e-01
>   65 KSP preconditioned resid norm 5.327354965414e-10 true resid  
> norm 5.327354965097e-10 ||Ae||/||Ax|| 9.105156880435e-05
>      0 KSP preconditioned resid norm 2.476662569003e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.476662569003e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.310145576275e+00 true resid  
> norm 6.408918975397e-01 ||Ae||/||Ax|| 6.408918975397e-01
>      1 KSP preconditioned resid norm 2.310145576275e+00 true resid  
> norm 6.408918975397e-01 ||Ae||/||Ax|| 6.408918975397e-01
>   66 KSP preconditioned resid norm 4.469580732178e-10 true resid  
> norm 4.469580732741e-10 ||Ae||/||Ax|| 7.639106841575e-05
>      0 KSP preconditioned resid norm 3.243520644840e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.243520644840e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.732155047053e+00 true resid  
> norm 7.812059837441e-01 ||Ae||/||Ax|| 7.812059837441e-01
>      1 KSP preconditioned resid norm 2.732155047053e+00 true resid  
> norm 7.812059837441e-01 ||Ae||/||Ax|| 7.812059837441e-01
>   67 KSP preconditioned resid norm 4.087445950732e-10 true resid  
> norm 4.087445950372e-10 ||Ae||/||Ax|| 6.985987767337e-05
>      0 KSP preconditioned resid norm 4.570320195732e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 4.570320195732e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.087601985141e+00 true resid  
> norm 1.032266974836e+00 ||Ae||/||Ax|| 1.032266974836e+00
>      1 KSP preconditioned resid norm 2.087601985141e+00 true resid  
> norm 1.032266974836e+00 ||Ae||/||Ax|| 1.032266974836e+00
>   68 KSP preconditioned resid norm 3.841153386650e-10 true resid  
> norm 3.841153386559e-10 ||Ae||/||Ax|| 6.565041078654e-05
>      0 KSP preconditioned resid norm 5.718860667569e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 5.718860667569e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.709934079219e+00 true resid  
> norm 1.273174095131e+00 ||Ae||/||Ax|| 1.273174095131e+00
>      1 KSP preconditioned resid norm 1.709934079219e+00 true resid  
> norm 1.273174095131e+00 ||Ae||/||Ax|| 1.273174095131e+00
>   69 KSP preconditioned resid norm 3.520264512665e-10 true resid  
> norm 3.520264512287e-10 ||Ae||/||Ax|| 6.016599392193e-05
>      0 KSP preconditioned resid norm 4.537109521149e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 4.537109521149e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.937349360261e+00 true resid  
> norm 1.046686001054e+00 ||Ae||/||Ax|| 1.046686001054e+00
>      1 KSP preconditioned resid norm 1.937349360261e+00 true resid  
> norm 1.046686001054e+00 ||Ae||/||Ax|| 1.046686001054e+00
>   70 KSP preconditioned resid norm 3.149991658898e-10 true resid  
> norm 3.149991658892e-10 ||Ae||/||Ax|| 5.383753929329e-05
>      0 KSP preconditioned resid norm 3.602956988994e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.602956988994e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.093057977304e+00 true resid  
> norm 9.252238178106e-01 ||Ae||/||Ax|| 9.252238178106e-01
>      1 KSP preconditioned resid norm 2.093057977304e+00 true resid  
> norm 9.252238178106e-01 ||Ae||/||Ax|| 9.252238178106e-01
>   71 KSP preconditioned resid norm 2.993160400510e-10 true resid  
> norm 2.993160400417e-10 ||Ae||/||Ax|| 5.115708488107e-05
>      0 KSP preconditioned resid norm 3.336754379842e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.336754379842e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.284284263997e+00 true resid  
> norm 8.760668211902e-01 ||Ae||/||Ax|| 8.760668211902e-01
>      1 KSP preconditioned resid norm 1.284284263997e+00 true resid  
> norm 8.760668211902e-01 ||Ae||/||Ax|| 8.760668211902e-01
>   72 KSP preconditioned resid norm 2.895591295761e-10 true resid  
> norm 2.895591295591e-10 ||Ae||/||Ax|| 4.948949934951e-05
>      0 KSP preconditioned resid norm 2.267067098558e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.267067098558e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 8.534973699953e-01 true resid  
> norm 7.726740440864e-01 ||Ae||/||Ax|| 7.726740440864e-01
>      1 KSP preconditioned resid norm 8.534973699953e-01 true resid  
> norm 7.726740440864e-01 ||Ae||/||Ax|| 7.726740440864e-01
>   73 KSP preconditioned resid norm 2.812425874590e-10 true resid  
> norm 2.812425874308e-10 ||Ae||/||Ax|| 4.806809189165e-05
>      0 KSP preconditioned resid norm 1.144552955812e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.144552955812e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 6.664517534844e-01 true resid  
> norm 6.421695318305e-01 ||Ae||/||Ax|| 6.421695318305e-01
>      1 KSP preconditioned resid norm 6.664517534844e-01 true resid  
> norm 6.421695318305e-01 ||Ae||/||Ax|| 6.421695318305e-01
>   74 KSP preconditioned resid norm 2.735484153434e-10 true resid  
> norm 2.735484153084e-10 ||Ae||/||Ax|| 4.675305573021e-05
>      0 KSP preconditioned resid norm 1.554702841568e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.554702841568e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 7.157380114110e-01 true resid  
> norm 7.377660147515e-01 ||Ae||/||Ax|| 7.377660147515e-01
>      1 KSP preconditioned resid norm 7.157380114110e-01 true resid  
> norm 7.377660147515e-01 ||Ae||/||Ax|| 7.377660147515e-01
>   75 KSP preconditioned resid norm 2.661574205602e-10 true resid  
> norm 2.661574205227e-10 ||Ae||/||Ax|| 4.548983660049e-05
>      0 KSP preconditioned resid norm 4.199331451693e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 4.199331451693e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 7.261245258089e-01 true resid  
> norm 9.689217434547e-01 ||Ae||/||Ax|| 9.689217434547e-01
>      1 KSP preconditioned resid norm 7.261245258089e-01 true resid  
> norm 9.689217434547e-01 ||Ae||/||Ax|| 9.689217434547e-01
>   76 KSP preconditioned resid norm 2.534998275631e-10 true resid  
> norm 2.534998275209e-10 ||Ae||/||Ax|| 4.332648591775e-05
>      0 KSP preconditioned resid norm 3.743395182510e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.743395182510e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 8.990417749799e-01 true resid  
> norm 9.329106139559e-01 ||Ae||/||Ax|| 9.329106139559e-01
>      1 KSP preconditioned resid norm 8.990417749799e-01 true resid  
> norm 9.329106139559e-01 ||Ae||/||Ax|| 9.329106139559e-01
>   77 KSP preconditioned resid norm 2.388049684536e-10 true resid  
> norm 2.388049684532e-10 ||Ae||/||Ax|| 4.081493941813e-05
>      0 KSP preconditioned resid norm 1.894155910280e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.894155910280e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 8.684190700742e-01 true resid  
> norm 7.727740370555e-01 ||Ae||/||Ax|| 7.727740370555e-01
>      1 KSP preconditioned resid norm 8.684190700742e-01 true resid  
> norm 7.727740370555e-01 ||Ae||/||Ax|| 7.727740370555e-01
>   78 KSP preconditioned resid norm 2.286512776556e-10 true resid  
> norm 2.286512776733e-10 ||Ae||/||Ax|| 3.907953886624e-05
>      0 KSP preconditioned resid norm 1.276207551837e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.276207551837e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 5.355779104233e-01 true resid  
> norm 5.278462128508e-01 ||Ae||/||Ax|| 5.278462128508e-01
>      1 KSP preconditioned resid norm 5.355779104233e-01 true resid  
> norm 5.278462128508e-01 ||Ae||/||Ax|| 5.278462128508e-01
>   79 KSP preconditioned resid norm 2.074225711250e-10 true resid  
> norm 2.074225711493e-10 ||Ae||/||Ax|| 3.545127109477e-05
>      0 KSP preconditioned resid norm 1.200062868567e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.200062868567e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 6.893976477109e-01 true resid  
> norm 6.184761860600e-01 ||Ae||/||Ax|| 6.184761860600e-01
>      1 KSP preconditioned resid norm 6.893976477109e-01 true resid  
> norm 6.184761860600e-01 ||Ae||/||Ax|| 6.184761860600e-01
>   80 KSP preconditioned resid norm 1.878908772984e-10 true resid  
> norm 1.878908773103e-10 ||Ae||/||Ax|| 3.211304532026e-05
>      0 KSP preconditioned resid norm 1.387129119694e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.387129119694e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 8.742548405622e-01 true resid  
> norm 6.169338830681e-01 ||Ae||/||Ax|| 6.169338830681e-01
>      1 KSP preconditioned resid norm 8.742548405622e-01 true resid  
> norm 6.169338830681e-01 ||Ae||/||Ax|| 6.169338830681e-01
>   81 KSP preconditioned resid norm 1.720957363240e-10 true resid  
> norm 1.720957363027e-10 ||Ae||/||Ax|| 2.941344603009e-05
>      0 KSP preconditioned resid norm 1.602115661552e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.602115661552e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 8.392172521059e-01 true resid  
> norm 6.206948554932e-01 ||Ae||/||Ax|| 6.206948554932e-01
>      1 KSP preconditioned resid norm 8.392172521059e-01 true resid  
> norm 6.206948554932e-01 ||Ae||/||Ax|| 6.206948554932e-01
>   82 KSP preconditioned resid norm 1.584755992063e-10 true resid  
> norm 1.584755991999e-10 ||Ae||/||Ax|| 2.708558378201e-05
>      0 KSP preconditioned resid norm 1.601197866084e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.601197866084e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 8.359479912386e-01 true resid  
> norm 6.119059337506e-01 ||Ae||/||Ax|| 6.119059337506e-01
>      1 KSP preconditioned resid norm 8.359479912386e-01 true resid  
> norm 6.119059337506e-01 ||Ae||/||Ax|| 6.119059337506e-01
>   83 KSP preconditioned resid norm 1.418702609113e-10 true resid  
> norm 1.418702608829e-10 ||Ae||/||Ax|| 2.424751101569e-05
>      0 KSP preconditioned resid norm 1.499465989768e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.499465989768e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.045754716297e+00 true resid  
> norm 6.153015126718e-01 ||Ae||/||Ax|| 6.153015126718e-01
>      1 KSP preconditioned resid norm 1.045754716297e+00 true resid  
> norm 6.153015126718e-01 ||Ae||/||Ax|| 6.153015126718e-01
>   84 KSP preconditioned resid norm 1.271329562402e-10 true resid  
> norm 1.271329562130e-10 ||Ae||/||Ax|| 2.172870999918e-05
>      0 KSP preconditioned resid norm 1.634503776014e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 1.634503776014e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.222338373864e+00 true resid  
> norm 6.558960123395e-01 ||Ae||/||Ax|| 6.558960123395e-01
>      1 KSP preconditioned resid norm 1.222338373864e+00 true resid  
> norm 6.558960123395e-01 ||Ae||/||Ax|| 6.558960123395e-01
>   85 KSP preconditioned resid norm 1.170830928689e-10 true resid  
> norm 1.170830928467e-10 ||Ae||/||Ax|| 2.001105493065e-05
>      0 KSP preconditioned resid norm 2.189478982761e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.189478982761e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.257863289529e+00 true resid  
> norm 5.975673409262e-01 ||Ae||/||Ax|| 5.975673409262e-01
>      1 KSP preconditioned resid norm 1.257863289529e+00 true resid  
> norm 5.975673409262e-01 ||Ae||/||Ax|| 5.975673409262e-01
>   86 KSP preconditioned resid norm 1.072794488701e-10 true resid  
> norm 1.072794488559e-10 ||Ae||/||Ax|| 1.833548202211e-05
>      0 KSP preconditioned resid norm 3.043239239438e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 3.043239239438e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 1.508125411857e+00 true resid  
> norm 5.316504517748e-01 ||Ae||/||Ax|| 5.316504517748e-01
>      1 KSP preconditioned resid norm 1.508125411857e+00 true resid  
> norm 5.316504517748e-01 ||Ae||/||Ax|| 5.316504517748e-01
>   87 KSP preconditioned resid norm 9.310419868753e-11 true resid  
> norm 9.310419867003e-11 ||Ae||/||Ax|| 1.591274357860e-05
>      0 KSP preconditioned resid norm 2.707043890291e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.707043890291e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.156895340838e+00 true resid  
> norm 6.565618094970e-01 ||Ae||/||Ax|| 6.565618094970e-01
>      1 KSP preconditioned resid norm 2.156895340838e+00 true resid  
> norm 6.565618094970e-01 ||Ae||/||Ax|| 6.565618094970e-01
>   88 KSP preconditioned resid norm 7.852841829285e-11 true resid  
> norm 7.852841828475e-11 ||Ae||/||Ax|| 1.342154920668e-05
>      0 KSP preconditioned resid norm 2.582289916941e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.582289916941e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.382288228383e+00 true resid  
> norm 6.422921135312e-01 ||Ae||/||Ax|| 6.422921135312e-01
>      1 KSP preconditioned resid norm 2.382288228383e+00 true resid  
> norm 6.422921135312e-01 ||Ae||/||Ax|| 6.422921135312e-01
>   89 KSP preconditioned resid norm 6.494099865988e-11 true resid  
> norm 6.494099869486e-11 ||Ae||/||Ax|| 1.109927881590e-05
>      0 KSP preconditioned resid norm 2.588940215193e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      0 KSP preconditioned resid norm 2.588940215193e+00 true resid  
> norm 1.000000000000e+00 ||Ae||/||Ax|| 1.000000000000e+00
>      1 KSP preconditioned resid norm 2.412871891541e+00 true resid  
> norm 6.483026287919e-01 ||Ae||/||Ax|| 6.483026287919e-01
>      1 KSP preconditioned resid norm 2.412871891541e+00 true resid  
> norm 6.483026287919e-01 ||Ae||/||Ax|| 6.483026287919e-01
>   90 KSP preconditioned resid norm 5.586819688621e-11 true resid  
> norm 5.586819689526e-11 ||Ae||/||Ax|| 9.548616540312e-06
>  2 SNES Function norm 5.587280798316e-11
> SNES Object:
>  type: ls
>    line search variant: SNESLineSearchCubic
>    alpha=0.0001, maxstep=1e+08, minlambda=1e-12
>  maximum iterations=50, maximum function evaluations=10000
>  tolerances: relative=1e-08, absolute=1e-50, solution=1e-08
>  total number of linear solver iterations=107
>  total number of function evaluations=3
>  KSP Object:
>    type: fgmres
>      GMRES: restart=30, using Classical (unmodified) Gram-Schmidt  
> Orthogonalization with no iterative refinement
>      GMRES: happy breakdown tolerance 1e-30
>    maximum iterations=10000, initial guess is zero
>    tolerances:  relative=1e-05, absolute=1e-50, divergence=10000
>    right preconditioning
>  PC Object:
>    type: mg
>      MG: type is FULL, levels=1 cycles=v
>    Coarse gride solver -- level 0 presmooths=1 postsmooths=1 -----
>      KSP Object:(mg_levels_0_)
>        type: gmres
>          GMRES: restart=30, using Classical (unmodified) Gram- 
> Schmidt Orthogonalization with no iterative refinement
>          GMRES: happy breakdown tolerance 1e-30
>        maximum iterations=1, initial guess is zero
>        tolerances:  relative=1e-05, absolute=1e-50, divergence=10000
>        left preconditioning
>      PC Object:(mg_levels_0_)
>        type: ilu
>          ILU: 0 levels of fill
>          ILU: factor fill ratio allocated 1
>          ILU: tolerance for zero pivot 1e-12
>          ILU: using diagonal shift to prevent zero pivot
>          ILU: using diagonal shift on blocks to prevent zero pivot
>               out-of-place factorization
>               matrix ordering: natural
>          ILU: factor fill ratio needed 1
>               Factored matrix follows
>              Matrix Object:
>                type=seqaij, rows=39366, cols=39366
>                package used to perform factorization: petsc
>                total: nonzeros=2125764, allocated nonzeros=2125764
>                  using I-node routines: found 19683 nodes, limit  
> used is 5
>        linear system matrix = precond matrix:
>        Matrix Object:
>          type=seqaij, rows=39366, cols=39366
>          total: nonzeros=2125764, allocated nonzeros=2125764
>            using I-node routines: found 19683 nodes, limit used is 5
>    linear system matrix = precond matrix:
>    Matrix Object:
>      type=seqaij, rows=39366, cols=39366
>      total: nonzeros=2125764, allocated nonzeros=2125764
>        using I-node routines: found 19683 nodes, limit used is 5
>
> Thanks again,
> Hal
>
>
>
>
> Barry Smith wrote:
>>  Please run with
>> -ksp_monitor_true_residual -snes_monitor - 
>> mg_levels_ksp_monitor_true_residua -mg_coarse_ksp_type gmres - 
>> mg_coarse_ksp_monitor_true_residual -snes_view
>> and send the output for one time-step.
>>   Barry
>> On Aug 26, 2009, at 2:34 PM, Hal Finkel wrote:
>>> Hello,
>>>
>>> I've constructed a evolution scheme for a time-dependent 3D PDE  
>>> system using the DMMG layer. The core of the code is essentially a  
>>> loop around DMMGSolve in the spirit of snes/examples/tutorials/ 
>>> ex29.c. If I only run with one level, then the code runs and  
>>> produces sensible results. Passing the option - 
>>> mg_levels_0_ksp_type bcgsl increases the solver speed by about  
>>> 30%, and -mg_levels_0_pc_type fieldsplit gives me another 5%  
>>> improvement. Does that say something about the structure of my  
>>> problem?
>>>
>>> If I run with two levels, the coarse solve seems to work, but the  
>>> fine grid's KSP never seems to complete. If I run with - 
>>> mg_levels_1_ksp_monitor_true_residual, I can see the residual does  
>>> not seem to be converging at all:
>>>
>>>     0 KSP preconditioned resid norm 1.979915874387e+02 true resid  
>>> norm 1.889855551272e+04 ||Ae||/||Ax|| 1.889855551272e+04
>>>     0 KSP preconditioned resid norm 3.833279709488e+06 true resid  
>>> norm 3.665290817713e+08 ||Ae||/||Ax|| 3.665290817713e+08
>>>     0 KSP preconditioned resid norm 5.080465654647e+01 true resid  
>>> norm 8.284057252719e+03 ||Ae||/||Ax|| 8.284057252719e+03
>>>     1 KSP preconditioned resid norm 6.057649668915e+00 true resid  
>>> norm 5.136009463814e+02 ||Ae||/||Ax|| 5.136009463814e+02
>>>     0 KSP preconditioned resid norm 5.511785811223e+04 true resid  
>>> norm 1.055162492334e+07 ||Ae||/||Ax|| 1.055162492334e+07
>>>     0 KSP preconditioned resid norm 2.164672340919e+01 true resid  
>>> norm 2.999406329054e+04 ||Ae||/||Ax|| 2.999406329054e+04
>>>     0 KSP preconditioned resid norm 5.275983407134e+05 true resid  
>>> norm 9.196351032040e+08 ||Ae||/||Ax|| 9.196351032040e+08
>>>     0 KSP preconditioned resid norm 3.338344860439e+01 true resid  
>>> norm 5.133553722923e+03 ||Ae||/||Ax|| 5.133553722923e+03
>>>     1 KSP preconditioned resid norm 4.306407436023e+00 true resid  
>>> norm 3.361745947223e+02 ||Ae||/||Ax|| 3.361745947223e+02
>>> ...
>>>
>>> If I run with -pc_mg_monitor I see, after the course solve, only  
>>> things like:
>>>   Residual norms for mg_levels_1_ solve.
>>>   0 KSP Residual norm 1.979915874387e+02
>>>   Residual norms for mg_levels_1_ solve.
>>>   0 KSP Residual norm 3.833279709488e+06
>>>   Residual norms for mg_levels_1_ solve.
>>>   0 KSP Residual norm 5.080465654647e+01
>>>   1 KSP Residual norm 6.057649668915e+00
>>>   Residual norms for mg_levels_1_ solve.
>>>   0 KSP Residual norm 5.511785811223e+04
>>>   Residual norms for mg_levels_1_ solve.
>>>   0 KSP Residual norm 2.164672340919e+01
>>>   Residual norms for mg_levels_1_ solve.
>>>   0 KSP Residual norm 5.275983407134e+05
>>>   Residual norms for mg_levels_1_ solve.
>>>   0 KSP Residual norm 3.338344860439e+01
>>>   1 KSP Residual norm 4.306407436023e+00
>>> ...
>>>
>>> running with -info shows:
>>> [0] KSPDefaultConverged(): user has provided nonzero initial  
>>> guess, computing 2-norm of preconditioned RHS
>>> [0] KSPDefaultConverged(): Linear solver is diverging. Initial  
>>> right hand size norm 0.0066162, current residual norm 23282.7 at  
>>> iteration 0
>>> [0] KSPDefaultConverged(): user has provided nonzero initial  
>>> guess, computing 2-norm of preconditioned RHS
>>> [0] KSPDefaultConverged(): Linear solver is diverging. Initial  
>>> right hand size norm 0.00287711, current residual norm 38.2205 at  
>>> iteration 0
>>> [0] KSPDefaultConverged(): user has provided nonzero initial  
>>> guess, computing 2-norm of preconditioned RHS
>>> [0] KSPDefaultConverged(): Linear solver is diverging. Initial  
>>> right hand size norm 0.00287711, current residual norm 809191 at  
>>> iteration 0
>>> [0] KSPDefaultConverged(): user has provided nonzero initial  
>>> guess, computing 2-norm of preconditioned RHS
>>> [0] KSPDefaultConverged(): Linear solver is diverging. Initial  
>>> right hand size norm 0.00970186, current residual norm 186.983 at  
>>> iteration 0
>>> [0] KSPDefaultConverged(): user has provided nonzero initial  
>>> guess, computing 2-norm of preconditioned RHS
>>> [0] KSPDefaultConverged(): Linear solver is diverging. Initial  
>>> right hand size norm 0.00970186, current residual norm 3.62292e+06  
>>> at iteration 0
>>>
>>> What is a good way to debug this?
>>>
>>> No matter how I run, I've arranged the code so that the fine grid  
>>> is *always* the same size; it has to be because the initial  
>>> conditions are loaded from a file.
>>>
>>> In general, however, I don't understand exactly what the mg  
>>> preconditioner is doing. Is there a writeup somewhere which is  
>>> more verbose than the manual? In the one-level case, how are the  
>>> results of the solve used to precondition the Jacobian?
>>>
>>> In an 1-processor, 1-level case, running with -snes_view gives:
>>> SNES Object:
>>> type: ls
>>>   line search variant: SNESLineSearchCubic
>>>   alpha=0.0001, maxstep=1e+08, minlambda=1e-12
>>> maximum iterations=50, maximum function evaluations=10000
>>> tolerances: relative=1e-08, absolute=1e-50, solution=1e-08
>>> total number of linear solver iterations=36
>>> total number of function evaluations=3
>>> KSP Object:
>>>   type: fgmres
>>>     GMRES: restart=30, using Classical (unmodified) Gram-Schmidt  
>>> Orthogonalization with no iterative refinement
>>>     GMRES: happy breakdown tolerance 1e-30
>>>   maximum iterations=10000, initial guess is zero
>>>   tolerances:  relative=1e-05, absolute=1e-50, divergence=10000
>>>   right preconditioning
>>> PC Object:
>>>   type: mg
>>>     MG: type is FULL, levels=1 cycles=v
>>>   Coarse gride solver -- level 0 presmooths=1 postsmooths=1 -----
>>>     KSP Object:(mg_levels_0_)
>>>       type: bcgsl
>>>         BCGSL: Ell = 2
>>>         BCGSL: Delta = 0
>>>       maximum iterations=1, initial guess is zero
>>>       tolerances:  relative=1e-05, absolute=1e-50, divergence=10000
>>>       left preconditioning
>>>     PC Object:(mg_levels_0_)
>>>       type: fieldsplit
>>>         FieldSplit with MULTIPLICATIVE composition: total splits =  
>>> 2, blocksize = 2
>>>         Solver info for each split is in the following KSP objects:
>>>         Split number 0 Fields  0
>>>         KSP Object:(mg_levels_0_fieldsplit_0_)
>>>           type: preonly
>>>           maximum iterations=10000, initial guess is zero
>>>           tolerances:  relative=1e-05, absolute=1e-50,  
>>> divergence=10000
>>>           left preconditioning
>>>         PC Object:(mg_levels_0_fieldsplit_0_)
>>>           type: ilu
>>>             ILU: 0 levels of fill
>>>             ILU: factor fill ratio allocated 1
>>>             ILU: tolerance for zero pivot 1e-12
>>>             ILU: using diagonal shift to prevent zero pivot
>>>             ILU: using diagonal shift on blocks to prevent zero  
>>> pivot
>>>                  out-of-place factorization
>>>                  matrix ordering: natural
>>>             ILU: factor fill ratio needed 1
>>>                  Factored matrix follows
>>>                 Matrix Object:
>>>                   type=seqaij, rows=19683, cols=19683
>>>                   package used to perform factorization: petsc
>>>                   total: nonzeros=531441, allocated nonzeros=531441
>>>                     not using I-node routines
>>>           linear system matrix = precond matrix:
>>>           Matrix Object:
>>>             type=seqaij, rows=19683, cols=19683
>>>             total: nonzeros=531441, allocated nonzeros=531441
>>>               not using I-node routines
>>>         Split number 1 Fields  1
>>>         KSP Object:(mg_levels_0_fieldsplit_1_)
>>>           type: preonly
>>>           maximum iterations=10000, initial guess is zero
>>>           tolerances:  relative=1e-05, absolute=1e-50,  
>>> divergence=10000
>>>           left preconditioning
>>>         PC Object:(mg_levels_0_fieldsplit_1_)
>>>           type: ilu
>>>             ILU: 0 levels of fill
>>>             ILU: factor fill ratio allocated 1
>>>             ILU: tolerance for zero pivot 1e-12
>>>             ILU: using diagonal shift to prevent zero pivot
>>>             ILU: using diagonal shift on blocks to prevent zero  
>>> pivot
>>>                  out-of-place factorization
>>>                  matrix ordering: natural
>>>             ILU: factor fill ratio needed 1
>>>                  Factored matrix follows
>>>                 Matrix Object:
>>>                   type=seqaij, rows=19683, cols=19683
>>>                   package used to perform factorization: petsc
>>>                   total: nonzeros=531441, allocated nonzeros=531441
>>>                     not using I-node routines
>>>           linear system matrix = precond matrix:
>>>           Matrix Object:
>>>             type=seqaij, rows=19683, cols=19683
>>>             total: nonzeros=531441, allocated nonzeros=531441
>>>               not using I-node routines
>>>       linear system matrix = precond matrix:
>>>       Matrix Object:
>>>         type=seqaij, rows=39366, cols=39366
>>>         total: nonzeros=2125764, allocated nonzeros=2125764
>>>           using I-node routines: found 19683 nodes, limit used is 5
>>>   linear system matrix = precond matrix:
>>>   Matrix Object:
>>>     type=seqaij, rows=39366, cols=39366
>>>     total: nonzeros=2125764, allocated nonzeros=2125764
>>>       using I-node routines: found 19683 nodes, limit used is 5
>>>
>>> Thank you in advance,
>>> Hal



More information about the petsc-users mailing list