[petsc-users] large number of iteration.

Sat Aug 11 14:27:05 CDT 2018

> On Aug 9, 2018, at 9:11 PM, Josh L <ysjosh.lo at gmail.com> wrote:
> 
> 
> 
> 2018-08-09 18:47 GMT-05:00 Smith, Barry F. <bsmith at mcs.anl.gov>:
> 
> 
> > On Aug 9, 2018, at 3:03 PM, Josh L <ysjosh.lo at gmail.com> wrote:
> > 
> > Hi Barry,
> > 
> > I use the example ex49 of KSP(linear elasticity problem), and it's output of ksp monitor is the same as my reduced problem, so I think my code is correct , at least for the reduced problem.
> 
>    Are you using -pc_type gamg ?
> 
>       No, just with GMRES and default PC.
>       strangely, with gamg, the final solution is still the same but ksp output becomes different between my code and petsc example. 
>       with -pc_type gamg, my code take 35 iteration and petsc example takes only 7.

   You should use GAMG for elasticity type problems. Does you code set the near null space like the example does?

>         
>      Thanks.
>     
> 
> > 
> > Within a Newton's method, several linear system(Ax=b) is solved, and b is the residual vector whose norm becomes smaller and smaller.
> > Should I change rtol for KSP ? since ||b|| is reducing, and converge requires ||b-Ax|| / ||b||  < rtol ( || b - Ax || < atol=10^-50 is rarely satisfied )
> > I observe that for the first linear solve in Newton's method, iterative solver converges with okay number of iteration
> > , but for the following linear solve, iterative solver takes more and more iterations.
> 
>    You can probably get away with -ksp_rtol 1.e-3 or even try 1.e-2 
> 
>     Try also -ksp_pc_side right
> 
> 
>    Barry
> 
> 
> > 
> > 
> > Thanks,
> > Josh
> >    
> > 
> > 
> > 
> > 2018-08-09 10:26 GMT-05:00 Smith, Barry F. <bsmith at mcs.anl.gov>:
> > 
> >    Ok, PCGAMG should work well for linear elasticity so on your reduced problem use -pc_type gamg then the group (Mark) will have specific suggestions for options. We want to see about 20 iterations for "well-behaved" linear elasticity problems.
> > 
> >    Barry
> > 
> > 
> > > On Aug 8, 2018, at 5:48 PM, Josh L <ysjosh.lo at gmail.com> wrote:
> > > 
> > > Hi Barry,
> > > 
> > > Thanks for your help.
> > > 
> > > I removed the phase field from my formulation by setting all corresponding degrees of freedom as Dirichlet boundary condition, so
> > > my formulation becomes simply linear elastic.
> > > Then I use CG for KSP and algebraic multigrid for precondiitoner. For a 150K dofs problem, the linear solver converges with 200s iteration(still too much I think), but with GMRES it again takes 2000 iteration to converge. with GMRES and default PC, it barely converges within 10K iteration.
> > > 
> > > I will double check my hessian. below is the  ksp monitor output from GMRES and gamg PC for first 500 iteration. 
> > > 
> > >  0 KSP preconditioned resid norm 9.175598437886e-07 true resid norm 4.423520976130e-07 ||r(i)||/||b|| 1.000000000000e+00
> > >   1 KSP preconditioned resid norm 9.171756840415e-07 true resid norm 4.185847348836e-07 ||r(i)||/||b|| 9.462704871128e-01
> > >   2 KSP preconditioned resid norm 9.171436192115e-07 true resid norm 4.373193748329e-07 ||r(i)||/||b|| 9.886228124446e-01
> > >   3 KSP preconditioned resid norm 9.047636402661e-07 true resid norm 2.655845586443e-07 ||r(i)||/||b|| 6.003917695371e-01
> > >   4 KSP preconditioned resid norm 9.032722605019e-07 true resid norm 3.045614764490e-07 ||r(i)||/||b|| 6.885046506899e-01
> > >   5 KSP preconditioned resid norm 8.926003608855e-07 true resid norm 3.498775710352e-07 ||r(i)||/||b|| 7.909481449805e-01
> > >   6 KSP preconditioned resid norm 8.788553543841e-07 true resid norm 2.052341235884e-07 ||r(i)||/||b|| 4.639610045841e-01
> > >   7 KSP preconditioned resid norm 8.725201948474e-07 true resid norm 3.315801151567e-07 ||r(i)||/||b|| 7.495841365870e-01
> > >   8 KSP preconditioned resid norm 8.704702843041e-07 true resid norm 2.453167687304e-07 ||r(i)||/||b|| 5.545735400696e-01
> > >   9 KSP preconditioned resid norm 8.673295560357e-07 true resid norm 3.480581533019e-07 ||r(i)||/||b|| 7.868350917291e-01
> > >  10 KSP preconditioned resid norm 8.650826882165e-07 true resid norm 3.331076551593e-07 ||r(i)||/||b|| 7.530373586036e-01
> > >  11 KSP preconditioned resid norm 8.632977966037e-07 true resid norm 2.943531620635e-07 ||r(i)||/||b|| 6.654273002250e-01
> > >  12 KSP preconditioned resid norm 8.622407761375e-07 true resid norm 3.413473413778e-07 ||r(i)||/||b|| 7.716643443532e-01
> > >  13 KSP preconditioned resid norm 8.612343318250e-07 true resid norm 2.962692292083e-07 ||r(i)||/||b|| 6.697588432541e-01
> > >  14 KSP preconditioned resid norm 8.579354639983e-07 true resid norm 3.298514619407e-07 ||r(i)||/||b|| 7.456762694710e-01
> > >  15 KSP preconditioned resid norm 8.578914052098e-07 true resid norm 3.287293954137e-07 ||r(i)||/||b|| 7.431396780699e-01
> > >  16 KSP preconditioned resid norm 8.564349944906e-07 true resid norm 3.231662390796e-07 ||r(i)||/||b|| 7.305633698212e-01
> > >  17 KSP preconditioned resid norm 8.544772830576e-07 true resid norm 3.522175745975e-07 ||r(i)||/||b|| 7.962380567383e-01
> > >  18 KSP preconditioned resid norm 8.518664697660e-07 true resid norm 2.957457436154e-07 ||r(i)||/||b|| 6.685754294176e-01
> > >  19 KSP preconditioned resid norm 8.502444318835e-07 true resid norm 3.231647326483e-07 ||r(i)||/||b|| 7.305599643183e-01
> > >  20 KSP preconditioned resid norm 8.488626061229e-07 true resid norm 3.034773190650e-07 ||r(i)||/||b|| 6.860537583129e-01
> > >  21 KSP preconditioned resid norm 8.472536047506e-07 true resid norm 3.142174821592e-07 ||r(i)||/||b|| 7.103334286301e-01
> > >  22 KSP preconditioned resid norm 8.465622251926e-07 true resid norm 3.109996301173e-07 ||r(i)||/||b|| 7.030590151951e-01
> > >  23 KSP preconditioned resid norm 8.455410030133e-07 true resid norm 3.026169375479e-07 ||r(i)||/||b|| 6.841087431955e-01
> > >  24 KSP preconditioned resid norm 8.441686432481e-07 true resid norm 3.247156730398e-07 ||r(i)||/||b|| 7.340660862513e-01
> > >  25 KSP preconditioned resid norm 8.422635872670e-07 true resid norm 2.949977317008e-07 ||r(i)||/||b|| 6.668844418115e-01
> > >  26 KSP preconditioned resid norm 8.391013229654e-07 true resid norm 3.503429354312e-07 ||r(i)||/||b|| 7.920001675626e-01
> > >  27 KSP preconditioned resid norm 8.369135179081e-07 true resid norm 2.932796516614e-07 ||r(i)||/||b|| 6.630004768691e-01
> > >  28 KSP preconditioned resid norm 8.344557411519e-07 true resid norm 3.290576497205e-07 ||r(i)||/||b|| 7.438817437425e-01
> > >  29 KSP preconditioned resid norm 8.255611852636e-07 true resid norm 3.228082527538e-07 ||r(i)||/||b|| 7.297540906796e-01
> > >  30 KSP preconditioned resid norm 8.191145448615e-07 true resid norm 2.695709281706e-07 ||r(i)||/||b|| 6.094035263430e-01
> > >  31 KSP preconditioned resid norm 8.190911648438e-07 true resid norm 2.661586473845e-07 ||r(i)||/||b|| 6.016895790044e-01
> > >  32 KSP preconditioned resid norm 8.188934260789e-07 true resid norm 3.000926727757e-07 ||r(i)||/||b|| 6.784022826953e-01
> > >  33 KSP preconditioned resid norm 8.166449659697e-07 true resid norm 2.081220810731e-07 ||r(i)||/||b|| 4.704896443267e-01
> > >  34 KSP preconditioned resid norm 8.130668560598e-07 true resid norm 3.175998062677e-07 ||r(i)||/||b|| 7.179796546271e-01
> > >  35 KSP preconditioned resid norm 8.103250854289e-07 true resid norm 2.675762536241e-07 ||r(i)||/||b|| 6.048942800723e-01
> > >  36 KSP preconditioned resid norm 8.079447876546e-07 true resid norm 2.624343353237e-07 ||r(i)||/||b|| 5.932702404709e-01
> > >  37 KSP preconditioned resid norm 8.064590891986e-07 true resid norm 2.891085928184e-07 ||r(i)||/||b|| 6.535712035243e-01
> > >  38 KSP preconditioned resid norm 8.039981484367e-07 true resid norm 2.435760434885e-07 ||r(i)||/||b|| 5.506383824173e-01
> > >  39 KSP preconditioned resid norm 8.030132361660e-07 true resid norm 2.791572408348e-07 ||r(i)||/||b|| 6.310747532139e-01
> > >  40 KSP preconditioned resid norm 8.025869823713e-07 true resid norm 2.673367609434e-07 ||r(i)||/||b|| 6.043528727137e-01
> > >  41 KSP preconditioned resid norm 8.011717744772e-07 true resid norm 2.626259645676e-07 ||r(i)||/||b|| 5.937034457049e-01
> > >  42 KSP preconditioned resid norm 7.994420264672e-07 true resid norm 2.931234480129e-07 ||r(i)||/||b|| 6.626473562454e-01
> > >  43 KSP preconditioned resid norm 7.976276065412e-07 true resid norm 2.565425485040e-07 ||r(i)||/||b|| 5.799510161438e-01
> > >  44 KSP preconditioned resid norm 7.963529254232e-07 true resid norm 2.683594511633e-07 ||r(i)||/||b|| 6.066648098007e-01
> > >  45 KSP preconditioned resid norm 7.951914923472e-07 true resid norm 2.726317559874e-07 ||r(i)||/||b|| 6.163229641241e-01
> > >  46 KSP preconditioned resid norm 7.943011197327e-07 true resid norm 2.561291446355e-07 ||r(i)||/||b|| 5.790164577440e-01
> > >  47 KSP preconditioned resid norm 7.926385476568e-07 true resid norm 2.978344787798e-07 ||r(i)||/||b|| 6.732973131290e-01
> > >  48 KSP preconditioned resid norm 7.909780991424e-07 true resid norm 2.498059973427e-07 ||r(i)||/||b|| 5.647220815515e-01
> > >  49 KSP preconditioned resid norm 7.863002375447e-07 true resid norm 3.283898230799e-07 ||r(i)||/||b|| 7.423720263834e-01
> > >  50 KSP preconditioned resid norm 7.778093966862e-07 true resid norm 2.908211438411e-07 ||r(i)||/||b|| 6.574426693360e-01
> > >  51 KSP preconditioned resid norm 7.727705792892e-07 true resid norm 2.662262655905e-07 ||r(i)||/||b|| 6.018424396020e-01
> > >  52 KSP preconditioned resid norm 7.580949386500e-07 true resid norm 4.077725304210e-07 ||r(i)||/||b|| 9.218279570084e-01
> > >  53 KSP preconditioned resid norm 7.223569984502e-07 true resid norm 2.806806877450e-07 ||r(i)||/||b|| 6.345187222115e-01
> > >  54 KSP preconditioned resid norm 6.833104315428e-07 true resid norm 3.167664065828e-07 ||r(i)||/||b|| 7.160956357890e-01
> > >  55 KSP preconditioned resid norm 6.480813314286e-07 true resid norm 3.449389182846e-07 ||r(i)||/||b|| 7.797836161419e-01
> > >  56 KSP preconditioned resid norm 5.628534804207e-07 true resid norm 5.008589310744e-07 ||r(i)||/||b|| 1.132263040635e+00
> > >  57 KSP preconditioned resid norm 4.676624755957e-07 true resid norm 2.747589656053e-07 ||r(i)||/||b|| 6.211318248245e-01
> > >  58 KSP preconditioned resid norm 4.266847724428e-07 true resid norm 2.051356033363e-07 ||r(i)||/||b|| 4.637382855043e-01
> > >  59 KSP preconditioned resid norm 3.963440719602e-07 true resid norm 1.462894974865e-07 ||r(i)||/||b|| 3.307082712524e-01
> > >  60 KSP preconditioned resid norm 3.710732500804e-07 true resid norm 2.006153077396e-07 ||r(i)||/||b|| 4.535195126737e-01
> > >  61 KSP preconditioned resid norm 3.700288732490e-07 true resid norm 1.637656172799e-07 ||r(i)||/||b|| 3.702155322956e-01
> > >  62 KSP preconditioned resid norm 3.681230892718e-07 true resid norm 2.598403207310e-07 ||r(i)||/||b|| 5.874061005545e-01
> > >  63 KSP preconditioned resid norm 3.447874366524e-07 true resid norm 9.834277028700e-08 ||r(i)||/||b|| 2.223178567880e-01
> > >  64 KSP preconditioned resid norm 3.308954457293e-07 true resid norm 8.462173093522e-08 ||r(i)||/||b|| 1.912994905910e-01
> > >  65 KSP preconditioned resid norm 3.238105866460e-07 true resid norm 1.508442004566e-07 ||r(i)||/||b|| 3.410048268575e-01
> > >  66 KSP preconditioned resid norm 3.149261250545e-07 true resid norm 6.146735546031e-08 ||r(i)||/||b|| 1.389557228100e-01
> > >  67 KSP preconditioned resid norm 3.080685419183e-07 true resid norm 1.469742604456e-07 ||r(i)||/||b|| 3.322562755748e-01
> > >  68 KSP preconditioned resid norm 3.017036477950e-07 true resid norm 8.246002370676e-08 ||r(i)||/||b|| 1.864126431224e-01
> > >  69 KSP preconditioned resid norm 2.951373085123e-07 true resid norm 9.600472070625e-08 ||r(i)||/||b|| 2.170323622840e-01
> > >  70 KSP preconditioned resid norm 2.854303567501e-07 true resid norm 1.353606365274e-07 ||r(i)||/||b|| 3.060020225015e-01
> > >  71 KSP preconditioned resid norm 2.720605973489e-07 true resid norm 7.105192119695e-08 ||r(i)||/||b|| 1.606230005020e-01
> > >  72 KSP preconditioned resid norm 2.679746464067e-07 true resid norm 1.093157769657e-07 ||r(i)||/||b|| 2.471239032336e-01
> > >  73 KSP preconditioned resid norm 2.560436669192e-07 true resid norm 1.046442873472e-07 ||r(i)||/||b|| 2.365633347550e-01
> > >  74 KSP preconditioned resid norm 2.486272155786e-07 true resid norm 6.788331443968e-08 ||r(i)||/||b|| 1.534599130557e-01
> > >  75 KSP preconditioned resid norm 2.450613653917e-07 true resid norm 8.385393991346e-08 ||r(i)||/||b|| 1.895637894925e-01
> > >  76 KSP preconditioned resid norm 2.381548789947e-07 true resid norm 9.639184405623e-08 ||r(i)||/||b|| 2.179075098239e-01
> > >  77 KSP preconditioned resid norm 2.318084665470e-07 true resid norm 5.817254053914e-08 ||r(i)||/||b|| 1.315073238107e-01
> > >  78 KSP preconditioned resid norm 2.301457113250e-07 true resid norm 7.214348778091e-08 ||r(i)||/||b|| 1.630906424322e-01
> > >  79 KSP preconditioned resid norm 2.288069605204e-07 true resid norm 6.520316797685e-08 ||r(i)||/||b|| 1.474010597637e-01
> > >  80 KSP preconditioned resid norm 2.272182407377e-07 true resid norm 6.553558340584e-08 ||r(i)||/||b|| 1.481525322463e-01
> > >  81 KSP preconditioned resid norm 2.261791202938e-07 true resid norm 6.410731366977e-08 ||r(i)||/||b|| 1.449237248240e-01
> > >  82 KSP preconditioned resid norm 2.250209367027e-07 true resid norm 6.108112632184e-08 ||r(i)||/||b|| 1.380825967627e-01
> > >  83 KSP preconditioned resid norm 2.237071893420e-07 true resid norm 6.644497913123e-08 ||r(i)||/||b|| 1.502083509715e-01
> > >  84 KSP preconditioned resid norm 2.234300550868e-07 true resid norm 5.793844170260e-08 ||r(i)||/||b|| 1.309781100061e-01
> > >  85 KSP preconditioned resid norm 2.229005171876e-07 true resid norm 6.926007074308e-08 ||r(i)||/||b|| 1.565722670172e-01
> > >  86 KSP preconditioned resid norm 2.225791427950e-07 true resid norm 6.289120214757e-08 ||r(i)||/||b|| 1.421745312997e-01
> > >  87 KSP preconditioned resid norm 2.224479658210e-07 true resid norm 6.242310048343e-08 ||r(i)||/||b|| 1.411163207325e-01
> > >  88 KSP preconditioned resid norm 2.217191418500e-07 true resid norm 7.465963600280e-08 ||r(i)||/||b|| 1.687787543128e-01
> > >  89 KSP preconditioned resid norm 2.208527637102e-07 true resid norm 5.960066095409e-08 ||r(i)||/||b|| 1.347357936714e-01
> > >  90 KSP preconditioned resid norm 2.204546869923e-07 true resid norm 6.334569716267e-08 ||r(i)||/||b|| 1.432019820964e-01
> > >  91 KSP preconditioned resid norm 2.204546270123e-07 true resid norm 6.327475947831e-08 ||r(i)||/||b|| 1.430416173445e-01
> > >  92 KSP preconditioned resid norm 2.204329606031e-07 true resid norm 6.775206679705e-08 ||r(i)||/||b|| 1.531632090424e-01
> > >  93 KSP preconditioned resid norm 2.203318409249e-07 true resid norm 6.059983893344e-08 ||r(i)||/||b|| 1.369945779854e-01
> > >  94 KSP preconditioned resid norm 2.202099673600e-07 true resid norm 7.148771248833e-08 ||r(i)||/||b|| 1.616081688639e-01
> > >  95 KSP preconditioned resid norm 2.200347850341e-07 true resid norm 6.555792528003e-08 ||r(i)||/||b|| 1.482030392391e-01
> > >  96 KSP preconditioned resid norm 2.196138742262e-07 true resid norm 6.418387078605e-08 ||r(i)||/||b|| 1.450967931030e-01
> > >  97 KSP preconditioned resid norm 2.193396877997e-07 true resid norm 7.242613574407e-08 ||r(i)||/||b|| 1.637296084610e-01
> > >  98 KSP preconditioned resid norm 2.186895327006e-07 true resid norm 5.717301192712e-08 ||r(i)||/||b|| 1.292477468416e-01
> > >  99 KSP preconditioned resid norm 2.183391464984e-07 true resid norm 6.921630451950e-08 ||r(i)||/||b|| 1.564733272273e-01
> > > 100 KSP preconditioned resid norm 2.182400010423e-07 true resid norm 6.548314285564e-08 ||r(i)||/||b|| 1.480339829041e-01
> > > 101 KSP preconditioned resid norm 2.177799012029e-07 true resid norm 6.272281990396e-08 ||r(i)||/||b|| 1.417938792252e-01
> > > 102 KSP preconditioned resid norm 2.169682429176e-07 true resid norm 7.907535208604e-08 ||r(i)||/||b|| 1.787611102394e-01
> > > 103 KSP preconditioned resid norm 2.164150347952e-07 true resid norm 5.949404986863e-08 ||r(i)||/||b|| 1.344947841090e-01
> > > 104 KSP preconditioned resid norm 2.163293952130e-07 true resid norm 6.398348014122e-08 ||r(i)||/||b|| 1.446437814729e-01
> > > 105 KSP preconditioned resid norm 2.160399869141e-07 true resid norm 6.102742478406e-08 ||r(i)||/||b|| 1.379611967782e-01
> > > 106 KSP preconditioned resid norm 2.152042538469e-07 true resid norm 5.769020450098e-08 ||r(i)||/||b|| 1.304169344110e-01
> > > 107 KSP preconditioned resid norm 2.150064693173e-07 true resid norm 6.321432589105e-08 ||r(i)||/||b|| 1.429049986022e-01
> > > 108 KSP preconditioned resid norm 2.144289854705e-07 true resid norm 5.801860121360e-08 ||r(i)||/||b|| 1.311593220122e-01
> > > 109 KSP preconditioned resid norm 2.131016574445e-07 true resid norm 5.968888809818e-08 ||r(i)||/||b|| 1.349352437126e-01
> > > 110 KSP preconditioned resid norm 2.131016340852e-07 true resid norm 5.978688769843e-08 ||r(i)||/||b|| 1.351567857846e-01
> > > 111 KSP preconditioned resid norm 2.128679373780e-07 true resid norm 7.339671126222e-08 ||r(i)||/||b|| 1.659237328325e-01
> > > 112 KSP preconditioned resid norm 2.124763157021e-07 true resid norm 6.095583088857e-08 ||r(i)||/||b|| 1.377993485676e-01
> > > 113 KSP preconditioned resid norm 2.114936950060e-07 true resid norm 7.680678889067e-08 ||r(i)||/||b|| 1.736326996190e-01
> > > 114 KSP preconditioned resid norm 2.111409526125e-07 true resid norm 6.861513382847e-08 ||r(i)||/||b|| 1.551142951480e-01
> > > 115 KSP preconditioned resid norm 2.104578242179e-07 true resid norm 6.666552557721e-08 ||r(i)||/||b|| 1.507069276645e-01
> > > 116 KSP preconditioned resid norm 2.095794193794e-07 true resid norm 8.409379058143e-08 ||r(i)||/||b|| 1.901060061323e-01
> > > 117 KSP preconditioned resid norm 2.088313732014e-07 true resid norm 6.461621062155e-08 ||r(i)||/||b|| 1.460741589567e-01
> > > 118 KSP preconditioned resid norm 2.076780694200e-07 true resid norm 8.889797338722e-08 ||r(i)||/||b|| 2.009665464840e-01
> > > 119 KSP preconditioned resid norm 2.059381548473e-07 true resid norm 7.343872609510e-08 ||r(i)||/||b|| 1.660187133539e-01
> > > 120 KSP preconditioned resid norm 2.036694513953e-07 true resid norm 7.626153726963e-08 ||r(i)||/||b|| 1.724000805719e-01
> > > 121 KSP preconditioned resid norm 2.036437947430e-07 true resid norm 7.403000216323e-08 ||r(i)||/||b|| 1.673553772271e-01
> > > 122 KSP preconditioned resid norm 2.034858116471e-07 true resid norm 9.140544194375e-08 ||r(i)||/||b|| 2.066350367433e-01
> > > 123 KSP preconditioned resid norm 2.013655754252e-07 true resid norm 4.519978376641e-08 ||r(i)||/||b|| 1.021805570954e-01
> > > 124 KSP preconditioned resid norm 1.998009157253e-07 true resid norm 7.924252610751e-08 ||r(i)||/||b|| 1.791390309555e-01
> > > 125 KSP preconditioned resid norm 1.978761477601e-07 true resid norm 6.193706028697e-08 ||r(i)||/||b|| 1.400175575547e-01
> > > 126 KSP preconditioned resid norm 1.966003019512e-07 true resid norm 5.417132474463e-08 ||r(i)||/||b|| 1.224620048983e-01
> > > 127 KSP preconditioned resid norm 1.957579266801e-07 true resid norm 7.621152479630e-08 ||r(i)||/||b|| 1.722870202437e-01
> > > 128 KSP preconditioned resid norm 1.950451407619e-07 true resid norm 5.429984244536e-08 ||r(i)||/||b|| 1.227525374885e-01
> > > 129 KSP preconditioned resid norm 1.948052418686e-07 true resid norm 6.458532086853e-08 ||r(i)||/||b|| 1.460043282648e-01
> > > 130 KSP preconditioned resid norm 1.946142511609e-07 true resid norm 5.988337322193e-08 ||r(i)||/||b|| 1.353749050701e-01
> > > 131 KSP preconditioned resid norm 1.942556458837e-07 true resid norm 5.860812144886e-08 ||r(i)||/||b|| 1.324920165748e-01
> > > 132 KSP preconditioned resid norm 1.935241717066e-07 true resid norm 8.129956448465e-08 ||r(i)||/||b|| 1.837892595590e-01
> > > 133 KSP preconditioned resid norm 1.924599958511e-07 true resid norm 5.461025246990e-08 ||r(i)||/||b|| 1.234542636162e-01
> > > 134 KSP preconditioned resid norm 1.920525995377e-07 true resid norm 6.091841929726e-08 ||r(i)||/||b|| 1.377147743302e-01
> > > 135 KSP preconditioned resid norm 1.912474104817e-07 true resid norm 6.146257286777e-08 ||r(i)||/||b|| 1.389449110775e-01
> > > 136 KSP preconditioned resid norm 1.899112302838e-07 true resid norm 5.363752248243e-08 ||r(i)||/||b|| 1.212552687596e-01
> > > 137 KSP preconditioned resid norm 1.871603374495e-07 true resid norm 1.033541760028e-07 ||r(i)||/||b|| 2.336468540796e-01
> > > 138 KSP preconditioned resid norm 1.848601023477e-07 true resid norm 4.885699993060e-08 ||r(i)||/||b|| 1.104482157861e-01
> > > 139 KSP preconditioned resid norm 1.827750189949e-07 true resid norm 8.191132589117e-08 ||r(i)||/||b|| 1.851722334610e-01
> > > 140 KSP preconditioned resid norm 1.793562029798e-07 true resid norm 6.003412567942e-08 ||r(i)||/||b|| 1.357157024989e-01
> > > 141 KSP preconditioned resid norm 1.762198590085e-07 true resid norm 5.955815320828e-08 ||r(i)||/||b|| 1.346396988500e-01
> > > 142 KSP preconditioned resid norm 1.735812332311e-07 true resid norm 7.966870349397e-08 ||r(i)||/||b|| 1.801024657142e-01
> > > 143 KSP preconditioned resid norm 1.688412385715e-07 true resid norm 5.688299429377e-08 ||r(i)||/||b|| 1.285921206223e-01
> > > 144 KSP preconditioned resid norm 1.661476005287e-07 true resid norm 7.082505578352e-08 ||r(i)||/||b|| 1.601101388819e-01
> > > 145 KSP preconditioned resid norm 1.610383377332e-07 true resid norm 5.920400760597e-08 ||r(i)||/||b|| 1.338391022117e-01
> > > 146 KSP preconditioned resid norm 1.544803228895e-07 true resid norm 6.998127061136e-08 ||r(i)||/||b|| 1.582026421690e-01
> > > 147 KSP preconditioned resid norm 1.526491664454e-07 true resid norm 5.645428190677e-08 ||r(i)||/||b|| 1.276229551333e-01
> > > 148 KSP preconditioned resid norm 1.514873753547e-07 true resid norm 5.864109468824e-08 ||r(i)||/||b|| 1.325665572848e-01
> > > 149 KSP preconditioned resid norm 1.504821676672e-07 true resid norm 6.213039985019e-08 ||r(i)||/||b|| 1.404546292093e-01
> > > 150 KSP preconditioned resid norm 1.486089733443e-07 true resid norm 5.614398416742e-08 ||r(i)||/||b|| 1.269214828423e-01
> > > 151 KSP preconditioned resid norm 1.485963531298e-07 true resid norm 5.477576327252e-08 ||r(i)||/||b|| 1.238284243888e-01
> > > 152 KSP preconditioned resid norm 1.485376571004e-07 true resid norm 6.371560914841e-08 ||r(i)||/||b|| 1.440382208929e-01
> > > 153 KSP preconditioned resid norm 1.474539380136e-07 true resid norm 3.640242097893e-08 ||r(i)||/||b|| 8.229286393207e-02
> > > 154 KSP preconditioned resid norm 1.468139621410e-07 true resid norm 4.869307908912e-08 ||r(i)||/||b|| 1.100776493474e-01
> > > 155 KSP preconditioned resid norm 1.460083083948e-07 true resid norm 4.630532787515e-08 ||r(i)||/||b|| 1.046797972136e-01
> > > 156 KSP preconditioned resid norm 1.443569894841e-07 true resid norm 3.603261718441e-08 ||r(i)||/||b|| 8.145686971725e-02
> > > 157 KSP preconditioned resid norm 1.423163427629e-07 true resid norm 6.442826410227e-08 ||r(i)||/||b|| 1.456492790470e-01
> > > 158 KSP preconditioned resid norm 1.409955526676e-07 true resid norm 3.683864351150e-08 ||r(i)||/||b|| 8.327900717616e-02
> > > 159 KSP preconditioned resid norm 1.392132231651e-07 true resid norm 6.633950516791e-08 ||r(i)||/||b|| 1.499699120359e-01
> > > 160 KSP preconditioned resid norm 1.373585912794e-07 true resid norm 4.602835576127e-08 ||r(i)||/||b|| 1.040536622515e-01
> > > 161 KSP preconditioned resid norm 1.358554686788e-07 true resid norm 4.404395475469e-08 ||r(i)||/||b|| 9.956764078290e-02
> > > 162 KSP preconditioned resid norm 1.356117729059e-07 true resid norm 5.220262213455e-08 ||r(i)||/||b|| 1.180114718936e-01
> > > 163 KSP preconditioned resid norm 1.345828776136e-07 true resid norm 4.364444677578e-08 ||r(i)||/||b|| 9.866449602318e-02
> > > 164 KSP preconditioned resid norm 1.335743316358e-07 true resid norm 4.365564289163e-08 ||r(i)||/||b|| 9.868980643971e-02
> > > 165 KSP preconditioned resid norm 1.335181864567e-07 true resid norm 4.195338231508e-08 ||r(i)||/||b|| 9.484160364891e-02
> > > 166 KSP preconditioned resid norm 1.334081155239e-07 true resid norm 4.320705771627e-08 ||r(i)||/||b|| 9.767571567858e-02
> > > 167 KSP preconditioned resid norm 1.330652717803e-07 true resid norm 4.671646276077e-08 ||r(i)||/||b|| 1.056092262541e-01
> > > 168 KSP preconditioned resid norm 1.327117008156e-07 true resid norm 4.076640307294e-08 ||r(i)||/||b|| 9.215826779826e-02
> > > 169 KSP preconditioned resid norm 1.323823831437e-07 true resid norm 4.609403230274e-08 ||r(i)||/||b|| 1.042021334396e-01
> > > 170 KSP preconditioned resid norm 1.321738715249e-07 true resid norm 4.115763769210e-08 ||r(i)||/||b|| 9.304270944840e-02
> > > 171 KSP preconditioned resid norm 1.317312129565e-07 true resid norm 4.587805680503e-08 ||r(i)||/||b|| 1.037138900270e-01
> > > 172 KSP preconditioned resid norm 1.315622581976e-07 true resid norm 4.346795666887e-08 ||r(i)||/||b|| 9.826551496744e-02
> > > 173 KSP preconditioned resid norm 1.313903001504e-07 true resid norm 4.268100404068e-08 ||r(i)||/||b|| 9.648649632497e-02
> > > 174 KSP preconditioned resid norm 1.310657837357e-07 true resid norm 4.888365697755e-08 ||r(i)||/||b|| 1.105084778423e-01
> > > 175 KSP preconditioned resid norm 1.308286004287e-07 true resid norm 4.218058360777e-08 ||r(i)||/||b|| 9.535522457196e-02
> > > 176 KSP preconditioned resid norm 1.305438769953e-07 true resid norm 5.026215795117e-08 ||r(i)||/||b|| 1.136247758797e-01
> > > 177 KSP preconditioned resid norm 1.303521375300e-07 true resid norm 4.518428840914e-08 ||r(i)||/||b|| 1.021455276305e-01
> > > 178 KSP preconditioned resid norm 1.302430349652e-07 true resid norm 4.699834591242e-08 ||r(i)||/||b|| 1.062464633174e-01
> > > 179 KSP preconditioned resid norm 1.299950133828e-07 true resid norm 4.780011567673e-08 ||r(i)||/||b|| 1.080589782091e-01
> > > 180 KSP preconditioned resid norm 1.297967984970e-07 true resid norm 4.439369158202e-08 ||r(i)||/||b|| 1.003582707567e-01
> > > 181 KSP preconditioned resid norm 1.297963590960e-07 true resid norm 4.419939374367e-08 ||r(i)||/||b|| 9.991903278447e-02
> > > 182 KSP preconditioned resid norm 1.297926195884e-07 true resid norm 4.616612604888e-08 ||r(i)||/||b|| 1.043651116339e-01
> > > 183 KSP preconditioned resid norm 1.297319003442e-07 true resid norm 3.981403448576e-08 ||r(i)||/||b|| 9.000530279069e-02
> > > 184 KSP preconditioned resid norm 1.296224619385e-07 true resid norm 5.101974490162e-08 ||r(i)||/||b|| 1.153374092198e-01
> > > 185 KSP preconditioned resid norm 1.294198893701e-07 true resid norm 4.272250450111e-08 ||r(i)||/||b|| 9.658031403412e-02
> > > 186 KSP preconditioned resid norm 1.292654432794e-07 true resid norm 4.341411289813e-08 ||r(i)||/||b|| 9.814379344509e-02
> > > 187 KSP preconditioned resid norm 1.291166048974e-07 true resid norm 4.903770559588e-08 ||r(i)||/||b|| 1.108567267127e-01
> > > 188 KSP preconditioned resid norm 1.287267461311e-07 true resid norm 3.838768901036e-08 ||r(i)||/||b|| 8.678084543401e-02
> > > 189 KSP preconditioned resid norm 1.285403517589e-07 true resid norm 4.836219780019e-08 ||r(i)||/||b|| 1.093296450071e-01
> > > 190 KSP preconditioned resid norm 1.283960766544e-07 true resid norm 4.373642319734e-08 ||r(i)||/||b|| 9.887242184076e-02
> > > 191 KSP preconditioned resid norm 1.281846985469e-07 true resid norm 4.196631979171e-08 ||r(i)||/||b|| 9.487085065985e-02
> > > 192 KSP preconditioned resid norm 1.279291087436e-07 true resid norm 5.017898447715e-08 ||r(i)||/||b|| 1.134367503804e-01
> > > 193 KSP preconditioned resid norm 1.277583114588e-07 true resid norm 4.217096345089e-08 ||r(i)||/||b|| 9.533347683541e-02
> > > 194 KSP preconditioned resid norm 1.275868702813e-07 true resid norm 4.784228026600e-08 ||r(i)||/||b|| 1.081542972762e-01
> > > 195 KSP preconditioned resid norm 1.273992295764e-07 true resid norm 4.379242155010e-08 ||r(i)||/||b|| 9.899901410304e-02
> > > 196 KSP preconditioned resid norm 1.272302392639e-07 true resid norm 4.236252438739e-08 ||r(i)||/||b|| 9.576652765067e-02
> > > 197 KSP preconditioned resid norm 1.269756464572e-07 true resid norm 5.265147070813e-08 ||r(i)||/||b|| 1.190261581040e-01
> > > 198 KSP preconditioned resid norm 1.266399406059e-07 true resid norm 3.658633711709e-08 ||r(i)||/||b|| 8.270863259045e-02
> > > 199 KSP preconditioned resid norm 1.262216614405e-07 true resid norm 4.823243517156e-08 ||r(i)||/||b|| 1.090362980798e-01
> > > 200 KSP preconditioned resid norm 1.256037114182e-07 true resid norm 4.118749777942e-08 ||r(i)||/||b|| 9.311021243410e-02
> > > 201 KSP preconditioned resid norm 1.252357182659e-07 true resid norm 4.297385591425e-08 ||r(i)||/||b|| 9.714852974845e-02
> > > 202 KSP preconditioned resid norm 1.242188985573e-07 true resid norm 4.735199275670e-08 ||r(i)||/||b|| 1.070459324421e-01
> > > 203 KSP preconditioned resid norm 1.231408970960e-07 true resid norm 3.893514112125e-08 ||r(i)||/||b|| 8.801843900221e-02
> > > 204 KSP preconditioned resid norm 1.220276184666e-07 true resid norm 4.828090901382e-08 ||r(i)||/||b|| 1.091458801130e-01
> > > 205 KSP preconditioned resid norm 1.200057581901e-07 true resid norm 3.901824500784e-08 ||r(i)||/||b|| 8.820630718920e-02
> > > 206 KSP preconditioned resid norm 1.190463271301e-07 true resid norm 3.812404409291e-08 ||r(i)||/||b|| 8.618483850000e-02
> > > 207 KSP preconditioned resid norm 1.176408472739e-07 true resid norm 4.100938913911e-08 ||r(i)||/||b|| 9.270757245280e-02
> > > 208 KSP preconditioned resid norm 1.166353857162e-07 true resid norm 3.610482888020e-08 ||r(i)||/||b|| 8.162011455361e-02
> > > 209 KSP preconditioned resid norm 1.159620049487e-07 true resid norm 3.566307135323e-08 ||r(i)||/||b|| 8.062145866534e-02
> > > 210 KSP preconditioned resid norm 1.146020921987e-07 true resid norm 3.592344723620e-08 ||r(i)||/||b|| 8.121007548070e-02
> > > 211 KSP preconditioned resid norm 1.145847448331e-07 true resid norm 3.473565983922e-08 ||r(i)||/||b|| 7.852491268077e-02
> > > 212 KSP preconditioned resid norm 1.145177079586e-07 true resid norm 4.122532839361e-08 ||r(i)||/||b|| 9.319573393247e-02
> > > 213 KSP preconditioned resid norm 1.132872800274e-07 true resid norm 2.141692237998e-08 ||r(i)||/||b|| 4.841600728366e-02
> > > 214 KSP preconditioned resid norm 1.123613362087e-07 true resid norm 3.246863698820e-08 ||r(i)||/||b|| 7.339998422842e-02
> > > 215 KSP preconditioned resid norm 1.111053137881e-07 true resid norm 2.903254997529e-08 ||r(i)||/||b|| 6.563221951914e-02
> > > 216 KSP preconditioned resid norm 1.099813982910e-07 true resid norm 2.173780265025e-08 ||r(i)||/||b|| 4.914140289501e-02
> > > 217 KSP preconditioned resid norm 1.089711486676e-07 true resid norm 4.266914180936e-08 ||r(i)||/||b|| 9.645968005942e-02
> > > 218 KSP preconditioned resid norm 1.077041044884e-07 true resid norm 2.174207697189e-08 ||r(i)||/||b|| 4.915106560862e-02
> > > 219 KSP preconditioned resid norm 1.068087285500e-07 true resid norm 3.726239717827e-08 ||r(i)||/||b|| 8.423696277093e-02
> > > 220 KSP preconditioned resid norm 1.060944039406e-07 true resid norm 2.612138847397e-08 ||r(i)||/||b|| 5.905112378786e-02
> > > 221 KSP preconditioned resid norm 1.052145789908e-07 true resid norm 2.848574746885e-08 ||r(i)||/||b|| 6.439609447443e-02
> > > 222 KSP preconditioned resid norm 1.034013372786e-07 true resid norm 4.496176952774e-08 ||r(i)||/||b|| 1.016424919659e-01
> > > 223 KSP preconditioned resid norm 1.016447882738e-07 true resid norm 2.629128290689e-08 ||r(i)||/||b|| 5.943519438194e-02
> > > 224 KSP preconditioned resid norm 1.002724751991e-07 true resid norm 3.297488178025e-08 ||r(i)||/||b|| 7.454442277585e-02
> > > 225 KSP preconditioned resid norm 9.969279422176e-08 true resid norm 3.069952269998e-08 ||r(i)||/||b|| 6.940064908846e-02
> > > 226 KSP preconditioned resid norm 9.811249548568e-08 true resid norm 3.219822477037e-08 ||r(i)||/||b|| 7.278867884683e-02
> > > 227 KSP preconditioned resid norm 9.637808562080e-08 true resid norm 4.091298315961e-08 ||r(i)||/||b|| 9.248963298779e-02
> > > 228 KSP preconditioned resid norm 9.526012021860e-08 true resid norm 2.720466192827e-08 ||r(i)||/||b|| 6.150001791574e-02
> > > 229 KSP preconditioned resid norm 9.392714618074e-08 true resid norm 4.018517470597e-08 ||r(i)||/||b|| 9.084431818639e-02
> > > 230 KSP preconditioned resid norm 9.288540879331e-08 true resid norm 2.742429822661e-08 ||r(i)||/||b|| 6.199653709024e-02
> > > 231 KSP preconditioned resid norm 9.182683719708e-08 true resid norm 3.418196050419e-08 ||r(i)||/||b|| 7.727319637148e-02
> > > 232 KSP preconditioned resid norm 9.152618596319e-08 true resid norm 3.061702948039e-08 ||r(i)||/||b|| 6.921416140130e-02
> > > 233 KSP preconditioned resid norm 9.028012081487e-08 true resid norm 3.309940751576e-08 ||r(i)||/||b|| 7.482593095946e-02
> > > 234 KSP preconditioned resid norm 8.964512632411e-08 true resid norm 3.657895201743e-08 ||r(i)||/||b|| 8.269193751948e-02
> > > 235 KSP preconditioned resid norm 8.927591956786e-08 true resid norm 2.996402299113e-08 ||r(i)||/||b|| 6.773794710778e-02
> > > 236 KSP preconditioned resid norm 8.863790942206e-08 true resid norm 3.770401488950e-08 ||r(i)||/||b|| 8.523530258577e-02
> > > 237 KSP preconditioned resid norm 8.842416675824e-08 true resid norm 3.294247881070e-08 ||r(i)||/||b|| 7.447117124223e-02
> > > 238 KSP preconditioned resid norm 8.793063593991e-08 true resid norm 3.836231748404e-08 ||r(i)||/||b|| 8.672348948056e-02
> > > 239 KSP preconditioned resid norm 8.778266322588e-08 true resid norm 3.572179823322e-08 ||r(i)||/||b|| 8.075421915252e-02
> > > 240 KSP preconditioned resid norm 8.738590572964e-08 true resid norm 3.574931934089e-08 ||r(i)||/||b|| 8.081643454117e-02
> > > 241 KSP preconditioned resid norm 8.738404146064e-08 true resid norm 3.532576961772e-08 ||r(i)||/||b|| 7.985893998998e-02
> > > 242 KSP preconditioned resid norm 8.737492315747e-08 true resid norm 3.850858638399e-08 ||r(i)||/||b|| 8.705415118814e-02
> > > 243 KSP preconditioned resid norm 8.704894133677e-08 true resid norm 2.725999899728e-08 ||r(i)||/||b|| 6.162511525180e-02
> > > 244 KSP preconditioned resid norm 8.691957267756e-08 true resid norm 3.445507385918e-08 ||r(i)||/||b|| 7.789060805883e-02
> > > 245 KSP preconditioned resid norm 8.664547872292e-08 true resid norm 3.233777274784e-08 ||r(i)||/||b|| 7.310414695067e-02
> > > 246 KSP preconditioned resid norm 8.647910251595e-08 true resid norm 2.869258593620e-08 ||r(i)||/||b|| 6.486368232688e-02
> > > 247 KSP preconditioned resid norm 8.602870326813e-08 true resid norm 3.830342792446e-08 ||r(i)||/||b|| 8.659036123294e-02
> > > 248 KSP preconditioned resid norm 8.584186792773e-08 true resid norm 2.914852049114e-08 ||r(i)||/||b|| 6.589438740865e-02
> > > 249 KSP preconditioned resid norm 8.568202493555e-08 true resid norm 3.726679821110e-08 ||r(i)||/||b|| 8.424691193326e-02
> > > 250 KSP preconditioned resid norm 8.535775976392e-08 true resid norm 3.374879488937e-08 ||r(i)||/||b|| 7.629396372591e-02
> > > 251 KSP preconditioned resid norm 8.505569181999e-08 true resid norm 3.019219829750e-08 ||r(i)||/||b|| 6.825376992767e-02
> > > 252 KSP preconditioned resid norm 8.489565939881e-08 true resid norm 3.532505625863e-08 ||r(i)||/||b|| 7.985732734003e-02
> > > 253 KSP preconditioned resid norm 8.454497959931e-08 true resid norm 2.833135878246e-08 ||r(i)||/||b|| 6.404707683166e-02
> > > 254 KSP preconditioned resid norm 8.448142425824e-08 true resid norm 3.023601426215e-08 ||r(i)||/||b|| 6.835282216432e-02
> > > 255 KSP preconditioned resid norm 8.447314709431e-08 true resid norm 2.955565650261e-08 ||r(i)||/||b|| 6.681477642380e-02
> > > 256 KSP preconditioned resid norm 8.434191340398e-08 true resid norm 3.011718192322e-08 ||r(i)||/||b|| 6.808418471561e-02
> > > 257 KSP preconditioned resid norm 8.420519688672e-08 true resid norm 3.194610164662e-08 ||r(i)||/||b|| 7.221871857057e-02
> > > 258 KSP preconditioned resid norm 8.414920999588e-08 true resid norm 2.927199782498e-08 ||r(i)||/||b|| 6.617352553076e-02
> > > 259 KSP preconditioned resid norm 8.411142889741e-08 true resid norm 3.116811073402e-08 ||r(i)||/||b|| 7.045995916421e-02
> > > 260 KSP preconditioned resid norm 8.393401673483e-08 true resid norm 2.913633916610e-08 ||r(i)||/||b|| 6.586684978622e-02
> > > 261 KSP preconditioned resid norm 8.386932870420e-08 true resid norm 2.931516814567e-08 ||r(i)||/||b|| 6.627111819715e-02
> > > 262 KSP preconditioned resid norm 8.383102906154e-08 true resid norm 2.947670084156e-08 ||r(i)||/||b|| 6.663628589221e-02
> > > 263 KSP preconditioned resid norm 8.371299202072e-08 true resid norm 2.900846382950e-08 ||r(i)||/||b|| 6.557776935168e-02
> > > 264 KSP preconditioned resid norm 8.354612585259e-08 true resid norm 3.153902284033e-08 ||r(i)||/||b|| 7.129845887590e-02
> > > 265 KSP preconditioned resid norm 8.348749379055e-08 true resid norm 2.912311287048e-08 ||r(i)||/||b|| 6.583694985881e-02
> > > 266 KSP preconditioned resid norm 8.328479663117e-08 true resid norm 3.201390360666e-08 ||r(i)||/||b|| 7.237199457042e-02
> > > 267 KSP preconditioned resid norm 8.304748250656e-08 true resid norm 3.103708076427e-08 ||r(i)||/||b|| 7.016374723157e-02
> > > 268 KSP preconditioned resid norm 8.294564373794e-08 true resid norm 2.975578688471e-08 ||r(i)||/||b|| 6.726719969290e-02
> > > 269 KSP preconditioned resid norm 8.286083099532e-08 true resid norm 3.122272154943e-08 ||r(i)||/||b|| 7.058341470044e-02
> > > 270 KSP preconditioned resid norm 8.249515525349e-08 true resid norm 2.958445476571e-08 ||r(i)||/||b|| 6.687987900443e-02
> > > 271 KSP preconditioned resid norm 8.249243482197e-08 true resid norm 2.915759140675e-08 ||r(i)||/||b|| 6.591489350698e-02
> > > 272 KSP preconditioned resid norm 8.247967811026e-08 true resid norm 3.226477388325e-08 ||r(i)||/||b|| 7.293912260697e-02
> > > 273 KSP preconditioned resid norm 8.225540420138e-08 true resid norm 2.335784346654e-08 ||r(i)||/||b|| 5.280373619246e-02
> > > 274 KSP preconditioned resid norm 8.208649428128e-08 true resid norm 3.103095297226e-08 ||r(i)||/||b|| 7.014989448385e-02
> > > 275 KSP preconditioned resid norm 8.177662092059e-08 true resid norm 2.780330970969e-08 ||r(i)||/||b|| 6.285334659815e-02
> > > 276 KSP preconditioned resid norm 8.156719698267e-08 true resid norm 2.529092246235e-08 ||r(i)||/||b|| 5.717373693676e-02
> > > 277 KSP preconditioned resid norm 8.129665601936e-08 true resid norm 3.216359520748e-08 ||r(i)||/||b|| 7.271039378141e-02
> > > 278 KSP preconditioned resid norm 8.111942990953e-08 true resid norm 2.578429842977e-08 ||r(i)||/||b|| 5.828908367091e-02
> > > 279 KSP preconditioned resid norm 8.103355449576e-08 true resid norm 3.114448259432e-08 ||r(i)||/||b|| 7.040654438485e-02
> > > 280 KSP preconditioned resid norm 8.096927476093e-08 true resid norm 2.905799246198e-08 ||r(i)||/||b|| 6.568973588864e-02
> > > 281 KSP preconditioned resid norm 8.069018681340e-08 true resid norm 2.806750078967e-08 ||r(i)||/||b|| 6.345058821044e-02
> > > 282 KSP preconditioned resid norm 8.047055052412e-08 true resid norm 3.356282539492e-08 ||r(i)||/||b|| 7.587355316280e-02
> > > 283 KSP preconditioned resid norm 8.023864541552e-08 true resid norm 2.697346140135e-08 ||r(i)||/||b|| 6.097735615340e-02
> > > 284 KSP preconditioned resid norm 8.014006658762e-08 true resid norm 3.033393715647e-08 ||r(i)||/||b|| 6.857419083160e-02
> > > 285 KSP preconditioned resid norm 8.000866139550e-08 true resid norm 2.744969989335e-08 ||r(i)||/||b|| 6.205396118040e-02
> > > 286 KSP preconditioned resid norm 7.963315124505e-08 true resid norm 2.853888338671e-08 ||r(i)||/||b|| 6.451621579442e-02
> > > 287 KSP preconditioned resid norm 7.901906690217e-08 true resid norm 3.213929486191e-08 ||r(i)||/||b|| 7.265545938481e-02
> > > 288 KSP preconditioned resid norm 7.847487693433e-08 true resid norm 2.531887675170e-08 ||r(i)||/||b|| 5.723693159436e-02
> > > 289 KSP preconditioned resid norm 7.776109704697e-08 true resid norm 3.151424977919e-08 ||r(i)||/||b|| 7.124245583834e-02
> > > 290 KSP preconditioned resid norm 7.697887176101e-08 true resid norm 2.452083040958e-08 ||r(i)||/||b|| 5.543283402950e-02
> > > 291 KSP preconditioned resid norm 7.630186207736e-08 true resid norm 2.646550673478e-08 ||r(i)||/||b|| 5.982905219075e-02
> > > 292 KSP preconditioned resid norm 7.539569101676e-08 true resid norm 2.639665425804e-08 ||r(i)||/||b|| 5.967340134812e-02
> > > 293 KSP preconditioned resid norm 7.387540581378e-08 true resid norm 2.766591414879e-08 ||r(i)||/||b|| 6.254274433891e-02
> > > 294 KSP preconditioned resid norm 7.148854762848e-08 true resid norm 4.506538736910e-08 ||r(i)||/||b|| 1.018767348732e-01
> > > 295 KSP preconditioned resid norm 6.875818761377e-08 true resid norm 1.988285545247e-08 ||r(i)||/||b|| 4.494803022244e-02
> > > 296 KSP preconditioned resid norm 6.720148343751e-08 true resid norm 2.185917455369e-08 ||r(i)||/||b|| 4.941578139143e-02
> > > 297 KSP preconditioned resid norm 6.559210493364e-08 true resid norm 2.579380002545e-08 ||r(i)||/||b|| 5.831056338297e-02
> > > 298 KSP preconditioned resid norm 6.296172453909e-08 true resid norm 2.690729261887e-08 ||r(i)||/||b|| 6.082777218435e-02
> > > 299 KSP preconditioned resid norm 6.126664666716e-08 true resid norm 2.523269850506e-08 ||r(i)||/||b|| 5.704211337804e-02
> > > 300 KSP preconditioned resid norm 5.996078539496e-08 true resid norm 1.432165407581e-08 ||r(i)||/||b|| 3.237614143370e-02
> > > 301 KSP preconditioned resid norm 5.994360410331e-08 true resid norm 1.354971586959e-08 ||r(i)||/||b|| 3.063106503328e-02
> > > 302 KSP preconditioned resid norm 5.968927298570e-08 true resid norm 2.119292714347e-08 ||r(i)||/||b|| 4.790963410783e-02
> > > 303 KSP preconditioned resid norm 5.871687993468e-08 true resid norm 8.809042798461e-09 ||r(i)||/||b|| 1.991409749382e-02
> > > 304 KSP preconditioned resid norm 5.799650512507e-08 true resid norm 1.745679956812e-08 ||r(i)||/||b|| 3.946358491871e-02
> > > 305 KSP preconditioned resid norm 5.745928074883e-08 true resid norm 1.274997712124e-08 ||r(i)||/||b|| 2.882314154277e-02
> > > 306 KSP preconditioned resid norm 5.632393272566e-08 true resid norm 1.202295750268e-08 ||r(i)||/||b|| 2.717961001553e-02
> > > 307 KSP preconditioned resid norm 5.396643228430e-08 true resid norm 2.502414535309e-08 ||r(i)||/||b|| 5.657064923649e-02
> > > 308 KSP preconditioned resid norm 5.160090231555e-08 true resid norm 1.262817440249e-08 ||r(i)||/||b|| 2.854778912689e-02
> > > 309 KSP preconditioned resid norm 4.907022431548e-08 true resid norm 2.171207321606e-08 ||r(i)||/||b|| 4.908323783977e-02
> > > 310 KSP preconditioned resid norm 4.776335659862e-08 true resid norm 1.151540470517e-08 ||r(i)||/||b|| 2.603221453522e-02
> > > 311 KSP preconditioned resid norm 4.697621190386e-08 true resid norm 1.508650195148e-08 ||r(i)||/||b|| 3.410518913076e-02
> > > 312 KSP preconditioned resid norm 4.595176479120e-08 true resid norm 1.933671761706e-08 ||r(i)||/||b|| 4.371340776138e-02
> > > 313 KSP preconditioned resid norm 4.509046368009e-08 true resid norm 1.186794873424e-08 ||r(i)||/||b|| 2.682919058886e-02
> > > 314 KSP preconditioned resid norm 4.450909170016e-08 true resid norm 1.579009874879e-08 ||r(i)||/||b|| 3.569577003024e-02
> > > 315 KSP preconditioned resid norm 4.337869810365e-08 true resid norm 1.647588479037e-08 ||r(i)||/||b|| 3.724608717643e-02
> > > 316 KSP preconditioned resid norm 4.223810751226e-08 true resid norm 1.498137614524e-08 ||r(i)||/||b|| 3.386753725389e-02
> > > 317 KSP preconditioned resid norm 4.156026722749e-08 true resid norm 1.333299778266e-08 ||r(i)||/||b|| 3.014114289185e-02
> > > 318 KSP preconditioned resid norm 4.099199515842e-08 true resid norm 1.310678580056e-08 ||r(i)||/||b|| 2.962975844646e-02
> > > 319 KSP preconditioned resid norm 4.066386009421e-08 true resid norm 1.506644976724e-08 ||r(i)||/||b|| 3.405985830867e-02
> > > 320 KSP preconditioned resid norm 4.023087548652e-08 true resid norm 1.240117063260e-08 ||r(i)||/||b|| 2.803461473228e-02
> > > 321 KSP preconditioned resid norm 3.991268177919e-08 true resid norm 1.312932289209e-08 ||r(i)||/||b|| 2.968070675585e-02
> > > 322 KSP preconditioned resid norm 3.956889976017e-08 true resid norm 1.421972275585e-08 ||r(i)||/||b|| 3.214571114861e-02
> > > 323 KSP preconditioned resid norm 3.900185975518e-08 true resid norm 1.347489145169e-08 ||r(i)||/||b|| 3.046191376598e-02
> > > 324 KSP preconditioned resid norm 3.877682049038e-08 true resid norm 1.279539901604e-08 ||r(i)||/||b|| 2.892582421352e-02
> > > 325 KSP preconditioned resid norm 3.869150965109e-08 true resid norm 1.224801722014e-08 ||r(i)||/||b|| 2.768838960238e-02
> > > 326 KSP preconditioned resid norm 3.851624335552e-08 true resid norm 1.309261686557e-08 ||r(i)||/||b|| 2.959772754831e-02
> > > 327 KSP preconditioned resid norm 3.836778709819e-08 true resid norm 1.256963552910e-08 ||r(i)||/||b|| 2.841545365542e-02
> > > 328 KSP preconditioned resid norm 3.810190892142e-08 true resid norm 1.532295260746e-08 ||r(i)||/||b|| 3.463971955858e-02
> > > 329 KSP preconditioned resid norm 3.779873511822e-08 true resid norm 1.357026597966e-08 ||r(i)||/||b|| 3.067752148771e-02
> > > 330 KSP preconditioned resid norm 3.758209190896e-08 true resid norm 1.326727470061e-08 ||r(i)||/||b|| 2.999256649217e-02
> > > 331 KSP preconditioned resid norm 3.758046617049e-08 true resid norm 1.304204653926e-08 ||r(i)||/||b|| 2.948340611389e-02
> > > 332 KSP preconditioned resid norm 3.756576997625e-08 true resid norm 1.547320887283e-08 ||r(i)||/||b|| 3.497939527431e-02
> > > 333 KSP preconditioned resid norm 3.735750946435e-08 true resid norm 9.401475437163e-09 ||r(i)||/||b|| 2.125337595977e-02
> > > 334 KSP preconditioned resid norm 3.726816411327e-08 true resid norm 1.293737018744e-08 ||r(i)||/||b|| 2.924677029283e-02
> > > 335 KSP preconditioned resid norm 3.715836120670e-08 true resid norm 1.137076112403e-08 ||r(i)||/||b|| 2.570522709260e-02
> > > 336 KSP preconditioned resid norm 3.711352115906e-08 true resid norm 1.100868545692e-08 ||r(i)||/||b|| 2.488670341188e-02
> > > 337 KSP preconditioned resid norm 3.697154209112e-08 true resid norm 1.292178506561e-08 ||r(i)||/||b|| 2.921153790237e-02
> > > 338 KSP preconditioned resid norm 3.687250442553e-08 true resid norm 1.038256633339e-08 ||r(i)||/||b|| 2.347127184298e-02
> > > 339 KSP preconditioned resid norm 3.681163672322e-08 true resid norm 1.217819776625e-08 ||r(i)||/||b|| 2.753055276999e-02
> > > 340 KSP preconditioned resid norm 3.676709918842e-08 true resid norm 1.163124964184e-08 ||r(i)||/||b|| 2.629409853509e-02
> > > 341 KSP preconditioned resid norm 3.664698023565e-08 true resid norm 1.141439938468e-08 ||r(i)||/||b|| 2.580387760401e-02
> > > 342 KSP preconditioned resid norm 3.656190729093e-08 true resid norm 1.232477473873e-08 ||r(i)||/||b|| 2.786191091946e-02
> > > 343 KSP preconditioned resid norm 3.650243259584e-08 true resid norm 1.132768943490e-08 ||r(i)||/||b|| 2.560785739692e-02
> > > 344 KSP preconditioned resid norm 3.650130795451e-08 true resid norm 1.141084292815e-08 ||r(i)||/||b|| 2.579583772683e-02
> > > 345 KSP preconditioned resid norm 3.647229125147e-08 true resid norm 1.138306478808e-08 ||r(i)||/||b|| 2.573304127980e-02
> > > 346 KSP preconditioned resid norm 3.643856164392e-08 true resid norm 1.116515940173e-08 ||r(i)||/||b|| 2.524043507871e-02
> > > 347 KSP preconditioned resid norm 3.639892567434e-08 true resid norm 1.174359887576e-08 ||r(i)||/||b|| 2.654808000036e-02
> > > 348 KSP preconditioned resid norm 3.632894120883e-08 true resid norm 1.064588448828e-08 ||r(i)||/||b|| 2.406654008362e-02
> > > 349 KSP preconditioned resid norm 3.632109543324e-08 true resid norm 1.070526312693e-08 ||r(i)||/||b|| 2.420077396422e-02
> > > 350 KSP preconditioned resid norm 3.628173432975e-08 true resid norm 1.071879321292e-08 ||r(i)||/||b|| 2.423136065311e-02
> > > 351 KSP preconditioned resid norm 3.621714360676e-08 true resid norm 1.066953807038e-08 ||r(i)||/||b|| 2.412001237918e-02
> > > 352 KSP preconditioned resid norm 3.614598721323e-08 true resid norm 1.067226627219e-08 ||r(i)||/||b|| 2.412617986843e-02
> > > 353 KSP preconditioned resid norm 3.608734513646e-08 true resid norm 1.072773727635e-08 ||r(i)||/||b|| 2.425157998401e-02
> > > 354 KSP preconditioned resid norm 3.593202477726e-08 true resid norm 1.166649044369e-08 ||r(i)||/||b|| 2.637376539332e-02
> > > 355 KSP preconditioned resid norm 3.574816645908e-08 true resid norm 1.093827518487e-08 ||r(i)||/||b|| 2.472753095079e-02
> > > 356 KSP preconditioned resid norm 3.551731486762e-08 true resid norm 1.076438469683e-08 ||r(i)||/||b|| 2.433442670423e-02
> > > 357 KSP preconditioned resid norm 3.526513581484e-08 true resid norm 1.110249798589e-08 ||r(i)||/||b|| 2.509878001212e-02
> > > 358 KSP preconditioned resid norm 3.465142744209e-08 true resid norm 1.363275954561e-08 ||r(i)||/||b|| 3.081879710568e-02
> > > 359 KSP preconditioned resid norm 3.445104570595e-08 true resid norm 1.002161340638e-08 ||r(i)||/||b|| 2.265528627639e-02
> > > 360 KSP preconditioned resid norm 3.412299596043e-08 true resid norm 1.132489003434e-08 ||r(i)||/||b|| 2.560152895272e-02
> > > 361 KSP preconditioned resid norm 3.411529696237e-08 true resid norm 1.086147186780e-08 ||r(i)||/||b|| 2.455390609972e-02
> > > 362 KSP preconditioned resid norm 3.406577468016e-08 true resid norm 1.456732293497e-08 ||r(i)||/||b|| 3.293151092439e-02
> > > 363 KSP preconditioned resid norm 3.365555787056e-08 true resid norm 7.711588827294e-09 ||r(i)||/||b|| 1.743314628529e-02
> > > 364 KSP preconditioned resid norm 3.345269937851e-08 true resid norm 1.136806437719e-08 ||r(i)||/||b|| 2.569913071178e-02
> > > 365 KSP preconditioned resid norm 3.314065779377e-08 true resid norm 9.636397417285e-09 ||r(i)||/||b|| 2.178445059780e-02
> > > 366 KSP preconditioned resid norm 3.276476852537e-08 true resid norm 8.198503499564e-09 ||r(i)||/||b|| 1.853388634033e-02
> > > 367 KSP preconditioned resid norm 3.259579551722e-08 true resid norm 1.047105927610e-08 ||r(i)||/||b|| 2.367132275987e-02
> > > 368 KSP preconditioned resid norm 3.250921252208e-08 true resid norm 8.145570438537e-09 ||r(i)||/||b|| 1.841422360715e-02
> > > 369 KSP preconditioned resid norm 3.241361225044e-08 true resid norm 1.107380056199e-08 ||r(i)||/||b|| 2.503390539290e-02
> > > 370 KSP preconditioned resid norm 3.226640160009e-08 true resid norm 8.914996078156e-09 ||r(i)||/||b|| 2.015361999245e-02
> > > 371 KSP preconditioned resid norm 3.219199485113e-08 true resid norm 9.028612338383e-09 ||r(i)||/||b|| 2.041046575138e-02
> > > 372 KSP preconditioned resid norm 3.215039853884e-08 true resid norm 9.957541741887e-09 ||r(i)||/||b|| 2.251044314161e-02
> > > 373 KSP preconditioned resid norm 3.191438320482e-08 true resid norm 8.943736857091e-09 ||r(i)||/||b|| 2.021859262192e-02
> > > 374 KSP preconditioned resid norm 3.186200739666e-08 true resid norm 8.758295038024e-09 ||r(i)||/||b|| 1.979937494427e-02
> > > 375 KSP preconditioned resid norm 3.183870059099e-08 true resid norm 8.943256269651e-09 ||r(i)||/||b|| 2.021750618548e-02
> > > 376 KSP preconditioned resid norm 3.179122668815e-08 true resid norm 8.590862092304e-09 ||r(i)||/||b|| 1.942086889304e-02
> > > 377 KSP preconditioned resid norm 3.167956879702e-08 true resid norm 9.582658100383e-09 ||r(i)||/||b|| 2.166296520824e-02
> > > 378 KSP preconditioned resid norm 3.136955166729e-08 true resid norm 9.977269021243e-09 ||r(i)||/||b|| 2.255503946987e-02
> > > 379 KSP preconditioned resid norm 3.130691641774e-08 true resid norm 8.509125545196e-09 ||r(i)||/||b|| 1.923609177194e-02
> > > 380 KSP preconditioned resid norm 3.117879107848e-08 true resid norm 9.053973136302e-09 ||r(i)||/||b|| 2.046779745176e-02
> > > 381 KSP preconditioned resid norm 3.088492490292e-08 true resid norm 1.048308325237e-08 ||r(i)||/||b|| 2.369850467295e-02
> > > 382 KSP preconditioned resid norm 3.050052142818e-08 true resid norm 9.220813554635e-09 ||r(i)||/||b|| 2.084496401033e-02
> > > 383 KSP preconditioned resid norm 2.985444875009e-08 true resid norm 1.234239992416e-08 ||r(i)||/||b|| 2.790175516463e-02
> > > 384 KSP preconditioned resid norm 2.952644478108e-08 true resid norm 8.796660599472e-09 ||r(i)||/||b|| 1.988610576719e-02
> > > 385 KSP preconditioned resid norm 2.923012320168e-08 true resid norm 9.047640736274e-09 ||r(i)||/||b|| 2.045348215843e-02
> > > 386 KSP preconditioned resid norm 2.885571723790e-08 true resid norm 1.000194856842e-08 ||r(i)||/||b|| 2.261083110579e-02
> > > 387 KSP preconditioned resid norm 2.854406928323e-08 true resid norm 7.861779671019e-09 ||r(i)||/||b|| 1.777267410608e-02
> > > 388 KSP preconditioned resid norm 2.797557513811e-08 true resid norm 1.546960768219e-08 ||r(i)||/||b|| 3.497125426932e-02
> > > 389 KSP preconditioned resid norm 2.745355913117e-08 true resid norm 7.687966698265e-09 ||r(i)||/||b|| 1.737974509390e-02
> > > 390 KSP preconditioned resid norm 2.661217744985e-08 true resid norm 1.052014137922e-08 ||r(i)||/||b|| 2.378227985352e-02
> > > 391 KSP preconditioned resid norm 2.658120474029e-08 true resid norm 9.465616738864e-09 ||r(i)||/||b|| 2.139837651939e-02
> > > 392 KSP preconditioned resid norm 2.623787329422e-08 true resid norm 1.909951824281e-08 ||r(i)||/||b|| 4.317718474915e-02
> > > 393 KSP preconditioned resid norm 2.543325628802e-08 true resid norm 5.948456163537e-09 ||r(i)||/||b|| 1.344733346046e-02
> > > 394 KSP preconditioned resid norm 2.517323260201e-08 true resid norm 1.034609461157e-08 ||r(i)||/||b|| 2.338882231462e-02
> > > 395 KSP preconditioned resid norm 2.490676685335e-08 true resid norm 8.641670445923e-09 ||r(i)||/||b|| 1.953572842212e-02
> > > 396 KSP preconditioned resid norm 2.439513980463e-08 true resid norm 7.519572419040e-09 ||r(i)||/||b|| 1.699906581119e-02
> > > 397 KSP preconditioned resid norm 2.414249722638e-08 true resid norm 1.073069104260e-08 ||r(i)||/||b|| 2.425825739384e-02
> > > 398 KSP preconditioned resid norm 2.392817846978e-08 true resid norm 7.116187521104e-09 ||r(i)||/||b|| 1.608715672313e-02
> > > 399 KSP preconditioned resid norm 2.371648249227e-08 true resid norm 1.098047911448e-08 ||r(i)||/||b|| 2.482293895233e-02
> > > 400 KSP preconditioned resid norm 2.345879128128e-08 true resid norm 8.016833131810e-09 ||r(i)||/||b|| 1.812319456621e-02
> > > 401 KSP preconditioned resid norm 2.331728390350e-08 true resid norm 7.808056352388e-09 ||r(i)||/||b|| 1.765122488290e-02
> > > 402 KSP preconditioned resid norm 2.325356933312e-08 true resid norm 9.927418776284e-09 ||r(i)||/||b|| 2.244234588206e-02
> > > 403 KSP preconditioned resid norm 2.314519860272e-08 true resid norm 7.444871113908e-09 ||r(i)||/||b|| 1.683019285787e-02
> > > 404 KSP preconditioned resid norm 2.308308693430e-08 true resid norm 7.801054524067e-09 ||r(i)||/||b|| 1.763539625145e-02
> > > 405 KSP preconditioned resid norm 2.306358661113e-08 true resid norm 7.805058505977e-09 ||r(i)||/||b|| 1.764444782357e-02
> > > 406 KSP preconditioned resid norm 2.305322796876e-08 true resid norm 7.571079190824e-09 ||r(i)||/||b|| 1.711550421413e-02
> > > 407 KSP preconditioned resid norm 2.298488633980e-08 true resid norm 8.830501095637e-09 ||r(i)||/||b|| 1.996260703473e-02
> > > 408 KSP preconditioned resid norm 2.287294808434e-08 true resid norm 7.013326899093e-09 ||r(i)||/||b|| 1.585462561823e-02
> > > 409 KSP preconditioned resid norm 2.286549605315e-08 true resid norm 7.082627748739e-09 ||r(i)||/||b|| 1.601129007177e-02
> > > 410 KSP preconditioned resid norm 2.286053015844e-08 true resid norm 7.033545134087e-09 ||r(i)||/||b|| 1.590033182173e-02
> > > 411 KSP preconditioned resid norm 2.280043141482e-08 true resid norm 7.319703904833e-09 ||r(i)||/||b|| 1.654723453179e-02
> > > 412 KSP preconditioned resid norm 2.278834021186e-08 true resid norm 7.137620865339e-09 ||r(i)||/||b|| 1.613560985436e-02
> > > 413 KSP preconditioned resid norm 2.274834174042e-08 true resid norm 7.536215034436e-09 ||r(i)||/||b|| 1.703668881668e-02
> > > 414 KSP preconditioned resid norm 2.271641465026e-08 true resid norm 7.111204145035e-09 ||r(i)||/||b|| 1.607589109085e-02
> > > 415 KSP preconditioned resid norm 2.271597283066e-08 true resid norm 7.105850673247e-09 ||r(i)||/||b|| 1.606378880442e-02
> > > 416 KSP preconditioned resid norm 2.264562496921e-08 true resid norm 7.590206017147e-09 ||r(i)||/||b|| 1.715874313269e-02
> > > 417 KSP preconditioned resid norm 2.264130303752e-08 true resid norm 7.322331610853e-09 ||r(i)||/||b|| 1.655317483599e-02
> > > 418 KSP preconditioned resid norm 2.257869016612e-08 true resid norm 8.689110661905e-09 ||r(i)||/||b|| 1.964297379574e-02
> > > 419 KSP preconditioned resid norm 2.252448770837e-08 true resid norm 7.589690206564e-09 ||r(i)||/||b|| 1.715757706931e-02
> > > 420 KSP preconditioned resid norm 2.251854717911e-08 true resid norm 7.606351482008e-09 ||r(i)||/||b|| 1.719524225849e-02
> > > 421 KSP preconditioned resid norm 2.251852680166e-08 true resid norm 7.587363564342e-09 ||r(i)||/||b|| 1.715231736276e-02
> > > 422 KSP preconditioned resid norm 2.251740722171e-08 true resid norm 8.042777274478e-09 ||r(i)||/||b|| 1.818184500057e-02
> > > 423 KSP preconditioned resid norm 2.251066763399e-08 true resid norm 7.161199860439e-09 ||r(i)||/||b|| 1.618891353535e-02
> > > 424 KSP preconditioned resid norm 2.250468324723e-08 true resid norm 7.892076688728e-09 ||r(i)||/||b|| 1.784116483524e-02
> > > 425 KSP preconditioned resid norm 2.248157980181e-08 true resid norm 7.381796123970e-09 ||r(i)||/||b|| 1.668760284806e-02
> > > 426 KSP preconditioned resid norm 2.245901138193e-08 true resid norm 7.147464780092e-09 ||r(i)||/||b|| 1.615786342748e-02
> > > 427 KSP preconditioned resid norm 2.241049755791e-08 true resid norm 8.351728267326e-09 ||r(i)||/||b|| 1.888027277907e-02
> > > 428 KSP preconditioned resid norm 2.234407003838e-08 true resid norm 6.648970113909e-09 ||r(i)||/||b|| 1.503094514480e-02
> > > 429 KSP preconditioned resid norm 2.225463790450e-08 true resid norm 9.144039069449e-09 ||r(i)||/||b|| 2.067140433784e-02
> > > 430 KSP preconditioned resid norm 2.219515360063e-08 true resid norm 7.964312082788e-09 ||r(i)||/||b|| 1.800446324492e-02
> > > 431 KSP preconditioned resid norm 2.207622538143e-08 true resid norm 7.744159741884e-09 ||r(i)||/||b|| 1.750677748263e-02
> > > 432 KSP preconditioned resid norm 2.189830543256e-08 true resid norm 1.088914113364e-08 ||r(i)||/||b|| 2.461645642103e-02
> > > 433 KSP preconditioned resid norm 2.136231265645e-08 true resid norm 6.923381943847e-09 ||r(i)||/||b|| 1.565129221995e-02
> > > 434 KSP preconditioned resid norm 2.037470395914e-08 true resid norm 1.030114953089e-08 ||r(i)||/||b|| 2.328721755017e-02
> > > 435 KSP preconditioned resid norm 1.961890283205e-08 true resid norm 7.295267301635e-09 ||r(i)||/||b|| 1.649199210539e-02
> > > 436 KSP preconditioned resid norm 1.913560642295e-08 true resid norm 6.039280397468e-09 ||r(i)||/||b|| 1.365265459361e-02
> > > 437 KSP preconditioned resid norm 1.877609800000e-08 true resid norm 8.984892222755e-09 ||r(i)||/||b|| 2.031163019513e-02
> > > 438 KSP preconditioned resid norm 1.811081731215e-08 true resid norm 6.564934723165e-09 ||r(i)||/||b|| 1.484097115983e-02
> > > 439 KSP preconditioned resid norm 1.785755067179e-08 true resid norm 5.336927073942e-09 ||r(i)||/||b|| 1.206488474394e-02
> > > 440 KSP preconditioned resid norm 1.772971743003e-08 true resid norm 4.970154886573e-09 ||r(i)||/||b|| 1.123574390942e-02
> > > 441 KSP preconditioned resid norm 1.735301571457e-08 true resid norm 5.652698869454e-09 ||r(i)||/||b|| 1.277873191957e-02
> > > 442 KSP preconditioned resid norm 1.631139023345e-08 true resid norm 7.160283137945e-09 ||r(i)||/||b|| 1.618684115342e-02
> > > 443 KSP preconditioned resid norm 1.483956291991e-08 true resid norm 7.988466840254e-09 ||r(i)||/||b|| 1.805906851886e-02
> > > 444 KSP preconditioned resid norm 1.410013314968e-08 true resid norm 7.482143551338e-09 ||r(i)||/||b|| 1.691445251806e-02
> > > 445 KSP preconditioned resid norm 1.356330060794e-08 true resid norm 3.083065574605e-09 ||r(i)||/||b|| 6.969709403983e-03
> > > 446 KSP preconditioned resid norm 1.314115350470e-08 true resid norm 4.164976230172e-09 ||r(i)||/||b|| 9.415522730979e-03
> > > 447 KSP preconditioned resid norm 1.236636402318e-08 true resid norm 5.761202097878e-09 ||r(i)||/||b|| 1.302401894094e-02
> > > 448 KSP preconditioned resid norm 1.180595146541e-08 true resid norm 4.038199940007e-09 ||r(i)||/||b|| 9.128926847635e-03
> > > 449 KSP preconditioned resid norm 1.131424900987e-08 true resid norm 5.090038236142e-09 ||r(i)||/||b|| 1.150675731755e-02
> > > 450 KSP preconditioned resid norm 1.063388583397e-08 true resid norm 3.010230442125e-09 ||r(i)||/||b|| 6.805055200074e-03
> > > 451 KSP preconditioned resid norm 1.051458985758e-08 true resid norm 1.649000916776e-09 ||r(i)||/||b|| 3.727801734579e-03
> > > 452 KSP preconditioned resid norm 1.012147631812e-08 true resid norm 5.884734670038e-09 ||r(i)||/||b|| 1.330328193716e-02
> > > 453 KSP preconditioned resid norm 9.390240831193e-09 true resid norm 2.031511507263e-09 ||r(i)||/||b|| 4.592521473788e-03
> > > 454 KSP preconditioned resid norm 9.098339938653e-09 true resid norm 1.769428017679e-09 ||r(i)||/||b|| 4.000044370146e-03
> > > 455 KSP preconditioned resid norm 8.890748233216e-09 true resid norm 2.050221736547e-09 ||r(i)||/||b|| 4.634818615330e-03
> > > 456 KSP preconditioned resid norm 8.527203662681e-09 true resid norm 2.051638846865e-09 ||r(i)||/||b|| 4.638022195295e-03
> > > 457 KSP preconditioned resid norm 8.268992410262e-09 true resid norm 2.382052265392e-09 ||r(i)||/||b|| 5.384968847771e-03
> > > 458 KSP preconditioned resid norm 7.908973261474e-09 true resid norm 3.438027649085e-09 ||r(i)||/||b|| 7.772151794095e-03
> > > 459 KSP preconditioned resid norm 7.427882465376e-09 true resid norm 2.945117076322e-09 ||r(i)||/||b|| 6.657857150931e-03
> > > 460 KSP preconditioned resid norm 7.015919500900e-09 true resid norm 1.769207642661e-09 ||r(i)||/||b|| 3.999546180990e-03
> > > 461 KSP preconditioned resid norm 6.803968849346e-09 true resid norm 1.305695673120e-09 ||r(i)||/||b|| 2.951711272911e-03
> > > 462 KSP preconditioned resid norm 6.710918799980e-09 true resid norm 1.795032965660e-09 ||r(i)||/||b|| 4.057928006550e-03
> > > 463 KSP preconditioned resid norm 6.577483627377e-09 true resid norm 1.782001044516e-09 ||r(i)||/||b|| 4.028467490336e-03
> > > 464 KSP preconditioned resid norm 6.417912605066e-09 true resid norm 1.290960823243e-09 ||r(i)||/||b|| 2.918401043442e-03
> > > 465 KSP preconditioned resid norm 6.365751616365e-09 true resid norm 1.263290494523e-09 ||r(i)||/||b|| 2.855848319336e-03
> > > 466 KSP preconditioned resid norm 6.293400160765e-09 true resid norm 1.425147805149e-09 ||r(i)||/||b|| 3.221749852300e-03
> > > 467 KSP preconditioned resid norm 5.891998607109e-09 true resid norm 2.318264750150e-09 ||r(i)||/||b|| 5.240768072899e-03
> > > 468 KSP preconditioned resid norm 5.803460471252e-09 true resid norm 1.081820742140e-09 ||r(i)||/||b|| 2.445610064874e-03
> > > 469 KSP preconditioned resid norm 5.754085062170e-09 true resid norm 1.656644764768e-09 ||r(i)||/||b|| 3.745081743044e-03
> > > 470 KSP preconditioned resid norm 5.525556632876e-09 true resid norm 1.979760762585e-09 ||r(i)||/||b|| 4.475531535326e-03
> > > 471 KSP preconditioned resid norm 5.443965422137e-09 true resid norm 9.955797379882e-10 ||r(i)||/||b|| 2.250649976253e-03
> > > 472 KSP preconditioned resid norm 5.414797083501e-09 true resid norm 1.143450718543e-09 ||r(i)||/||b|| 2.584933415516e-03
> > > 473 KSP preconditioned resid norm 5.408283291827e-09 true resid norm 1.029764590400e-09 ||r(i)||/||b|| 2.327929710194e-03
> > > 474 KSP preconditioned resid norm 5.355045752288e-09 true resid norm 1.886388210190e-09 ||r(i)||/||b|| 4.264449564882e-03
> > > 475 KSP preconditioned resid norm 5.241533530016e-09 true resid norm 1.425455398363e-09 ||r(i)||/||b|| 3.222445210625e-03
> > > 476 KSP preconditioned resid norm 5.125189682735e-09 true resid norm 1.354368288121e-09 ||r(i)||/||b|| 3.061742660270e-03
> > > 477 KSP preconditioned resid norm 5.057977457429e-09 true resid norm 1.740562818023e-09 ||r(i)||/||b|| 3.934790469888e-03
> > > 478 KSP preconditioned resid norm 4.979286088604e-09 true resid norm 1.417735808423e-09 ||r(i)||/||b|| 3.204993976684e-03
> > > 479 KSP preconditioned resid norm 4.894533209216e-09 true resid norm 1.326984715102e-09 ||r(i)||/||b|| 2.999838188318e-03
> > > 480 KSP preconditioned resid norm 4.777786489681e-09 true resid norm 1.456212644054e-09 ||r(i)||/||b|| 3.291976350766e-03
> > > 481 KSP preconditioned resid norm 4.775308813328e-09 true resid norm 1.364283691096e-09 ||r(i)||/||b|| 3.084157842718e-03
> > > 482 KSP preconditioned resid norm 4.760397485605e-09 true resid norm 2.049838358389e-09 ||r(i)||/||b|| 4.633951934330e-03
> > > 483 KSP preconditioned resid norm 4.670996943034e-09 true resid norm 8.889456596556e-10 ||r(i)||/||b|| 2.009588435214e-03
> > > 484 KSP preconditioned resid norm 4.597559289814e-09 true resid norm 1.386989122943e-09 ||r(i)||/||b|| 3.135486709406e-03
> > > 485 KSP preconditioned resid norm 4.570207496163e-09 true resid norm 1.099843879320e-09 ||r(i)||/||b|| 2.486353936728e-03
> > > 486 KSP preconditioned resid norm 4.542158022055e-09 true resid norm 1.011236566485e-09 ||r(i)||/||b|| 2.286044469873e-03
> > > 487 KSP preconditioned resid norm 4.526766510181e-09 true resid norm 1.399400517345e-09 ||r(i)||/||b|| 3.163544436426e-03
> > > 488 KSP preconditioned resid norm 4.505705850329e-09 true resid norm 9.117728324580e-10 ||r(i)||/||b|| 2.061192514692e-03
> > > 489 KSP preconditioned resid norm 4.487150083935e-09 true resid norm 1.381092775475e-09 ||r(i)||/||b|| 3.122157175082e-03
> > > 490 KSP preconditioned resid norm 4.473919835893e-09 true resid norm 9.652867482479e-10 ||r(i)||/||b|| 2.182168352895e-03
> > > 491 KSP preconditioned resid norm 4.452517186816e-09 true resid norm 1.131636320873e-09 ||r(i)||/||b|| 2.558225284743e-03
> > > 492 KSP preconditioned resid norm 4.400952072877e-09 true resid norm 1.786271233792e-09 ||r(i)||/||b|| 4.038120862161e-03
> > > 493 KSP preconditioned resid norm 4.366719039095e-09 true resid norm 1.028221901066e-09 ||r(i)||/||b|| 2.324442240954e-03
> > > 494 KSP preconditioned resid norm 4.331818466820e-09 true resid norm 1.573868226869e-09 ||r(i)||/||b|| 3.557953574452e-03
> > > 495 KSP preconditioned resid norm 4.302438670088e-09 true resid norm 1.043943800033e-09 ||r(i)||/||b|| 2.359983835651e-03
> > > 496 KSP preconditioned resid norm 4.254710406786e-09 true resid norm 1.390625661617e-09 ||r(i)||/||b|| 3.143707623679e-03
> > > 497 KSP preconditioned resid norm 4.221208729086e-09 true resid norm 1.442390433810e-09 ||r(i)||/||b|| 3.260729273340e-03
> > > 498 KSP preconditioned resid norm 4.194726771303e-09 true resid norm 1.122208863419e-09 ||r(i)||/||b|| 2.536913172729e-03
> > > 499 KSP preconditioned resid norm 4.161552261100e-09 true resid norm 1.685040004550e-09 ||r(i)||/||b|| 3.809273231987e-03
> > > 500 KSP preconditioned resid norm 4.157891682720e-09 true resid norm 1.444023641507e-09 ||r(i)||/||b|| 3.264421372248e-03
> > > 
> > > 
> > > 
> > > 
> > > 2018-08-06 15:40 GMT-05:00 Smith, Barry F. <bsmith at mcs.anl.gov>:
> > > 
> > >     Ok, I think you want to use PCFIELDSPLIT with two fields u and c. Start by using PC_COMPOSITE_MULTIPLICATIVE with direct solvers (LU) for each field. Then try replacing the direct solvers LU with hypre BoomerAMG first one at a time. 
> > > 
> > >     Let us know how it goes and we'll make additional suggestions,
> > > 
> > >     Barry
> > > 
> > > 
> > > > On Aug 6, 2018, at 12:58 PM, Josh L <ysjosh.lo at gmail.com> wrote:
> > > > 
> > > > Hi Barry,
> > > > 
> > > > (1)
> > > > I am basically solving the equilibrium coupled with phase field equation:
> > > > 
> > > > 1-D example
> > > > u is displacement and c is phase-field parameter. 
> > > > 
> > > > equilibrium: (c^2)*E* (\Delta u) = 0
> > > > 
> > > > phase-field equation:  2*G_c*L*(\Delta c)-E*(\epsilon)^2*c+G_c/2L(1-c)=0
> > > > 
> > > > I solve the above 2 equations coupled. 
> > > > it is the formulation for quasi-static fracture problem, where G_c is the critical energy release rate and L is the length scale in phase-field method (both constant).
> > > > 
> > > > The free energy I am using now is 
> > > > 1-D:
> > > > 
> > > > \psi=c^2*0.5*E*\epsilon^2+G_c/4L*(1-c)^2+G_c*L*grad c * grad c
> > > > 
> > > > 
> > > > it is not convex w.r.t u and c simultaneously. 
> > > > 
> > > > (2)
> > > > 
> > > > with an appropriate step size. Newton's method usually converges with 5 iteration, and I can see the quadratic convergence of Newton's method.
> > > > 
> > > > 
> > > > 
> > > > 
> > > > Thanks,
> > > > Josh
> > > > 
> > > > 
> > > > 
> > > > 2018-08-05 22:23 GMT-05:00 Smith, Barry F. <bsmith at mcs.anl.gov>:
> > > > 
> > > > 
> > > > > On Aug 5, 2018, at 9:38 PM, Josh L <ysjosh.lo at gmail.com> wrote:
> > > > > 
> > > > > Hi,
> > > > > 
> > > > > I am using GRMES to solve the linear systems within Newton Raphson. 
> > > > > I am using finite element method to solve fracture problem with phase field method.(the formulation gives symmetric but indefinite hessian so can't use CG) 
> > > > 
> > > >     What exact equations are you using for the phase field method?
> > > > 
> > > >      With the direct LU solver roughly how many iterations does your Newton's method take?
> > > > 
> > > > 
> > > >    Barry
> > > > 
> > > > > 
> > > > > The total iteration number to solve one linear system is often very large( > 2000) even for a small sized problem(120K degree of freedom). I've tried different preconditioner, but it doesn't help a lot.  I have checked my hessian and right hand side, and sure they are correct. 
> > > > > 
> > > > > I think it might stem from the great difference in element size(max/min=100) and damage stiffness around crack. 
> > > > > 
> > > > > Anyone has idea to reduce the number of iteration?
> > > > > 
> > > > > Now, I get away with it by using LU, which is not ideal for large size problem (I will have to run it in the future)
> > > > > 
> > > > > 
> > > > > Thanks,
> > > > > Josh
> > > > > 
> > > > 
> > > > 
> > > 
> > > 
> > 
> > 