[petsc-users] large number of iteration.
Smith, Barry F.
bsmith at mcs.anl.gov
Sun Aug 12 22:02:14 CDT 2018
Sending this to PETSc users because someone else (Mark?) will know why the Eigen estimator fails at iteration 0.
I notice you are using a real old version of PETSc, for GAMG which is a fast moving component of PETSc this may fail. You really should work with the latest version of PETSc. Why aren't you?
Barry
> On Aug 12, 2018, at 9:25 PM, Josh L <ysjosh.lo at gmail.com> wrote:
>
> Hi Barry,
>
> I set the near null space following the example, but I get error when solving it with -pc_type gamg(no error if solving with default PC).
> Moreover, there will be no error if I don't call VecSetBlockSize(vec_coord,2) (it is a 2-D problem), but the near null space will not affect iteration number.
>
> Is it because the way I set Dirichlet boundary conditions?
> I just zero out the corresponding row and modify right hand size.
> There is no Neumann bc.
>
>
> Thanks,
>
> The following is the error I get
>
> [0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
> [0]PETSC ERROR: Petsc has generated inconsistent data
> [0]PETSC ERROR: Eigen estimator failed: DIVERGED_NANORINF at iteration 0
> [0]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
> [0]PETSC ERROR: Petsc Release Version 3.7.5, Jan, 01, 2017
> [0]PETSC ERROR: /work/03691/yslo/lonestar/inex/crack on a haswell named nid00009 by yslo Sun Aug 12 21:14:17 2018
> [0]PETSC ERROR: Configure options --with-x=0 -with-pic --with-np=8 --with-external-packages-dir=/opt/apps/intel16/cray_mpich_7_3/petsc/3.7/externalpackages --with-mpi-compilers=1 --with-mpi-dir=/opt/apps/intel16/cray_mpich/7.3.0 --with-scalar-type=real --with-shared-libraries=1 --with-precision=double --with-chaco=1 --download-chaco --with-hypre=1 --download-hypre --with-ml=1 --download-ml --with-ml=1 --download-ml --with-plapack=1 --download-plapack --with-spai=1 --download-spai --with-sundials=1 --download-sundials --with-hdf5=1 --with-hdf5-dir=/opt/apps/intel16/cray_mpich_7_2/phdf5/1.8.16/x86_64 --with-mumps=1 --download-mumps --with-parmetis=1 --download-parmetis --with-metis=1 --download-metis --with-scalapack=1 --download-scalapack --with-blacs=1 --download-blacs --with-spooles=1 --download-spooles --with-suitesparse=1 --download-suitesparse --with-superlu_dist=1 --download-superlu_dist --with-superlu=1 --download-superlu --with-parmetis=1 --download-parmetis --with-metis=1 --download-metis --with-debugging=no --with-blas-lapack-dir=/opt/apps/intel/16.0.1.150/compilers_and_libraries_2016.1.150/linux/mkl --CFLAGS="-xhost -O2 -g" --FFLAGS="-xhost -O2 -g" --CXXFLAGS="-xhost -O2 -g"
> [0]PETSC ERROR: #1 KSPSolve_Chebyshev() line 440 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/ksp/impls/cheby/cheby.c
> [0]PETSC ERROR: #2 KSPSolve() line 656 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/ksp/interface/itfunc.c
> [0]PETSC ERROR: #3 PCMGMCycle_Private() line 21 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/pc/impls/mg/mg.c
> [0]PETSC ERROR: #4 PCMGMCycle_Private() line 55 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/pc/impls/mg/mg.c
> [0]PETSC ERROR: #5 PCMGMCycle_Private() line 55 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/pc/impls/mg/mg.c
> [0]PETSC ERROR: #6 PCMGMCycle_Private() line 55 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/pc/impls/mg/mg.c
> [0]PETSC ERROR: #7 PCApply_MG() line 343 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/pc/impls/mg/mg.c
> [0]PETSC ERROR: #8 PCApply() line 482 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/pc/interface/precon.c
> [0]PETSC ERROR: #9 KSP_PCApply() line 244 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/include/petsc/private/kspimpl.h
> [0]PETSC ERROR: #10 KSPInitialResidual() line 69 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/ksp/interface/itres.c
> [0]PETSC ERROR: #11 KSPSolve_GMRES() line 239 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/ksp/impls/gmres/gmres.c
> [0]PETSC ERROR: #12 KSPSolve() line 656 in /opt/apps/intel16/cray_mpich_7_3/petsc/3.7/src/ksp/ksp/interface/itfunc.c
>
> 2018-08-11 14:27 GMT-05:00 Smith, Barry F. <bsmith at mcs.anl.gov>:
>
>
> > On Aug 9, 2018, at 9:11 PM, Josh L <ysjosh.lo at gmail.com> wrote:
> >
> >
> >
> > 2018-08-09 18:47 GMT-05:00 Smith, Barry F. <bsmith at mcs.anl.gov>:
> >
> >
> > > On Aug 9, 2018, at 3:03 PM, Josh L <ysjosh.lo at gmail.com> wrote:
> > >
> > > Hi Barry,
> > >
> > > I use the example ex49 of KSP(linear elasticity problem), and it's output of ksp monitor is the same as my reduced problem, so I think my code is correct , at least for the reduced problem.
> >
> > Are you using -pc_type gamg ?
> >
> > No, just with GMRES and default PC.
> > strangely, with gamg, the final solution is still the same but ksp output becomes different between my code and petsc example.
> > with -pc_type gamg, my code take 35 iteration and petsc example takes only 7.
>
> You should use GAMG for elasticity type problems. Does you code set the near null space like the example does?
>
> >
> > Thanks.
> >
> >
> > >
> > > Within a Newton's method, several linear system(Ax=b) is solved, and b is the residual vector whose norm becomes smaller and smaller.
> > > Should I change rtol for KSP ? since ||b|| is reducing, and converge requires ||b-Ax|| / ||b|| < rtol ( || b - Ax || < atol=10^-50 is rarely satisfied )
> > > I observe that for the first linear solve in Newton's method, iterative solver converges with okay number of iteration
> > > , but for the following linear solve, iterative solver takes more and more iterations.
> >
> > You can probably get away with -ksp_rtol 1.e-3 or even try 1.e-2
> >
> > Try also -ksp_pc_side right
> >
> >
> > Barry
> >
> >
> > >
> > >
> > > Thanks,
> > > Josh
> > >
> > >
> > >
> > >
> > > 2018-08-09 10:26 GMT-05:00 Smith, Barry F. <bsmith at mcs.anl.gov>:
> > >
> > > Ok, PCGAMG should work well for linear elasticity so on your reduced problem use -pc_type gamg then the group (Mark) will have specific suggestions for options. We want to see about 20 iterations for "well-behaved" linear elasticity problems.
> > >
> > > Barry
> > >
> > >
> > > > On Aug 8, 2018, at 5:48 PM, Josh L <ysjosh.lo at gmail.com> wrote:
> > > >
> > > > Hi Barry,
> > > >
> > > > Thanks for your help.
> > > >
> > > > I removed the phase field from my formulation by setting all corresponding degrees of freedom as Dirichlet boundary condition, so
> > > > my formulation becomes simply linear elastic.
> > > > Then I use CG for KSP and algebraic multigrid for precondiitoner. For a 150K dofs problem, the linear solver converges with 200s iteration(still too much I think), but with GMRES it again takes 2000 iteration to converge. with GMRES and default PC, it barely converges within 10K iteration.
> > > >
> > > > I will double check my hessian. below is the ksp monitor output from GMRES and gamg PC for first 500 iteration.
> > > >
> > > > 0 KSP preconditioned resid norm 9.175598437886e-07 true resid norm 4.423520976130e-07 ||r(i)||/||b|| 1.000000000000e+00
> > > > 1 KSP preconditioned resid norm 9.171756840415e-07 true resid norm 4.185847348836e-07 ||r(i)||/||b|| 9.462704871128e-01
> > > > 2 KSP preconditioned resid norm 9.171436192115e-07 true resid norm 4.373193748329e-07 ||r(i)||/||b|| 9.886228124446e-01
> > > > 3 KSP preconditioned resid norm 9.047636402661e-07 true resid norm 2.655845586443e-07 ||r(i)||/||b|| 6.003917695371e-01
> > > > 4 KSP preconditioned resid norm 9.032722605019e-07 true resid norm 3.045614764490e-07 ||r(i)||/||b|| 6.885046506899e-01
> > > > 5 KSP preconditioned resid norm 8.926003608855e-07 true resid norm 3.498775710352e-07 ||r(i)||/||b|| 7.909481449805e-01
> > > > 6 KSP preconditioned resid norm 8.788553543841e-07 true resid norm 2.052341235884e-07 ||r(i)||/||b|| 4.639610045841e-01
> > > > 7 KSP preconditioned resid norm 8.725201948474e-07 true resid norm 3.315801151567e-07 ||r(i)||/||b|| 7.495841365870e-01
> > > > 8 KSP preconditioned resid norm 8.704702843041e-07 true resid norm 2.453167687304e-07 ||r(i)||/||b|| 5.545735400696e-01
> > > > 9 KSP preconditioned resid norm 8.673295560357e-07 true resid norm 3.480581533019e-07 ||r(i)||/||b|| 7.868350917291e-01
> > > > 10 KSP preconditioned resid norm 8.650826882165e-07 true resid norm 3.331076551593e-07 ||r(i)||/||b|| 7.530373586036e-01
> > > > 11 KSP preconditioned resid norm 8.632977966037e-07 true resid norm 2.943531620635e-07 ||r(i)||/||b|| 6.654273002250e-01
> > > > 12 KSP preconditioned resid norm 8.622407761375e-07 true resid norm 3.413473413778e-07 ||r(i)||/||b|| 7.716643443532e-01
> > > > 13 KSP preconditioned resid norm 8.612343318250e-07 true resid norm 2.962692292083e-07 ||r(i)||/||b|| 6.697588432541e-01
> > > > 14 KSP preconditioned resid norm 8.579354639983e-07 true resid norm 3.298514619407e-07 ||r(i)||/||b|| 7.456762694710e-01
> > > > 15 KSP preconditioned resid norm 8.578914052098e-07 true resid norm 3.287293954137e-07 ||r(i)||/||b|| 7.431396780699e-01
> > > > 16 KSP preconditioned resid norm 8.564349944906e-07 true resid norm 3.231662390796e-07 ||r(i)||/||b|| 7.305633698212e-01
> > > > 17 KSP preconditioned resid norm 8.544772830576e-07 true resid norm 3.522175745975e-07 ||r(i)||/||b|| 7.962380567383e-01
> > > > 18 KSP preconditioned resid norm 8.518664697660e-07 true resid norm 2.957457436154e-07 ||r(i)||/||b|| 6.685754294176e-01
> > > > 19 KSP preconditioned resid norm 8.502444318835e-07 true resid norm 3.231647326483e-07 ||r(i)||/||b|| 7.305599643183e-01
> > > > 20 KSP preconditioned resid norm 8.488626061229e-07 true resid norm 3.034773190650e-07 ||r(i)||/||b|| 6.860537583129e-01
> > > > 21 KSP preconditioned resid norm 8.472536047506e-07 true resid norm 3.142174821592e-07 ||r(i)||/||b|| 7.103334286301e-01
> > > > 22 KSP preconditioned resid norm 8.465622251926e-07 true resid norm 3.109996301173e-07 ||r(i)||/||b|| 7.030590151951e-01
> > > > 23 KSP preconditioned resid norm 8.455410030133e-07 true resid norm 3.026169375479e-07 ||r(i)||/||b|| 6.841087431955e-01
> > > > 24 KSP preconditioned resid norm 8.441686432481e-07 true resid norm 3.247156730398e-07 ||r(i)||/||b|| 7.340660862513e-01
> > > > 25 KSP preconditioned resid norm 8.422635872670e-07 true resid norm 2.949977317008e-07 ||r(i)||/||b|| 6.668844418115e-01
> > > > 26 KSP preconditioned resid norm 8.391013229654e-07 true resid norm 3.503429354312e-07 ||r(i)||/||b|| 7.920001675626e-01
> > > > 27 KSP preconditioned resid norm 8.369135179081e-07 true resid norm 2.932796516614e-07 ||r(i)||/||b|| 6.630004768691e-01
> > > > 28 KSP preconditioned resid norm 8.344557411519e-07 true resid norm 3.290576497205e-07 ||r(i)||/||b|| 7.438817437425e-01
> > > > 29 KSP preconditioned resid norm 8.255611852636e-07 true resid norm 3.228082527538e-07 ||r(i)||/||b|| 7.297540906796e-01
> > > > 30 KSP preconditioned resid norm 8.191145448615e-07 true resid norm 2.695709281706e-07 ||r(i)||/||b|| 6.094035263430e-01
> > > > 31 KSP preconditioned resid norm 8.190911648438e-07 true resid norm 2.661586473845e-07 ||r(i)||/||b|| 6.016895790044e-01
> > > > 32 KSP preconditioned resid norm 8.188934260789e-07 true resid norm 3.000926727757e-07 ||r(i)||/||b|| 6.784022826953e-01
> > > > 33 KSP preconditioned resid norm 8.166449659697e-07 true resid norm 2.081220810731e-07 ||r(i)||/||b|| 4.704896443267e-01
> > > > 34 KSP preconditioned resid norm 8.130668560598e-07 true resid norm 3.175998062677e-07 ||r(i)||/||b|| 7.179796546271e-01
> > > > 35 KSP preconditioned resid norm 8.103250854289e-07 true resid norm 2.675762536241e-07 ||r(i)||/||b|| 6.048942800723e-01
> > > > 36 KSP preconditioned resid norm 8.079447876546e-07 true resid norm 2.624343353237e-07 ||r(i)||/||b|| 5.932702404709e-01
> > > > 37 KSP preconditioned resid norm 8.064590891986e-07 true resid norm 2.891085928184e-07 ||r(i)||/||b|| 6.535712035243e-01
> > > > 38 KSP preconditioned resid norm 8.039981484367e-07 true resid norm 2.435760434885e-07 ||r(i)||/||b|| 5.506383824173e-01
> > > > 39 KSP preconditioned resid norm 8.030132361660e-07 true resid norm 2.791572408348e-07 ||r(i)||/||b|| 6.310747532139e-01
> > > > 40 KSP preconditioned resid norm 8.025869823713e-07 true resid norm 2.673367609434e-07 ||r(i)||/||b|| 6.043528727137e-01
> > > > 41 KSP preconditioned resid norm 8.011717744772e-07 true resid norm 2.626259645676e-07 ||r(i)||/||b|| 5.937034457049e-01
> > > > 42 KSP preconditioned resid norm 7.994420264672e-07 true resid norm 2.931234480129e-07 ||r(i)||/||b|| 6.626473562454e-01
> > > > 43 KSP preconditioned resid norm 7.976276065412e-07 true resid norm 2.565425485040e-07 ||r(i)||/||b|| 5.799510161438e-01
> > > > 44 KSP preconditioned resid norm 7.963529254232e-07 true resid norm 2.683594511633e-07 ||r(i)||/||b|| 6.066648098007e-01
> > > > 45 KSP preconditioned resid norm 7.951914923472e-07 true resid norm 2.726317559874e-07 ||r(i)||/||b|| 6.163229641241e-01
> > > > 46 KSP preconditioned resid norm 7.943011197327e-07 true resid norm 2.561291446355e-07 ||r(i)||/||b|| 5.790164577440e-01
> > > > 47 KSP preconditioned resid norm 7.926385476568e-07 true resid norm 2.978344787798e-07 ||r(i)||/||b|| 6.732973131290e-01
> > > > 48 KSP preconditioned resid norm 7.909780991424e-07 true resid norm 2.498059973427e-07 ||r(i)||/||b|| 5.647220815515e-01
> > > > 49 KSP preconditioned resid norm 7.863002375447e-07 true resid norm 3.283898230799e-07 ||r(i)||/||b|| 7.423720263834e-01
> > > > 50 KSP preconditioned resid norm 7.778093966862e-07 true resid norm 2.908211438411e-07 ||r(i)||/||b|| 6.574426693360e-01
> > > > 51 KSP preconditioned resid norm 7.727705792892e-07 true resid norm 2.662262655905e-07 ||r(i)||/||b|| 6.018424396020e-01
> > > > 52 KSP preconditioned resid norm 7.580949386500e-07 true resid norm 4.077725304210e-07 ||r(i)||/||b|| 9.218279570084e-01
> > > > 53 KSP preconditioned resid norm 7.223569984502e-07 true resid norm 2.806806877450e-07 ||r(i)||/||b|| 6.345187222115e-01
> > > > 54 KSP preconditioned resid norm 6.833104315428e-07 true resid norm 3.167664065828e-07 ||r(i)||/||b|| 7.160956357890e-01
> > > > 55 KSP preconditioned resid norm 6.480813314286e-07 true resid norm 3.449389182846e-07 ||r(i)||/||b|| 7.797836161419e-01
> > > > 56 KSP preconditioned resid norm 5.628534804207e-07 true resid norm 5.008589310744e-07 ||r(i)||/||b|| 1.132263040635e+00
> > > > 57 KSP preconditioned resid norm 4.676624755957e-07 true resid norm 2.747589656053e-07 ||r(i)||/||b|| 6.211318248245e-01
> > > > 58 KSP preconditioned resid norm 4.266847724428e-07 true resid norm 2.051356033363e-07 ||r(i)||/||b|| 4.637382855043e-01
> > > > 59 KSP preconditioned resid norm 3.963440719602e-07 true resid norm 1.462894974865e-07 ||r(i)||/||b|| 3.307082712524e-01
> > > > 60 KSP preconditioned resid norm 3.710732500804e-07 true resid norm 2.006153077396e-07 ||r(i)||/||b|| 4.535195126737e-01
> > > > 61 KSP preconditioned resid norm 3.700288732490e-07 true resid norm 1.637656172799e-07 ||r(i)||/||b|| 3.702155322956e-01
> > > > 62 KSP preconditioned resid norm 3.681230892718e-07 true resid norm 2.598403207310e-07 ||r(i)||/||b|| 5.874061005545e-01
> > > > 63 KSP preconditioned resid norm 3.447874366524e-07 true resid norm 9.834277028700e-08 ||r(i)||/||b|| 2.223178567880e-01
> > > > 64 KSP preconditioned resid norm 3.308954457293e-07 true resid norm 8.462173093522e-08 ||r(i)||/||b|| 1.912994905910e-01
> > > > 65 KSP preconditioned resid norm 3.238105866460e-07 true resid norm 1.508442004566e-07 ||r(i)||/||b|| 3.410048268575e-01
> > > > 66 KSP preconditioned resid norm 3.149261250545e-07 true resid norm 6.146735546031e-08 ||r(i)||/||b|| 1.389557228100e-01
> > > > 67 KSP preconditioned resid norm 3.080685419183e-07 true resid norm 1.469742604456e-07 ||r(i)||/||b|| 3.322562755748e-01
> > > > 68 KSP preconditioned resid norm 3.017036477950e-07 true resid norm 8.246002370676e-08 ||r(i)||/||b|| 1.864126431224e-01
> > > > 69 KSP preconditioned resid norm 2.951373085123e-07 true resid norm 9.600472070625e-08 ||r(i)||/||b|| 2.170323622840e-01
> > > > 70 KSP preconditioned resid norm 2.854303567501e-07 true resid norm 1.353606365274e-07 ||r(i)||/||b|| 3.060020225015e-01
> > > > 71 KSP preconditioned resid norm 2.720605973489e-07 true resid norm 7.105192119695e-08 ||r(i)||/||b|| 1.606230005020e-01
> > > > 72 KSP preconditioned resid norm 2.679746464067e-07 true resid norm 1.093157769657e-07 ||r(i)||/||b|| 2.471239032336e-01
> > > > 73 KSP preconditioned resid norm 2.560436669192e-07 true resid norm 1.046442873472e-07 ||r(i)||/||b|| 2.365633347550e-01
> > > > 74 KSP preconditioned resid norm 2.486272155786e-07 true resid norm 6.788331443968e-08 ||r(i)||/||b|| 1.534599130557e-01
> > > > 75 KSP preconditioned resid norm 2.450613653917e-07 true resid norm 8.385393991346e-08 ||r(i)||/||b|| 1.895637894925e-01
> > > > 76 KSP preconditioned resid norm 2.381548789947e-07 true resid norm 9.639184405623e-08 ||r(i)||/||b|| 2.179075098239e-01
> > > > 77 KSP preconditioned resid norm 2.318084665470e-07 true resid norm 5.817254053914e-08 ||r(i)||/||b|| 1.315073238107e-01
> > > > 78 KSP preconditioned resid norm 2.301457113250e-07 true resid norm 7.214348778091e-08 ||r(i)||/||b|| 1.630906424322e-01
> > > > 79 KSP preconditioned resid norm 2.288069605204e-07 true resid norm 6.520316797685e-08 ||r(i)||/||b|| 1.474010597637e-01
> > > > 80 KSP preconditioned resid norm 2.272182407377e-07 true resid norm 6.553558340584e-08 ||r(i)||/||b|| 1.481525322463e-01
> > > > 81 KSP preconditioned resid norm 2.261791202938e-07 true resid norm 6.410731366977e-08 ||r(i)||/||b|| 1.449237248240e-01
> > > > 82 KSP preconditioned resid norm 2.250209367027e-07 true resid norm 6.108112632184e-08 ||r(i)||/||b|| 1.380825967627e-01
> > > > 83 KSP preconditioned resid norm 2.237071893420e-07 true resid norm 6.644497913123e-08 ||r(i)||/||b|| 1.502083509715e-01
> > > > 84 KSP preconditioned resid norm 2.234300550868e-07 true resid norm 5.793844170260e-08 ||r(i)||/||b|| 1.309781100061e-01
> > > > 85 KSP preconditioned resid norm 2.229005171876e-07 true resid norm 6.926007074308e-08 ||r(i)||/||b|| 1.565722670172e-01
> > > > 86 KSP preconditioned resid norm 2.225791427950e-07 true resid norm 6.289120214757e-08 ||r(i)||/||b|| 1.421745312997e-01
> > > > 87 KSP preconditioned resid norm 2.224479658210e-07 true resid norm 6.242310048343e-08 ||r(i)||/||b|| 1.411163207325e-01
> > > > 88 KSP preconditioned resid norm 2.217191418500e-07 true resid norm 7.465963600280e-08 ||r(i)||/||b|| 1.687787543128e-01
> > > > 89 KSP preconditioned resid norm 2.208527637102e-07 true resid norm 5.960066095409e-08 ||r(i)||/||b|| 1.347357936714e-01
> > > > 90 KSP preconditioned resid norm 2.204546869923e-07 true resid norm 6.334569716267e-08 ||r(i)||/||b|| 1.432019820964e-01
> > > > 91 KSP preconditioned resid norm 2.204546270123e-07 true resid norm 6.327475947831e-08 ||r(i)||/||b|| 1.430416173445e-01
> > > > 92 KSP preconditioned resid norm 2.204329606031e-07 true resid norm 6.775206679705e-08 ||r(i)||/||b|| 1.531632090424e-01
> > > > 93 KSP preconditioned resid norm 2.203318409249e-07 true resid norm 6.059983893344e-08 ||r(i)||/||b|| 1.369945779854e-01
> > > > 94 KSP preconditioned resid norm 2.202099673600e-07 true resid norm 7.148771248833e-08 ||r(i)||/||b|| 1.616081688639e-01
> > > > 95 KSP preconditioned resid norm 2.200347850341e-07 true resid norm 6.555792528003e-08 ||r(i)||/||b|| 1.482030392391e-01
> > > > 96 KSP preconditioned resid norm 2.196138742262e-07 true resid norm 6.418387078605e-08 ||r(i)||/||b|| 1.450967931030e-01
> > > > 97 KSP preconditioned resid norm 2.193396877997e-07 true resid norm 7.242613574407e-08 ||r(i)||/||b|| 1.637296084610e-01
> > > > 98 KSP preconditioned resid norm 2.186895327006e-07 true resid norm 5.717301192712e-08 ||r(i)||/||b|| 1.292477468416e-01
> > > > 99 KSP preconditioned resid norm 2.183391464984e-07 true resid norm 6.921630451950e-08 ||r(i)||/||b|| 1.564733272273e-01
> > > > 100 KSP preconditioned resid norm 2.182400010423e-07 true resid norm 6.548314285564e-08 ||r(i)||/||b|| 1.480339829041e-01
> > > > 101 KSP preconditioned resid norm 2.177799012029e-07 true resid norm 6.272281990396e-08 ||r(i)||/||b|| 1.417938792252e-01
> > > > 102 KSP preconditioned resid norm 2.169682429176e-07 true resid norm 7.907535208604e-08 ||r(i)||/||b|| 1.787611102394e-01
> > > > 103 KSP preconditioned resid norm 2.164150347952e-07 true resid norm 5.949404986863e-08 ||r(i)||/||b|| 1.344947841090e-01
> > > > 104 KSP preconditioned resid norm 2.163293952130e-07 true resid norm 6.398348014122e-08 ||r(i)||/||b|| 1.446437814729e-01
> > > > 105 KSP preconditioned resid norm 2.160399869141e-07 true resid norm 6.102742478406e-08 ||r(i)||/||b|| 1.379611967782e-01
> > > > 106 KSP preconditioned resid norm 2.152042538469e-07 true resid norm 5.769020450098e-08 ||r(i)||/||b|| 1.304169344110e-01
> > > > 107 KSP preconditioned resid norm 2.150064693173e-07 true resid norm 6.321432589105e-08 ||r(i)||/||b|| 1.429049986022e-01
> > > > 108 KSP preconditioned resid norm 2.144289854705e-07 true resid norm 5.801860121360e-08 ||r(i)||/||b|| 1.311593220122e-01
> > > > 109 KSP preconditioned resid norm 2.131016574445e-07 true resid norm 5.968888809818e-08 ||r(i)||/||b|| 1.349352437126e-01
> > > > 110 KSP preconditioned resid norm 2.131016340852e-07 true resid norm 5.978688769843e-08 ||r(i)||/||b|| 1.351567857846e-01
> > > > 111 KSP preconditioned resid norm 2.128679373780e-07 true resid norm 7.339671126222e-08 ||r(i)||/||b|| 1.659237328325e-01
> > > > 112 KSP preconditioned resid norm 2.124763157021e-07 true resid norm 6.095583088857e-08 ||r(i)||/||b|| 1.377993485676e-01
> > > > 113 KSP preconditioned resid norm 2.114936950060e-07 true resid norm 7.680678889067e-08 ||r(i)||/||b|| 1.736326996190e-01
> > > > 114 KSP preconditioned resid norm 2.111409526125e-07 true resid norm 6.861513382847e-08 ||r(i)||/||b|| 1.551142951480e-01
> > > > 115 KSP preconditioned resid norm 2.104578242179e-07 true resid norm 6.666552557721e-08 ||r(i)||/||b|| 1.507069276645e-01
> > > > 116 KSP preconditioned resid norm 2.095794193794e-07 true resid norm 8.409379058143e-08 ||r(i)||/||b|| 1.901060061323e-01
> > > > 117 KSP preconditioned resid norm 2.088313732014e-07 true resid norm 6.461621062155e-08 ||r(i)||/||b|| 1.460741589567e-01
> > > > 118 KSP preconditioned resid norm 2.076780694200e-07 true resid norm 8.889797338722e-08 ||r(i)||/||b|| 2.009665464840e-01
> > > > 119 KSP preconditioned resid norm 2.059381548473e-07 true resid norm 7.343872609510e-08 ||r(i)||/||b|| 1.660187133539e-01
> > > > 120 KSP preconditioned resid norm 2.036694513953e-07 true resid norm 7.626153726963e-08 ||r(i)||/||b|| 1.724000805719e-01
> > > > 121 KSP preconditioned resid norm 2.036437947430e-07 true resid norm 7.403000216323e-08 ||r(i)||/||b|| 1.673553772271e-01
> > > > 122 KSP preconditioned resid norm 2.034858116471e-07 true resid norm 9.140544194375e-08 ||r(i)||/||b|| 2.066350367433e-01
> > > > 123 KSP preconditioned resid norm 2.013655754252e-07 true resid norm 4.519978376641e-08 ||r(i)||/||b|| 1.021805570954e-01
> > > > 124 KSP preconditioned resid norm 1.998009157253e-07 true resid norm 7.924252610751e-08 ||r(i)||/||b|| 1.791390309555e-01
> > > > 125 KSP preconditioned resid norm 1.978761477601e-07 true resid norm 6.193706028697e-08 ||r(i)||/||b|| 1.400175575547e-01
> > > > 126 KSP preconditioned resid norm 1.966003019512e-07 true resid norm 5.417132474463e-08 ||r(i)||/||b|| 1.224620048983e-01
> > > > 127 KSP preconditioned resid norm 1.957579266801e-07 true resid norm 7.621152479630e-08 ||r(i)||/||b|| 1.722870202437e-01
> > > > 128 KSP preconditioned resid norm 1.950451407619e-07 true resid norm 5.429984244536e-08 ||r(i)||/||b|| 1.227525374885e-01
> > > > 129 KSP preconditioned resid norm 1.948052418686e-07 true resid norm 6.458532086853e-08 ||r(i)||/||b|| 1.460043282648e-01
> > > > 130 KSP preconditioned resid norm 1.946142511609e-07 true resid norm 5.988337322193e-08 ||r(i)||/||b|| 1.353749050701e-01
> > > > 131 KSP preconditioned resid norm 1.942556458837e-07 true resid norm 5.860812144886e-08 ||r(i)||/||b|| 1.324920165748e-01
> > > > 132 KSP preconditioned resid norm 1.935241717066e-07 true resid norm 8.129956448465e-08 ||r(i)||/||b|| 1.837892595590e-01
> > > > 133 KSP preconditioned resid norm 1.924599958511e-07 true resid norm 5.461025246990e-08 ||r(i)||/||b|| 1.234542636162e-01
> > > > 134 KSP preconditioned resid norm 1.920525995377e-07 true resid norm 6.091841929726e-08 ||r(i)||/||b|| 1.377147743302e-01
> > > > 135 KSP preconditioned resid norm 1.912474104817e-07 true resid norm 6.146257286777e-08 ||r(i)||/||b|| 1.389449110775e-01
> > > > 136 KSP preconditioned resid norm 1.899112302838e-07 true resid norm 5.363752248243e-08 ||r(i)||/||b|| 1.212552687596e-01
> > > > 137 KSP preconditioned resid norm 1.871603374495e-07 true resid norm 1.033541760028e-07 ||r(i)||/||b|| 2.336468540796e-01
> > > > 138 KSP preconditioned resid norm 1.848601023477e-07 true resid norm 4.885699993060e-08 ||r(i)||/||b|| 1.104482157861e-01
> > > > 139 KSP preconditioned resid norm 1.827750189949e-07 true resid norm 8.191132589117e-08 ||r(i)||/||b|| 1.851722334610e-01
> > > > 140 KSP preconditioned resid norm 1.793562029798e-07 true resid norm 6.003412567942e-08 ||r(i)||/||b|| 1.357157024989e-01
> > > > 141 KSP preconditioned resid norm 1.762198590085e-07 true resid norm 5.955815320828e-08 ||r(i)||/||b|| 1.346396988500e-01
> > > > 142 KSP preconditioned resid norm 1.735812332311e-07 true resid norm 7.966870349397e-08 ||r(i)||/||b|| 1.801024657142e-01
> > > > 143 KSP preconditioned resid norm 1.688412385715e-07 true resid norm 5.688299429377e-08 ||r(i)||/||b|| 1.285921206223e-01
> > > > 144 KSP preconditioned resid norm 1.661476005287e-07 true resid norm 7.082505578352e-08 ||r(i)||/||b|| 1.601101388819e-01
> > > > 145 KSP preconditioned resid norm 1.610383377332e-07 true resid norm 5.920400760597e-08 ||r(i)||/||b|| 1.338391022117e-01
> > > > 146 KSP preconditioned resid norm 1.544803228895e-07 true resid norm 6.998127061136e-08 ||r(i)||/||b|| 1.582026421690e-01
> > > > 147 KSP preconditioned resid norm 1.526491664454e-07 true resid norm 5.645428190677e-08 ||r(i)||/||b|| 1.276229551333e-01
> > > > 148 KSP preconditioned resid norm 1.514873753547e-07 true resid norm 5.864109468824e-08 ||r(i)||/||b|| 1.325665572848e-01
> > > > 149 KSP preconditioned resid norm 1.504821676672e-07 true resid norm 6.213039985019e-08 ||r(i)||/||b|| 1.404546292093e-01
> > > > 150 KSP preconditioned resid norm 1.486089733443e-07 true resid norm 5.614398416742e-08 ||r(i)||/||b|| 1.269214828423e-01
> > > > 151 KSP preconditioned resid norm 1.485963531298e-07 true resid norm 5.477576327252e-08 ||r(i)||/||b|| 1.238284243888e-01
> > > > 152 KSP preconditioned resid norm 1.485376571004e-07 true resid norm 6.371560914841e-08 ||r(i)||/||b|| 1.440382208929e-01
> > > > 153 KSP preconditioned resid norm 1.474539380136e-07 true resid norm 3.640242097893e-08 ||r(i)||/||b|| 8.229286393207e-02
> > > > 154 KSP preconditioned resid norm 1.468139621410e-07 true resid norm 4.869307908912e-08 ||r(i)||/||b|| 1.100776493474e-01
> > > > 155 KSP preconditioned resid norm 1.460083083948e-07 true resid norm 4.630532787515e-08 ||r(i)||/||b|| 1.046797972136e-01
> > > > 156 KSP preconditioned resid norm 1.443569894841e-07 true resid norm 3.603261718441e-08 ||r(i)||/||b|| 8.145686971725e-02
> > > > 157 KSP preconditioned resid norm 1.423163427629e-07 true resid norm 6.442826410227e-08 ||r(i)||/||b|| 1.456492790470e-01
> > > > 158 KSP preconditioned resid norm 1.409955526676e-07 true resid norm 3.683864351150e-08 ||r(i)||/||b|| 8.327900717616e-02
> > > > 159 KSP preconditioned resid norm 1.392132231651e-07 true resid norm 6.633950516791e-08 ||r(i)||/||b|| 1.499699120359e-01
> > > > 160 KSP preconditioned resid norm 1.373585912794e-07 true resid norm 4.602835576127e-08 ||r(i)||/||b|| 1.040536622515e-01
> > > > 161 KSP preconditioned resid norm 1.358554686788e-07 true resid norm 4.404395475469e-08 ||r(i)||/||b|| 9.956764078290e-02
> > > > 162 KSP preconditioned resid norm 1.356117729059e-07 true resid norm 5.220262213455e-08 ||r(i)||/||b|| 1.180114718936e-01
> > > > 163 KSP preconditioned resid norm 1.345828776136e-07 true resid norm 4.364444677578e-08 ||r(i)||/||b|| 9.866449602318e-02
> > > > 164 KSP preconditioned resid norm 1.335743316358e-07 true resid norm 4.365564289163e-08 ||r(i)||/||b|| 9.868980643971e-02
> > > > 165 KSP preconditioned resid norm 1.335181864567e-07 true resid norm 4.195338231508e-08 ||r(i)||/||b|| 9.484160364891e-02
> > > > 166 KSP preconditioned resid norm 1.334081155239e-07 true resid norm 4.320705771627e-08 ||r(i)||/||b|| 9.767571567858e-02
> > > > 167 KSP preconditioned resid norm 1.330652717803e-07 true resid norm 4.671646276077e-08 ||r(i)||/||b|| 1.056092262541e-01
> > > > 168 KSP preconditioned resid norm 1.327117008156e-07 true resid norm 4.076640307294e-08 ||r(i)||/||b|| 9.215826779826e-02
> > > > 169 KSP preconditioned resid norm 1.323823831437e-07 true resid norm 4.609403230274e-08 ||r(i)||/||b|| 1.042021334396e-01
> > > > 170 KSP preconditioned resid norm 1.321738715249e-07 true resid norm 4.115763769210e-08 ||r(i)||/||b|| 9.304270944840e-02
> > > > 171 KSP preconditioned resid norm 1.317312129565e-07 true resid norm 4.587805680503e-08 ||r(i)||/||b|| 1.037138900270e-01
> > > > 172 KSP preconditioned resid norm 1.315622581976e-07 true resid norm 4.346795666887e-08 ||r(i)||/||b|| 9.826551496744e-02
> > > > 173 KSP preconditioned resid norm 1.313903001504e-07 true resid norm 4.268100404068e-08 ||r(i)||/||b|| 9.648649632497e-02
> > > > 174 KSP preconditioned resid norm 1.310657837357e-07 true resid norm 4.888365697755e-08 ||r(i)||/||b|| 1.105084778423e-01
> > > > 175 KSP preconditioned resid norm 1.308286004287e-07 true resid norm 4.218058360777e-08 ||r(i)||/||b|| 9.535522457196e-02
> > > > 176 KSP preconditioned resid norm 1.305438769953e-07 true resid norm 5.026215795117e-08 ||r(i)||/||b|| 1.136247758797e-01
> > > > 177 KSP preconditioned resid norm 1.303521375300e-07 true resid norm 4.518428840914e-08 ||r(i)||/||b|| 1.021455276305e-01
> > > > 178 KSP preconditioned resid norm 1.302430349652e-07 true resid norm 4.699834591242e-08 ||r(i)||/||b|| 1.062464633174e-01
> > > > 179 KSP preconditioned resid norm 1.299950133828e-07 true resid norm 4.780011567673e-08 ||r(i)||/||b|| 1.080589782091e-01
> > > > 180 KSP preconditioned resid norm 1.297967984970e-07 true resid norm 4.439369158202e-08 ||r(i)||/||b|| 1.003582707567e-01
> > > > 181 KSP preconditioned resid norm 1.297963590960e-07 true resid norm 4.419939374367e-08 ||r(i)||/||b|| 9.991903278447e-02
> > > > 182 KSP preconditioned resid norm 1.297926195884e-07 true resid norm 4.616612604888e-08 ||r(i)||/||b|| 1.043651116339e-01
> > > > 183 KSP preconditioned resid norm 1.297319003442e-07 true resid norm 3.981403448576e-08 ||r(i)||/||b|| 9.000530279069e-02
> > > > 184 KSP preconditioned resid norm 1.296224619385e-07 true resid norm 5.101974490162e-08 ||r(i)||/||b|| 1.153374092198e-01
> > > > 185 KSP preconditioned resid norm 1.294198893701e-07 true resid norm 4.272250450111e-08 ||r(i)||/||b|| 9.658031403412e-02
> > > > 186 KSP preconditioned resid norm 1.292654432794e-07 true resid norm 4.341411289813e-08 ||r(i)||/||b|| 9.814379344509e-02
> > > > 187 KSP preconditioned resid norm 1.291166048974e-07 true resid norm 4.903770559588e-08 ||r(i)||/||b|| 1.108567267127e-01
> > > > 188 KSP preconditioned resid norm 1.287267461311e-07 true resid norm 3.838768901036e-08 ||r(i)||/||b|| 8.678084543401e-02
> > > > 189 KSP preconditioned resid norm 1.285403517589e-07 true resid norm 4.836219780019e-08 ||r(i)||/||b|| 1.093296450071e-01
> > > > 190 KSP preconditioned resid norm 1.283960766544e-07 true resid norm 4.373642319734e-08 ||r(i)||/||b|| 9.887242184076e-02
> > > > 191 KSP preconditioned resid norm 1.281846985469e-07 true resid norm 4.196631979171e-08 ||r(i)||/||b|| 9.487085065985e-02
> > > > 192 KSP preconditioned resid norm 1.279291087436e-07 true resid norm 5.017898447715e-08 ||r(i)||/||b|| 1.134367503804e-01
> > > > 193 KSP preconditioned resid norm 1.277583114588e-07 true resid norm 4.217096345089e-08 ||r(i)||/||b|| 9.533347683541e-02
> > > > 194 KSP preconditioned resid norm 1.275868702813e-07 true resid norm 4.784228026600e-08 ||r(i)||/||b|| 1.081542972762e-01
> > > > 195 KSP preconditioned resid norm 1.273992295764e-07 true resid norm 4.379242155010e-08 ||r(i)||/||b|| 9.899901410304e-02
> > > > 196 KSP preconditioned resid norm 1.272302392639e-07 true resid norm 4.236252438739e-08 ||r(i)||/||b|| 9.576652765067e-02
> > > > 197 KSP preconditioned resid norm 1.269756464572e-07 true resid norm 5.265147070813e-08 ||r(i)||/||b|| 1.190261581040e-01
> > > > 198 KSP preconditioned resid norm 1.266399406059e-07 true resid norm 3.658633711709e-08 ||r(i)||/||b|| 8.270863259045e-02
> > > > 199 KSP preconditioned resid norm 1.262216614405e-07 true resid norm 4.823243517156e-08 ||r(i)||/||b|| 1.090362980798e-01
> > > > 200 KSP preconditioned resid norm 1.256037114182e-07 true resid norm 4.118749777942e-08 ||r(i)||/||b|| 9.311021243410e-02
> > > > 201 KSP preconditioned resid norm 1.252357182659e-07 true resid norm 4.297385591425e-08 ||r(i)||/||b|| 9.714852974845e-02
> > > > 202 KSP preconditioned resid norm 1.242188985573e-07 true resid norm 4.735199275670e-08 ||r(i)||/||b|| 1.070459324421e-01
> > > > 203 KSP preconditioned resid norm 1.231408970960e-07 true resid norm 3.893514112125e-08 ||r(i)||/||b|| 8.801843900221e-02
> > > > 204 KSP preconditioned resid norm 1.220276184666e-07 true resid norm 4.828090901382e-08 ||r(i)||/||b|| 1.091458801130e-01
> > > > 205 KSP preconditioned resid norm 1.200057581901e-07 true resid norm 3.901824500784e-08 ||r(i)||/||b|| 8.820630718920e-02
> > > > 206 KSP preconditioned resid norm 1.190463271301e-07 true resid norm 3.812404409291e-08 ||r(i)||/||b|| 8.618483850000e-02
> > > > 207 KSP preconditioned resid norm 1.176408472739e-07 true resid norm 4.100938913911e-08 ||r(i)||/||b|| 9.270757245280e-02
> > > > 208 KSP preconditioned resid norm 1.166353857162e-07 true resid norm 3.610482888020e-08 ||r(i)||/||b|| 8.162011455361e-02
> > > > 209 KSP preconditioned resid norm 1.159620049487e-07 true resid norm 3.566307135323e-08 ||r(i)||/||b|| 8.062145866534e-02
> > > > 210 KSP preconditioned resid norm 1.146020921987e-07 true resid norm 3.592344723620e-08 ||r(i)||/||b|| 8.121007548070e-02
> > > > 211 KSP preconditioned resid norm 1.145847448331e-07 true resid norm 3.473565983922e-08 ||r(i)||/||b|| 7.852491268077e-02
> > > > 212 KSP preconditioned resid norm 1.145177079586e-07 true resid norm 4.122532839361e-08 ||r(i)||/||b|| 9.319573393247e-02
> > > > 213 KSP preconditioned resid norm 1.132872800274e-07 true resid norm 2.141692237998e-08 ||r(i)||/||b|| 4.841600728366e-02
> > > > 214 KSP preconditioned resid norm 1.123613362087e-07 true resid norm 3.246863698820e-08 ||r(i)||/||b|| 7.339998422842e-02
> > > > 215 KSP preconditioned resid norm 1.111053137881e-07 true resid norm 2.903254997529e-08 ||r(i)||/||b|| 6.563221951914e-02
> > > > 216 KSP preconditioned resid norm 1.099813982910e-07 true resid norm 2.173780265025e-08 ||r(i)||/||b|| 4.914140289501e-02
> > > > 217 KSP preconditioned resid norm 1.089711486676e-07 true resid norm 4.266914180936e-08 ||r(i)||/||b|| 9.645968005942e-02
> > > > 218 KSP preconditioned resid norm 1.077041044884e-07 true resid norm 2.174207697189e-08 ||r(i)||/||b|| 4.915106560862e-02
> > > > 219 KSP preconditioned resid norm 1.068087285500e-07 true resid norm 3.726239717827e-08 ||r(i)||/||b|| 8.423696277093e-02
> > > > 220 KSP preconditioned resid norm 1.060944039406e-07 true resid norm 2.612138847397e-08 ||r(i)||/||b|| 5.905112378786e-02
> > > > 221 KSP preconditioned resid norm 1.052145789908e-07 true resid norm 2.848574746885e-08 ||r(i)||/||b|| 6.439609447443e-02
> > > > 222 KSP preconditioned resid norm 1.034013372786e-07 true resid norm 4.496176952774e-08 ||r(i)||/||b|| 1.016424919659e-01
> > > > 223 KSP preconditioned resid norm 1.016447882738e-07 true resid norm 2.629128290689e-08 ||r(i)||/||b|| 5.943519438194e-02
> > > > 224 KSP preconditioned resid norm 1.002724751991e-07 true resid norm 3.297488178025e-08 ||r(i)||/||b|| 7.454442277585e-02
> > > > 225 KSP preconditioned resid norm 9.969279422176e-08 true resid norm 3.069952269998e-08 ||r(i)||/||b|| 6.940064908846e-02
> > > > 226 KSP preconditioned resid norm 9.811249548568e-08 true resid norm 3.219822477037e-08 ||r(i)||/||b|| 7.278867884683e-02
> > > > 227 KSP preconditioned resid norm 9.637808562080e-08 true resid norm 4.091298315961e-08 ||r(i)||/||b|| 9.248963298779e-02
> > > > 228 KSP preconditioned resid norm 9.526012021860e-08 true resid norm 2.720466192827e-08 ||r(i)||/||b|| 6.150001791574e-02
> > > > 229 KSP preconditioned resid norm 9.392714618074e-08 true resid norm 4.018517470597e-08 ||r(i)||/||b|| 9.084431818639e-02
> > > > 230 KSP preconditioned resid norm 9.288540879331e-08 true resid norm 2.742429822661e-08 ||r(i)||/||b|| 6.199653709024e-02
> > > > 231 KSP preconditioned resid norm 9.182683719708e-08 true resid norm 3.418196050419e-08 ||r(i)||/||b|| 7.727319637148e-02
> > > > 232 KSP preconditioned resid norm 9.152618596319e-08 true resid norm 3.061702948039e-08 ||r(i)||/||b|| 6.921416140130e-02
> > > > 233 KSP preconditioned resid norm 9.028012081487e-08 true resid norm 3.309940751576e-08 ||r(i)||/||b|| 7.482593095946e-02
> > > > 234 KSP preconditioned resid norm 8.964512632411e-08 true resid norm 3.657895201743e-08 ||r(i)||/||b|| 8.269193751948e-02
> > > > 235 KSP preconditioned resid norm 8.927591956786e-08 true resid norm 2.996402299113e-08 ||r(i)||/||b|| 6.773794710778e-02
> > > > 236 KSP preconditioned resid norm 8.863790942206e-08 true resid norm 3.770401488950e-08 ||r(i)||/||b|| 8.523530258577e-02
> > > > 237 KSP preconditioned resid norm 8.842416675824e-08 true resid norm 3.294247881070e-08 ||r(i)||/||b|| 7.447117124223e-02
> > > > 238 KSP preconditioned resid norm 8.793063593991e-08 true resid norm 3.836231748404e-08 ||r(i)||/||b|| 8.672348948056e-02
> > > > 239 KSP preconditioned resid norm 8.778266322588e-08 true resid norm 3.572179823322e-08 ||r(i)||/||b|| 8.075421915252e-02
> > > > 240 KSP preconditioned resid norm 8.738590572964e-08 true resid norm 3.574931934089e-08 ||r(i)||/||b|| 8.081643454117e-02
> > > > 241 KSP preconditioned resid norm 8.738404146064e-08 true resid norm 3.532576961772e-08 ||r(i)||/||b|| 7.985893998998e-02
> > > > 242 KSP preconditioned resid norm 8.737492315747e-08 true resid norm 3.850858638399e-08 ||r(i)||/||b|| 8.705415118814e-02
> > > > 243 KSP preconditioned resid norm 8.704894133677e-08 true resid norm 2.725999899728e-08 ||r(i)||/||b|| 6.162511525180e-02
> > > > 244 KSP preconditioned resid norm 8.691957267756e-08 true resid norm 3.445507385918e-08 ||r(i)||/||b|| 7.789060805883e-02
> > > > 245 KSP preconditioned resid norm 8.664547872292e-08 true resid norm 3.233777274784e-08 ||r(i)||/||b|| 7.310414695067e-02
> > > > 246 KSP preconditioned resid norm 8.647910251595e-08 true resid norm 2.869258593620e-08 ||r(i)||/||b|| 6.486368232688e-02
> > > > 247 KSP preconditioned resid norm 8.602870326813e-08 true resid norm 3.830342792446e-08 ||r(i)||/||b|| 8.659036123294e-02
> > > > 248 KSP preconditioned resid norm 8.584186792773e-08 true resid norm 2.914852049114e-08 ||r(i)||/||b|| 6.589438740865e-02
> > > > 249 KSP preconditioned resid norm 8.568202493555e-08 true resid norm 3.726679821110e-08 ||r(i)||/||b|| 8.424691193326e-02
> > > > 250 KSP preconditioned resid norm 8.535775976392e-08 true resid norm 3.374879488937e-08 ||r(i)||/||b|| 7.629396372591e-02
> > > > 251 KSP preconditioned resid norm 8.505569181999e-08 true resid norm 3.019219829750e-08 ||r(i)||/||b|| 6.825376992767e-02
> > > > 252 KSP preconditioned resid norm 8.489565939881e-08 true resid norm 3.532505625863e-08 ||r(i)||/||b|| 7.985732734003e-02
> > > > 253 KSP preconditioned resid norm 8.454497959931e-08 true resid norm 2.833135878246e-08 ||r(i)||/||b|| 6.404707683166e-02
> > > > 254 KSP preconditioned resid norm 8.448142425824e-08 true resid norm 3.023601426215e-08 ||r(i)||/||b|| 6.835282216432e-02
> > > > 255 KSP preconditioned resid norm 8.447314709431e-08 true resid norm 2.955565650261e-08 ||r(i)||/||b|| 6.681477642380e-02
> > > > 256 KSP preconditioned resid norm 8.434191340398e-08 true resid norm 3.011718192322e-08 ||r(i)||/||b|| 6.808418471561e-02
> > > > 257 KSP preconditioned resid norm 8.420519688672e-08 true resid norm 3.194610164662e-08 ||r(i)||/||b|| 7.221871857057e-02
> > > > 258 KSP preconditioned resid norm 8.414920999588e-08 true resid norm 2.927199782498e-08 ||r(i)||/||b|| 6.617352553076e-02
> > > > 259 KSP preconditioned resid norm 8.411142889741e-08 true resid norm 3.116811073402e-08 ||r(i)||/||b|| 7.045995916421e-02
> > > > 260 KSP preconditioned resid norm 8.393401673483e-08 true resid norm 2.913633916610e-08 ||r(i)||/||b|| 6.586684978622e-02
> > > > 261 KSP preconditioned resid norm 8.386932870420e-08 true resid norm 2.931516814567e-08 ||r(i)||/||b|| 6.627111819715e-02
> > > > 262 KSP preconditioned resid norm 8.383102906154e-08 true resid norm 2.947670084156e-08 ||r(i)||/||b|| 6.663628589221e-02
> > > > 263 KSP preconditioned resid norm 8.371299202072e-08 true resid norm 2.900846382950e-08 ||r(i)||/||b|| 6.557776935168e-02
> > > > 264 KSP preconditioned resid norm 8.354612585259e-08 true resid norm 3.153902284033e-08 ||r(i)||/||b|| 7.129845887590e-02
> > > > 265 KSP preconditioned resid norm 8.348749379055e-08 true resid norm 2.912311287048e-08 ||r(i)||/||b|| 6.583694985881e-02
> > > > 266 KSP preconditioned resid norm 8.328479663117e-08 true resid norm 3.201390360666e-08 ||r(i)||/||b|| 7.237199457042e-02
> > > > 267 KSP preconditioned resid norm 8.304748250656e-08 true resid norm 3.103708076427e-08 ||r(i)||/||b|| 7.016374723157e-02
> > > > 268 KSP preconditioned resid norm 8.294564373794e-08 true resid norm 2.975578688471e-08 ||r(i)||/||b|| 6.726719969290e-02
> > > > 269 KSP preconditioned resid norm 8.286083099532e-08 true resid norm 3.122272154943e-08 ||r(i)||/||b|| 7.058341470044e-02
> > > > 270 KSP preconditioned resid norm 8.249515525349e-08 true resid norm 2.958445476571e-08 ||r(i)||/||b|| 6.687987900443e-02
> > > > 271 KSP preconditioned resid norm 8.249243482197e-08 true resid norm 2.915759140675e-08 ||r(i)||/||b|| 6.591489350698e-02
> > > > 272 KSP preconditioned resid norm 8.247967811026e-08 true resid norm 3.226477388325e-08 ||r(i)||/||b|| 7.293912260697e-02
> > > > 273 KSP preconditioned resid norm 8.225540420138e-08 true resid norm 2.335784346654e-08 ||r(i)||/||b|| 5.280373619246e-02
> > > > 274 KSP preconditioned resid norm 8.208649428128e-08 true resid norm 3.103095297226e-08 ||r(i)||/||b|| 7.014989448385e-02
> > > > 275 KSP preconditioned resid norm 8.177662092059e-08 true resid norm 2.780330970969e-08 ||r(i)||/||b|| 6.285334659815e-02
> > > > 276 KSP preconditioned resid norm 8.156719698267e-08 true resid norm 2.529092246235e-08 ||r(i)||/||b|| 5.717373693676e-02
> > > > 277 KSP preconditioned resid norm 8.129665601936e-08 true resid norm 3.216359520748e-08 ||r(i)||/||b|| 7.271039378141e-02
> > > > 278 KSP preconditioned resid norm 8.111942990953e-08 true resid norm 2.578429842977e-08 ||r(i)||/||b|| 5.828908367091e-02
> > > > 279 KSP preconditioned resid norm 8.103355449576e-08 true resid norm 3.114448259432e-08 ||r(i)||/||b|| 7.040654438485e-02
> > > > 280 KSP preconditioned resid norm 8.096927476093e-08 true resid norm 2.905799246198e-08 ||r(i)||/||b|| 6.568973588864e-02
> > > > 281 KSP preconditioned resid norm 8.069018681340e-08 true resid norm 2.806750078967e-08 ||r(i)||/||b|| 6.345058821044e-02
> > > > 282 KSP preconditioned resid norm 8.047055052412e-08 true resid norm 3.356282539492e-08 ||r(i)||/||b|| 7.587355316280e-02
> > > > 283 KSP preconditioned resid norm 8.023864541552e-08 true resid norm 2.697346140135e-08 ||r(i)||/||b|| 6.097735615340e-02
> > > > 284 KSP preconditioned resid norm 8.014006658762e-08 true resid norm 3.033393715647e-08 ||r(i)||/||b|| 6.857419083160e-02
> > > > 285 KSP preconditioned resid norm 8.000866139550e-08 true resid norm 2.744969989335e-08 ||r(i)||/||b|| 6.205396118040e-02
> > > > 286 KSP preconditioned resid norm 7.963315124505e-08 true resid norm 2.853888338671e-08 ||r(i)||/||b|| 6.451621579442e-02
> > > > 287 KSP preconditioned resid norm 7.901906690217e-08 true resid norm 3.213929486191e-08 ||r(i)||/||b|| 7.265545938481e-02
> > > > 288 KSP preconditioned resid norm 7.847487693433e-08 true resid norm 2.531887675170e-08 ||r(i)||/||b|| 5.723693159436e-02
> > > > 289 KSP preconditioned resid norm 7.776109704697e-08 true resid norm 3.151424977919e-08 ||r(i)||/||b|| 7.124245583834e-02
> > > > 290 KSP preconditioned resid norm 7.697887176101e-08 true resid norm 2.452083040958e-08 ||r(i)||/||b|| 5.543283402950e-02
> > > > 291 KSP preconditioned resid norm 7.630186207736e-08 true resid norm 2.646550673478e-08 ||r(i)||/||b|| 5.982905219075e-02
> > > > 292 KSP preconditioned resid norm 7.539569101676e-08 true resid norm 2.639665425804e-08 ||r(i)||/||b|| 5.967340134812e-02
> > > > 293 KSP preconditioned resid norm 7.387540581378e-08 true resid norm 2.766591414879e-08 ||r(i)||/||b|| 6.254274433891e-02
> > > > 294 KSP preconditioned resid norm 7.148854762848e-08 true resid norm 4.506538736910e-08 ||r(i)||/||b|| 1.018767348732e-01
> > > > 295 KSP preconditioned resid norm 6.875818761377e-08 true resid norm 1.988285545247e-08 ||r(i)||/||b|| 4.494803022244e-02
> > > > 296 KSP preconditioned resid norm 6.720148343751e-08 true resid norm 2.185917455369e-08 ||r(i)||/||b|| 4.941578139143e-02
> > > > 297 KSP preconditioned resid norm 6.559210493364e-08 true resid norm 2.579380002545e-08 ||r(i)||/||b|| 5.831056338297e-02
> > > > 298 KSP preconditioned resid norm 6.296172453909e-08 true resid norm 2.690729261887e-08 ||r(i)||/||b|| 6.082777218435e-02
> > > > 299 KSP preconditioned resid norm 6.126664666716e-08 true resid norm 2.523269850506e-08 ||r(i)||/||b|| 5.704211337804e-02
> > > > 300 KSP preconditioned resid norm 5.996078539496e-08 true resid norm 1.432165407581e-08 ||r(i)||/||b|| 3.237614143370e-02
> > > > 301 KSP preconditioned resid norm 5.994360410331e-08 true resid norm 1.354971586959e-08 ||r(i)||/||b|| 3.063106503328e-02
> > > > 302 KSP preconditioned resid norm 5.968927298570e-08 true resid norm 2.119292714347e-08 ||r(i)||/||b|| 4.790963410783e-02
> > > > 303 KSP preconditioned resid norm 5.871687993468e-08 true resid norm 8.809042798461e-09 ||r(i)||/||b|| 1.991409749382e-02
> > > > 304 KSP preconditioned resid norm 5.799650512507e-08 true resid norm 1.745679956812e-08 ||r(i)||/||b|| 3.946358491871e-02
> > > > 305 KSP preconditioned resid norm 5.745928074883e-08 true resid norm 1.274997712124e-08 ||r(i)||/||b|| 2.882314154277e-02
> > > > 306 KSP preconditioned resid norm 5.632393272566e-08 true resid norm 1.202295750268e-08 ||r(i)||/||b|| 2.717961001553e-02
> > > > 307 KSP preconditioned resid norm 5.396643228430e-08 true resid norm 2.502414535309e-08 ||r(i)||/||b|| 5.657064923649e-02
> > > > 308 KSP preconditioned resid norm 5.160090231555e-08 true resid norm 1.262817440249e-08 ||r(i)||/||b|| 2.854778912689e-02
> > > > 309 KSP preconditioned resid norm 4.907022431548e-08 true resid norm 2.171207321606e-08 ||r(i)||/||b|| 4.908323783977e-02
> > > > 310 KSP preconditioned resid norm 4.776335659862e-08 true resid norm 1.151540470517e-08 ||r(i)||/||b|| 2.603221453522e-02
> > > > 311 KSP preconditioned resid norm 4.697621190386e-08 true resid norm 1.508650195148e-08 ||r(i)||/||b|| 3.410518913076e-02
> > > > 312 KSP preconditioned resid norm 4.595176479120e-08 true resid norm 1.933671761706e-08 ||r(i)||/||b|| 4.371340776138e-02
> > > > 313 KSP preconditioned resid norm 4.509046368009e-08 true resid norm 1.186794873424e-08 ||r(i)||/||b|| 2.682919058886e-02
> > > > 314 KSP preconditioned resid norm 4.450909170016e-08 true resid norm 1.579009874879e-08 ||r(i)||/||b|| 3.569577003024e-02
> > > > 315 KSP preconditioned resid norm 4.337869810365e-08 true resid norm 1.647588479037e-08 ||r(i)||/||b|| 3.724608717643e-02
> > > > 316 KSP preconditioned resid norm 4.223810751226e-08 true resid norm 1.498137614524e-08 ||r(i)||/||b|| 3.386753725389e-02
> > > > 317 KSP preconditioned resid norm 4.156026722749e-08 true resid norm 1.333299778266e-08 ||r(i)||/||b|| 3.014114289185e-02
> > > > 318 KSP preconditioned resid norm 4.099199515842e-08 true resid norm 1.310678580056e-08 ||r(i)||/||b|| 2.962975844646e-02
> > > > 319 KSP preconditioned resid norm 4.066386009421e-08 true resid norm 1.506644976724e-08 ||r(i)||/||b|| 3.405985830867e-02
> > > > 320 KSP preconditioned resid norm 4.023087548652e-08 true resid norm 1.240117063260e-08 ||r(i)||/||b|| 2.803461473228e-02
> > > > 321 KSP preconditioned resid norm 3.991268177919e-08 true resid norm 1.312932289209e-08 ||r(i)||/||b|| 2.968070675585e-02
> > > > 322 KSP preconditioned resid norm 3.956889976017e-08 true resid norm 1.421972275585e-08 ||r(i)||/||b|| 3.214571114861e-02
> > > > 323 KSP preconditioned resid norm 3.900185975518e-08 true resid norm 1.347489145169e-08 ||r(i)||/||b|| 3.046191376598e-02
> > > > 324 KSP preconditioned resid norm 3.877682049038e-08 true resid norm 1.279539901604e-08 ||r(i)||/||b|| 2.892582421352e-02
> > > > 325 KSP preconditioned resid norm 3.869150965109e-08 true resid norm 1.224801722014e-08 ||r(i)||/||b|| 2.768838960238e-02
> > > > 326 KSP preconditioned resid norm 3.851624335552e-08 true resid norm 1.309261686557e-08 ||r(i)||/||b|| 2.959772754831e-02
> > > > 327 KSP preconditioned resid norm 3.836778709819e-08 true resid norm 1.256963552910e-08 ||r(i)||/||b|| 2.841545365542e-02
> > > > 328 KSP preconditioned resid norm 3.810190892142e-08 true resid norm 1.532295260746e-08 ||r(i)||/||b|| 3.463971955858e-02
> > > > 329 KSP preconditioned resid norm 3.779873511822e-08 true resid norm 1.357026597966e-08 ||r(i)||/||b|| 3.067752148771e-02
> > > > 330 KSP preconditioned resid norm 3.758209190896e-08 true resid norm 1.326727470061e-08 ||r(i)||/||b|| 2.999256649217e-02
> > > > 331 KSP preconditioned resid norm 3.758046617049e-08 true resid norm 1.304204653926e-08 ||r(i)||/||b|| 2.948340611389e-02
> > > > 332 KSP preconditioned resid norm 3.756576997625e-08 true resid norm 1.547320887283e-08 ||r(i)||/||b|| 3.497939527431e-02
> > > > 333 KSP preconditioned resid norm 3.735750946435e-08 true resid norm 9.401475437163e-09 ||r(i)||/||b|| 2.125337595977e-02
> > > > 334 KSP preconditioned resid norm 3.726816411327e-08 true resid norm 1.293737018744e-08 ||r(i)||/||b|| 2.924677029283e-02
> > > > 335 KSP preconditioned resid norm 3.715836120670e-08 true resid norm 1.137076112403e-08 ||r(i)||/||b|| 2.570522709260e-02
> > > > 336 KSP preconditioned resid norm 3.711352115906e-08 true resid norm 1.100868545692e-08 ||r(i)||/||b|| 2.488670341188e-02
> > > > 337 KSP preconditioned resid norm 3.697154209112e-08 true resid norm 1.292178506561e-08 ||r(i)||/||b|| 2.921153790237e-02
> > > > 338 KSP preconditioned resid norm 3.687250442553e-08 true resid norm 1.038256633339e-08 ||r(i)||/||b|| 2.347127184298e-02
> > > > 339 KSP preconditioned resid norm 3.681163672322e-08 true resid norm 1.217819776625e-08 ||r(i)||/||b|| 2.753055276999e-02
> > > > 340 KSP preconditioned resid norm 3.676709918842e-08 true resid norm 1.163124964184e-08 ||r(i)||/||b|| 2.629409853509e-02
> > > > 341 KSP preconditioned resid norm 3.664698023565e-08 true resid norm 1.141439938468e-08 ||r(i)||/||b|| 2.580387760401e-02
> > > > 342 KSP preconditioned resid norm 3.656190729093e-08 true resid norm 1.232477473873e-08 ||r(i)||/||b|| 2.786191091946e-02
> > > > 343 KSP preconditioned resid norm 3.650243259584e-08 true resid norm 1.132768943490e-08 ||r(i)||/||b|| 2.560785739692e-02
> > > > 344 KSP preconditioned resid norm 3.650130795451e-08 true resid norm 1.141084292815e-08 ||r(i)||/||b|| 2.579583772683e-02
> > > > 345 KSP preconditioned resid norm 3.647229125147e-08 true resid norm 1.138306478808e-08 ||r(i)||/||b|| 2.573304127980e-02
> > > > 346 KSP preconditioned resid norm 3.643856164392e-08 true resid norm 1.116515940173e-08 ||r(i)||/||b|| 2.524043507871e-02
> > > > 347 KSP preconditioned resid norm 3.639892567434e-08 true resid norm 1.174359887576e-08 ||r(i)||/||b|| 2.654808000036e-02
> > > > 348 KSP preconditioned resid norm 3.632894120883e-08 true resid norm 1.064588448828e-08 ||r(i)||/||b|| 2.406654008362e-02
> > > > 349 KSP preconditioned resid norm 3.632109543324e-08 true resid norm 1.070526312693e-08 ||r(i)||/||b|| 2.420077396422e-02
> > > > 350 KSP preconditioned resid norm 3.628173432975e-08 true resid norm 1.071879321292e-08 ||r(i)||/||b|| 2.423136065311e-02
> > > > 351 KSP preconditioned resid norm 3.621714360676e-08 true resid norm 1.066953807038e-08 ||r(i)||/||b|| 2.412001237918e-02
> > > > 352 KSP preconditioned resid norm 3.614598721323e-08 true resid norm 1.067226627219e-08 ||r(i)||/||b|| 2.412617986843e-02
> > > > 353 KSP preconditioned resid norm 3.608734513646e-08 true resid norm 1.072773727635e-08 ||r(i)||/||b|| 2.425157998401e-02
> > > > 354 KSP preconditioned resid norm 3.593202477726e-08 true resid norm 1.166649044369e-08 ||r(i)||/||b|| 2.637376539332e-02
> > > > 355 KSP preconditioned resid norm 3.574816645908e-08 true resid norm 1.093827518487e-08 ||r(i)||/||b|| 2.472753095079e-02
> > > > 356 KSP preconditioned resid norm 3.551731486762e-08 true resid norm 1.076438469683e-08 ||r(i)||/||b|| 2.433442670423e-02
> > > > 357 KSP preconditioned resid norm 3.526513581484e-08 true resid norm 1.110249798589e-08 ||r(i)||/||b|| 2.509878001212e-02
> > > > 358 KSP preconditioned resid norm 3.465142744209e-08 true resid norm 1.363275954561e-08 ||r(i)||/||b|| 3.081879710568e-02
> > > > 359 KSP preconditioned resid norm 3.445104570595e-08 true resid norm 1.002161340638e-08 ||r(i)||/||b|| 2.265528627639e-02
> > > > 360 KSP preconditioned resid norm 3.412299596043e-08 true resid norm 1.132489003434e-08 ||r(i)||/||b|| 2.560152895272e-02
> > > > 361 KSP preconditioned resid norm 3.411529696237e-08 true resid norm 1.086147186780e-08 ||r(i)||/||b|| 2.455390609972e-02
> > > > 362 KSP preconditioned resid norm 3.406577468016e-08 true resid norm 1.456732293497e-08 ||r(i)||/||b|| 3.293151092439e-02
> > > > 363 KSP preconditioned resid norm 3.365555787056e-08 true resid norm 7.711588827294e-09 ||r(i)||/||b|| 1.743314628529e-02
> > > > 364 KSP preconditioned resid norm 3.345269937851e-08 true resid norm 1.136806437719e-08 ||r(i)||/||b|| 2.569913071178e-02
> > > > 365 KSP preconditioned resid norm 3.314065779377e-08 true resid norm 9.636397417285e-09 ||r(i)||/||b|| 2.178445059780e-02
> > > > 366 KSP preconditioned resid norm 3.276476852537e-08 true resid norm 8.198503499564e-09 ||r(i)||/||b|| 1.853388634033e-02
> > > > 367 KSP preconditioned resid norm 3.259579551722e-08 true resid norm 1.047105927610e-08 ||r(i)||/||b|| 2.367132275987e-02
> > > > 368 KSP preconditioned resid norm 3.250921252208e-08 true resid norm 8.145570438537e-09 ||r(i)||/||b|| 1.841422360715e-02
> > > > 369 KSP preconditioned resid norm 3.241361225044e-08 true resid norm 1.107380056199e-08 ||r(i)||/||b|| 2.503390539290e-02
> > > > 370 KSP preconditioned resid norm 3.226640160009e-08 true resid norm 8.914996078156e-09 ||r(i)||/||b|| 2.015361999245e-02
> > > > 371 KSP preconditioned resid norm 3.219199485113e-08 true resid norm 9.028612338383e-09 ||r(i)||/||b|| 2.041046575138e-02
> > > > 372 KSP preconditioned resid norm 3.215039853884e-08 true resid norm 9.957541741887e-09 ||r(i)||/||b|| 2.251044314161e-02
> > > > 373 KSP preconditioned resid norm 3.191438320482e-08 true resid norm 8.943736857091e-09 ||r(i)||/||b|| 2.021859262192e-02
> > > > 374 KSP preconditioned resid norm 3.186200739666e-08 true resid norm 8.758295038024e-09 ||r(i)||/||b|| 1.979937494427e-02
> > > > 375 KSP preconditioned resid norm 3.183870059099e-08 true resid norm 8.943256269651e-09 ||r(i)||/||b|| 2.021750618548e-02
> > > > 376 KSP preconditioned resid norm 3.179122668815e-08 true resid norm 8.590862092304e-09 ||r(i)||/||b|| 1.942086889304e-02
> > > > 377 KSP preconditioned resid norm 3.167956879702e-08 true resid norm 9.582658100383e-09 ||r(i)||/||b|| 2.166296520824e-02
> > > > 378 KSP preconditioned resid norm 3.136955166729e-08 true resid norm 9.977269021243e-09 ||r(i)||/||b|| 2.255503946987e-02
> > > > 379 KSP preconditioned resid norm 3.130691641774e-08 true resid norm 8.509125545196e-09 ||r(i)||/||b|| 1.923609177194e-02
> > > > 380 KSP preconditioned resid norm 3.117879107848e-08 true resid norm 9.053973136302e-09 ||r(i)||/||b|| 2.046779745176e-02
> > > > 381 KSP preconditioned resid norm 3.088492490292e-08 true resid norm 1.048308325237e-08 ||r(i)||/||b|| 2.369850467295e-02
> > > > 382 KSP preconditioned resid norm 3.050052142818e-08 true resid norm 9.220813554635e-09 ||r(i)||/||b|| 2.084496401033e-02
> > > > 383 KSP preconditioned resid norm 2.985444875009e-08 true resid norm 1.234239992416e-08 ||r(i)||/||b|| 2.790175516463e-02
> > > > 384 KSP preconditioned resid norm 2.952644478108e-08 true resid norm 8.796660599472e-09 ||r(i)||/||b|| 1.988610576719e-02
> > > > 385 KSP preconditioned resid norm 2.923012320168e-08 true resid norm 9.047640736274e-09 ||r(i)||/||b|| 2.045348215843e-02
> > > > 386 KSP preconditioned resid norm 2.885571723790e-08 true resid norm 1.000194856842e-08 ||r(i)||/||b|| 2.261083110579e-02
> > > > 387 KSP preconditioned resid norm 2.854406928323e-08 true resid norm 7.861779671019e-09 ||r(i)||/||b|| 1.777267410608e-02
> > > > 388 KSP preconditioned resid norm 2.797557513811e-08 true resid norm 1.546960768219e-08 ||r(i)||/||b|| 3.497125426932e-02
> > > > 389 KSP preconditioned resid norm 2.745355913117e-08 true resid norm 7.687966698265e-09 ||r(i)||/||b|| 1.737974509390e-02
> > > > 390 KSP preconditioned resid norm 2.661217744985e-08 true resid norm 1.052014137922e-08 ||r(i)||/||b|| 2.378227985352e-02
> > > > 391 KSP preconditioned resid norm 2.658120474029e-08 true resid norm 9.465616738864e-09 ||r(i)||/||b|| 2.139837651939e-02
> > > > 392 KSP preconditioned resid norm 2.623787329422e-08 true resid norm 1.909951824281e-08 ||r(i)||/||b|| 4.317718474915e-02
> > > > 393 KSP preconditioned resid norm 2.543325628802e-08 true resid norm 5.948456163537e-09 ||r(i)||/||b|| 1.344733346046e-02
> > > > 394 KSP preconditioned resid norm 2.517323260201e-08 true resid norm 1.034609461157e-08 ||r(i)||/||b|| 2.338882231462e-02
> > > > 395 KSP preconditioned resid norm 2.490676685335e-08 true resid norm 8.641670445923e-09 ||r(i)||/||b|| 1.953572842212e-02
> > > > 396 KSP preconditioned resid norm 2.439513980463e-08 true resid norm 7.519572419040e-09 ||r(i)||/||b|| 1.699906581119e-02
> > > > 397 KSP preconditioned resid norm 2.414249722638e-08 true resid norm 1.073069104260e-08 ||r(i)||/||b|| 2.425825739384e-02
> > > > 398 KSP preconditioned resid norm 2.392817846978e-08 true resid norm 7.116187521104e-09 ||r(i)||/||b|| 1.608715672313e-02
> > > > 399 KSP preconditioned resid norm 2.371648249227e-08 true resid norm 1.098047911448e-08 ||r(i)||/||b|| 2.482293895233e-02
> > > > 400 KSP preconditioned resid norm 2.345879128128e-08 true resid norm 8.016833131810e-09 ||r(i)||/||b|| 1.812319456621e-02
> > > > 401 KSP preconditioned resid norm 2.331728390350e-08 true resid norm 7.808056352388e-09 ||r(i)||/||b|| 1.765122488290e-02
> > > > 402 KSP preconditioned resid norm 2.325356933312e-08 true resid norm 9.927418776284e-09 ||r(i)||/||b|| 2.244234588206e-02
> > > > 403 KSP preconditioned resid norm 2.314519860272e-08 true resid norm 7.444871113908e-09 ||r(i)||/||b|| 1.683019285787e-02
> > > > 404 KSP preconditioned resid norm 2.308308693430e-08 true resid norm 7.801054524067e-09 ||r(i)||/||b|| 1.763539625145e-02
> > > > 405 KSP preconditioned resid norm 2.306358661113e-08 true resid norm 7.805058505977e-09 ||r(i)||/||b|| 1.764444782357e-02
> > > > 406 KSP preconditioned resid norm 2.305322796876e-08 true resid norm 7.571079190824e-09 ||r(i)||/||b|| 1.711550421413e-02
> > > > 407 KSP preconditioned resid norm 2.298488633980e-08 true resid norm 8.830501095637e-09 ||r(i)||/||b|| 1.996260703473e-02
> > > > 408 KSP preconditioned resid norm 2.287294808434e-08 true resid norm 7.013326899093e-09 ||r(i)||/||b|| 1.585462561823e-02
> > > > 409 KSP preconditioned resid norm 2.286549605315e-08 true resid norm 7.082627748739e-09 ||r(i)||/||b|| 1.601129007177e-02
> > > > 410 KSP preconditioned resid norm 2.286053015844e-08 true resid norm 7.033545134087e-09 ||r(i)||/||b|| 1.590033182173e-02
> > > > 411 KSP preconditioned resid norm 2.280043141482e-08 true resid norm 7.319703904833e-09 ||r(i)||/||b|| 1.654723453179e-02
> > > > 412 KSP preconditioned resid norm 2.278834021186e-08 true resid norm 7.137620865339e-09 ||r(i)||/||b|| 1.613560985436e-02
> > > > 413 KSP preconditioned resid norm 2.274834174042e-08 true resid norm 7.536215034436e-09 ||r(i)||/||b|| 1.703668881668e-02
> > > > 414 KSP preconditioned resid norm 2.271641465026e-08 true resid norm 7.111204145035e-09 ||r(i)||/||b|| 1.607589109085e-02
> > > > 415 KSP preconditioned resid norm 2.271597283066e-08 true resid norm 7.105850673247e-09 ||r(i)||/||b|| 1.606378880442e-02
> > > > 416 KSP preconditioned resid norm 2.264562496921e-08 true resid norm 7.590206017147e-09 ||r(i)||/||b|| 1.715874313269e-02
> > > > 417 KSP preconditioned resid norm 2.264130303752e-08 true resid norm 7.322331610853e-09 ||r(i)||/||b|| 1.655317483599e-02
> > > > 418 KSP preconditioned resid norm 2.257869016612e-08 true resid norm 8.689110661905e-09 ||r(i)||/||b|| 1.964297379574e-02
> > > > 419 KSP preconditioned resid norm 2.252448770837e-08 true resid norm 7.589690206564e-09 ||r(i)||/||b|| 1.715757706931e-02
> > > > 420 KSP preconditioned resid norm 2.251854717911e-08 true resid norm 7.606351482008e-09 ||r(i)||/||b|| 1.719524225849e-02
> > > > 421 KSP preconditioned resid norm 2.251852680166e-08 true resid norm 7.587363564342e-09 ||r(i)||/||b|| 1.715231736276e-02
> > > > 422 KSP preconditioned resid norm 2.251740722171e-08 true resid norm 8.042777274478e-09 ||r(i)||/||b|| 1.818184500057e-02
> > > > 423 KSP preconditioned resid norm 2.251066763399e-08 true resid norm 7.161199860439e-09 ||r(i)||/||b|| 1.618891353535e-02
> > > > 424 KSP preconditioned resid norm 2.250468324723e-08 true resid norm 7.892076688728e-09 ||r(i)||/||b|| 1.784116483524e-02
> > > > 425 KSP preconditioned resid norm 2.248157980181e-08 true resid norm 7.381796123970e-09 ||r(i)||/||b|| 1.668760284806e-02
> > > > 426 KSP preconditioned resid norm 2.245901138193e-08 true resid norm 7.147464780092e-09 ||r(i)||/||b|| 1.615786342748e-02
> > > > 427 KSP preconditioned resid norm 2.241049755791e-08 true resid norm 8.351728267326e-09 ||r(i)||/||b|| 1.888027277907e-02
> > > > 428 KSP preconditioned resid norm 2.234407003838e-08 true resid norm 6.648970113909e-09 ||r(i)||/||b|| 1.503094514480e-02
> > > > 429 KSP preconditioned resid norm 2.225463790450e-08 true resid norm 9.144039069449e-09 ||r(i)||/||b|| 2.067140433784e-02
> > > > 430 KSP preconditioned resid norm 2.219515360063e-08 true resid norm 7.964312082788e-09 ||r(i)||/||b|| 1.800446324492e-02
> > > > 431 KSP preconditioned resid norm 2.207622538143e-08 true resid norm 7.744159741884e-09 ||r(i)||/||b|| 1.750677748263e-02
> > > > 432 KSP preconditioned resid norm 2.189830543256e-08 true resid norm 1.088914113364e-08 ||r(i)||/||b|| 2.461645642103e-02
> > > > 433 KSP preconditioned resid norm 2.136231265645e-08 true resid norm 6.923381943847e-09 ||r(i)||/||b|| 1.565129221995e-02
> > > > 434 KSP preconditioned resid norm 2.037470395914e-08 true resid norm 1.030114953089e-08 ||r(i)||/||b|| 2.328721755017e-02
> > > > 435 KSP preconditioned resid norm 1.961890283205e-08 true resid norm 7.295267301635e-09 ||r(i)||/||b|| 1.649199210539e-02
> > > > 436 KSP preconditioned resid norm 1.913560642295e-08 true resid norm 6.039280397468e-09 ||r(i)||/||b|| 1.365265459361e-02
> > > > 437 KSP preconditioned resid norm 1.877609800000e-08 true resid norm 8.984892222755e-09 ||r(i)||/||b|| 2.031163019513e-02
> > > > 438 KSP preconditioned resid norm 1.811081731215e-08 true resid norm 6.564934723165e-09 ||r(i)||/||b|| 1.484097115983e-02
> > > > 439 KSP preconditioned resid norm 1.785755067179e-08 true resid norm 5.336927073942e-09 ||r(i)||/||b|| 1.206488474394e-02
> > > > 440 KSP preconditioned resid norm 1.772971743003e-08 true resid norm 4.970154886573e-09 ||r(i)||/||b|| 1.123574390942e-02
> > > > 441 KSP preconditioned resid norm 1.735301571457e-08 true resid norm 5.652698869454e-09 ||r(i)||/||b|| 1.277873191957e-02
> > > > 442 KSP preconditioned resid norm 1.631139023345e-08 true resid norm 7.160283137945e-09 ||r(i)||/||b|| 1.618684115342e-02
> > > > 443 KSP preconditioned resid norm 1.483956291991e-08 true resid norm 7.988466840254e-09 ||r(i)||/||b|| 1.805906851886e-02
> > > > 444 KSP preconditioned resid norm 1.410013314968e-08 true resid norm 7.482143551338e-09 ||r(i)||/||b|| 1.691445251806e-02
> > > > 445 KSP preconditioned resid norm 1.356330060794e-08 true resid norm 3.083065574605e-09 ||r(i)||/||b|| 6.969709403983e-03
> > > > 446 KSP preconditioned resid norm 1.314115350470e-08 true resid norm 4.164976230172e-09 ||r(i)||/||b|| 9.415522730979e-03
> > > > 447 KSP preconditioned resid norm 1.236636402318e-08 true resid norm 5.761202097878e-09 ||r(i)||/||b|| 1.302401894094e-02
> > > > 448 KSP preconditioned resid norm 1.180595146541e-08 true resid norm 4.038199940007e-09 ||r(i)||/||b|| 9.128926847635e-03
> > > > 449 KSP preconditioned resid norm 1.131424900987e-08 true resid norm 5.090038236142e-09 ||r(i)||/||b|| 1.150675731755e-02
> > > > 450 KSP preconditioned resid norm 1.063388583397e-08 true resid norm 3.010230442125e-09 ||r(i)||/||b|| 6.805055200074e-03
> > > > 451 KSP preconditioned resid norm 1.051458985758e-08 true resid norm 1.649000916776e-09 ||r(i)||/||b|| 3.727801734579e-03
> > > > 452 KSP preconditioned resid norm 1.012147631812e-08 true resid norm 5.884734670038e-09 ||r(i)||/||b|| 1.330328193716e-02
> > > > 453 KSP preconditioned resid norm 9.390240831193e-09 true resid norm 2.031511507263e-09 ||r(i)||/||b|| 4.592521473788e-03
> > > > 454 KSP preconditioned resid norm 9.098339938653e-09 true resid norm 1.769428017679e-09 ||r(i)||/||b|| 4.000044370146e-03
> > > > 455 KSP preconditioned resid norm 8.890748233216e-09 true resid norm 2.050221736547e-09 ||r(i)||/||b|| 4.634818615330e-03
> > > > 456 KSP preconditioned resid norm 8.527203662681e-09 true resid norm 2.051638846865e-09 ||r(i)||/||b|| 4.638022195295e-03
> > > > 457 KSP preconditioned resid norm 8.268992410262e-09 true resid norm 2.382052265392e-09 ||r(i)||/||b|| 5.384968847771e-03
> > > > 458 KSP preconditioned resid norm 7.908973261474e-09 true resid norm 3.438027649085e-09 ||r(i)||/||b|| 7.772151794095e-03
> > > > 459 KSP preconditioned resid norm 7.427882465376e-09 true resid norm 2.945117076322e-09 ||r(i)||/||b|| 6.657857150931e-03
> > > > 460 KSP preconditioned resid norm 7.015919500900e-09 true resid norm 1.769207642661e-09 ||r(i)||/||b|| 3.999546180990e-03
> > > > 461 KSP preconditioned resid norm 6.803968849346e-09 true resid norm 1.305695673120e-09 ||r(i)||/||b|| 2.951711272911e-03
> > > > 462 KSP preconditioned resid norm 6.710918799980e-09 true resid norm 1.795032965660e-09 ||r(i)||/||b|| 4.057928006550e-03
> > > > 463 KSP preconditioned resid norm 6.577483627377e-09 true resid norm 1.782001044516e-09 ||r(i)||/||b|| 4.028467490336e-03
> > > > 464 KSP preconditioned resid norm 6.417912605066e-09 true resid norm 1.290960823243e-09 ||r(i)||/||b|| 2.918401043442e-03
> > > > 465 KSP preconditioned resid norm 6.365751616365e-09 true resid norm 1.263290494523e-09 ||r(i)||/||b|| 2.855848319336e-03
> > > > 466 KSP preconditioned resid norm 6.293400160765e-09 true resid norm 1.425147805149e-09 ||r(i)||/||b|| 3.221749852300e-03
> > > > 467 KSP preconditioned resid norm 5.891998607109e-09 true resid norm 2.318264750150e-09 ||r(i)||/||b|| 5.240768072899e-03
> > > > 468 KSP preconditioned resid norm 5.803460471252e-09 true resid norm 1.081820742140e-09 ||r(i)||/||b|| 2.445610064874e-03
> > > > 469 KSP preconditioned resid norm 5.754085062170e-09 true resid norm 1.656644764768e-09 ||r(i)||/||b|| 3.745081743044e-03
> > > > 470 KSP preconditioned resid norm 5.525556632876e-09 true resid norm 1.979760762585e-09 ||r(i)||/||b|| 4.475531535326e-03
> > > > 471 KSP preconditioned resid norm 5.443965422137e-09 true resid norm 9.955797379882e-10 ||r(i)||/||b|| 2.250649976253e-03
> > > > 472 KSP preconditioned resid norm 5.414797083501e-09 true resid norm 1.143450718543e-09 ||r(i)||/||b|| 2.584933415516e-03
> > > > 473 KSP preconditioned resid norm 5.408283291827e-09 true resid norm 1.029764590400e-09 ||r(i)||/||b|| 2.327929710194e-03
> > > > 474 KSP preconditioned resid norm 5.355045752288e-09 true resid norm 1.886388210190e-09 ||r(i)||/||b|| 4.264449564882e-03
> > > > 475 KSP preconditioned resid norm 5.241533530016e-09 true resid norm 1.425455398363e-09 ||r(i)||/||b|| 3.222445210625e-03
> > > > 476 KSP preconditioned resid norm 5.125189682735e-09 true resid norm 1.354368288121e-09 ||r(i)||/||b|| 3.061742660270e-03
> > > > 477 KSP preconditioned resid norm 5.057977457429e-09 true resid norm 1.740562818023e-09 ||r(i)||/||b|| 3.934790469888e-03
> > > > 478 KSP preconditioned resid norm 4.979286088604e-09 true resid norm 1.417735808423e-09 ||r(i)||/||b|| 3.204993976684e-03
> > > > 479 KSP preconditioned resid norm 4.894533209216e-09 true resid norm 1.326984715102e-09 ||r(i)||/||b|| 2.999838188318e-03
> > > > 480 KSP preconditioned resid norm 4.777786489681e-09 true resid norm 1.456212644054e-09 ||r(i)||/||b|| 3.291976350766e-03
> > > > 481 KSP preconditioned resid norm 4.775308813328e-09 true resid norm 1.364283691096e-09 ||r(i)||/||b|| 3.084157842718e-03
> > > > 482 KSP preconditioned resid norm 4.760397485605e-09 true resid norm 2.049838358389e-09 ||r(i)||/||b|| 4.633951934330e-03
> > > > 483 KSP preconditioned resid norm 4.670996943034e-09 true resid norm 8.889456596556e-10 ||r(i)||/||b|| 2.009588435214e-03
> > > > 484 KSP preconditioned resid norm 4.597559289814e-09 true resid norm 1.386989122943e-09 ||r(i)||/||b|| 3.135486709406e-03
> > > > 485 KSP preconditioned resid norm 4.570207496163e-09 true resid norm 1.099843879320e-09 ||r(i)||/||b|| 2.486353936728e-03
> > > > 486 KSP preconditioned resid norm 4.542158022055e-09 true resid norm 1.011236566485e-09 ||r(i)||/||b|| 2.286044469873e-03
> > > > 487 KSP preconditioned resid norm 4.526766510181e-09 true resid norm 1.399400517345e-09 ||r(i)||/||b|| 3.163544436426e-03
> > > > 488 KSP preconditioned resid norm 4.505705850329e-09 true resid norm 9.117728324580e-10 ||r(i)||/||b|| 2.061192514692e-03
> > > > 489 KSP preconditioned resid norm 4.487150083935e-09 true resid norm 1.381092775475e-09 ||r(i)||/||b|| 3.122157175082e-03
> > > > 490 KSP preconditioned resid norm 4.473919835893e-09 true resid norm 9.652867482479e-10 ||r(i)||/||b|| 2.182168352895e-03
> > > > 491 KSP preconditioned resid norm 4.452517186816e-09 true resid norm 1.131636320873e-09 ||r(i)||/||b|| 2.558225284743e-03
> > > > 492 KSP preconditioned resid norm 4.400952072877e-09 true resid norm 1.786271233792e-09 ||r(i)||/||b|| 4.038120862161e-03
> > > > 493 KSP preconditioned resid norm 4.366719039095e-09 true resid norm 1.028221901066e-09 ||r(i)||/||b|| 2.324442240954e-03
> > > > 494 KSP preconditioned resid norm 4.331818466820e-09 true resid norm 1.573868226869e-09 ||r(i)||/||b|| 3.557953574452e-03
> > > > 495 KSP preconditioned resid norm 4.302438670088e-09 true resid norm 1.043943800033e-09 ||r(i)||/||b|| 2.359983835651e-03
> > > > 496 KSP preconditioned resid norm 4.254710406786e-09 true resid norm 1.390625661617e-09 ||r(i)||/||b|| 3.143707623679e-03
> > > > 497 KSP preconditioned resid norm 4.221208729086e-09 true resid norm 1.442390433810e-09 ||r(i)||/||b|| 3.260729273340e-03
> > > > 498 KSP preconditioned resid norm 4.194726771303e-09 true resid norm 1.122208863419e-09 ||r(i)||/||b|| 2.536913172729e-03
> > > > 499 KSP preconditioned resid norm 4.161552261100e-09 true resid norm 1.685040004550e-09 ||r(i)||/||b|| 3.809273231987e-03
> > > > 500 KSP preconditioned resid norm 4.157891682720e-09 true resid norm 1.444023641507e-09 ||r(i)||/||b|| 3.264421372248e-03
> > > >
> > > >
> > > >
> > > >
> > > > 2018-08-06 15:40 GMT-05:00 Smith, Barry F. <bsmith at mcs.anl.gov>:
> > > >
> > > > Ok, I think you want to use PCFIELDSPLIT with two fields u and c. Start by using PC_COMPOSITE_MULTIPLICATIVE with direct solvers (LU) for each field. Then try replacing the direct solvers LU with hypre BoomerAMG first one at a time.
> > > >
> > > > Let us know how it goes and we'll make additional suggestions,
> > > >
> > > > Barry
> > > >
> > > >
> > > > > On Aug 6, 2018, at 12:58 PM, Josh L <ysjosh.lo at gmail.com> wrote:
> > > > >
> > > > > Hi Barry,
> > > > >
> > > > > (1)
> > > > > I am basically solving the equilibrium coupled with phase field equation:
> > > > >
> > > > > 1-D example
> > > > > u is displacement and c is phase-field parameter.
> > > > >
> > > > > equilibrium: (c^2)*E* (\Delta u) = 0
> > > > >
> > > > > phase-field equation: 2*G_c*L*(\Delta c)-E*(\epsilon)^2*c+G_c/2L(1-c)=0
> > > > >
> > > > > I solve the above 2 equations coupled.
> > > > > it is the formulation for quasi-static fracture problem, where G_c is the critical energy release rate and L is the length scale in phase-field method (both constant).
> > > > >
> > > > > The free energy I am using now is
> > > > > 1-D:
> > > > >
> > > > > \psi=c^2*0.5*E*\epsilon^2+G_c/4L*(1-c)^2+G_c*L*grad c * grad c
> > > > >
> > > > >
> > > > > it is not convex w.r.t u and c simultaneously.
> > > > >
> > > > > (2)
> > > > >
> > > > > with an appropriate step size. Newton's method usually converges with 5 iteration, and I can see the quadratic convergence of Newton's method.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > Thanks,
> > > > > Josh
> > > > >
> > > > >
> > > > >
> > > > > 2018-08-05 22:23 GMT-05:00 Smith, Barry F. <bsmith at mcs.anl.gov>:
> > > > >
> > > > >
> > > > > > On Aug 5, 2018, at 9:38 PM, Josh L <ysjosh.lo at gmail.com> wrote:
> > > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I am using GRMES to solve the linear systems within Newton Raphson.
> > > > > > I am using finite element method to solve fracture problem with phase field method.(the formulation gives symmetric but indefinite hessian so can't use CG)
> > > > >
> > > > > What exact equations are you using for the phase field method?
> > > > >
> > > > > With the direct LU solver roughly how many iterations does your Newton's method take?
> > > > >
> > > > >
> > > > > Barry
> > > > >
> > > > > >
> > > > > > The total iteration number to solve one linear system is often very large( > 2000) even for a small sized problem(120K degree of freedom). I've tried different preconditioner, but it doesn't help a lot. I have checked my hessian and right hand side, and sure they are correct.
> > > > > >
> > > > > > I think it might stem from the great difference in element size(max/min=100) and damage stiffness around crack.
> > > > > >
> > > > > > Anyone has idea to reduce the number of iteration?
> > > > > >
> > > > > > Now, I get away with it by using LU, which is not ideal for large size problem (I will have to run it in the future)
> > > > > >
> > > > > >
> > > > > > Thanks,
> > > > > > Josh
> > > > > >
> > > > >
> > > > >
> > > >
> > > >
> > >
> > >
>
>
More information about the petsc-users
mailing list