<div dir="ltr">if this solver doesn't converge. I have a fall-back solution, which uses GMRES solver. this setup is fine with me. I just want to know if HYPRE is a reliable solution for me. Or I will have to go without preconditioner. <div><br></div><div>Thanks!</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Oct 21, 2017 at 5:30 PM, Hao Zhang <span dir="ltr"><<a href="mailto:hbcbh1999@gmail.com" target="_blank">hbcbh1999@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>this is serial run. still dumping output. parallel more or less the same.</div><div><br></div><div>KSP Object: 1 MPI processes</div><div> type: bcgs</div><div> maximum iterations=40000, initial guess is zero</div><div> tolerances: relative=1e-14, absolute=1e-14, divergence=10000.</div><div> left preconditioning</div><div> using PRECONDITIONED norm type for convergence test</div><div>PC Object: 1 MPI processes</div><div> type: hypre</div><div> HYPRE BoomerAMG preconditioning</div><div> Cycle type V</div><div> Maximum number of levels 25</div><div> Maximum number of iterations PER hypre call 1</div><div> Convergence tolerance PER hypre call 0.</div><div> Threshold for strong coupling 0.25</div><div> Interpolation truncation factor 0.</div><div> Interpolation: max elements per row 0</div><div> Number of levels of aggressive coarsening 0</div><div> Number of paths for aggressive coarsening 1</div><div> Maximum row sums 0.9</div><div> Sweeps down 1</div><div> Sweeps up 1</div><div> Sweeps on coarse 1</div><div> Relax down symmetric-SOR/Jacobi</div><div> Relax up symmetric-SOR/Jacobi</div><div> Relax on coarse Gaussian-elimination</div><div> Relax weight (all) 1.</div><div> Outer relax weight (all) 1.</div><div> Using CF-relaxation</div><div> Not using more complex smoothers.</div><div> Measure type local</div><div> Coarsen type Falgout</div><div> Interpolation type classical</div><div> linear system matrix = precond matrix:</div><div> Mat Object: A 1 MPI processes</div><div> type: seqaij</div><div> rows=497664, cols=497664</div><div> total: nonzeros=3363552, allocated nonzeros=3483648</div><div> total number of mallocs used during MatSetValues calls =0</div><div> has attached null space</div><div> not using I-node routines</div><div> 0 KSP preconditioned resid norm 1.630377897956e+01 true resid norm 7.365742695123e+00 ||r(i)||/||b|| 1.000000000000e+00</div><div> 1 KSP preconditioned resid norm 3.815819909205e-02 true resid norm 7.592300567353e-01 ||r(i)||/||b|| 1.030758320187e-01</div><div> 2 KSP preconditioned resid norm 4.312671277701e-04 true resid norm 2.553060965521e-02 ||r(i)||/||b|| 3.466128360975e-03</div><div> 3 KSP preconditioned resid norm 3.011875330569e-04 true resid norm 6.836208627386e-04 ||r(i)||/||b|| 9.281085303065e-05</div><div> 4 KSP preconditioned resid norm 3.011783821295e-04 true resid norm 2.504661140204e-04 ||r(i)||/||b|| 3.400418998972e-05</div><div> 5 KSP preconditioned resid norm 3.011783818372e-04 true resid norm 2.504053673004e-04 ||r(i)||/||b|| 3.399594279422e-05</div><div> 6 KSP preconditioned resid norm 3.011783818375e-04 true resid norm 2.503984078890e-04 ||r(i)||/||b|| 3.399499795925e-05</div><div> 7 KSP preconditioned resid norm 3.011783887442e-04 true resid norm 2.504121501772e-04 ||r(i)||/||b|| 3.399686366224e-05</div><div> 8 KSP preconditioned resid norm 3.010913654181e-04 true resid norm 2.504150259031e-04 ||r(i)||/||b|| 3.399725408124e-05</div><div> 9 KSP preconditioned resid norm 3.006520688232e-04 true resid norm 2.504061607382e-04 ||r(i)||/||b|| 3.399605051423e-05</div><div> 10 KSP preconditioned resid norm 3.007309991942e-04 true resid norm 2.503843638523e-04 ||r(i)||/||b|| 3.399309128978e-05</div><div> 11 KSP preconditioned resid norm 3.015946168077e-04 true resid norm 2.503644677844e-04 ||r(i)||/||b|| 3.399039012728e-05</div><div> 12 KSP preconditioned resid norm 2.956643907377e-04 true resid norm 2.503863046509e-04 ||r(i)||/||b|| 3.399335477965e-05</div><div> 13 KSP preconditioned resid norm 2.997992358936e-04 true resid norm 2.504336903093e-04 ||r(i)||/||b|| 3.399978802886e-05</div><div> 14 KSP preconditioned resid norm 2.481415420420e-05 true resid norm 2.491591201250e-04 ||r(i)||/||b|| 3.382674774806e-05</div><div> 15 KSP preconditioned resid norm 2.615494786181e-05 true resid norm 2.490353237273e-04 ||r(i)||/||b|| 3.380994069915e-05</div><div> 16 KSP preconditioned resid norm 2.645126692130e-05 true resid norm 2.490535523344e-04 ||r(i)||/||b|| 3.381241548111e-05</div><div> 17 KSP preconditioned resid norm 2.667223026209e-05 true resid norm 2.490482602536e-04 ||r(i)||/||b|| 3.381169700898e-05</div><div> 18 KSP preconditioned resid norm 2.650813432116e-05 true resid norm 2.490473169014e-04 ||r(i)||/||b|| 3.381156893606e-05</div><div> 19 KSP preconditioned resid norm 2.613309555449e-05 true resid norm 2.490465633690e-04 ||r(i)||/||b|| 3.381146663375e-05</div><div> 20 KSP preconditioned resid norm 2.644160446804e-05 true resid norm 2.490532739949e-04 ||r(i)||/||b|| 3.381237769272e-05</div><div> 21 KSP preconditioned resid norm 2.635987608975e-05 true resid norm 2.490499548926e-04 ||r(i)||/||b|| 3.381192707933e-05</div><div> 22 KSP preconditioned resid norm 2.640527129095e-05 true resid norm 2.490594066529e-04 ||r(i)||/||b|| 3.381321028466e-05</div><div> 23 KSP preconditioned resid norm 2.627505117691e-05 true resid norm 2.490550162585e-04 ||r(i)||/||b|| 3.381261422875e-05</div><div> 24 KSP preconditioned resid norm 2.642659196388e-05 true resid norm 2.490504347640e-04 ||r(i)||/||b|| 3.381199222842e-05</div><div> 25 KSP preconditioned resid norm 2.659432190695e-05 true resid norm 2.490510775152e-04 ||r(i)||/||b|| 3.381207949065e-05</div><div> 26 KSP preconditioned resid norm 2.687918062951e-05 true resid norm 2.490518882015e-04 ||r(i)||/||b|| 3.381218955237e-05</div><div> 27 KSP preconditioned resid norm 2.662909048432e-05 true resid norm 2.490446263285e-04 ||r(i)||/||b|| 3.381120365409e-05</div><div> 28 KSP preconditioned resid norm 2.085466483199e-05 true resid norm 2.490131612366e-04 ||r(i)||/||b|| 3.380693183886e-05</div><div> 29 KSP preconditioned resid norm 2.098541330282e-05 true resid norm 2.490126933398e-04 ||r(i)||/||b|| 3.380686831549e-05</div><div> 30 KSP preconditioned resid norm 2.175345180286e-05 true resid norm 2.490098852429e-04 ||r(i)||/||b|| 3.380648707805e-05</div><div> 31 KSP preconditioned resid norm 2.182182437676e-05 true resid norm 2.490028301020e-04 ||r(i)||/||b|| 3.380552924648e-05</div><div> 32 KSP preconditioned resid norm 2.152970404369e-05 true resid norm 2.490089939838e-04 ||r(i)||/||b|| 3.380636607747e-05</div><div> 33 KSP preconditioned resid norm 2.187932450016e-05 true resid norm 2.490085293931e-04 ||r(i)||/||b|| 3.380630300295e-05</div><div> 34 KSP preconditioned resid norm 2.207255875067e-05 true resid norm 2.490039036092e-04 ||r(i)||/||b|| 3.380567498971e-05</div><div> 35 KSP preconditioned resid norm 2.205060279701e-05 true resid norm 2.490101636150e-04 ||r(i)||/||b|| 3.380652487086e-05</div><div> 36 KSP preconditioned resid norm 2.168654200416e-05 true resid norm 2.490091609876e-04 ||r(i)||/||b|| 3.380638875052e-05</div><div> 37 KSP preconditioned resid norm 2.164521042361e-05 true resid norm 2.490083143913e-04 ||r(i)||/||b|| 3.380627381352e-05</div><div> 38 KSP preconditioned resid norm 2.154429063973e-05 true resid norm 2.490075485470e-04 ||r(i)||/||b|| 3.380616983972e-05</div><div> 39 KSP preconditioned resid norm 2.165962086228e-05 true resid norm 2.490099695056e-04 ||r(i)||/||b|| 3.380649851786e-05</div><div> 40 KSP preconditioned resid norm 2.153877616091e-05 true resid norm 2.490090652619e-04 ||r(i)||/||b|| 3.380637575444e-05</div><div> 41 KSP preconditioned resid norm 2.347651187611e-05 true resid norm 2.490233544624e-04 ||r(i)||/||b|| 3.380831570825e-05</div><div> 42 KSP preconditioned resid norm 2.352860162514e-05 true resid norm 2.490191394202e-04 ||r(i)||/||b|| 3.380774345879e-05</div><div> 43 KSP preconditioned resid norm 2.312377506928e-05 true resid norm 2.490209491359e-04 ||r(i)||/||b|| 3.380798915237e-05</div><div> 44 KSP preconditioned resid norm 2.295770973533e-05 true resid norm 2.490178136759e-04 ||r(i)||/||b|| 3.380756347093e-05</div><div> 45 KSP preconditioned resid norm 2.833646456041e-05 true resid norm 2.489991602651e-04 ||r(i)||/||b|| 3.380503101608e-05</div><div> 46 KSP preconditioned resid norm 2.760296424494e-05 true resid norm 2.490104320666e-04 ||r(i)||/||b|| 3.380656131682e-05</div><div> 47 KSP preconditioned resid norm 2.451504295239e-05 true resid norm 2.490241388672e-04 ||r(i)||/||b|| 3.380842220189e-05</div><div> 48 KSP preconditioned resid norm 2.512391514098e-05 true resid norm 2.490245923753e-04 ||r(i)||/||b|| 3.380848377180e-05</div><div> 49 KSP preconditioned resid norm 2.483419450528e-05 true resid norm 2.490273364402e-04 ||r(i)||/||b|| 3.380885631602e-05</div><div> 50 KSP preconditioned resid norm 2.507460538466e-05 true resid norm 2.490309488780e-04 ||r(i)||/||b|| 3.380934675371e-05</div><div> 51 KSP preconditioned resid norm 2.499708772881e-05 true resid norm 2.490300908170e-04 ||r(i)||/||b|| 3.380923026022e-05</div><div> 52 KSP preconditioned resid norm 1.059778259446e-05 true resid norm 2.489352833521e-04 ||r(i)||/||b|| 3.379635885420e-05</div><div> 53 KSP preconditioned resid norm 1.074975117060e-05 true resid norm 2.489294722901e-04 ||r(i)||/||b|| 3.379556992330e-05</div><div> 54 KSP preconditioned resid norm 1.095242219559e-05 true resid norm 2.489295454212e-04 ||r(i)||/||b|| 3.379557985184e-05</div><div> 55 KSP preconditioned resid norm 8.359999674720e-06 true resid norm 2.489673581944e-04 ||r(i)||/||b|| 3.380071345137e-05</div><div> 56 KSP preconditioned resid norm 8.368232998470e-06 true resid norm 2.489700421343e-04 ||r(i)||/||b|| 3.380107783281e-05</div><div> 57 KSP preconditioned resid norm 8.443378041101e-06 true resid norm 2.489702900875e-04 ||r(i)||/||b|| 3.380111149584e-05</div><div> 58 KSP preconditioned resid norm 8.647159584302e-06 true resid norm 2.489640805831e-04 ||r(i)||/||b|| 3.380026847095e-05</div><div> 59 KSP preconditioned resid norm 1.024742790737e-05 true resid norm 2.489447846660e-04 ||r(i)||/||b|| 3.379764878711e-05</div><div> 60 KSP preconditioned resid norm 1.033394118910e-05 true resid norm 2.489441404923e-04 ||r(i)||/||b|| 3.379756133175e-05</div><div> 61 KSP preconditioned resid norm 1.030066336446e-05 true resid norm 2.489399918556e-04 ||r(i)||/||b|| 3.379699809776e-05</div><div> 62 KSP preconditioned resid norm 1.029956398963e-05 true resid norm 2.489445295139e-04 ||r(i)||/||b|| 3.379761414674e-05</div><div> 63 KSP preconditioned resid norm 1.028190129002e-05 true resid norm 2.489456200527e-04 ||r(i)||/||b|| 3.379776220225e-05</div><div> 64 KSP preconditioned resid norm 9.878799185773e-06 true resid norm 2.489488742330e-04 ||r(i)||/||b|| 3.379820400160e-05</div><div> 65 KSP preconditioned resid norm 9.917711104174e-06 true resid norm 2.489478066593e-04 ||r(i)||/||b|| 3.379805906391e-05</div><div> 66 KSP preconditioned resid norm 1.003572019576e-05 true resid norm 2.489441995703e-04 ||r(i)||/||b|| 3.379756935240e-05</div><div> 67 KSP preconditioned resid norm 9.924487278236e-06 true resid norm 2.489475403451e-04 ||r(i)||/||b|| 3.379802290812e-05</div><div> 68 KSP preconditioned resid norm 9.804213483359e-06 true resid norm 2.489457781760e-04 ||r(i)||/||b|| 3.379778366964e-05</div><div> 69 KSP preconditioned resid norm 9.748922705476e-06 true resid norm 2.489408473578e-04 ||r(i)||/||b|| 3.379711424383e-05</div><div> 70 KSP preconditioned resid norm 9.886044523689e-06 true resid norm 2.489514438395e-04 ||r(i)||/||b|| 3.379855286071e-05</div><div> 71 KSP preconditioned resid norm 1.083888478689e-05 true resid norm 2.489420898851e-04 ||r(i)||/||b|| 3.379728293386e-05</div><div> 72 KSP preconditioned resid norm 1.106561823757e-05 true resid norm 2.489364778104e-04 ||r(i)||/||b|| 3.379652101821e-05</div><div> 73 KSP preconditioned resid norm 1.132091515426e-05 true resid norm 2.489456804535e-04 ||r(i)||/||b|| 3.379777040248e-05</div><div> 74 KSP preconditioned resid norm 1.330905328963e-05 true resid norm 2.489317458981e-04 ||r(i)||/||b|| 3.379587859660e-05</div><div> 75 KSP preconditioned resid norm 1.305555302619e-05 true resid norm 2.489320939810e-04 ||r(i)||/||b|| 3.379592585359e-05</div><div> 76 KSP preconditioned resid norm 1.308083397399e-05 true resid norm 2.489299951581e-04 ||r(i)||/||b|| 3.379564090977e-05</div><div> 77 KSP preconditioned resid norm 1.320098861853e-05 true resid norm 2.489323669317e-04 ||r(i)||/||b|| 3.379596291036e-05</div><div> 78 KSP preconditioned resid norm 1.300160788274e-05 true resid norm 2.489306393356e-04 ||r(i)||/||b|| 3.379572836564e-05</div><div> 79 KSP preconditioned resid norm 1.317651537793e-05 true resid norm 2.489381364970e-04 ||r(i)||/||b|| 3.379674620752e-05</div><div> 80 KSP preconditioned resid norm 1.309769805765e-05 true resid norm 2.489285056062e-04 ||r(i)||/||b|| 3.379543868279e-05</div><div> 81 KSP preconditioned resid norm 1.293686496271e-05 true resid norm 2.489347818072e-04 ||r(i)||/||b|| 3.379629076264e-05</div><div> 82 KSP preconditioned resid norm 1.311788285799e-05 true resid norm 2.489320040215e-04 ||r(i)||/||b|| 3.379591364037e-05</div><div> 83 KSP preconditioned resid norm 1.313667378798e-05 true resid norm 2.489329437217e-04 ||r(i)||/||b|| 3.379604121748e-05</div><div> 84 KSP preconditioned resid norm 1.416138205017e-05 true resid norm 2.489266908838e-04 ||r(i)||/||b|| 3.379519230948e-05</div><div> 85 KSP preconditioned resid norm 1.452253464774e-05 true resid norm 2.489285688375e-04 ||r(i)||/||b|| 3.379544726729e-05</div><div> 86 KSP preconditioned resid norm 1.426709413370e-05 true resid norm 2.489362313402e-04 ||r(i)||/||b|| 3.379648755651e-05</div><div> 87 KSP preconditioned resid norm 1.427480849552e-05 true resid norm 2.489378183000e-04 ||r(i)||/||b|| 3.379670300795e-05</div><div> 88 KSP preconditioned resid norm 1.413870980147e-05 true resid norm 2.489325756118e-04 ||r(i)||/||b|| 3.379599124153e-05</div><div> 89 KSP preconditioned resid norm 1.353259857657e-05 true resid norm 2.489318968308e-04 ||r(i)||/||b|| 3.379589908776e-05</div><div> 90 KSP preconditioned resid norm 1.347676448611e-05 true resid norm 2.489332074417e-04 ||r(i)||/||b|| 3.379607702106e-05</div><div> 91 KSP preconditioned resid norm 1.362825902909e-05 true resid norm 2.489344974971e-04 ||r(i)||/||b|| 3.379625216367e-05</div><div> 92 KSP preconditioned resid norm 1.346280901052e-05 true resid norm 2.489302570131e-04 ||r(i)||/||b|| 3.379567646016e-05</div><div> 93 KSP preconditioned resid norm 1.328052169696e-05 true resid norm 2.489346601224e-04 ||r(i)||/||b|| 3.379627424228e-05</div><div> 94 KSP preconditioned resid norm 1.554682082515e-05 true resid norm 2.489309078759e-04 ||r(i)||/||b|| 3.379576482365e-05</div><div> 95 KSP preconditioned resid norm 1.557128675775e-05 true resid norm 2.489317143582e-04 ||r(i)||/||b|| 3.379587431462e-05</div><div> 96 KSP preconditioned resid norm 1.542571813923e-05 true resid norm 2.489319910303e-04 ||r(i)||/||b|| 3.379591187663e-05</div><div> 97 KSP preconditioned resid norm 1.570516684444e-05 true resid norm 2.489321980894e-04 ||r(i)||/||b|| 3.379593998772e-05</div><div> 98 KSP preconditioned resid norm 1.600431789899e-05 true resid norm 2.489297450311e-04 ||r(i)||/||b|| 3.379560695162e-05</div><div> 99 KSP preconditioned resid norm 1.587495554658e-05 true resid norm 2.489339000570e-04 ||r(i)||/||b|| 3.379617105303e-05</div><div>100 KSP preconditioned resid norm 1.621163002878e-05 true resid norm 2.489299953360e-04 ||r(i)||/||b|| 3.379564093392e-05</div><div>101 KSP preconditioned resid norm 1.627060872574e-05 true resid norm 2.489301570161e-04 ||r(i)||/||b|| 3.379566288419e-05</div><div>102 KSP preconditioned resid norm 1.622931647243e-05 true resid norm 2.489277930910e-04 ||r(i)||/||b|| 3.379534194913e-05</div><div>103 KSP preconditioned resid norm 1.612544300282e-05 true resid norm 2.489317483299e-04 ||r(i)||/||b|| 3.379587892674e-05</div><div>104 KSP preconditioned resid norm 1.880131646630e-05 true resid norm 2.489335862583e-04 ||r(i)||/||b|| 3.379612845059e-05</div><div>105 KSP preconditioned resid norm 1.880563295793e-05 true resid norm 2.489365017923e-04 ||r(i)||/||b|| 3.379652427408e-05</div><div>106 KSP preconditioned resid norm 1.860619184027e-05 true resid norm 2.489362382373e-04 ||r(i)||/||b|| 3.379648849288e-05</div><div>107 KSP preconditioned resid norm 1.877134148719e-05 true resid norm 2.489425484523e-04 ||r(i)||/||b|| 3.379734519061e-05</div><div>108 KSP preconditioned resid norm 1.914810713538e-05 true resid norm 2.489347415573e-04 ||r(i)||/||b|| 3.379628529818e-05</div><div>109 KSP preconditioned resid norm 1.220673255622e-05 true resid norm 2.490196186357e-04 ||r(i)||/||b|| 3.380780851884e-05</div><div>110 KSP preconditioned resid norm 1.215819132910e-05 true resid norm 2.490233518072e-04 ||r(i)||/||b|| 3.380831534776e-05</div><div>111 KSP preconditioned resid norm 1.196565427400e-05 true resid norm 2.490279438906e-04 ||r(i)||/||b|| 3.380893878570e-05</div><div>112 KSP preconditioned resid norm 1.171748185197e-05 true resid norm 2.490242578983e-04 ||r(i)||/||b|| 3.380843836198e-05</div><div>113 KSP preconditioned resid norm 1.162855824118e-05 true resid norm 2.490229018536e-04 ||r(i)||/||b|| 3.380825426043e-05</div><div>114 KSP preconditioned resid norm 1.175594685689e-05 true resid norm 2.490274328440e-04 ||r(i)||/||b|| 3.380886940415e-05</div><div>115 KSP preconditioned resid norm 1.167979454122e-05 true resid norm 2.490271161036e-04 ||r(i)||/||b|| 3.380882640232e-05</div><div>116 KSP preconditioned resid norm 1.181010893019e-05 true resid norm 2.490235420657e-04 ||r(i)||/||b|| 3.380834117795e-05</div><div>117 KSP preconditioned resid norm 1.175206638194e-05 true resid norm 2.490263165345e-04 ||r(i)||/||b|| 3.380871784992e-05</div><div>118 KSP preconditioned resid norm 1.183804125791e-05 true resid norm 2.490221353083e-04 ||r(i)||/||b|| 3.380815019145e-05</div><div>119 KSP preconditioned resid norm 1.186426973727e-05 true resid norm 2.490227115336e-04 ||r(i)||/||b|| 3.380822842189e-05</div><div>120 KSP preconditioned resid norm 1.181986776689e-05 true resid norm 2.490257884230e-04 ||r(i)||/||b|| 3.380864615159e-05</div><div>121 KSP preconditioned resid norm 1.131443277370e-05 true resid norm 2.490259110230e-04 ||r(i)||/||b|| 3.380866279620e-05</div><div>122 KSP preconditioned resid norm 1.114920075859e-05 true resid norm 2.490249829382e-04 ||r(i)||/||b|| 3.380853679603e-05</div><div>123 KSP preconditioned resid norm 1.082073321672e-05 true resid norm 2.490314084868e-04 ||r(i)||/||b|| 3.380940915187e-05</div><div>124 KSP preconditioned resid norm 3.307785860990e-06 true resid norm 2.490613501549e-04 ||r(i)||/||b|| 3.381347414155e-05</div><div>125 KSP preconditioned resid norm 3.287051720572e-06 true resid norm 2.490584648195e-04 ||r(i)||/||b|| 3.381308241794e-05</div><div>126 KSP preconditioned resid norm 3.286797046069e-06 true resid norm 2.490654396386e-04 ||r(i)||/||b|| 3.381402934473e-05</div><div>127 KSP preconditioned resid norm 3.311592899411e-06 true resid norm 2.490627973588e-04 ||r(i)||/||b|| 3.381367061922e-05</div><div>128 KSP preconditioned resid norm 3.560993694635e-06 true resid norm 2.490571732816e-04 ||r(i)||/||b|| 3.381290707406e-05</div><div>129 KSP preconditioned resid norm 3.411994617661e-06 true resid norm 2.490652122141e-04 ||r(i)||/||b|| 3.381399846875e-05</div><div>130 KSP preconditioned resid norm 3.412383310721e-06 true resid norm 2.490633454022e-04 ||r(i)||/||b|| 3.381374502359e-05</div><div>131 KSP preconditioned resid norm 3.288320044878e-06 true resid norm 2.490639470096e-04 ||r(i)||/||b|| 3.381382669999e-05</div><div>132 KSP preconditioned resid norm 3.273215756565e-06 true resid norm 2.490640390847e-04 ||r(i)||/||b|| 3.381383920043e-05</div><div>133 KSP preconditioned resid norm 3.236969051459e-06 true resid norm 2.490678216102e-04 ||r(i)||/||b|| 3.381435272985e-05</div><div>134 KSP preconditioned resid norm 3.203260913942e-06 true resid norm 2.490640965346e-04 ||r(i)||/||b|| 3.381384700005e-05</div><div>135 KSP preconditioned resid norm 3.224117152353e-06 true resid norm 2.490655026376e-04 ||r(i)||/||b|| 3.381403789770e-05</div><div>136 KSP preconditioned resid norm 3.221577997984e-06 true resid norm 2.490684737611e-04 ||r(i)||/||b|| 3.381444126823e-05</div><div>137 KSP preconditioned resid norm 3.195936222128e-06 true resid norm 2.490673982333e-04 ||r(i)||/||b|| 3.381429525066e-05</div><div>138 KSP preconditioned resid norm 3.207528137426e-06 true resid norm 2.490641247196e-04 ||r(i)||/||b|| 3.381385082655e-05</div><div>139 KSP preconditioned resid norm 3.240134271963e-06 true resid norm 2.490615861251e-04 ||r(i)||/||b|| 3.381350617773e-05</div><div>140 KSP preconditioned resid norm 2.698833607230e-06 true resid norm 2.490638954889e-04 ||r(i)||/||b|| 3.381381970535e-05</div><div>141 KSP preconditioned resid norm 2.599151209137e-06 true resid norm 2.490657106698e-04 ||r(i)||/||b|| 3.381406614091e-05</div><div>142 KSP preconditioned resid norm 2.633939920994e-06 true resid norm 2.490707754695e-04 ||r(i)||/||b|| 3.381475375652e-05</div><div>143 KSP preconditioned resid norm 2.519609221376e-06 true resid norm 2.490639100480e-04 ||r(i)||/||b|| 3.381382168195e-05</div><div>144 KSP preconditioned resid norm 3.768526937684e-06 true resid norm 2.490654096698e-04 ||r(i)||/||b|| 3.381402527606e-05</div><div>145 KSP preconditioned resid norm 3.707841943289e-06 true resid norm 2.490630207923e-04 ||r(i)||/||b|| 3.381370095336e-05</div><div>146 KSP preconditioned resid norm 3.698827503486e-06 true resid norm 2.490646071561e-04 ||r(i)||/||b|| 3.381391632387e-05</div><div>147 KSP preconditioned resid norm 3.642747039615e-06 true resid norm 2.490610990161e-04 ||r(i)||/||b|| 3.381344004604e-05</div><div>148 KSP preconditioned resid norm 3.613100087842e-06 true resid norm 2.490617159023e-04 ||r(i)||/||b|| 3.381352379676e-05</div><div>149 KSP preconditioned resid norm 3.637646399299e-06 true resid norm 2.490648063023e-04 ||r(i)||/||b|| 3.381394336069e-05</div><div>150 KSP preconditioned resid norm 3.640235367864e-06 true resid norm 2.490648516718e-04 ||r(i)||/||b|| 3.381394952022e-05</div><div>151 KSP preconditioned resid norm 3.724708848977e-06 true resid norm 2.490622201040e-04 ||r(i)||/||b|| 3.381359224901e-05</div><div>152 KSP preconditioned resid norm 3.665185002770e-06 true resid norm 2.490664302790e-04 ||r(i)||/||b|| 3.381416383766e-05</div><div>153 KSP preconditioned resid norm 3.348992579120e-06 true resid norm 2.490655722697e-04 ||r(i)||/||b|| 3.381404735121e-05</div><div>154 KSP preconditioned resid norm 3.309431137943e-06 true resid norm 2.490727563300e-04 ||r(i)||/||b|| 3.381502268535e-05</div><div>155 KSP preconditioned resid norm 3.299031245428e-06 true resid norm 2.490688392843e-04 ||r(i)||/||b|| 3.381449089298e-05</div><div>156 KSP preconditioned resid norm 3.297127463503e-06 true resid norm 2.490642207769e-04 ||r(i)||/||b|| 3.381386386763e-05</div><div>157 KSP preconditioned resid norm 3.297370198641e-06 true resid norm 2.490666651723e-04 ||r(i)||/||b|| 3.381419572764e-05</div><div>158 KSP preconditioned resid norm 3.290873165210e-06 true resid norm 2.490679189538e-04 ||r(i)||/||b|| 3.381436594557e-05</div><div>159 KSP preconditioned resid norm 3.346705292419e-06 true resid norm 2.490617329776e-04 ||r(i)||/||b|| 3.381352611496e-05</div><div>160 KSP preconditioned resid norm 3.429583550890e-06 true resid norm 2.490675116236e-04 ||r(i)||/||b|| 3.381431064494e-05</div><div>161 KSP preconditioned resid norm 3.425238504679e-06 true resid norm 2.490648199058e-04 ||r(i)||/||b|| 3.381394520756e-05</div><div>162 KSP preconditioned resid norm 3.423484857849e-06 true resid norm 2.490723208298e-04 ||r(i)||/||b|| 3.381496356025e-05</div><div>163 KSP preconditioned resid norm 3.383655922943e-06 true resid norm 2.490659981249e-04 ||r(i)||/||b|| 3.381410516686e-05</div><div>164 KSP preconditioned resid norm 3.477197358452e-06 true resid norm 2.490665979073e-04 ||r(i)||/||b|| 3.381418659549e-05</div><div>165 KSP preconditioned resid norm 3.454672202601e-06 true resid norm 2.490651358644e-04 ||r(i)||/||b|| 3.381398810323e-05</div><div>166 KSP preconditioned resid norm 3.399075522566e-06 true resid norm 2.490678159511e-04 ||r(i)||/||b|| 3.381435196154e-05</div><div>167 KSP preconditioned resid norm 3.305455787400e-06 true resid norm 2.490651924523e-04 ||r(i)||/||b|| 3.381399578581e-05</div><div>168 KSP preconditioned resid norm 3.368445533284e-06 true resid norm 2.490688061735e-04 ||r(i)||/||b|| 3.381448639774e-05</div><div>169 KSP preconditioned resid norm 2.981519724814e-06 true resid norm 2.490676378334e-04 ||r(i)||/||b|| 3.381432777964e-05</div><div>170 KSP preconditioned resid norm 3.034423065539e-06 true resid norm 2.490694458885e-04 ||r(i)||/||b|| 3.381457324777e-05</div><div>171 KSP preconditioned resid norm 2.885972780503e-06 true resid norm 2.490688033729e-04 ||r(i)||/||b|| 3.381448601752e-05</div><div>172 KSP preconditioned resid norm 2.892491075033e-06 true resid norm 2.490692993765e-04 ||r(i)||/||b|| 3.381455335678e-05</div><div>173 KSP preconditioned resid norm 2.921316177611e-06 true resid norm 2.490697629787e-04 ||r(i)||/||b|| 3.381461629709e-05</div><div>174 KSP preconditioned resid norm 2.999889222269e-06 true resid norm 2.490707272626e-04 ||r(i)||/||b|| 3.381474721178e-05</div><div>175 KSP preconditioned resid norm 2.975590207575e-06 true resid norm 2.490685439925e-04 ||r(i)||/||b|| 3.381445080310e-05</div><div>176 KSP preconditioned resid norm 2.983065843597e-06 true resid norm 2.490701883671e-04 ||r(i)||/||b|| 3.381467404937e-05</div><div>177 KSP preconditioned resid norm 2.965959610245e-06 true resid norm 2.490711538630e-04 ||r(i)||/||b|| 3.381480512861e-05</div><div>178 KSP preconditioned resid norm 3.005389788827e-06 true resid norm 2.490751808095e-04 ||r(i)||/||b|| 3.381535184150e-05</div><div>179 KSP preconditioned resid norm 2.956581668772e-06 true resid norm 2.490653125636e-04 ||r(i)||/||b|| 3.381401209257e-05</div><div>180 KSP preconditioned resid norm 2.937498883661e-06 true resid norm 2.490666056653e-04 ||r(i)||/||b|| 3.381418764874e-05</div><div>181 KSP preconditioned resid norm 2.913227475431e-06 true resid norm 2.490682436979e-04 ||r(i)||/||b|| 3.381441003402e-05</div><div>182 KSP preconditioned resid norm 3.048172862254e-06 true resid norm 2.490719669872e-04 ||r(i)||/||b|| 3.381491552130e-05</div><div>183 KSP preconditioned resid norm 3.023868104933e-06 true resid norm 2.490648745555e-04 ||r(i)||/||b|| 3.381395262699e-05</div><div>184 KSP preconditioned resid norm 2.985947506400e-06 true resid norm 2.490638818852e-04 ||r(i)||/||b|| 3.381381785846e-05</div><div>185 KSP preconditioned resid norm 2.840032055776e-06 true resid norm 2.490701112392e-04 ||r(i)||/||b|| 3.381466357820e-05</div><div>186 KSP preconditioned resid norm 2.229279683815e-06 true resid norm 2.490609220680e-04 ||r(i)||/||b|| 3.381341602292e-05</div><div>187 KSP preconditioned resid norm 2.441513276379e-06 true resid norm 2.490674056899e-04 ||r(i)||/||b|| 3.381429626300e-05</div><div>188 KSP preconditioned resid norm 2.467046864016e-06 true resid norm 2.490691622632e-04 ||r(i)||/||b|| 3.381453474178e-05</div><div>189 KSP preconditioned resid norm 2.482124586361e-06 true resid norm 2.490664992339e-04 ||r(i)||/||b|| 3.381417319923e-05</div><div>190 KSP preconditioned resid norm 2.470564926502e-06 true resid norm 2.490617019713e-04 ||r(i)||/||b|| 3.381352190543e-05</div><div>191 KSP preconditioned resid norm 2.457947086578e-06 true resid norm 2.490628644250e-04 ||r(i)||/||b|| 3.381367972437e-05</div><div>192 KSP preconditioned resid norm 2.469444741724e-06 true resid norm 2.490639416335e-04 ||r(i)||/||b|| 3.381382597011e-05</div><div>193 KSP preconditioned resid norm 2.469951525219e-06 true resid norm 2.490599769764e-04 ||r(i)||/||b|| 3.381328771385e-05</div><div>194 KSP preconditioned resid norm 2.467486786643e-06 true resid norm 2.490630178622e-04 ||r(i)||/||b|| 3.381370055556e-05</div><div>195 KSP preconditioned resid norm 2.409684391404e-06 true resid norm 2.490640302606e-04 ||r(i)||/||b|| 3.381383800245e-05</div><div>196 KSP preconditioned resid norm 2.456046691135e-06 true resid norm 2.490637730235e-04 ||r(i)||/||b|| 3.381380307900e-05</div><div>197 KSP preconditioned resid norm 2.300015653805e-06 true resid norm 2.490615406913e-04 ||r(i)||/||b|| 3.381350000947e-05</div><div>198 KSP preconditioned resid norm 2.238328275301e-06 true resid norm 2.490647641246e-04 ||r(i)||/||b|| 3.381393763449e-05</div><div>199 KSP preconditioned resid norm 2.317293820319e-06 true resid norm 2.490641611282e-04 ||r(i)||/||b|| 3.381385576951e-05</div><div>200 KSP preconditioned resid norm 2.359590971314e-06 true resid norm 2.490685242974e-04 ||r(i)||/||b|| 3.381444812922e-05</div><div>201 KSP preconditioned resid norm 2.311199691596e-06 true resid norm 2.490656791753e-04 ||r(i)||/||b|| 3.381406186510e-05</div><div>202 KSP preconditioned resid norm 2.328772904196e-06 true resid norm 2.490651045523e-04 ||r(i)||/||b|| 3.381398385220e-05</div><div>203 KSP preconditioned resid norm 2.332731604717e-06 true resid norm 2.490649960574e-04 ||r(i)||/||b|| 3.381396912253e-05</div><div>204 KSP preconditioned resid norm 2.357629383490e-06 true resid norm 2.490686317727e-04 ||r(i)||/||b|| 3.381446272046e-05</div><div>205 KSP preconditioned resid norm 2.374856180299e-06 true resid norm 2.490645897176e-04 ||r(i)||/||b|| 3.381391395637e-05</div><div>206 KSP preconditioned resid norm 2.340395514404e-06 true resid norm 2.490618341127e-04 ||r(i)||/||b|| 3.381353984542e-05</div><div>207 KSP preconditioned resid norm 2.314963680954e-06 true resid norm 2.490676153984e-04 ||r(i)||/||b|| 3.381432473379e-05</div><div>208 KSP preconditioned resid norm 2.448070953106e-06 true resid norm 2.490644606776e-04 ||r(i)||/||b|| 3.381389643743e-05</div><div>209 KSP preconditioned resid norm 2.428805110632e-06 true resid norm 2.490635817597e-04 ||r(i)||/||b|| 3.381377711234e-05</div><div>210 KSP preconditioned resid norm 2.537929937808e-06 true resid norm 2.490680589404e-04 ||r(i)||/||b|| 3.381438495066e-05</div><div>211 KSP preconditioned resid norm 2.515909029682e-06 true resid norm 2.490687803038e-04 ||r(i)||/||b|| 3.381448288557e-05</div><div>212 KSP preconditioned resid norm 2.497907513266e-06 true resid norm 2.490618016885e-04 ||r(i)||/||b|| 3.381353544340e-05</div><div>213 KSP preconditioned resid norm 1.783501869502e-06 true resid norm 2.490632647470e-04 ||r(i)||/||b|| 3.381373407354e-05</div><div>214 KSP preconditioned resid norm 1.767420653144e-06 true resid norm 2.490685569328e-04 ||r(i)||/||b|| 3.381445255992e-05</div><div>215 KSP preconditioned resid norm 1.854926068272e-06 true resid norm 2.490609365464e-04 ||r(i)||/||b|| 3.381341798856e-05</div><div>216 KSP preconditioned resid norm 1.818308539774e-06 true resid norm 2.490639142283e-04 ||r(i)||/||b|| 3.381382224948e-05</div><div>217 KSP preconditioned resid norm 1.809431578070e-06 true resid norm 2.490605125049e-04 ||r(i)||/||b|| 3.381336041915e-05</div><div>218 KSP preconditioned resid norm 1.789862735999e-06 true resid norm 2.490564024901e-04 ||r(i)||/||b|| 3.381280242859e-05</div><div>219 KSP preconditioned resid norm 1.769239890163e-06 true resid norm 2.490647825316e-04 ||r(i)||/||b|| 3.381394013349e-05</div><div>220 KSP preconditioned resid norm 1.780760773109e-06 true resid norm 2.490622606663e-04 ||r(i)||/||b|| 3.381359775589e-05</div><div>221 KSP preconditioned resid norm 5.009024913368e-07 true resid norm 2.490659101637e-04 ||r(i)||/||b|| 3.381409322492e-05</div><div>222 KSP preconditioned resid norm 4.974450322799e-07 true resid norm 2.490714287402e-04 ||r(i)||/||b|| 3.381484244693e-05</div><div>223 KSP preconditioned resid norm 4.938819481519e-07 true resid norm 2.490665661715e-04 ||r(i)||/||b|| 3.381418228693e-05</div><div>224 KSP preconditioned resid norm 4.973231831266e-07 true resid norm 2.490725000995e-04 ||r(i)||/||b|| 3.381498789855e-05</div><div>225 KSP preconditioned resid norm 5.086864036771e-07 true resid norm 2.490664132954e-04 ||r(i)||/||b|| 3.381416153192e-05</div><div>226 KSP preconditioned resid norm 5.046954570561e-07 true resid norm 2.490698772594e-04 ||r(i)||/||b|| 3.381463181226e-05</div><div>227 KSP preconditioned resid norm 5.086852920874e-07 true resid norm 2.490703544723e-04 ||r(i)||/||b|| 3.381469660041e-05</div><div>228 KSP preconditioned resid norm 5.182381756169e-07 true resid norm 2.490665200032e-04 ||r(i)||/||b|| 3.381417601896e-05</div><div>229 KSP preconditioned resid norm 5.261455182896e-07 true resid norm 2.490697169472e-04 ||r(i)||/||b|| 3.381461004770e-05</div><div>230 KSP preconditioned resid norm 5.265262522400e-07 true resid norm 2.490726890541e-04 ||r(i)||/||b|| 3.381501355172e-05</div><div>231 KSP preconditioned resid norm 5.220652263946e-07 true resid norm 2.490689325236e-04 ||r(i)||/||b|| 3.381450355149e-05</div><div>232 KSP preconditioned resid norm 5.256466259888e-07 true resid norm 2.490694033989e-04 ||r(i)||/||b|| 3.381456747923e-05</div><div>233 KSP preconditioned resid norm 5.443022648374e-07 true resid norm 2.490650183144e-04 ||r(i)||/||b|| 3.381397214423e-05</div><div>234 KSP preconditioned resid norm 5.562619006436e-07 true resid norm 2.490764576883e-04 ||r(i)||/||b|| 3.381552519520e-05</div><div>235 KSP preconditioned resid norm 5.998148629545e-07 true resid norm 2.490714032716e-04 ||r(i)||/||b|| 3.381483898922e-05</div><div>236 KSP preconditioned resid norm 6.498977322955e-07 true resid norm 2.490650270144e-04 ||r(i)||/||b|| 3.381397332537e-05</div><div>237 KSP preconditioned resid norm 6.503686003429e-07 true resid norm 2.490706976108e-04 ||r(i)||/||b|| 3.381474318615e-05</div><div>238 KSP preconditioned resid norm 6.566719023119e-07 true resid norm 2.490664107559e-04 ||r(i)||/||b|| 3.381416118714e-05</div><div>239 KSP preconditioned resid norm 6.549737473208e-07 true resid norm 2.490721547909e-04 ||r(i)||/||b|| 3.381494101821e-05</div><div>240 KSP preconditioned resid norm 6.616898981418e-07 true resid norm 2.490679659838e-04 ||r(i)||/||b|| 3.381437233053e-05</div><div>241 KSP preconditioned resid norm 6.829917691021e-07 true resid norm 2.490728328614e-04 ||r(i)||/||b|| 3.381503307553e-05</div><div>242 KSP preconditioned resid norm 7.030239869389e-07 true resid norm 2.490706345115e-04 ||r(i)||/||b|| 3.381473461955e-05</div><div>243 KSP preconditioned resid norm 7.018435683340e-07 true resid norm 2.490650978460e-04 ||r(i)||/||b|| 3.381398294172e-05</div><div>244 KSP preconditioned resid norm 7.058047080376e-07 true resid norm 2.490685975642e-04 ||r(i)||/||b|| 3.381445807618e-05</div><div>245 KSP preconditioned resid norm 6.896300385099e-07 true resid norm 2.490708566380e-04 ||r(i)||/||b|| 3.381476477625e-05</div><div>246 KSP preconditioned resid norm 7.093960074437e-07 true resid norm 2.490667427871e-04 ||r(i)||/||b|| 3.381420626490e-05</div><div>247 KSP preconditioned resid norm 7.817121711853e-07 true resid norm 2.490692299030e-04 ||r(i)||/||b|| 3.381454392480e-05</div><div>248 KSP preconditioned resid norm 7.976109778309e-07 true resid norm 2.490686360729e-04 ||r(i)||/||b|| 3.381446330426e-05</div><div>249 KSP preconditioned resid norm 7.855322750445e-07 true resid norm 2.490720861966e-04 ||r(i)||/||b|| 3.381493170560e-05</div><div>250 KSP preconditioned resid norm 7.778531114042e-07 true resid norm 2.490673235034e-04 ||r(i)||/||b|| 3.381428510506e-05</div><div>251 KSP preconditioned resid norm 7.848682182070e-07 true resid norm 2.490686360729e-04 ||r(i)||/||b|| 3.381446330426e-05</div><div>252 KSP preconditioned resid norm 7.967291867330e-07 true resid norm 2.490724820229e-04 ||r(i)||/||b|| 3.381498544442e-05</div><div>253 KSP preconditioned resid norm 7.865012959525e-07 true resid norm 2.490666662028e-04 ||r(i)||/||b|| 3.381419586754e-05</div><div>254 KSP preconditioned resid norm 7.656025385804e-07 true resid norm 2.490686283214e-04 ||r(i)||/||b|| 3.381446225190e-05</div><div>255 KSP preconditioned resid norm 7.757018653468e-07 true resid norm 2.490655983763e-04 ||r(i)||/||b|| 3.381405089553e-05</div><div>256 KSP preconditioned resid norm 6.686490372981e-07 true resid norm 2.490715698964e-04 ||r(i)||/||b|| 3.381486161081e-05</div><div>257 KSP preconditioned resid norm 6.596005109428e-07 true resid norm 2.490666403003e-04 ||r(i)||/||b|| 3.381419235092e-05</div><div>258 KSP preconditioned resid norm 6.681742296333e-07 true resid norm 2.490683725835e-04 ||r(i)||/||b|| 3.381442753198e-05</div><div>259 KSP preconditioned resid norm 1.089245482033e-06 true resid norm 2.490688086568e-04 ||r(i)||/||b|| 3.381448673488e-05</div><div>260 KSP preconditioned resid norm 1.099844873189e-06 true resid norm 2.490690703265e-04 ||r(i)||/||b|| 3.381452226011e-05</div><div>261 KSP preconditioned resid norm 1.112925540869e-06 true resid norm 2.490664481058e-04 ||r(i)||/||b|| 3.381416625790e-05</div><div>262 KSP preconditioned resid norm 1.113056910480e-06 true resid norm 2.490658753273e-04 ||r(i)||/||b|| 3.381408849541e-05</div><div>263 KSP preconditioned resid norm 1.104801535149e-06 true resid norm 2.490736510776e-04 ||r(i)||/||b|| 3.381514415953e-05</div><div>264 KSP preconditioned resid norm 1.158709147873e-06 true resid norm 2.490607531152e-04 ||r(i)||/||b|| 3.381339308528e-05</div><div>265 KSP preconditioned resid norm 1.178985740182e-06 true resid norm 2.490727895619e-04 ||r(i)||/||b|| 3.381502719703e-05</div><div>266 KSP preconditioned resid norm 1.165130533478e-06 true resid norm 2.490639076693e-04 ||r(i)||/||b|| 3.381382135901e-05</div><div>267 KSP preconditioned resid norm 1.181364114499e-06 true resid norm 2.490667871436e-04 ||r(i)||/||b|| 3.381421228690e-05</div><div>268 KSP preconditioned resid norm 1.170295348543e-06 true resid norm 2.490662613306e-04 ||r(i)||/||b|| 3.381414090063e-05</div><div>269 KSP preconditioned resid norm 1.213243016230e-06 true resid norm 2.490666173719e-04 ||r(i)||/||b|| 3.381418923808e-05</div><div>270 KSP preconditioned resid norm 1.239691953997e-06 true resid norm 2.490678323197e-04 ||r(i)||/||b|| 3.381435418381e-05</div><div>271 KSP preconditioned resid norm 1.219891740100e-06 true resid norm 2.490625009256e-04 ||r(i)||/||b|| 3.381363037437e-05</div><div>272 KSP preconditioned resid norm 1.231321334346e-06 true resid norm 2.490659733696e-04 ||r(i)||/||b|| 3.381410180599e-05</div><div>273 KSP preconditioned resid norm 1.208183234158e-06 true resid norm 2.490685987255e-04 ||r(i)||/||b|| 3.381445823385e-05</div><div>274 KSP preconditioned resid norm 1.211768545589e-06 true resid norm 2.490671548953e-04 ||r(i)||/||b|| 3.381426221421e-05</div><div>275 KSP preconditioned resid norm 1.209433459842e-06 true resid norm 2.490669016096e-04 ||r(i)||/||b|| 3.381422782722e-05</div><div>276 KSP preconditioned resid norm 1.223729184405e-06 true resid norm 2.490658128014e-04 ||r(i)||/||b|| 3.381408000666e-05</div><div>277 KSP preconditioned resid norm 1.243915201868e-06 true resid norm 2.490693375756e-04 ||r(i)||/||b|| 3.381455854282e-05</div><div>278 KSP preconditioned resid norm 1.231994655529e-06 true resid norm 2.490682988311e-04 ||r(i)||/||b|| 3.381441751910e-05</div><div>279 KSP preconditioned resid norm 1.227930683777e-06 true resid norm 2.490667825866e-04 ||r(i)||/||b|| 3.381421166823e-05</div><div>280 KSP preconditioned resid norm 1.193458846469e-06 true resid norm 2.490687366117e-04 ||r(i)||/||b|| 3.381447695378e-05</div><div>281 KSP preconditioned resid norm 1.217089059805e-06 true resid norm 2.490674797371e-04 ||r(i)||/||b|| 3.381430631591e-05</div><div>282 KSP preconditioned resid norm 1.249318287709e-06 true resid norm 2.490662866951e-04 ||r(i)||/||b|| 3.381414434420e-05</div><div>283 KSP preconditioned resid norm 1.183320029547e-06 true resid norm 2.490645783630e-04 ||r(i)||/||b|| 3.381391241482e-05</div><div>284 KSP preconditioned resid norm 1.174730603102e-06 true resid norm 2.490686881647e-04 ||r(i)||/||b|| 3.381447037643e-05</div><div>285 KSP preconditioned resid norm 1.175838261923e-06 true resid norm 2.490665969300e-04 ||r(i)||/||b|| 3.381418646281e-05</div><div>286 KSP preconditioned resid norm 1.188946188368e-06 true resid norm 2.490661974622e-04 ||r(i)||/||b|| 3.381413222961e-05</div><div>287 KSP preconditioned resid norm 1.177848565707e-06 true resid norm 2.490660236206e-04 ||r(i)||/||b|| 3.381410862824e-05</div><div>288 KSP preconditioned resid norm 1.200075508281e-06 true resid norm 2.490645353536e-04 ||r(i)||/||b|| 3.381390657571e-05</div><div>289 KSP preconditioned resid norm 1.184589570618e-06 true resid norm 2.490664920355e-04 ||r(i)||/||b|| 3.381417222195e-05</div><div>290 KSP preconditioned resid norm 1.221114703873e-06 true resid norm 2.490670597538e-04 ||r(i)||/||b|| 3.381424929746e-05</div><div>291 KSP preconditioned resid norm 1.249479658256e-06 true resid norm 2.490641582876e-04 ||r(i)||/||b|| 3.381385538385e-05</div><div>292 KSP preconditioned resid norm 1.245768496850e-06 true resid norm 2.490704480588e-04 ||r(i)||/||b|| 3.381470930606e-05</div><div>293 KSP preconditioned resid norm 1.243742607953e-06 true resid norm 2.490649690604e-04 ||r(i)||/||b|| 3.381396545733e-05</div><div>294 KSP preconditioned resid norm 1.342758483339e-06 true resid norm 2.490676207432e-04 ||r(i)||/||b|| 3.381432545942e-05</div><div>295 KSP preconditioned resid norm 1.353816099600e-06 true resid norm 2.490695263153e-04 ||r(i)||/||b|| 3.381458416681e-05</div><div>296 KSP preconditioned resid norm 1.343886763293e-06 true resid norm 2.490673674307e-04 ||r(i)||/||b|| 3.381429106879e-05</div><div>297 KSP preconditioned resid norm 1.355511022815e-06 true resid norm 2.490686565995e-04 ||r(i)||/||b|| 3.381446609103e-05</div><div>298 KSP preconditioned resid norm 1.347247627243e-06 true resid norm 2.490696287707e-04 ||r(i)||/||b|| 3.381459807652e-05</div><div>299 KSP preconditioned resid norm 1.414742595618e-06 true resid norm 2.490749815091e-04 ||r(i)||/||b|| 3.381532478374e-05</div><div>300 KSP preconditioned resid norm 1.418560683189e-06 true resid norm 2.490721501153e-04 ||r(i)||/||b|| 3.381494038343e-05</div><div>301 KSP preconditioned resid norm 1.416276404923e-06 true resid norm 2.490689576447e-04 ||r(i)||/||b|| 3.381450696203e-05</div><div>302 KSP preconditioned resid norm 1.431448272112e-06 true resid norm 2.490688812701e-04 ||r(i)||/||b|| 3.381449659312e-05</div><div>303 KSP preconditioned resid norm 1.446154958969e-06 true resid norm 2.490727536322e-04 ||r(i)||/||b|| 3.381502231909e-05</div><div>304 KSP preconditioned resid norm 1.468860617921e-06 true resid norm 2.490692363788e-04 ||r(i)||/||b|| 3.381454480397e-05</div><div>305 KSP preconditioned resid norm 1.627595214971e-06 true resid norm 2.490687019603e-04 ||r(i)||/||b|| 3.381447224938e-05</div><div>306 KSP preconditioned resid norm 1.614384672893e-06 true resid norm 2.490687019603e-04 ||r(i)||/||b|| 3.381447224938e-05</div><div>307 KSP preconditioned resid norm 1.605568020532e-06 true resid norm 2.490699757693e-04 ||r(i)||/||b|| 3.381464518632e-05</div><div>308 KSP preconditioned resid norm 1.617069685075e-06 true resid norm 2.490649282923e-04 ||r(i)||/||b|| 3.381395992249e-05</div><div>309 KSP preconditioned resid norm 1.654297792738e-06 true resid norm 2.490644766626e-04 ||r(i)||/||b|| 3.381389860760e-05</div><div>310 KSP preconditioned resid norm 1.587528143215e-06 true resid norm 2.490696752096e-04 ||r(i)||/||b|| 3.381460438124e-05</div><div>311 KSP preconditioned resid norm 1.662782022388e-06 true resid norm 2.490699317737e-04 ||r(i)||/||b|| 3.381463921332e-05</div><div>312 KSP preconditioned resid norm 1.618211471748e-06 true resid norm 2.490735831308e-04 ||r(i)||/||b|| 3.381513493483e-05</div><div>313 KSP preconditioned resid norm 1.609074961921e-06 true resid norm 2.490679566436e-04 ||r(i)||/||b|| 3.381437106247e-05</div><div>314 KSP preconditioned resid norm 1.548068942878e-06 true resid norm 2.490660071226e-04 ||r(i)||/||b|| 3.381410638842e-05</div><div>315 KSP preconditioned resid norm 1.526718322150e-06 true resid norm 2.490619832967e-04 ||r(i)||/||b|| 3.381356009919e-05</div><div>316 KSP preconditioned resid norm 1.553150959105e-06 true resid norm 2.490660071226e-04 ||r(i)||/||b|| 3.381410638842e-05</div><div>317 KSP preconditioned resid norm 1.615015320906e-06 true resid norm 2.490672348079e-04 ||r(i)||/||b|| 3.381427306343e-05</div><div>318 KSP preconditioned resid norm 1.602904469797e-06 true resid norm 2.490696731006e-04 ||r(i)||/||b|| 3.381460409491e-05</div><div>319 KSP preconditioned resid norm 1.538140323073e-06 true resid norm 2.490722982494e-04 ||r(i)||/||b|| 3.381496049466e-05</div><div>320 KSP preconditioned resid norm 1.534779679430e-06 true resid norm 2.490778499789e-04 ||r(i)||/||b|| 3.381571421763e-05</div><div>321 KSP preconditioned resid norm 1.547155843355e-06 true resid norm 2.490767612985e-04 ||r(i)||/||b|| 3.381556641442e-05</div><div>322 KSP preconditioned resid norm 1.422137008870e-06 true resid norm 2.490737676309e-04 ||r(i)||/||b|| 3.381515998323e-05</div><div>323 KSP preconditioned resid norm 1.403072558954e-06 true resid norm 2.490741361870e-04 ||r(i)||/||b|| 3.381521001975e-05</div><div>324 KSP preconditioned resid norm 1.373070436118e-06 true resid norm 2.490742214990e-04 ||r(i)||/||b|| 3.381522160202e-05</div><div>325 KSP preconditioned resid norm 1.359547585233e-06 true resid norm 2.490792987570e-04 ||r(i)||/||b|| 3.381591090902e-05</div><div>326 KSP preconditioned resid norm 1.370351913612e-06 true resid norm 2.490727161158e-04 ||r(i)||/||b|| 3.381501722573e-05</div><div>327 KSP preconditioned resid norm 1.365238666187e-06 true resid norm 2.490716949642e-04 ||r(i)||/||b|| 3.381487859046e-05</div><div>328 KSP preconditioned resid norm 1.369073373042e-06 true resid norm 2.490807360288e-04 ||r(i)||/||b|| 3.381610603826e-05</div><div>329 KSP preconditioned resid norm 1.426698981572e-06 true resid norm 2.490791479521e-04 ||r(i)||/||b|| 3.381589043520e-05</div><div>330 KSP preconditioned resid norm 1.445542403570e-06 true resid norm 2.490775981409e-04 ||r(i)||/||b|| 3.381568002720e-05</div><div>331 KSP preconditioned resid norm 1.464506963984e-06 true resid norm 2.490740562430e-04 ||r(i)||/||b|| 3.381519916626e-05</div><div>332 KSP preconditioned resid norm 1.461462964401e-06 true resid norm 2.490768016856e-04 ||r(i)||/||b|| 3.381557189753e-05</div><div>333 KSP preconditioned resid norm 1.476680847971e-06 true resid norm 2.490744321516e-04 ||r(i)||/||b|| 3.381525020097e-05</div><div>334 KSP preconditioned resid norm 1.459640372198e-06 true resid norm 2.490788817993e-04 ||r(i)||/||b|| 3.381585430132e-05</div><div>335 KSP preconditioned resid norm 1.790770882365e-06 true resid norm 2.490771711471e-04 ||r(i)||/||b|| 3.381562205697e-05</div><div>336 KSP preconditioned resid norm 1.803770155018e-06 true resid norm 2.490768953858e-04 ||r(i)||/||b|| 3.381558461860e-05</div><div>337 KSP preconditioned resid norm 1.787821255995e-06 true resid norm 2.490767985676e-04 ||r(i)||/||b|| 3.381557147421e-05</div><div>338 KSP preconditioned resid norm 1.749912220831e-06 true resid norm 2.490760198704e-04 ||r(i)||/||b|| 3.381546575545e-05</div><div>339 KSP preconditioned resid norm 1.802915839010e-06 true resid norm 2.490815556273e-04 ||r(i)||/||b|| 3.381621730993e-05</div><div>340 KSP preconditioned resid norm 1.800777670709e-06 true resid norm 2.490823909286e-04 ||r(i)||/||b|| 3.381633071347e-05</div><div>341 KSP preconditioned resid norm 1.962516327690e-06 true resid norm 2.490773477410e-04 ||r(i)||/||b|| 3.381564603199e-05</div><div>342 KSP preconditioned resid norm 1.981726465132e-06 true resid norm 2.490769116884e-04 ||r(i)||/||b|| 3.381558683191e-05</div><div>343 KSP preconditioned resid norm 1.963419167052e-06 true resid norm 2.490764009914e-04 ||r(i)||/||b|| 3.381551749783e-05</div><div>344 KSP preconditioned resid norm 1.992082169278e-06 true resid norm 2.490806829883e-04 ||r(i)||/||b|| 3.381609883728e-05</div><div>345 KSP preconditioned resid norm 1.981005134253e-06 true resid norm 2.490748677339e-04 ||r(i)||/||b|| 3.381530933721e-05</div><div>346 KSP preconditioned resid norm 1.959802663114e-06 true resid norm 2.490773752317e-04 ||r(i)||/||b|| 3.381564976423e-05</div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Oct 21, 2017 at 5:25 PM, Matthew Knepley <span dir="ltr"><<a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><span>On Sat, Oct 21, 2017 at 5:21 PM, Hao Zhang <span dir="ltr"><<a href="mailto:hbcbh1999@gmail.com" target="_blank">hbcbh1999@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>ierr = MatAssemblyBegin(A,MAT_FINAL_A<wbr>SSEMBLY);</div><div> <span style="white-space:pre-wrap"> </span>ierr = MatAssemblyEnd(A,MAT_FINAL_ASS<wbr>EMBLY);</div><div><br></div><div> <span style="white-space:pre-wrap"> </span>ierr = VecAssemblyBegin(x);</div><div> <span style="white-space:pre-wrap"> </span>ierr = VecAssemblyEnd(x);</div></div></blockquote></span><div>This is probably unnecessary </div><span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><br></div><div> <span style="white-space:pre-wrap"> </span>ierr = VecAssemblyBegin(b);</div><div> <span style="white-space:pre-wrap"> </span>ierr = VecAssemblyEnd(b);</div></div></blockquote></span><div>This is probably unnecessary </div><span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"></div></blockquote><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div></div><div><br></div><div><span style="white-space:pre-wrap"> </span>ierr = MatNullSpaceCreate(PETSC_COMM_<wbr>WORLD,PETSC_TRUE,0,PETSC_NULL,<wbr>&nullsp);</div><div> ierr = MatSetNullSpace(A,nullsp); // Petsc-3.8</div></div></blockquote></span><div>Is your rhs consistent with this nullspace?</div><span><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div> // KSPSetOperators(ksp,A,A,DIFFER<wbr>ENT_NONZERO_PATTERN);</div><div> KSPSetOperators(ksp,A,A);</div><div><br></div><div><span style="white-space:pre-wrap"> </span>KSPSetType(ksp,KSPBCGS);</div><div><br></div><div> KSPSetComputeSingularValues(ks<wbr>p, PETSC_TRUE);</div><div>#if defined(__HYPRE__)</div><div><span style="white-space:pre-wrap"> </span>KSPGetPC(ksp, &pc);</div><div><span style="white-space:pre-wrap"> </span>PCSetType(pc, PCHYPRE);</div><div> PCHYPRESetType(pc,"boomeramg")<wbr>;</div></div></blockquote></span><div>This is terribly unnecessary. You just use</div><div><br></div><div> -pc_type hypre -pc_hypre_type boomeramg</div><div><br></div><div>or</div><div><br></div><div> -pc_type gamg</div><span><div> <br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>#else</div><div><span style="white-space:pre-wrap"> </span>KSPSetType(ksp,KSPBCGSL);</div><div><span style="white-space:pre-wrap"> </span>KSPBCGSLSetEll(ksp,2);</div><div>#endif /* defined(__HYPRE__) */</div><div><br></div><div> KSPSetFromOptions(ksp);</div><div> KSPSetUp(ksp);</div><div><br></div><div> ierr = KSPSolve(ksp,b,x);<br></div><div><br></div><div><br></div><div>command line </div></div></blockquote><div><br></div></span><div>You did not provide any of what I asked for the in the eprevious mail.</div><div><br></div><div> Matt</div><div><div class="m_617716428732516411h5"><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="gmail_extra"><div class="gmail_quote">On Sat, Oct 21, 2017 at 5:16 PM, Matthew Knepley <span dir="ltr"><<a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><span>On Sat, Oct 21, 2017 at 5:04 PM, Hao Zhang <span dir="ltr"><<a href="mailto:hbcbh1999@gmail.com" target="_blank">hbcbh1999@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">hi, <div><br></div><div>I implemented HYPRE preconditioner for my study due to the fact that without preconditioner, PETSc solver will take thousands of iterations to converge for fine grid simulation.</div><div><br></div><div>with HYPRE, depending on the parallel partition, it will take HYPRE forever to do anything. observation of output file is that the simulation is hanging with no output.</div><div><br></div><div>Any idea what happened? will post snippet of code.</div></div></blockquote><div><br></div></span><div>1) For any question about convergence, we need to see the output of</div><div><br></div><div> -ksp_view_pre -ksp_view -ksp_monitor_true_residual -ksp_converged_reason</div><div><br></div><div>2) Hypre has many preconditioners, which one are you talking about</div><div><br></div><div>3) PETSc has some preconditioners in common with Hypre, like AMG</div><div><br></div><div> Thanks,</div><div><br></div><div> Matt</div><span><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><span class="m_617716428732516411m_8570297967989127953gmail-m_3490654126839091020m_4609829663930822582HOEnZb"><font color="#888888"><div>-- <br><div class="m_617716428732516411m_8570297967989127953gmail-m_3490654126839091020m_4609829663930822582m_8504183156012973410gmail_signature">Hao Zhang<br>Dept. of Applid Mathematics and Statistics,<br>Stony Brook University, <br>Stony Brook, New York, 11790</div></div></font></span></div>
</blockquote></span></div><span class="m_617716428732516411m_8570297967989127953gmail-m_3490654126839091020HOEnZb"><font color="#888888"><br><br clear="all"><span class="m_617716428732516411m_8570297967989127953gmail-HOEnZb"><font color="#888888"><div><br></div>-- <br><div class="m_617716428732516411m_8570297967989127953gmail-m_3490654126839091020m_4609829663930822582gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>-- Norbert Wiener</div><div><br></div><div><a href="http://www.caam.rice.edu/~mk51/" target="_blank">https://www.cse.buffalo.edu/~k<wbr>nepley/</a><br></div></div></div></div></div>
</font></span></font></span></div></div><span class="m_617716428732516411m_8570297967989127953gmail-HOEnZb"><font color="#888888">
</font></span></blockquote></div><span class="m_617716428732516411m_8570297967989127953gmail-HOEnZb"><font color="#888888"><br><br clear="all"><div><br></div>-- <br><div class="m_617716428732516411m_8570297967989127953gmail-m_3490654126839091020gmail_signature">Hao Zhang<br>Dept. of Applid Mathematics and Statistics,<br>Stony Brook University, <br>Stony Brook, New York, 11790</div>
</font></span></div>
</blockquote></div></div></div><div><div class="m_617716428732516411h5"><br><br clear="all"><div><br></div>-- <br><div class="m_617716428732516411m_8570297967989127953gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>-- Norbert Wiener</div><div><br></div><div><a href="http://www.caam.rice.edu/~mk51/" target="_blank">https://www.cse.buffalo.edu/~k<wbr>nepley/</a><br></div></div></div></div></div>
</div></div></div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="m_617716428732516411gmail_signature" data-smartmail="gmail_signature">Hao Zhang<br>Dept. of Applid Mathematics and Statistics,<br>Stony Brook University, <br>Stony Brook, New York, 11790</div>
</div>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature">Hao Zhang<br>Dept. of Applid Mathematics and Statistics,<br>Stony Brook University, <br>Stony Brook, New York, 11790</div>
</div>