[petsc-users] [petsc-maint] Iterative Solver Problem

Foad Hassaninejadfarahani umhassa5 at cc.umanitoba.ca
Mon Apr 28 14:59:09 CDT 2014


  Here are the results that you asked for based on the following  
options (as I mentioned before -ksp_monitor_singular_value did not  
work):

-ksp_type gmres -ksp_max_it 500 -ksp_gmres_restart 500  
-ksp_monitor_true_residual -pc_type asm -sub_pc_type lu  
-ksp_converged_reason -ksp_view -log_summary



   0 KSP preconditioned resid norm 2.622210477042e+04 true resid norm  
1.860478790525e+07 ||r(i)||/||b|| 1.000000000000e+00
   1 KSP preconditioned resid norm 5.998205227155e+03 true resid norm  
4.223014979562e+06 ||r(i)||/||b|| 2.269853868300e-01
   2 KSP preconditioned resid norm 1.879862239084e+03 true resid norm  
3.444600162270e+06 ||r(i)||/||b|| 1.851458979169e-01
   3 KSP preconditioned resid norm 8.529038157181e+02 true resid norm  
1.311707893098e+06 ||r(i)||/||b|| 7.050378105779e-02
   4 KSP preconditioned resid norm 5.117477039988e+02 true resid norm  
1.150626093586e+06 ||r(i)||/||b|| 6.184569797010e-02
   5 KSP preconditioned resid norm 2.668129662870e+02 true resid norm  
4.043828616910e+05 ||r(i)||/||b|| 2.173541906258e-02
   6 KSP preconditioned resid norm 1.406200642770e+02 true resid norm  
2.157802026927e+05 ||r(i)||/||b|| 1.159810064977e-02
   7 KSP preconditioned resid norm 4.945736602548e+01 true resid norm  
8.664213205211e+04 ||r(i)||/||b|| 4.656980369428e-03
   8 KSP preconditioned resid norm 2.074113313015e+01 true resid norm  
1.871982540148e+03 ||r(i)||/||b|| 1.006183219976e-04
   9 KSP preconditioned resid norm 9.175543524744e+00 true resid norm  
1.972683087747e+03 ||r(i)||/||b|| 1.060309366489e-04
  10 KSP preconditioned resid norm 5.132382955099e+00 true resid norm  
9.668302341603e+02 ||r(i)||/||b|| 5.196674313538e-05
  11 KSP preconditioned resid norm 2.805085110849e+00 true resid norm  
8.679902185785e+02 ||r(i)||/||b|| 4.665413134506e-05
  12 KSP preconditioned resid norm 1.139484572989e+00 true resid norm  
1.708233863489e+02 ||r(i)||/||b|| 9.181689531690e-06
  13 KSP preconditioned resid norm 5.183239498946e-01 true resid norm  
8.061206948868e+01 ||r(i)||/||b|| 4.332866888847e-06
  14 KSP preconditioned resid norm 2.548292072900e-01 true resid norm  
1.784492887150e+01 ||r(i)||/||b|| 9.591578771219e-07
  15 KSP preconditioned resid norm 2.039372407280e-01 true resid norm  
1.076957601145e+01 ||r(i)||/||b|| 5.788604560449e-07
  16 KSP preconditioned resid norm 1.804982466524e-01 true resid norm  
9.739865064005e+00 ||r(i)||/||b|| 5.235138994117e-07
  17 KSP preconditioned resid norm 1.700936282311e-01 true resid norm  
1.695691923860e+01 ||r(i)||/||b|| 9.114277101657e-07
  18 KSP preconditioned resid norm 1.614639032299e-01 true resid norm  
4.816194157975e+00 ||r(i)||/||b|| 2.588685333315e-07
  19 KSP preconditioned resid norm 1.541008159975e-01 true resid norm  
1.351979893208e+01 ||r(i)||/||b|| 7.266838515403e-07
  20 KSP preconditioned resid norm 1.441065624835e-01 true resid norm  
1.723197534299e+01 ||r(i)||/||b|| 9.262118671147e-07
  21 KSP preconditioned resid norm 1.196140411042e-01 true resid norm  
6.561761118891e+00 ||r(i)||/||b|| 3.526920678864e-07
  22 KSP preconditioned resid norm 9.822321352825e-02 true resid norm  
1.061582812231e+01 ||r(i)||/||b|| 5.705965677422e-07
  23 KSP preconditioned resid norm 7.431304177587e-02 true resid norm  
1.327655908969e+01 ||r(i)||/||b|| 7.136098061053e-07
  24 KSP preconditioned resid norm 6.667763866612e-02 true resid norm  
2.841492940094e+00 ||r(i)||/||b|| 1.527291229852e-07
  25 KSP preconditioned resid norm 6.303986761069e-02 true resid norm  
2.414143897545e+00 ||r(i)||/||b|| 1.297592807744e-07
  26 KSP preconditioned resid norm 6.099053572176e-02 true resid norm  
2.238032868296e+00 ||r(i)||/||b|| 1.202933825257e-07
  27 KSP preconditioned resid norm 5.916313912854e-02 true resid norm  
2.468465881398e+00 ||r(i)||/||b|| 1.326790659463e-07
  28 KSP preconditioned resid norm 5.783250141316e-02 true resid norm  
4.252169414392e+00 ||r(i)||/||b|| 2.285524261845e-07
  29 KSP preconditioned resid norm 5.517165857664e-02 true resid norm  
2.974123231867e+00 ||r(i)||/||b|| 1.598579487718e-07
  30 KSP preconditioned resid norm 4.998751735155e-02 true resid norm  
2.954311987456e+00 ||r(i)||/||b|| 1.587931022112e-07
  31 KSP preconditioned resid norm 4.220190698609e-02 true resid norm  
6.558846516228e+00 ||r(i)||/||b|| 3.525354091447e-07
  32 KSP preconditioned resid norm 3.807512846045e-02 true resid norm  
8.499956982737e-01 ||r(i)||/||b|| 4.568693298749e-08
  33 KSP preconditioned resid norm 3.610786244449e-02 true resid norm  
5.181174592165e-01 ||r(i)||/||b|| 2.784860874820e-08
  34 KSP preconditioned resid norm 3.516902521841e-02 true resid norm  
1.154078194829e+00 ||r(i)||/||b|| 6.203124704813e-08
  35 KSP preconditioned resid norm 3.430695555312e-02 true resid norm  
1.216650859022e+00 ||r(i)||/||b|| 6.539450302891e-08
  36 KSP preconditioned resid norm 3.367251402060e-02 true resid norm  
1.979303465729e+00 ||r(i)||/||b|| 1.063867793500e-07
  37 KSP preconditioned resid norm 3.295560906128e-02 true resid norm  
1.817709293239e+00 ||r(i)||/||b|| 9.770115641715e-08
  38 KSP preconditioned resid norm 3.199481594350e-02 true resid norm  
1.560738982683e+00 ||r(i)||/||b|| 8.388910374206e-08
  39 KSP preconditioned resid norm 2.944618065492e-02 true resid norm  
2.882956861820e+00 ||r(i)||/||b|| 1.549577923974e-07
  40 KSP preconditioned resid norm 2.663367005560e-02 true resid norm  
3.308407886135e-01 ||r(i)||/||b|| 1.778256168780e-08
  41 KSP preconditioned resid norm 2.474483734332e-02 true resid norm  
9.152316486265e-01 ||r(i)||/||b|| 4.919333954719e-08
  42 KSP preconditioned resid norm 2.372729505116e-02 true resid norm  
1.076997098988e+00 ||r(i)||/||b|| 5.788816859796e-08
  43 KSP preconditioned resid norm 2.315451384044e-02 true resid norm  
7.138944574620e-01 ||r(i)||/||b|| 3.837154506129e-08
  44 KSP preconditioned resid norm 2.285950220585e-02 true resid norm  
1.273945994361e+00 ||r(i)||/||b|| 6.847409391866e-08
  45 KSP preconditioned resid norm 2.247768360902e-02 true resid norm  
1.309834117856e+00 ||r(i)||/||b|| 7.040306637875e-08
  46 KSP preconditioned resid norm 2.211290648456e-02 true resid norm  
7.229032032922e-01 ||r(i)||/||b|| 3.885576159072e-08
  47 KSP preconditioned resid norm 2.125491655457e-02 true resid norm  
1.467907956008e+00 ||r(i)||/||b|| 7.889947273161e-08
  48 KSP preconditioned resid norm 2.001194328986e-02 true resid norm  
1.045520372766e+00 ||r(i)||/||b|| 5.619630699851e-08
  49 KSP preconditioned resid norm 1.871103482690e-02 true resid norm  
5.683982921115e-01 ||r(i)||/||b|| 3.055118365263e-08
  50 KSP preconditioned resid norm 1.784976733327e-02 true resid norm  
7.859172163874e-01 ||r(i)||/||b|| 4.224273990061e-08
  51 KSP preconditioned resid norm 1.722235167994e-02 true resid norm  
8.153844111284e-01 ||r(i)||/||b|| 4.382658997678e-08
  52 KSP preconditioned resid norm 1.692767633876e-02 true resid norm  
8.214004787306e-01 ||r(i)||/||b|| 4.414995123373e-08
  53 KSP preconditioned resid norm 1.679902147112e-02 true resid norm  
7.384467810827e-01 ||r(i)||/||b|| 3.969122275639e-08
  54 KSP preconditioned resid norm 1.665329178530e-02 true resid norm  
5.308690872668e-01 ||r(i)||/||b|| 2.853400371831e-08
  55 KSP preconditioned resid norm 1.628710029317e-02 true resid norm  
8.791786276987e-01 ||r(i)||/||b|| 4.725550391524e-08
  56 KSP preconditioned resid norm 1.560353224506e-02 true resid norm  
7.474689747669e-01 ||r(i)||/||b|| 4.017616210266e-08
  57 KSP preconditioned resid norm 1.482857597085e-02 true resid norm  
6.511977490116e-01 ||r(i)||/||b|| 3.500162175070e-08
  58 KSP preconditioned resid norm 1.430916177716e-02 true resid norm  
8.379874473158e-01 ||r(i)||/||b|| 4.504149424242e-08
  59 KSP preconditioned resid norm 1.375408057045e-02 true resid norm  
9.086139880718e-01 ||r(i)||/||b|| 4.883764290672e-08
  60 KSP preconditioned resid norm 1.339008284348e-02 true resid norm  
6.964842841507e-01 ||r(i)||/||b|| 3.743575512377e-08
  61 KSP preconditioned resid norm 1.325481281566e-02 true resid norm  
6.814559395447e-01 ||r(i)||/||b|| 3.662798753822e-08
  62 KSP preconditioned resid norm 1.316008245220e-02 true resid norm  
5.394241512881e-01 ||r(i)||/||b|| 2.899383502974e-08
  63 KSP preconditioned resid norm 1.297054602257e-02 true resid norm  
5.540383982993e-01 ||r(i)||/||b|| 2.977934503317e-08
  64 KSP preconditioned resid norm 1.267029342520e-02 true resid norm  
6.222671963629e-01 ||r(i)||/||b|| 3.344661597499e-08
  65 KSP preconditioned resid norm 1.218768500723e-02 true resid norm  
6.019256916485e-01 ||r(i)||/||b|| 3.235326813259e-08
  66 KSP preconditioned resid norm 1.173171524129e-02 true resid norm  
7.974979783411e-01 ||r(i)||/||b|| 4.286520128059e-08
  67 KSP preconditioned resid norm 1.120242187096e-02 true resid norm  
7.439328341402e-01 ||r(i)||/||b|| 3.998609594094e-08
  68 KSP preconditioned resid norm 1.090989022280e-02 true resid norm  
6.707714484204e-01 ||r(i)||/||b|| 3.605370036125e-08
  69 KSP preconditioned resid norm 1.075180649299e-02 true resid norm  
6.456430592738e-01 ||r(i)||/||b|| 3.470305937170e-08
  70 KSP preconditioned resid norm 1.068398143887e-02 true resid norm  
5.140092329889e-01 ||r(i)||/||b|| 2.762779321144e-08
  71 KSP preconditioned resid norm 1.061541304445e-02 true resid norm  
5.600243898609e-01 ||r(i)||/||b|| 3.010108971481e-08
  72 KSP preconditioned resid norm 1.047249627571e-02 true resid norm  
6.998966576891e-01 ||r(i)||/||b|| 3.761916885339e-08
  73 KSP preconditioned resid norm 1.020027918558e-02 true resid norm  
4.636266257888e-01 ||r(i)||/||b|| 2.491974797831e-08
  74 KSP preconditioned resid norm 9.876338774474e-03 true resid norm  
6.978770495864e-01 ||r(i)||/||b|| 3.751061571572e-08
  75 KSP preconditioned resid norm 9.406867350892e-03 true resid norm  
5.852304272192e-01 ||r(i)||/||b|| 3.145590426505e-08
  76 KSP preconditioned resid norm 9.076310138766e-03 true resid norm  
4.704254025560e-01 ||r(i)||/||b|| 2.528517954366e-08
  77 KSP preconditioned resid norm 8.893300436215e-03 true resid norm  
5.467695072692e-01 ||r(i)||/||b|| 2.938864501191e-08
  78 KSP preconditioned resid norm 8.813578822205e-03 true resid norm  
4.312260836262e-01 ||r(i)||/||b|| 2.317823163706e-08
  79 KSP preconditioned resid norm 8.748471910442e-03 true resid norm  
4.820716495205e-01 ||r(i)||/||b|| 2.591116071710e-08
  80 KSP preconditioned resid norm 8.661282395294e-03 true resid norm  
5.863447781755e-01 ||r(i)||/||b|| 3.151580018873e-08
  81 KSP preconditioned resid norm 8.532352878138e-03 true resid norm  
5.100248589176e-01 ||r(i)||/||b|| 2.741363467915e-08
  82 KSP preconditioned resid norm 8.359845622080e-03 true resid norm  
5.496958389615e-01 ||r(i)||/||b|| 2.954593418431e-08
  83 KSP preconditioned resid norm 8.103730293968e-03 true resid norm  
4.327772638399e-01 ||r(i)||/||b|| 2.326160696074e-08
  84 KSP preconditioned resid norm 7.814651802893e-03 true resid norm  
3.968564175533e-01 ||r(i)||/||b|| 2.133087566353e-08
  85 KSP preconditioned resid norm 7.553683118005e-03 true resid norm  
5.015451920734e-01 ||r(i)||/||b|| 2.695785593621e-08
  86 KSP preconditioned resid norm 7.424368309992e-03 true resid norm  
3.970531542212e-01 ||r(i)||/||b|| 2.134145018171e-08
  87 KSP preconditioned resid norm 7.352606110686e-03 true resid norm  
4.415932315709e-01 ||r(i)||/||b|| 2.373546174349e-08
  88 KSP preconditioned resid norm 7.280042564676e-03 true resid norm  
5.109639015446e-01 ||r(i)||/||b|| 2.746410784938e-08
  89 KSP preconditioned resid norm 7.171390142951e-03 true resid norm  
4.409703319008e-01 ||r(i)||/||b|| 2.370198113231e-08
  90 KSP preconditioned resid norm 7.069655565573e-03 true resid norm  
4.344117469317e-01 ||r(i)||/||b|| 2.334945978121e-08
  91 KSP preconditioned resid norm 6.944694600832e-03 true resid norm  
4.400140866139e-01 ||r(i)||/||b|| 2.365058332590e-08
  92 KSP preconditioned resid norm 6.805591346380e-03 true resid norm  
4.034426989803e-01 ||r(i)||/||b|| 2.168488568829e-08
  93 KSP preconditioned resid norm 6.578034682351e-03 true resid norm  
4.437828777791e-01 ||r(i)||/||b|| 2.385315436216e-08
  94 KSP preconditioned resid norm 6.395854263833e-03 true resid norm  
4.319680486901e-01 ||r(i)||/||b|| 2.321811196613e-08
  95 KSP preconditioned resid norm 6.256982164629e-03 true resid norm  
4.156043449194e-01 ||r(i)||/||b|| 2.233856935301e-08
  96 KSP preconditioned resid norm 6.159034987122e-03 true resid norm  
4.117408096095e-01 ||r(i)||/||b|| 2.213090585640e-08
  97 KSP preconditioned resid norm 6.094488409795e-03 true resid norm  
3.960004222128e-01 ||r(i)||/||b|| 2.128486625215e-08
  98 KSP preconditioned resid norm 6.051901763657e-03 true resid norm  
3.777028982928e-01 ||r(i)||/||b|| 2.030138156997e-08
  99 KSP preconditioned resid norm 6.014576545823e-03 true resid norm  
3.742789946061e-01 ||r(i)||/||b|| 2.011734809944e-08
100 KSP preconditioned resid norm 5.956552050091e-03 true resid norm  
3.551181951200e-01 ||r(i)||/||b|| 1.908746269662e-08
101 KSP preconditioned resid norm 5.842043633900e-03 true resid norm  
4.382746134205e-01 ||r(i)||/||b|| 2.355708732895e-08
102 KSP preconditioned resid norm 5.658344160022e-03 true resid norm  
4.596230962871e-01 ||r(i)||/||b|| 2.470455984921e-08
103 KSP preconditioned resid norm 5.485803980234e-03 true resid norm  
3.503965499180e-01 ||r(i)||/||b|| 1.883367613232e-08
104 KSP preconditioned resid norm 5.376727133021e-03 true resid norm  
3.464527812415e-01 ||r(i)||/||b|| 1.862170012396e-08
105 KSP preconditioned resid norm 5.296512288308e-03 true resid norm  
3.496873763914e-01 ||r(i)||/||b|| 1.879555833543e-08
106 KSP preconditioned resid norm 5.243956795563e-03 true resid norm  
3.403623443924e-01 ||r(i)||/||b|| 1.829434154938e-08
107 KSP preconditioned resid norm 5.224149348899e-03 true resid norm  
3.646760344077e-01 ||r(i)||/||b|| 1.960119278247e-08
108 KSP preconditioned resid norm 5.207350168927e-03 true resid norm  
3.502961273653e-01 ||r(i)||/||b|| 1.882827845979e-08
109 KSP preconditioned resid norm 5.174774410129e-03 true resid norm  
3.530076169203e-01 ||r(i)||/||b|| 1.897401995218e-08
110 KSP preconditioned resid norm 5.080464512716e-03 true resid norm  
3.754354350869e-01 ||r(i)||/||b|| 2.017950631842e-08
111 KSP preconditioned resid norm 4.932196560828e-03 true resid norm  
3.319266661424e-01 ||r(i)||/||b|| 1.784092717600e-08
112 KSP preconditioned resid norm 4.819086590844e-03 true resid norm  
3.397892392797e-01 ||r(i)||/||b|| 1.826353737598e-08
113 KSP preconditioned resid norm 4.747968645116e-03 true resid norm  
3.254579053760e-01 ||r(i)||/||b|| 1.749323384031e-08
114 KSP preconditioned resid norm 4.688081041951e-03 true resid norm  
3.186617859066e-01 ||r(i)||/||b|| 1.712794510367e-08
115 KSP preconditioned resid norm 4.639394290711e-03 true resid norm  
3.547444504944e-01 ||r(i)||/||b|| 1.906737407064e-08
116 KSP preconditioned resid norm 4.609049915582e-03 true resid norm  
3.342056457156e-01 ||r(i)||/||b|| 1.796342142774e-08
117 KSP preconditioned resid norm 4.590310507218e-03 true resid norm  
3.273850372603e-01 ||r(i)||/||b|| 1.759681641777e-08
118 KSP preconditioned resid norm 4.537739208221e-03 true resid norm  
3.343297460299e-01 ||r(i)||/||b|| 1.797009177060e-08
119 KSP preconditioned resid norm 4.392061311691e-03 true resid norm  
2.937387873364e-01 ||r(i)||/||b|| 1.578834377647e-08
120 KSP preconditioned resid norm 4.192610027036e-03 true resid norm  
3.026418819871e-01 ||r(i)||/||b|| 1.626688159674e-08
121 KSP preconditioned resid norm 3.979626874668e-03 true resid norm  
3.335650008413e-01 ||r(i)||/||b|| 1.792898701883e-08
122 KSP preconditioned resid norm 3.815602083753e-03 true resid norm  
3.045581838231e-01 ||r(i)||/||b|| 1.636988206338e-08
123 KSP preconditioned resid norm 3.683106242308e-03 true resid norm  
3.098877278696e-01 ||r(i)||/||b|| 1.665634295042e-08
124 KSP preconditioned resid norm 3.491204328621e-03 true resid norm  
2.724215703848e-01 ||r(i)||/||b|| 1.464255178678e-08
125 KSP preconditioned resid norm 3.300581833063e-03 true resid norm  
2.604278612239e-01 ||r(i)||/||b|| 1.399789465756e-08
126 KSP preconditioned resid norm 3.138524711813e-03 true resid norm  
2.979743756364e-01 ||r(i)||/||b|| 1.601600497430e-08
127 KSP preconditioned resid norm 2.998768146737e-03 true resid norm  
2.684276442529e-01 ||r(i)||/||b|| 1.442787983501e-08
128 KSP preconditioned resid norm 2.828798841220e-03 true resid norm  
2.488787122874e-01 ||r(i)||/||b|| 1.337713246477e-08
129 KSP preconditioned resid norm 2.682445898860e-03 true resid norm  
2.713173341660e-01 ||r(i)||/||b|| 1.458319952626e-08
130 KSP preconditioned resid norm 2.557725541906e-03 true resid norm  
2.456688134002e-01 ||r(i)||/||b|| 1.320460166767e-08
131 KSP preconditioned resid norm 2.435166675884e-03 true resid norm  
2.557230363513e-01 ||r(i)||/||b|| 1.374501217932e-08
132 KSP preconditioned resid norm 2.329723884039e-03 true resid norm  
2.459481821293e-01 ||r(i)||/||b|| 1.321961762649e-08
133 KSP preconditioned resid norm 2.233092060836e-03 true resid norm  
2.488289469002e-01 ||r(i)||/||b|| 1.337445759486e-08
134 KSP preconditioned resid norm 2.146767644244e-03 true resid norm  
2.436791649693e-01 ||r(i)||/||b|| 1.309765885052e-08
135 KSP preconditioned resid norm 2.069055646567e-03 true resid norm  
2.443539291969e-01 ||r(i)||/||b|| 1.313392716119e-08
136 KSP preconditioned resid norm 1.998218744259e-03 true resid norm  
2.419703114076e-01 ||r(i)||/||b|| 1.300580864667e-08
137 KSP preconditioned resid norm 1.934154419559e-03 true resid norm  
2.413673649358e-01 ||r(i)||/||b|| 1.297340051201e-08
138 KSP preconditioned resid norm 1.875352742458e-03 true resid norm  
2.402293008081e-01 ||r(i)||/||b|| 1.291223001475e-08
139 KSP preconditioned resid norm 1.821713720491e-03 true resid norm  
2.394600637115e-01 ||r(i)||/||b|| 1.287088382469e-08
140 KSP preconditioned resid norm 1.772244386117e-03 true resid norm  
2.386749177324e-01 ||r(i)||/||b|| 1.282868253849e-08
141 KSP preconditioned resid norm 1.726660380259e-03 true resid norm  
2.380358592609e-01 ||r(i)||/||b|| 1.279433339811e-08
142 KSP preconditioned resid norm 1.684371894472e-03 true resid norm  
2.374167740258e-01 ||r(i)||/||b|| 1.276105781130e-08
143 KSP preconditioned resid norm 1.645066345043e-03 true resid norm  
2.368897695349e-01 ||r(i)||/||b|| 1.273273152811e-08
144 KSP preconditioned resid norm 1.608378395889e-03 true resid norm  
2.363909366220e-01 ||r(i)||/||b|| 1.270591945610e-08
145 KSP preconditioned resid norm 1.574045424112e-03 true resid norm  
2.359483824966e-01 ||r(i)||/||b|| 1.268213234670e-08
146 KSP preconditioned resid norm 1.541818911387e-03 true resid norm  
2.355369368148e-01 ||r(i)||/||b|| 1.266001730384e-08
147 KSP preconditioned resid norm 1.511495012743e-03 true resid norm  
2.351622190575e-01 ||r(i)||/||b|| 1.263987637242e-08
148 KSP preconditioned resid norm 1.482892296987e-03 true resid norm  
2.348153672194e-01 ||r(i)||/||b|| 1.262123322315e-08
149 KSP preconditioned resid norm 1.455854398511e-03 true resid norm  
2.344953173543e-01 ||r(i)||/||b|| 1.260403066934e-08
150 KSP preconditioned resid norm 1.430243441942e-03 true resid norm  
2.341982647419e-01 ||r(i)||/||b|| 1.258806420877e-08
151 KSP preconditioned resid norm 1.405938253032e-03 true resid norm  
2.339221629824e-01 ||r(i)||/||b|| 1.257322384828e-08
152 KSP preconditioned resid norm 1.382831488600e-03 true resid norm  
2.336647410623e-01 ||r(i)||/||b|| 1.255938752177e-08
153 KSP preconditioned resid norm 1.360827803948e-03 true resid norm  
2.334242223406e-01 ||r(i)||/||b|| 1.254645973549e-08
154 KSP preconditioned resid norm 1.339842133796e-03 true resid norm  
2.331989794938e-01 ||r(i)||/||b|| 1.253435302146e-08
155 KSP preconditioned resid norm 1.319798326743e-03 true resid norm  
2.329876098843e-01 ||r(i)||/||b|| 1.252299198845e-08
156 KSP preconditioned resid norm 1.300627973461e-03 true resid norm  
2.327888723649e-01 ||r(i)||/||b|| 1.251230992530e-08
157 KSP preconditioned resid norm 1.282269425120e-03 true resid norm  
2.326016686901e-01 ||r(i)||/||b|| 1.250224780173e-08
158 KSP preconditioned resid norm 1.264666957355e-03 true resid norm  
2.324250272145e-01 ||r(i)||/||b|| 1.249275339220e-08
159 KSP preconditioned resid norm 1.247770057982e-03 true resid norm  
2.322580834349e-01 ||r(i)||/||b|| 1.248378023000e-08
160 KSP preconditioned resid norm 1.231532816432e-03 true resid norm  
2.321000566002e-01 ||r(i)||/||b|| 1.247528635006e-08
161 KSP preconditioned resid norm 1.215913398441e-03 true resid norm  
2.319502503289e-01 ||r(i)||/||b|| 1.246723432216e-08
162 KSP preconditioned resid norm 1.200873592223e-03 true resid norm  
2.318080450631e-01 ||r(i)||/||b|| 1.245959084531e-08
163 KSP preconditioned resid norm 1.186378414894e-03 true resid norm  
2.316728740452e-01 ||r(i)||/||b|| 1.245232545649e-08
164 KSP preconditioned resid norm 1.172395769938e-03 true resid norm  
2.315442332791e-01 ||r(i)||/||b|| 1.244541106613e-08
165 KSP preconditioned resid norm 1.158896148065e-03 true resid norm  
2.314216550879e-01 ||r(i)||/||b|| 1.243882253679e-08
166 KSP preconditioned resid norm 1.145852365100e-03 true resid norm  
2.313047260225e-01 ||r(i)||/||b|| 1.243253764571e-08
167 KSP preconditioned resid norm 1.133239331624e-03 true resid norm  
2.311930638485e-01 ||r(i)||/||b|| 1.242653584797e-08
168 KSP preconditioned resid norm 1.121033849900e-03 true resid norm  
2.310863209631e-01 ||r(i)||/||b|| 1.242079846005e-08
169 KSP preconditioned resid norm 1.109214434359e-03 true resid norm  
2.309841757666e-01 ||r(i)||/||b|| 1.241530819609e-08
170 KSP preconditioned resid norm 1.097761152478e-03 true resid norm  
2.308863479957e-01 ||r(i)||/||b|| 1.241004999205e-08
171 KSP preconditioned resid norm 1.086655483361e-03 true resid norm  
2.307925634297e-01 ||r(i)||/||b|| 1.240500910868e-08
172 KSP preconditioned resid norm 1.075880191754e-03 true resid norm  
2.307025749247e-01 ||r(i)||/||b|| 1.240017226209e-08
173 KSP preconditioned resid norm 1.065419215531e-03 true resid norm  
2.306161549158e-01 ||r(i)||/||b|| 1.239552722075e-08
174 KSP preconditioned resid norm 1.055257564987e-03 true resid norm  
2.305330988532e-01 ||r(i)||/||b|| 1.239106299020e-08
175 KSP preconditioned resid norm 1.045381232503e-03 true resid norm  
2.304532188963e-01 ||r(i)||/||b|| 1.238676947407e-08
176 KSP preconditioned resid norm 1.035777111332e-03 true resid norm  
2.303763286387e-01 ||r(i)||/||b|| 1.238263665310e-08
177 KSP preconditioned resid norm 1.026432922454e-03 true resid norm  
2.303022696117e-01 ||r(i)||/||b|| 1.237865600966e-08
178 KSP preconditioned resid norm 1.017337148558e-03 true resid norm  
2.302308831450e-01 ||r(i)||/||b|| 1.237481901527e-08
179 KSP preconditioned resid norm 1.008478974346e-03 true resid norm  
2.301620347457e-01 ||r(i)||/||b|| 1.237111844101e-08
180 KSP preconditioned resid norm 9.998482324606e-04 true resid norm  
2.300955845367e-01 ||r(i)||/||b|| 1.236754676853e-08
181 KSP preconditioned resid norm 9.914353544130e-04 true resid norm  
2.300314108316e-01 ||r(i)||/||b|| 1.236409745723e-08
182 KSP preconditioned resid norm 9.832313259834e-04 true resid norm  
2.299694002578e-01 ||r(i)||/||b|| 1.236076441339e-08
183 KSP preconditioned resid norm 9.752276466110e-04 true resid norm  
2.299094435160e-01 ||r(i)||/||b|| 1.235754176220e-08
184 KSP preconditioned resid norm 9.674162923639e-04 true resid norm  
2.298514409700e-01 ||r(i)||/||b|| 1.235442414827e-08
185 KSP preconditioned resid norm 9.597896821203e-04 true resid norm  
2.297953006592e-01 ||r(i)||/||b|| 1.235140662874e-08
186 KSP preconditioned resid norm 9.523406466369e-04 true resid norm  
2.297409322096e-01 ||r(i)||/||b|| 1.234848434605e-08
187 KSP preconditioned resid norm 9.450624002177e-04 true resid norm  
2.296882498964e-01 ||r(i)||/||b|| 1.234565269253e-08
188 KSP preconditioned resid norm 9.379485147290e-04 true resid norm  
2.296371855641e-01 ||r(i)||/||b|| 1.234290800484e-08
189 KSP preconditioned resid norm 9.309928957338e-04 true resid norm  
2.295876599605e-01 ||r(i)||/||b|| 1.234024602321e-08
190 KSP preconditioned resid norm 9.241897605453e-04 true resid norm  
2.295396008850e-01 ||r(i)||/||b|| 1.233766286689e-08
191 KSP preconditioned resid norm 9.175336180183e-04 true resid norm  
2.294929517616e-01 ||r(i)||/||b|| 1.233515549494e-08
192 KSP preconditioned resid norm 9.110192499196e-04 true resid norm  
2.294476550937e-01 ||r(i)||/||b|| 1.233272081693e-08
193 KSP preconditioned resid norm 9.046416937330e-04 true resid norm  
2.294036343745e-01 ||r(i)||/||b|| 1.233035472067e-08
194 KSP preconditioned resid norm 8.983962267697e-04 true resid norm  
2.293608510670e-01 ||r(i)||/||b|| 1.232805513479e-08
195 KSP preconditioned resid norm 8.922783514693e-04 true resid norm  
2.293192547524e-01 ||r(i)||/||b|| 1.232581934931e-08
196 KSP preconditioned resid norm 8.862837817875e-04 true resid norm  
2.292787946262e-01 ||r(i)||/||b|| 1.232364463352e-08
197 KSP preconditioned resid norm 8.804084305754e-04 true resid norm  
2.292394175247e-01 ||r(i)||/||b|| 1.232152812986e-08
198 KSP preconditioned resid norm 8.746483978686e-04 true resid norm  
2.292010834774e-01 ||r(i)||/||b|| 1.231946768996e-08
199 KSP preconditioned resid norm 8.689999600067e-04 true resid norm  
2.291637624697e-01 ||r(i)||/||b|| 1.231746170055e-08
200 KSP preconditioned resid norm 8.634595595170e-04 true resid norm  
2.291274049854e-01 ||r(i)||/||b|| 1.231550750013e-08
201 KSP preconditioned resid norm 8.580237956982e-04 true resid norm  
2.290919720801e-01 ||r(i)||/||b|| 1.231360299547e-08
202 KSP preconditioned resid norm 8.526894158485e-04 true resid norm  
2.290574356997e-01 ||r(i)||/||b|| 1.231174667866e-08
203 KSP preconditioned resid norm 8.474533070857e-04 true resid norm  
2.290237596137e-01 ||r(i)||/||b|| 1.230993660235e-08
204 KSP preconditioned resid norm 8.423124887137e-04 true resid norm  
2.289909090686e-01 ||r(i)||/||b|| 1.230817089852e-08
205 KSP preconditioned resid norm 8.372641050919e-04 true resid norm  
2.289588584825e-01 ||r(i)||/||b|| 1.230644819218e-08
206 KSP preconditioned resid norm 8.323054189692e-04 true resid norm  
2.289275744616e-01 ||r(i)||/||b|| 1.230476668842e-08
207 KSP preconditioned resid norm 8.274338052477e-04 true resid norm  
2.288970376791e-01 ||r(i)||/||b|| 1.230312534842e-08
208 KSP preconditioned resid norm 8.226467451421e-04 true resid norm  
2.288672146645e-01 ||r(i)||/||b|| 1.230152237317e-08
209 KSP preconditioned resid norm 8.179418207082e-04 true resid norm  
2.288380816620e-01 ||r(i)||/||b|| 1.229995648580e-08
210 KSP preconditioned resid norm 8.133167097103e-04 true resid norm  
2.288096168578e-01 ||r(i)||/||b|| 1.229842651381e-08
211 KSP preconditioned resid norm 8.087691808049e-04 true resid norm  
2.287817990843e-01 ||r(i)||/||b|| 1.229693131947e-08
212 KSP preconditioned resid norm 8.042970890175e-04 true resid norm  
2.287545984345e-01 ||r(i)||/||b|| 1.229546929530e-08
213 KSP preconditioned resid norm 7.998983714913e-04 true resid norm  
2.287280031968e-01 ||r(i)||/||b|| 1.229403981178e-08
214 KSP preconditioned resid norm 7.955710434887e-04 true resid norm  
2.287019910352e-01 ||r(i)||/||b|| 1.229264166837e-08
215 KSP preconditioned resid norm 7.913131946287e-04 true resid norm  
2.286765459346e-01 ||r(i)||/||b|| 1.229127400426e-08
216 KSP preconditioned resid norm 7.871229853431e-04 true resid norm  
2.286516391503e-01 ||r(i)||/||b|| 1.228993527445e-08
217 KSP preconditioned resid norm 7.829986435369e-04 true resid norm  
2.286272693763e-01 ||r(i)||/||b|| 1.228862540872e-08
218 KSP preconditioned resid norm 7.789384614395e-04 true resid norm  
2.286034070064e-01 ||r(i)||/||b|| 1.228734281577e-08
219 KSP preconditioned resid norm 7.749407926335e-04 true resid norm  
2.285800360455e-01 ||r(i)||/||b|| 1.228608663585e-08
220 KSP preconditioned resid norm 7.710040492496e-04 true resid norm  
2.285571480396e-01 ||r(i)||/||b|| 1.228485641457e-08
221 KSP preconditioned resid norm 7.671266993165e-04 true resid norm  
2.285347243777e-01 ||r(i)||/||b|| 1.228365115161e-08
222 KSP preconditioned resid norm 7.633072642562e-04 true resid norm  
2.285127555462e-01 ||r(i)||/||b|| 1.228247033559e-08
223 KSP preconditioned resid norm 7.595443165147e-04 true resid norm  
2.284912245964e-01 ||r(i)||/||b|| 1.228131305554e-08
224 KSP preconditioned resid norm 7.558364773208e-04 true resid norm  
2.284701167825e-01 ||r(i)||/||b|| 1.228017851889e-08
225 KSP preconditioned resid norm 7.521824145629e-04 true resid norm  
2.284494252947e-01 ||r(i)||/||b|| 1.227906635959e-08
226 KSP preconditioned resid norm 7.485808407788e-04 true resid norm  
2.284291297251e-01 ||r(i)||/||b|| 1.227797548074e-08
227 KSP preconditioned resid norm 7.450305112491e-04 true resid norm  
2.284092255255e-01 ||r(i)||/||b|| 1.227690563788e-08
228 KSP preconditioned resid norm 7.415302221908e-04 true resid norm  
2.283896991871e-01 ||r(i)||/||b|| 1.227585610490e-08
229 KSP preconditioned resid norm 7.380788090416e-04 true resid norm  
2.283705422023e-01 ||r(i)||/||b|| 1.227482642454e-08
230 KSP preconditioned resid norm 7.346751448326e-04 true resid norm  
2.283517372412e-01 ||r(i)||/||b|| 1.227381566531e-08
231 KSP preconditioned resid norm 7.313181386419e-04 true resid norm  
2.283332864722e-01 ||r(i)||/||b|| 1.227282394376e-08
232 KSP preconditioned resid norm 7.280067341260e-04 true resid norm  
2.283151684393e-01 ||r(i)||/||b|| 1.227185010665e-08
233 KSP preconditioned resid norm 7.247399081230e-04 true resid norm  
2.282973787544e-01 ||r(i)||/||b|| 1.227089391812e-08
234 KSP preconditioned resid norm 7.215166693243e-04 true resid norm  
2.282799167157e-01 ||r(i)||/||b|| 1.226995534044e-08
235 KSP preconditioned resid norm 7.183360570113e-04 true resid norm  
2.282627562941e-01 ||r(i)||/||b|| 1.226903297455e-08
236 KSP preconditioned resid norm 7.151971398519e-04 true resid norm  
2.282459005354e-01 ||r(i)||/||b|| 1.226812698418e-08
237 KSP preconditioned resid norm 7.120990147553e-04 true resid norm  
2.282293440867e-01 ||r(i)||/||b|| 1.226723708161e-08
238 KSP preconditioned resid norm 7.090408057796e-04 true resid norm  
2.282130711554e-01 ||r(i)||/||b|| 1.226636241798e-08
239 KSP preconditioned resid norm 7.060216630923e-04 true resid norm  
2.281970808035e-01 ||r(i)||/||b|| 1.226550294288e-08
240 KSP preconditioned resid norm 7.030407619775e-04 true resid norm  
2.281813599523e-01 ||r(i)||/||b|| 1.226465795334e-08
241 KSP preconditioned resid norm 7.000973018899e-04 true resid norm  
2.281659027838e-01 ||r(i)||/||b|| 1.226382713664e-08
242 KSP preconditioned resid norm 6.971905055512e-04 true resid norm  
2.281507115980e-01 ||r(i)||/||b|| 1.226301061640e-08
243 KSP preconditioned resid norm 6.943196180880e-04 true resid norm  
2.281357689033e-01 ||r(i)||/||b|| 1.226220745247e-08
244 KSP preconditioned resid norm 6.914839062086e-04 true resid norm  
2.281210748466e-01 ||r(i)||/||b|| 1.226141765272e-08
245 KSP preconditioned resid norm 6.886826574152e-04 true resid norm  
2.281066202026e-01 ||r(i)||/||b|| 1.226064072132e-08
246 KSP preconditioned resid norm 6.859151792529e-04 true resid norm  
2.280923969589e-01 ||r(i)||/||b|| 1.225987622759e-08
247 KSP preconditioned resid norm 6.831807985900e-04 true resid norm  
2.280784106590e-01 ||r(i)||/||b|| 1.225912446950e-08
248 KSP preconditioned resid norm 6.804788609301e-04 true resid norm  
2.280646379303e-01 ||r(i)||/||b|| 1.225838419077e-08
249 KSP preconditioned resid norm 6.778087297544e-04 true resid norm  
2.280510903373e-01 ||r(i)||/||b|| 1.225765601300e-08
250 KSP preconditioned resid norm 6.751697858915e-04 true resid norm  
2.280377511770e-01 ||r(i)||/||b|| 1.225693903840e-08
251 KSP preconditioned resid norm 6.725614269143e-04 true resid norm  
2.280246239704e-01 ||r(i)||/||b|| 1.225623345623e-08
252 KSP preconditioned resid norm 6.699830665622e-04 true resid norm  
2.280116959814e-01 ||r(i)||/||b|| 1.225553858193e-08
253 KSP preconditioned resid norm 6.674341341876e-04 true resid norm  
2.279989696805e-01 ||r(i)||/||b|| 1.225485454828e-08
254 KSP preconditioned resid norm 6.649140742254e-04 true resid norm  
2.279864354329e-01 ||r(i)||/||b|| 1.225418083743e-08
255 KSP preconditioned resid norm 6.624223456843e-04 true resid norm  
2.279740931070e-01 ||r(i)||/||b|| 1.225351744228e-08
256 KSP preconditioned resid norm 6.599584216587e-04 true resid norm  
2.279619301052e-01 ||r(i)||/||b|| 1.225286368574e-08
257 KSP preconditioned resid norm 6.575217888610e-04 true resid norm  
2.279499505857e-01 ||r(i)||/||b|| 1.225221979130e-08
258 KSP preconditioned resid norm 6.551119471720e-04 true resid norm  
2.279381539369e-01 ||r(i)||/||b|| 1.225158572609e-08
259 KSP preconditioned resid norm 6.527284092102e-04 true resid norm  
2.279265280692e-01 ||r(i)||/||b|| 1.225096084029e-08
260 KSP preconditioned resid norm 6.503706999171e-04 true resid norm  
2.279150677391e-01 ||r(i)||/||b|| 1.225034485208e-08
261 KSP preconditioned resid norm 6.480383561599e-04 true resid norm  
2.279037754067e-01 ||r(i)||/||b|| 1.224973789367e-08
262 KSP preconditioned resid norm 6.457309263495e-04 true resid norm  
2.278926440841e-01 ||r(i)||/||b|| 1.224913958948e-08
263 KSP preconditioned resid norm 6.434479700724e-04 true resid norm  
2.278816724344e-01 ||r(i)||/||b|| 1.224854986765e-08
264 KSP preconditioned resid norm 6.411890577384e-04 true resid norm  
2.278708569273e-01 ||r(i)||/||b|| 1.224796853841e-08
265 KSP preconditioned resid norm 6.389537702407e-04 true resid norm  
2.278601945294e-01 ||r(i)||/||b|| 1.224739543873e-08
266 KSP preconditioned resid norm 6.367416986291e-04 true resid norm  
2.278496785824e-01 ||r(i)||/||b|| 1.224683021074e-08
267 KSP preconditioned resid norm 6.345524437961e-04 true resid norm  
2.278393107729e-01 ||r(i)||/||b|| 1.224627294507e-08
268 KSP preconditioned resid norm 6.323856161740e-04 true resid norm  
2.278290793929e-01 ||r(i)||/||b|| 1.224572301244e-08
269 KSP preconditioned resid norm 6.302408354439e-04 true resid norm  
2.278189975206e-01 ||r(i)||/||b|| 1.224518111579e-08
270 KSP preconditioned resid norm 6.281177302553e-04 true resid norm  
2.278090479439e-01 ||r(i)||/||b|| 1.224464632997e-08
271 KSP preconditioned resid norm 6.260159379560e-04 true resid norm  
2.277992270207e-01 ||r(i)||/||b|| 1.224411845923e-08
272 KSP preconditioned resid norm 6.239351043318e-04 true resid norm  
2.277895437391e-01 ||r(i)||/||b|| 1.224359798667e-08
273 KSP preconditioned resid norm 6.218748833559e-04 true resid norm  
2.277799910443e-01 ||r(i)||/||b|| 1.224308453310e-08
274 KSP preconditioned resid norm 6.198349369469e-04 true resid norm  
2.277705592500e-01 ||r(i)||/||b|| 1.224257757788e-08
275 KSP preconditioned resid norm 6.178149347363e-04 true resid norm  
2.277612586135e-01 ||r(i)||/||b|| 1.224207767234e-08
276 KSP preconditioned resid norm 6.158145538429e-04 true resid norm  
2.277520668499e-01 ||r(i)||/||b|| 1.224158361868e-08
277 KSP preconditioned resid norm 6.138334786568e-04 true resid norm  
2.277430112949e-01 ||r(i)||/||b|| 1.224109688618e-08
278 KSP preconditioned resid norm 6.118714006300e-04 true resid norm  
2.277340559836e-01 ||r(i)||/||b|| 1.224061554173e-08
279 KSP preconditioned resid norm 6.099280180742e-04 true resid norm  
2.277252270854e-01 ||r(i)||/||b|| 1.224014099194e-08
280 KSP preconditioned resid norm 6.080030359664e-04 true resid norm  
2.277165063564e-01 ||r(i)||/||b|| 1.223967225620e-08
281 KSP preconditioned resid norm 6.060961657604e-04 true resid norm  
2.277078943529e-01 ||r(i)||/||b|| 1.223920936442e-08
282 KSP preconditioned resid norm 6.042071252055e-04 true resid norm  
2.276993939626e-01 ||r(i)||/||b|| 1.223875247180e-08
283 KSP preconditioned resid norm 6.023356381705e-04 true resid norm  
2.276909967784e-01 ||r(i)||/||b|| 1.223830112646e-08
284 KSP preconditioned resid norm 6.004814344746e-04 true resid norm  
2.276827043313e-01 ||r(i)||/||b|| 1.223785541071e-08
285 KSP preconditioned resid norm 5.986442497236e-04 true resid norm  
2.276745169083e-01 ||r(i)||/||b|| 1.223741533996e-08
286 KSP preconditioned resid norm 5.968238251509e-04 true resid norm  
2.276664231577e-01 ||r(i)||/||b|| 1.223698030406e-08
287 KSP preconditioned resid norm 5.950199074650e-04 true resid norm  
2.276584395337e-01 ||r(i)||/||b|| 1.223655118742e-08
288 KSP preconditioned resid norm 5.932322487016e-04 true resid norm  
2.276505384966e-01 ||r(i)||/||b|| 1.223612650980e-08
289 KSP preconditioned resid norm 5.914606060796e-04 true resid norm  
2.276427397608e-01 ||r(i)||/||b|| 1.223570733083e-08
290 KSP preconditioned resid norm 5.897047418634e-04 true resid norm  
2.276350322672e-01 ||r(i)||/||b|| 1.223529305609e-08
291 KSP preconditioned resid norm 5.879644232287e-04 true resid norm  
2.276274208585e-01 ||r(i)||/||b|| 1.223488394589e-08
292 KSP preconditioned resid norm 5.862394221325e-04 true resid norm  
2.276198926130e-01 ||r(i)||/||b|| 1.223447930566e-08
293 KSP preconditioned resid norm 5.845295151879e-04 true resid norm  
2.276124585454e-01 ||r(i)||/||b|| 1.223407972747e-08
294 KSP preconditioned resid norm 5.828344835425e-04 true resid norm  
2.276051047451e-01 ||r(i)||/||b|| 1.223368446360e-08
295 KSP preconditioned resid norm 5.811541127607e-04 true resid norm  
2.275978428963e-01 ||r(i)||/||b|| 1.223329414210e-08
296 KSP preconditioned resid norm 5.794881927099e-04 true resid norm  
2.275906670116e-01 ||r(i)||/||b|| 1.223290844113e-08
297 KSP preconditioned resid norm 5.778365174499e-04 true resid norm  
2.275835677786e-01 ||r(i)||/||b|| 1.223252686016e-08
298 KSP preconditioned resid norm 5.761988851261e-04 true resid norm  
2.275765484745e-01 ||r(i)||/||b|| 1.223214957534e-08
299 KSP preconditioned resid norm 5.745750978659e-04 true resid norm  
2.275696146925e-01 ||r(i)||/||b|| 1.223177688730e-08
300 KSP preconditioned resid norm 5.729649616779e-04 true resid norm  
2.275627510683e-01 ||r(i)||/||b|| 1.223140797021e-08
301 KSP preconditioned resid norm 5.713682863554e-04 true resid norm  
2.275559709262e-01 ||r(i)||/||b|| 1.223104354025e-08
302 KSP preconditioned resid norm 5.697848853810e-04 true resid norm  
2.275492623914e-01 ||r(i)||/||b|| 1.223068295915e-08
303 KSP preconditioned resid norm 5.682145758359e-04 true resid norm  
2.275426321888e-01 ||r(i)||/||b|| 1.223032658839e-08
304 KSP preconditioned resid norm 5.666571783106e-04 true resid norm  
2.275360696194e-01 ||r(i)||/||b|| 1.222997385287e-08
305 KSP preconditioned resid norm 5.651125168191e-04 true resid norm  
2.275295863598e-01 ||r(i)||/||b|| 1.222962538023e-08
306 KSP preconditioned resid norm 5.635804187152e-04 true resid norm  
2.275231742717e-01 ||r(i)||/||b|| 1.222928073303e-08
307 KSP preconditioned resid norm 5.620607146115e-04 true resid norm  
2.275168211743e-01 ||r(i)||/||b|| 1.222893925655e-08
308 KSP preconditioned resid norm 5.605532383010e-04 true resid norm  
2.275105454059e-01 ||r(i)||/||b|| 1.222860193648e-08
309 KSP preconditioned resid norm 5.590578266801e-04 true resid norm  
2.275043341609e-01 ||r(i)||/||b|| 1.222826808451e-08
310 KSP preconditioned resid norm 5.575743196751e-04 true resid norm  
2.274981921808e-01 ||r(i)||/||b|| 1.222793795551e-08
311 KSP preconditioned resid norm 5.561025601701e-04 true resid norm  
2.274921161984e-01 ||r(i)||/||b|| 1.222761137386e-08
312 KSP preconditioned resid norm 5.546423939368e-04 true resid norm  
2.274861025252e-01 ||r(i)||/||b|| 1.222728814129e-08
313 KSP preconditioned resid norm 5.531936695668e-04 true resid norm  
2.274801473152e-01 ||r(i)||/||b|| 1.222696805111e-08
314 KSP preconditioned resid norm 5.517562384059e-04 true resid norm  
2.274742621715e-01 ||r(i)||/||b|| 1.222665172696e-08
315 KSP preconditioned resid norm 5.503299544895e-04 true resid norm  
2.274684288202e-01 ||r(i)||/||b|| 1.222633818663e-08
316 KSP preconditioned resid norm 5.489146744809e-04 true resid norm  
2.274626652936e-01 ||r(i)||/||b|| 1.222602839935e-08
317 KSP preconditioned resid norm 5.475102576105e-04 true resid norm  
2.274569603655e-01 ||r(i)||/||b|| 1.222572176172e-08
318 KSP preconditioned resid norm 5.461165656167e-04 true resid norm  
2.274513056984e-01 ||r(i)||/||b|| 1.222541782560e-08
319 KSP preconditioned resid norm 5.447334626896e-04 true resid norm  
2.274457171259e-01 ||r(i)||/||b|| 1.222511744204e-08
320 KSP preconditioned resid norm 5.433608154143e-04 true resid norm  
2.274401805906e-01 ||r(i)||/||b|| 1.222481985545e-08
321 KSP preconditioned resid norm 5.419984927178e-04 true resid norm  
2.274347014589e-01 ||r(i)||/||b|| 1.222452535429e-08
322 KSP preconditioned resid norm 5.406463658158e-04 true resid norm  
2.274292714706e-01 ||r(i)||/||b|| 1.222423349456e-08
323 KSP preconditioned resid norm 5.393043081620e-04 true resid norm  
2.274239051253e-01 ||r(i)||/||b|| 1.222394505563e-08
324 KSP preconditioned resid norm 5.379721953979e-04 true resid norm  
2.274185887375e-01 ||r(i)||/||b|| 1.222365930188e-08
325 KSP preconditioned resid norm 5.366499053049e-04 true resid norm  
2.274133248777e-01 ||r(i)||/||b|| 1.222337637150e-08
326 KSP preconditioned resid norm 5.353373177566e-04 true resid norm  
2.274081127307e-01 ||r(i)||/||b|| 1.222309622065e-08
327 KSP preconditioned resid norm 5.340343146738e-04 true resid norm  
2.274029468427e-01 ||r(i)||/||b|| 1.222281855621e-08
328 KSP preconditioned resid norm 5.327407799788e-04 true resid norm  
2.273978353712e-01 ||r(i)||/||b|| 1.222254381664e-08
329 KSP preconditioned resid norm 5.314565995531e-04 true resid norm  
2.273927809222e-01 ||r(i)||/||b|| 1.222227214200e-08
330 KSP preconditioned resid norm 5.301816611941e-04 true resid norm  
2.273877604496e-01 ||r(i)||/||b|| 1.222200229359e-08
331 KSP preconditioned resid norm 5.289158545748e-04 true resid norm  
2.273827995564e-01 ||r(i)||/||b|| 1.222173564753e-08
332 KSP preconditioned resid norm 5.276590712029e-04 true resid norm  
2.273778827831e-01 ||r(i)||/||b|| 1.222147137291e-08
333 KSP preconditioned resid norm 5.264112043825e-04 true resid norm  
2.273730105232e-01 ||r(i)||/||b|| 1.222120949086e-08
334 KSP preconditioned resid norm 5.251721491753e-04 true resid norm  
2.273681879072e-01 ||r(i)||/||b|| 1.222095027716e-08
335 KSP preconditioned resid norm 5.239418023642e-04 true resid norm  
2.273634127611e-01 ||r(i)||/||b|| 1.222069361495e-08
336 KSP preconditioned resid norm 5.227200624168e-04 true resid norm  
2.273586761157e-01 ||r(i)||/||b|| 1.222043902213e-08
337 KSP preconditioned resid norm 5.215068294502e-04 true resid norm  
2.273539880103e-01 ||r(i)||/||b|| 1.222018703831e-08
338 KSP preconditioned resid norm 5.203020051970e-04 true resid norm  
2.273493409278e-01 ||r(i)||/||b|| 1.221993725947e-08
339 KSP preconditioned resid norm 5.191054929715e-04 true resid norm  
2.273447356659e-01 ||r(i)||/||b|| 1.221968972845e-08
340 KSP preconditioned resid norm 5.179171976373e-04 true resid norm  
2.273401743693e-01 ||r(i)||/||b|| 1.221944456056e-08
341 KSP preconditioned resid norm 5.167370255756e-04 true resid norm  
2.273356583138e-01 ||r(i)||/||b|| 1.221920182437e-08
342 KSP preconditioned resid norm 5.155648846541e-04 true resid norm  
2.273311761791e-01 ||r(i)||/||b|| 1.221896091140e-08
343 KSP preconditioned resid norm 5.144006841968e-04 true resid norm  
2.273267443148e-01 ||r(i)||/||b|| 1.221872270044e-08
344 KSP preconditioned resid norm 5.132443349545e-04 true resid norm  
2.273223492524e-01 ||r(i)||/||b|| 1.221848646758e-08
345 KSP preconditioned resid norm 5.120957490761e-04 true resid norm  
2.273179883497e-01 ||r(i)||/||b|| 1.221825207078e-08
346 KSP preconditioned resid norm 5.109548400808e-04 true resid norm  
2.273136645087e-01 ||r(i)||/||b|| 1.221801966603e-08
347 KSP preconditioned resid norm 5.098215228303e-04 true resid norm  
2.273093837127e-01 ||r(i)||/||b|| 1.221778957494e-08
348 KSP preconditioned resid norm 5.086957135023e-04 true resid norm  
2.273051488454e-01 ||r(i)||/||b|| 1.221756195250e-08
349 KSP preconditioned resid norm 5.075773295647e-04 true resid norm  
2.273009423403e-01 ||r(i)||/||b|| 1.221733585451e-08
350 KSP preconditioned resid norm 5.064662897500e-04 true resid norm  
2.272967719436e-01 ||r(i)||/||b|| 1.221711169733e-08
351 KSP preconditioned resid norm 5.053625140303e-04 true resid norm  
2.272926387381e-01 ||r(i)||/||b|| 1.221688953917e-08
352 KSP preconditioned resid norm 5.042659235933e-04 true resid norm  
2.272885475640e-01 ||r(i)||/||b|| 1.221666964018e-08
353 KSP preconditioned resid norm 5.031764408188e-04 true resid norm  
2.272844895049e-01 ||r(i)||/||b|| 1.221645152110e-08
354 KSP preconditioned resid norm 5.020939892553e-04 true resid norm  
2.272804697266e-01 ||r(i)||/||b|| 1.221623545961e-08
355 KSP preconditioned resid norm 5.010184935978e-04 true resid norm  
2.272764750102e-01 ||r(i)||/||b|| 1.221602074518e-08
356 KSP preconditioned resid norm 4.999498796654e-04 true resid norm  
2.272725184153e-01 ||r(i)||/||b|| 1.221580807977e-08
357 KSP preconditioned resid norm 4.988880743802e-04 true resid norm  
2.272686009393e-01 ||r(i)||/||b|| 1.221559751698e-08
358 KSP preconditioned resid norm 4.978330057460e-04 true resid norm  
2.272647089737e-01 ||r(i)||/||b|| 1.221538832536e-08
359 KSP preconditioned resid norm 4.967846028282e-04 true resid norm  
2.272608549171e-01 ||r(i)||/||b|| 1.221518117135e-08
360 KSP preconditioned resid norm 4.957427957331e-04 true resid norm  
2.272570371519e-01 ||r(i)||/||b|| 1.221497596797e-08
361 KSP preconditioned resid norm 4.947075155891e-04 true resid norm  
2.272532368496e-01 ||r(i)||/||b|| 1.221477170323e-08
362 KSP preconditioned resid norm 4.936786945270e-04 true resid norm  
2.272494806239e-01 ||r(i)||/||b|| 1.221456980758e-08
363 KSP preconditioned resid norm 4.926562656616e-04 true resid norm  
2.272457630299e-01 ||r(i)||/||b|| 1.221436998837e-08
364 KSP preconditioned resid norm 4.916401630734e-04 true resid norm  
2.272420559634e-01 ||r(i)||/||b|| 1.221417073501e-08
365 KSP preconditioned resid norm 4.906303217906e-04 true resid norm  
2.272383875961e-01 ||r(i)||/||b|| 1.221397356172e-08
366 KSP preconditioned resid norm 4.896266777717e-04 true resid norm  
2.272347532208e-01 ||r(i)||/||b|| 1.221377821548e-08
367 KSP preconditioned resid norm 4.886291678887e-04 true resid norm  
2.272311469888e-01 ||r(i)||/||b|| 1.221358438194e-08
368 KSP preconditioned resid norm 4.876377299101e-04 true resid norm  
2.272275679731e-01 ||r(i)||/||b|| 1.221339201126e-08
369 KSP preconditioned resid norm 4.866523024848e-04 true resid norm  
2.272240236707e-01 ||r(i)||/||b|| 1.221320150640e-08
370 KSP preconditioned resid norm 4.856728251258e-04 true resid norm  
2.272205041611e-01 ||r(i)||/||b|| 1.221301233415e-08
371 KSP preconditioned resid norm 4.846992381953e-04 true resid norm  
2.272170183199e-01 ||r(i)||/||b|| 1.221282497156e-08
372 KSP preconditioned resid norm 4.837314828886e-04 true resid norm  
2.272135473147e-01 ||r(i)||/||b|| 1.221263840641e-08
373 KSP preconditioned resid norm 4.827695012199e-04 true resid norm  
2.272101115439e-01 ||r(i)||/||b|| 1.221245373508e-08
374 KSP preconditioned resid norm 4.818132360072e-04 true resid norm  
2.272067081687e-01 ||r(i)||/||b|| 1.221227080501e-08
375 KSP preconditioned resid norm 4.808626308583e-04 true resid norm  
2.272033271308e-01 ||r(i)||/||b|| 1.221208907556e-08
376 KSP preconditioned resid norm 4.799176301569e-04 true resid norm  
2.271999749848e-01 ||r(i)||/||b|| 1.221190889904e-08
377 KSP preconditioned resid norm 4.789781790487e-04 true resid norm  
2.271966450350e-01 ||r(i)||/||b|| 1.221172991555e-08
378 KSP preconditioned resid norm 4.780442234279e-04 true resid norm  
2.271933397917e-01 ||r(i)||/||b|| 1.221155226003e-08
379 KSP preconditioned resid norm 4.771157099247e-04 true resid norm  
2.271900724801e-01 ||r(i)||/||b|| 1.221137664332e-08
380 KSP preconditioned resid norm 4.761925858919e-04 true resid norm  
2.271868170668e-01 ||r(i)||/||b|| 1.221120166614e-08
381 KSP preconditioned resid norm 4.752747993927e-04 true resid norm  
2.271835904147e-01 ||r(i)||/||b|| 1.221102823486e-08
382 KSP preconditioned resid norm 4.743622991882e-04 true resid norm  
2.271803942131e-01 ||r(i)||/||b|| 1.221085644029e-08
383 KSP preconditioned resid norm 4.734550347255e-04 true resid norm  
2.271772113960e-01 ||r(i)||/||b|| 1.221068536513e-08
384 KSP preconditioned resid norm 4.725529561261e-04 true resid norm  
2.271740607530e-01 ||r(i)||/||b|| 1.221051601932e-08
385 KSP preconditioned resid norm 4.716560141741e-04 true resid norm  
2.271709379123e-01 ||r(i)||/||b|| 1.221034816786e-08
386 KSP preconditioned resid norm 4.707641603049e-04 true resid norm  
2.271678371952e-01 ||r(i)||/||b|| 1.221018150554e-08
387 KSP preconditioned resid norm 4.698773465945e-04 true resid norm  
2.271647550651e-01 ||r(i)||/||b|| 1.221001584227e-08
388 KSP preconditioned resid norm 4.689955257484e-04 true resid norm  
2.271616974404e-01 ||r(i)||/||b|| 1.220985149614e-08
389 KSP preconditioned resid norm 4.681186510911e-04 true resid norm  
2.271586639247e-01 ||r(i)||/||b|| 1.220968844587e-08
390 KSP preconditioned resid norm 4.672466765557e-04 true resid norm  
2.271556569050e-01 ||r(i)||/||b|| 1.220952681975e-08
391 KSP preconditioned resid norm 4.663795566737e-04 true resid norm  
2.271526629300e-01 ||r(i)||/||b|| 1.220936589478e-08
392 KSP preconditioned resid norm 4.655172465652e-04 true resid norm  
2.271496888861e-01 ||r(i)||/||b|| 1.220920604110e-08
393 KSP preconditioned resid norm 4.646597019289e-04 true resid norm  
2.271467476964e-01 ||r(i)||/||b|| 1.220904795331e-08
394 KSP preconditioned resid norm 4.638068790326e-04 true resid norm  
2.271438309499e-01 ||r(i)||/||b|| 1.220889117934e-08
395 KSP preconditioned resid norm 4.629587347041e-04 true resid norm  
2.271409246445e-01 ||r(i)||/||b|| 1.220873496657e-08
396 KSP preconditioned resid norm 4.621152263217e-04 true resid norm  
2.271380445215e-01 ||r(i)||/||b|| 1.220858016110e-08
397 KSP preconditioned resid norm 4.612763118054e-04 true resid norm  
2.271351835881e-01 ||r(i)||/||b|| 1.220842638706e-08
398 KSP preconditioned resid norm 4.604419496079e-04 true resid norm  
2.271323410508e-01 ||r(i)||/||b|| 1.220827360180e-08
399 KSP preconditioned resid norm 4.596120987061e-04 true resid norm  
2.271295276622e-01 ||r(i)||/||b|| 1.220812238328e-08
400 KSP preconditioned resid norm 4.587867185927e-04 true resid norm  
2.271267325128e-01 ||r(i)||/||b|| 1.220797214510e-08
401 KSP preconditioned resid norm 4.579657692675e-04 true resid norm  
2.271239586573e-01 ||r(i)||/||b|| 1.220782305146e-08
402 KSP preconditioned resid norm 4.571492112299e-04 true resid norm  
2.271212006983e-01 ||r(i)||/||b|| 1.220767481226e-08
403 KSP preconditioned resid norm 4.563370054704e-04 true resid norm  
2.271184630789e-01 ||r(i)||/||b|| 1.220752766630e-08
404 KSP preconditioned resid norm 4.555291134628e-04 true resid norm  
2.271157424499e-01 ||r(i)||/||b|| 1.220738143356e-08
405 KSP preconditioned resid norm 4.547254971569e-04 true resid norm  
2.271130457614e-01 ||r(i)||/||b|| 1.220723648762e-08
406 KSP preconditioned resid norm 4.539261189705e-04 true resid norm  
2.271103648407e-01 ||r(i)||/||b|| 1.220709238919e-08
407 KSP preconditioned resid norm 4.531309417826e-04 true resid norm  
2.271076977760e-01 ||r(i)||/||b|| 1.220694903552e-08
408 KSP preconditioned resid norm 4.523399289253e-04 true resid norm  
2.271050597086e-01 ||r(i)||/||b|| 1.220680724044e-08
409 KSP preconditioned resid norm 4.515530441776e-04 true resid norm  
2.271024370999e-01 ||r(i)||/||b|| 1.220666627626e-08
410 KSP preconditioned resid norm 4.507702517580e-04 true resid norm  
2.270998303189e-01 ||r(i)||/||b|| 1.220652616281e-08
411 KSP preconditioned resid norm 4.499915163175e-04 true resid norm  
2.270972384154e-01 ||r(i)||/||b|| 1.220638684902e-08
412 KSP preconditioned resid norm 4.492168029333e-04 true resid norm  
2.270946735014e-01 ||r(i)||/||b|| 1.220624898591e-08
413 KSP preconditioned resid norm 4.484460771019e-04 true resid norm  
2.270921205245e-01 ||r(i)||/||b|| 1.220611176440e-08
414 KSP preconditioned resid norm 4.476793047329e-04 true resid norm  
2.270895903425e-01 ||r(i)||/||b|| 1.220597576812e-08
415 KSP preconditioned resid norm 4.469164521424e-04 true resid norm  
2.270870676456e-01 ||r(i)||/||b|| 1.220584017416e-08
416 KSP preconditioned resid norm 4.461574860470e-04 true resid norm  
2.270845680213e-01 ||r(i)||/||b|| 1.220570582034e-08
417 KSP preconditioned resid norm 4.454023735575e-04 true resid norm  
2.270820869287e-01 ||r(i)||/||b|| 1.220557246259e-08
418 KSP preconditioned resid norm 4.446510821733e-04 true resid norm  
2.270796200224e-01 ||r(i)||/||b|| 1.220543986735e-08
419 KSP preconditioned resid norm 4.439035797760e-04 true resid norm  
2.270771634200e-01 ||r(i)||/||b|| 1.220530782594e-08
420 KSP preconditioned resid norm 4.431598346240e-04 true resid norm  
2.270747400295e-01 ||r(i)||/||b|| 1.220517756967e-08
421 KSP preconditioned resid norm 4.424198153467e-04 true resid norm  
2.270723202497e-01 ||r(i)||/||b|| 1.220504750746e-08
422 KSP preconditioned resid norm 4.416834909390e-04 true resid norm  
2.270699179499e-01 ||r(i)||/||b|| 1.220491838479e-08
423 KSP preconditioned resid norm 4.409508307558e-04 true resid norm  
2.270675366511e-01 ||r(i)||/||b|| 1.220479039092e-08
424 KSP preconditioned resid norm 4.402218045067e-04 true resid norm  
2.270651645741e-01 ||r(i)||/||b|| 1.220466289272e-08
425 KSP preconditioned resid norm 4.394963822506e-04 true resid norm  
2.270628099520e-01 ||r(i)||/||b|| 1.220453633271e-08
426 KSP preconditioned resid norm 4.387745343908e-04 true resid norm  
2.270604733944e-01 ||r(i)||/||b|| 1.220441074366e-08
427 KSP preconditioned resid norm 4.380562316695e-04 true resid norm  
2.270581537641e-01 ||r(i)||/||b|| 1.220428606445e-08
428 KSP preconditioned resid norm 4.373414451635e-04 true resid norm  
2.270558434526e-01 ||r(i)||/||b|| 1.220416188612e-08
429 KSP preconditioned resid norm 4.366301462784e-04 true resid norm  
2.270535516584e-01 ||r(i)||/||b|| 1.220403870309e-08
430 KSP preconditioned resid norm 4.359223067447e-04 true resid norm  
2.270512761768e-01 ||r(i)||/||b|| 1.220391639685e-08
431 KSP preconditioned resid norm 4.352178986124e-04 true resid norm  
2.270490152990e-01 ||r(i)||/||b|| 1.220379487556e-08
432 KSP preconditioned resid norm 4.345168942468e-04 true resid norm  
2.270467633796e-01 ||r(i)||/||b|| 1.220367383578e-08
433 KSP preconditioned resid norm 4.338192663236e-04 true resid norm  
2.270445319892e-01 ||r(i)||/||b|| 1.220355389943e-08
434 KSP preconditioned resid norm 4.331249878248e-04 true resid norm  
2.270423115941e-01 ||r(i)||/||b|| 1.220343455407e-08
435 KSP preconditioned resid norm 4.324340320340e-04 true resid norm  
2.270401105554e-01 ||r(i)||/||b|| 1.220331624911e-08
436 KSP preconditioned resid norm 4.317463725322e-04 true resid norm  
2.270379186454e-01 ||r(i)||/||b|| 1.220319843482e-08
437 KSP preconditioned resid norm 4.310619831936e-04 true resid norm  
2.270357391552e-01 ||r(i)||/||b|| 1.220308128808e-08
438 KSP preconditioned resid norm 4.303808381813e-04 true resid norm  
2.270335770775e-01 ||r(i)||/||b|| 1.220296507725e-08
439 KSP preconditioned resid norm 4.297029119434e-04 true resid norm  
2.270314323086e-01 ||r(i)||/||b|| 1.220284979677e-08
440 KSP preconditioned resid norm 4.290281792087e-04 true resid norm  
2.270292968363e-01 ||r(i)||/||b|| 1.220273501598e-08
441 KSP preconditioned resid norm 4.283566149830e-04 true resid norm  
2.270271716039e-01 ||r(i)||/||b|| 1.220262078558e-08
442 KSP preconditioned resid norm 4.276881945451e-04 true resid norm  
2.270250607831e-01 ||r(i)||/||b|| 1.220250732980e-08
443 KSP preconditioned resid norm 4.270228934431e-04 true resid norm  
2.270229646143e-01 ||r(i)||/||b|| 1.220239466155e-08
444 KSP preconditioned resid norm 4.263606874903e-04 true resid norm  
2.270208861679e-01 ||r(i)||/||b|| 1.220228294588e-08
445 KSP preconditioned resid norm 4.257015527619e-04 true resid norm  
2.270188171070e-01 ||r(i)||/||b|| 1.220217173467e-08
446 KSP preconditioned resid norm 4.250454655911e-04 true resid norm  
2.270167567033e-01 ||r(i)||/||b|| 1.220206098879e-08
447 KSP preconditioned resid norm 4.243924025659e-04 true resid norm  
2.270147147863e-01 ||r(i)||/||b|| 1.220195123655e-08
448 KSP preconditioned resid norm 4.237423405250e-04 true resid norm  
2.270126868721e-01 ||r(i)||/||b|| 1.220184223697e-08
449 KSP preconditioned resid norm 4.230952565548e-04 true resid norm  
2.270106674291e-01 ||r(i)||/||b|| 1.220173369270e-08
450 KSP preconditioned resid norm 4.224511279860e-04 true resid norm  
2.270086563071e-01 ||r(i)||/||b|| 1.220162559569e-08
451 KSP preconditioned resid norm 4.218099323900e-04 true resid norm  
2.270066621367e-01 ||r(i)||/||b|| 1.220151840982e-08
452 KSP preconditioned resid norm 4.211716475759e-04 true resid norm  
2.270046806121e-01 ||r(i)||/||b|| 1.220141190366e-08
453 KSP preconditioned resid norm 4.205362515871e-04 true resid norm  
2.270027093782e-01 ||r(i)||/||b|| 1.220130595061e-08
454 KSP preconditioned resid norm 4.199037226981e-04 true resid norm  
2.270007533393e-01 ||r(i)||/||b|| 1.220120081429e-08
455 KSP preconditioned resid norm 4.192740394116e-04 true resid norm  
2.269987974986e-01 ||r(i)||/||b|| 1.220109568863e-08
456 KSP preconditioned resid norm 4.186471804550e-04 true resid norm  
2.269968704692e-01 ||r(i)||/||b|| 1.220099211156e-08
457 KSP preconditioned resid norm 4.180231247782e-04 true resid norm  
2.269949465846e-01 ||r(i)||/||b|| 1.220088870352e-08
458 KSP preconditioned resid norm 4.174018515494e-04 true resid norm  
2.269930380515e-01 ||r(i)||/||b|| 1.220078612062e-08
459 KSP preconditioned resid norm 4.167833401536e-04 true resid norm  
2.269911319289e-01 ||r(i)||/||b|| 1.220068366728e-08
460 KSP preconditioned resid norm 4.161675701884e-04 true resid norm  
2.269892413764e-01 ||r(i)||/||b|| 1.220058205083e-08
461 KSP preconditioned resid norm 4.155545214621e-04 true resid norm  
2.269873679167e-01 ||r(i)||/||b|| 1.220048135312e-08
462 KSP preconditioned resid norm 4.149441739906e-04 true resid norm  
2.269854983148e-01 ||r(i)||/||b|| 1.220038086275e-08
463 KSP preconditioned resid norm 4.143365079946e-04 true resid norm  
2.269836387108e-01 ||r(i)||/||b|| 1.220028090977e-08
464 KSP preconditioned resid norm 4.137315038968e-04 true resid norm  
2.269817985566e-01 ||r(i)||/||b|| 1.220018200221e-08
465 KSP preconditioned resid norm 4.131291423197e-04 true resid norm  
2.269799604871e-01 ||r(i)||/||b|| 1.220008320670e-08
466 KSP preconditioned resid norm 4.125294040826e-04 true resid norm  
2.269781397259e-01 ||r(i)||/||b|| 1.219998534151e-08
467 KSP preconditioned resid norm 4.119322701991e-04 true resid norm  
2.269763300365e-01 ||r(i)||/||b|| 1.219988807142e-08
468 KSP preconditioned resid norm 4.113377218747e-04 true resid norm  
2.269745252023e-01 ||r(i)||/||b|| 1.219979106229e-08
469 KSP preconditioned resid norm 4.107457405041e-04 true resid norm  
2.269727304101e-01 ||r(i)||/||b|| 1.219969459292e-08
470 KSP preconditioned resid norm 4.101563076692e-04 true resid norm  
2.269709535702e-01 ||r(i)||/||b|| 1.219959908848e-08
471 KSP preconditioned resid norm 4.095694051360e-04 true resid norm  
2.269691758088e-01 ||r(i)||/||b|| 1.219950353450e-08
472 KSP preconditioned resid norm 4.089850148528e-04 true resid norm  
2.269674151244e-01 ||r(i)||/||b|| 1.219940889841e-08
473 KSP preconditioned resid norm 4.084031189479e-04 true resid norm  
2.269656652530e-01 ||r(i)||/||b|| 1.219931484352e-08
474 KSP preconditioned resid norm 4.078236997266e-04 true resid norm  
2.269639202302e-01 ||r(i)||/||b|| 1.219922104923e-08
475 KSP preconditioned resid norm 4.072467396699e-04 true resid norm  
2.269621861633e-01 ||r(i)||/||b|| 1.219912784382e-08
476 KSP preconditioned resid norm 4.066722214315e-04 true resid norm  
2.269604712779e-01 ||r(i)||/||b|| 1.219903566941e-08
477 KSP preconditioned resid norm 4.061001278360e-04 true resid norm  
2.269587553579e-01 ||r(i)||/||b|| 1.219894343938e-08
478 KSP preconditioned resid norm 4.055304418768e-04 true resid norm  
2.269570522399e-01 ||r(i)||/||b|| 1.219885189746e-08
479 KSP preconditioned resid norm 4.049631467137e-04 true resid norm  
2.269553629850e-01 ||r(i)||/||b|| 1.219876110068e-08
480 KSP preconditioned resid norm 4.043982256709e-04 true resid norm  
2.269536819539e-01 ||r(i)||/||b|| 1.219867074593e-08
481 KSP preconditioned resid norm 4.038356622351e-04 true resid norm  
2.269520051347e-01 ||r(i)||/||b|| 1.219858061755e-08
482 KSP preconditioned resid norm 4.032754400533e-04 true resid norm  
2.269503391324e-01 ||r(i)||/||b|| 1.219849107059e-08
483 KSP preconditioned resid norm 4.027175429308e-04 true resid norm  
2.269486835371e-01 ||r(i)||/||b|| 1.219840208300e-08
484 KSP preconditioned resid norm 4.021619548294e-04 true resid norm  
2.269470378222e-01 ||r(i)||/||b|| 1.219831362647e-08
485 KSP preconditioned resid norm 4.016086598653e-04 true resid norm  
2.269453968781e-01 ||r(i)||/||b|| 1.219822542637e-08
486 KSP preconditioned resid norm 4.010576423073e-04 true resid norm  
2.269437660933e-01 ||r(i)||/||b|| 1.219813777233e-08
487 KSP preconditioned resid norm 4.005088865749e-04 true resid norm  
2.269421551975e-01 ||r(i)||/||b|| 1.219805118732e-08
488 KSP preconditioned resid norm 3.999623772362e-04 true resid norm  
2.269405444292e-01 ||r(i)||/||b|| 1.219796460916e-08
489 KSP preconditioned resid norm 3.994180990066e-04 true resid norm  
2.269389343314e-01 ||r(i)||/||b|| 1.219787806704e-08
490 KSP preconditioned resid norm 3.988760367466e-04 true resid norm  
2.269373508449e-01 ||r(i)||/||b|| 1.219779295527e-08
491 KSP preconditioned resid norm 3.983361754599e-04 true resid norm  
2.269357662877e-01 ||r(i)||/||b|| 1.219770778594e-08
492 KSP preconditioned resid norm 3.977985002923e-04 true resid norm  
2.269341873098e-01 ||r(i)||/||b|| 1.219762291650e-08
493 KSP preconditioned resid norm 3.972629965292e-04 true resid norm  
2.269326165890e-01 ||r(i)||/||b|| 1.219753849088e-08
494 KSP preconditioned resid norm 3.967296495946e-04 true resid norm  
2.269310627073e-01 ||r(i)||/||b|| 1.219745497035e-08
495 KSP preconditioned resid norm 3.961984450490e-04 true resid norm  
2.269295113684e-01 ||r(i)||/||b|| 1.219737158650e-08
496 KSP preconditioned resid norm 3.956693685876e-04 true resid norm  
2.269279722981e-01 ||r(i)||/||b|| 1.219728886208e-08
497 KSP preconditioned resid norm 3.951424060395e-04 true resid norm  
2.269264344699e-01 ||r(i)||/||b|| 1.219720620442e-08
498 KSP preconditioned resid norm 3.946175433651e-04 true resid norm  
2.269249136179e-01 ||r(i)||/||b|| 1.219712445923e-08
499 KSP preconditioned resid norm 3.940947666552e-04 true resid norm  
2.269233870762e-01 ||r(i)||/||b|| 1.219704240822e-08
500 KSP preconditioned resid norm 3.935740621292e-04 true resid norm  
2.269218859991e-01 ||r(i)||/||b|| 1.219696172592e-08
Linear solve did not converge due to DIVERGED_ITS iterations 500
KSP Object: 8 MPI processes
   type: gmres
     GMRES: restart=500, using Classical (unmodified) Gram-Schmidt  
Orthogonalization with no iterative refinement
     GMRES: happy breakdown tolerance 1e-30
   maximum iterations=500, initial guess is zero
   tolerances:  relative=1e-12, absolute=1e-50, divergence=10000
   left preconditioning
   using PRECONDITIONED norm type for convergence test
PC Object: 8 MPI processes
   type: asm
     Additive Schwarz: total subdomain blocks = 8, amount of overlap = 1
     Additive Schwarz: restriction/interpolation type - RESTRICT
     Local solve is same for all blocks, in the following KSP and PC objects:
   KSP Object:  (sub_)   1 MPI processes
     type: preonly
     maximum iterations=10000, initial guess is zero
     tolerances:  relative=1e-05, absolute=1e-50, divergence=10000
     left preconditioning
     using NONE norm type for convergence test
   PC Object:  (sub_)   1 MPI processes
     type: lu
       LU: out-of-place factorization
       tolerance for zero pivot 1e-12
       matrix ordering: nd
       factor fill ratio given 5, needed 3.70575
         Factored matrix follows:
           Matrix Object:           1 MPI processes
             type: seqaij
             rows=5630, cols=5630
             package used to perform factorization: petsc
             total: nonzeros=877150, allocated nonzeros=877150
             total number of mallocs used during MatSetValues calls =0
               using I-node routines: found 1126 nodes, limit used is 5
     linear system matrix = precond matrix:
     Matrix Object:     1 MPI processes
       type: seqaij
       rows=5630, cols=5630
       total: nonzeros=236700, allocated nonzeros=236700
       total number of mallocs used during MatSetValues calls =0
         using I-node routines: found 1126 nodes, limit used is 5
   linear system matrix = precond matrix:
   Matrix Object:   8 MPI processes
     type: mpiaij
     rows=41000, cols=41000
     total: nonzeros=1817800, allocated nonzeros=2555700
     total number of mallocs used during MatSetValues calls =121180
       using I-node (on process 0) routines: found 1025 nodes, limit used is 5

************************************************************************************************************************
***             WIDEN YOUR WINDOW TO 120 CHARACTERS.  Use 'enscript -r  
-fCourier9' to print this document            ***
************************************************************************************************************************

---------------------------------------------- PETSc Performance  
Summary: ----------------------------------------------

/home/u14/umhassa5/mecfd/gas-code/TLEC2CCP/ctf/bin/Linux_p/ctf_Linux  
on a arch-linu named mecfd02 with 8 processors, by umhassa5 Mon Apr 28  
14:55:39 2014
Using Petsc Release Version 3.2.0, Patch 5, Sat Oct 29 13:45:54 CDT 2011

                          Max       Max/Min        Avg      Total
Time (sec):           7.395e+01      1.04834   7.331e+01
Objects:              1.541e+03      1.00000   1.541e+03
Flops:                5.413e+09      1.03192   5.360e+09  4.288e+10
Flops/sec:            7.655e+07      1.07860   7.314e+07  5.851e+08
MPI Messages:         3.108e+03      1.95718   2.732e+03  2.185e+04
MPI Message Lengths:  3.360e+07      2.89490   7.101e+03  1.552e+08
MPI Reductions:       1.559e+03      1.00000

Flop counting convention: 1 flop = 1 real number operation of type  
(multiply/divide/add/subtract)
                             e.g., VecAXPY() for real vectors of  
length N --> 2N flops
                             and VecAXPY() for complex vectors of  
length N --> 8N flops

Summary of Stages:   ----- Time ------  ----- Flops -----  ---  
Messages ---  -- Message Lengths --  -- Reductions --
                         Avg     %Total     Avg     %Total   counts    
%Total     Avg         %Total   counts   %Total
  0:      Main Stage: 7.3305e+01 100.0%  4.2880e+10 100.0%  2.185e+04  
100.0%  7.101e+03      100.0%  1.558e+03  99.9%

------------------------------------------------------------------------------------------------------------------------
See the 'Profiling' chapter of the users' manual for details on  
interpreting output.
Phase summary info:
    Count: number of times phase was executed
    Time and Flops: Max - maximum over all processors
                    Ratio - ratio of maximum to minimum over all processors
    Mess: number of messages sent
    Avg. len: average message length
    Reduct: number of global reductions
    Global: entire computation
    Stage: stages of a computation. Set stages with  
PetscLogStagePush() and PetscLogStagePop().
       %T - percent time in this phase         %f - percent flops in this phase
       %M - percent messages in this phase     %L - percent message  
lengths in this phase
       %R - percent reductions in this phase
    Total Mflop/s: 10e-6 * (sum of flops over all processors)/(max  
time over all processors)
------------------------------------------------------------------------------------------------------------------------
Event                Count      Time (sec)     Flops                    
           --- Global ---  --- Stage ---   Total
                    Max Ratio  Max     Ratio   Max  Ratio  Mess   Avg  
len Reduct  %T %f %M %L %R  %T %f %M %L %R Mflop/s
------------------------------------------------------------------------------------------------------------------------

--- Event Stage 0: Main Stage

MatMult             1001 1.0 2.0220e+00 1.2 4.54e+08 1.0 1.4e+04  
4.0e+03 0.0e+00  3  8 64 36  0   3  8 64 36  0  1779
MatSolve             501 1.0 3.0825e+00 1.2 1.00e+09 1.1 0.0e+00  
0.0e+00 0.0e+00  4 18  0  0  0   4 18  0  0  0  2510
MatLUFactorSym         1 1.0 3.1987e-02 1.3 0.00e+00 0.0 0.0e+00  
0.0e+00 3.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatLUFactorNum         1 1.0 9.0718e-02 1.6 8.21e+07 1.5 0.0e+00  
0.0e+00 0.0e+00  0  1  0  0  0   0  1  0  0  0  5825
MatAssemblyBegin       2 1.0 1.1914e+01190.5 0.00e+00 0.0 4.2e+01  
1.2e+06 2.0e+00 14  0  0 33  0  14  0  0 33  0     0
MatAssemblyEnd         2 1.0 3.0220e+01 1.0 0.00e+00 0.0 5.6e+01  
1.0e+03 9.0e+00 41  0  0  0  1  41  0  0  0  1     0
MatGetRowIJ            1 1.0 2.6202e-04 1.1 0.00e+00 0.0 0.0e+00  
0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatGetSubMatrice       1 1.0 2.6700e-02 1.1 0.00e+00 0.0 1.4e+02  
5.5e+04 7.0e+00  0  0  1  5  0   0  0  1  5  0     0
MatGetOrdering         1 1.0 1.0290e-03 1.2 0.00e+00 0.0 0.0e+00  
0.0e+00 4.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatIncreaseOvrlp       1 1.0 3.5419e-03 1.4 0.00e+00 0.0 0.0e+00  
0.0e+00 2.0e+00  0  0  0  0  0   0  0  0  0  0     0
MatView                3 3.0 3.3307e-04 3.6 0.00e+00 0.0 0.0e+00  
0.0e+00 1.0e+00  0  0  0  0  0   0  0  0  0  0     0
VecMDot              500 1.0 3.7091e+00 1.2 1.28e+09 1.0 0.0e+00  
0.0e+00 5.0e+02  5 24  0  0 32   5 24  0  0 32  2769
VecNorm             1003 1.0 9.0194e-01 5.3 1.03e+07 1.0 0.0e+00  
0.0e+00 1.0e+03  1  0  0  0 64   1  0  0  0 64    91
VecScale             501 1.0 4.4811e-03 1.1 2.57e+06 1.0 0.0e+00  
0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  4584
VecCopy              502 1.0 2.6488e-02 1.2 0.00e+00 0.0 0.0e+00  
0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
VecSet              1505 1.0 3.8517e-02 1.4 0.00e+00 0.0 0.0e+00  
0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
VecAXPY              501 1.0 6.1393e-03 1.1 5.14e+06 1.0 0.0e+00  
0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  6692
VecAYPX              501 1.0 1.7209e-02 1.2 2.57e+06 1.0 0.0e+00  
0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0  1194
VecMAXPY            1001 1.0 6.7261e+00 1.1 2.57e+09 1.0 0.0e+00  
0.0e+00 0.0e+00  9 48  0  0  0   9 48  0  0  0  3060
VecAssemblyBegin       1 1.0 1.2943e-02 1.2 0.00e+00 0.0 2.2e+02  
3.1e+04 3.0e+00  0  0  1  4  0   0  0  1  4  0     0
VecAssemblyEnd         1 1.0 1.7521e-03 6.8 0.00e+00 0.0 0.0e+00  
0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
VecScatterBegin     2004 1.0 9.6959e-02 1.3 0.00e+00 0.0 2.1e+04  
4.1e+03 0.0e+00  0  0 96 56  0   0  0 96 56  0     0
VecScatterEnd       2004 1.0 5.1422e-01 5.4 0.00e+00 0.0 0.0e+00  
0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
VecNormalize         501 1.0 5.3980e-01 5.8 7.70e+06 1.0 0.0e+00  
0.0e+00 5.0e+02  0  0  0  0 32   0  0  0  0 32   114
KSPGMRESOrthog       500 1.0 6.9229e+00 1.1 2.57e+09 1.0 0.0e+00  
0.0e+00 5.0e+02  9 48  0  0 32   9 48  0  0 32  2967
KSPSetup               2 1.0 2.8701e-03 1.3 0.00e+00 0.0 0.0e+00  
0.0e+00 0.0e+00  0  0  0  0  0   0  0  0  0  0     0
KSPSolve               1 1.0 1.5673e+01 1.0 5.41e+09 1.0 2.1e+04  
4.4e+03 1.5e+03 21100 97 60 98  21100 97 60 98  2736
PCSetUp                2 1.0 1.5435e-01 1.4 8.21e+07 1.5 2.0e+02  
4.0e+04 2.6e+01  0  1  1  5  2   0  1  1  5  2  3423
PCSetUpOnBlocks        1 1.0 1.2381e-01 1.5 8.21e+07 1.5 0.0e+00  
0.0e+00 7.0e+00  0  1  0  0  0   0  1  0  0  0  4268
PCApply              501 1.0 3.2335e+00 1.2 1.00e+09 1.1 7.0e+03  
4.0e+03 0.0e+00  4 18 32 18  0   4 18 32 18  0  2393
------------------------------------------------------------------------------------------------------------------------

Memory usage is given in bytes:

Object Type          Creations   Destructions     Memory  Descendants' Mem.
Reports information only for process 0.

--- Event Stage 0: Main Stage

               Matrix     5              5     14741588     0
               Vector  1515           1515     64610424     0
       Vector Scatter     3              3         3180     0
            Index Set    12             12       413568     0
        Krylov Solver     2              2      4048456     0
       Preconditioner     2              2         1832     0
               Viewer     2              1          720     0
========================================================================================================================
Average time to get PetscTime(): 1.90735e-07
Average time for MPI_Barrier(): 8.2016e-06
Average time for zero size MPI_Send(): 1.05202e-05
#PETSc Option Table entries:
-ksp_converged_reason
-ksp_gmres_restart 500
-ksp_max_it 500
-ksp_monitor_true_residual
-ksp_type gmres
-ksp_view
-log_summary
-pc_type asm
-sub_pc_type lu
#End of PETSc Option Table entries
Compiled without FORTRAN kernels
Compiled with full precision matrices (default)
sizeof(short) 2 sizeof(int) 4 sizeof(long) 8 sizeof(void*) 8  
sizeof(PetscScalar) 8
Configure run at: Sat Dec 31 07:53:05 2011
Configure options: --with-mpi-dir=/home/mecfd/common/openmpi-p  
--PETSC_DIR=/home/mecfd/common/sw/petsc-3.2-p5-pgi --with-debugging=0  
--with-shared-libraries=1 --download-f-blas-lapack=1  
--download-superlu_dist=yes --download-parmetis=yes  
--download-mumps=yes --download-scalapack=yes --download-spooles=yes  
--download-blacs=yes --download-hypre=yes
-----------------------------------------
Libraries compiled on Sat Dec 31 07:53:05 2011 on mecfd02
Machine characteristics:  
Linux-2.6.18-238.19.1.el5-x86_64-with-redhat-5.7-Final
Using PETSc directory: /home/mecfd/common/sw/petsc-3.2-p5-pgi
Using PETSc arch: arch-linux2-c-opt
-----------------------------------------

Using C compiler: /home/mecfd/common/openmpi-p/bin/mpicc  -fPIC -O   
${COPTFLAGS} ${CFLAGS}
Using Fortran compiler: /home/mecfd/common/openmpi-p/bin/mpif90  -fPIC  
-O   ${FOPTFLAGS} ${FFLAGS}
-----------------------------------------

Using include paths:  
-I/home/mecfd/common/sw/petsc-3.2-p5-pgi/arch-linux2-c-opt/include  
-I/home/mecfd/common/sw/petsc-3.2-p5-pgi/include  
-I/home/mecfd/common/sw/petsc-3.2-p5-pgi/include  
-I/home/mecfd/common/sw/petsc-3.2-p5-pgi/arch-linux2-c-opt/include  
-I/home/mecfd/common/openmpi-p/include  
-I/home/mecfd/common/sw/openmpi-1.4.4-pgi/include
-----------------------------------------

Using C linker: /home/mecfd/common/openmpi-p/bin/mpicc
Using Fortran linker: /home/mecfd/common/openmpi-p/bin/mpif90
Using libraries:  
-Wl,-rpath,/home/mecfd/common/sw/petsc-3.2-p5-pgi/arch-linux2-c-opt/lib  
-L/home/mecfd/common/sw/petsc-3.2-p5-pgi/arch-linux2-c-opt/lib -lpetsc  
-lX11 -lpthread  
-Wl,-rpath,/home/mecfd/common/sw/petsc-3.2-p5-pgi/arch-linux2-c-opt/lib  
-L/home/mecfd/common/sw/petsc-3.2-p5-pgi/arch-linux2-c-opt/lib  
-lsuperlu_dist_2.5 -lcmumps -ldmumps -lsmumps -lzmumps -lmumps_common  
-lpord -lparmetis -lmetis -lHYPRE  
-Wl,-rpath,/home/mecfd/common/sw/openmpi-1.4.4-pgi/lib  
-Wl,-rpath,/local/linux-local/pgi/linux86-64/10.0/libso  
-Wl,-rpath,/local/linux-local/pgi/linux86-64/10.0/lib  
-Wl,-rpath,/usr/lib/gcc/x86_64-redhat-linux/4.1.2 -lmpi_cxx -lstd -lC  
-lspooles -lscalapack -lblacs -lflapack -lfblas  
/local/linux-local/pgi/linux86-64/10.0/lib/pgi.ld  
-L/home/mecfd/common/sw/openmpi-1.4.4-pgi/lib  
-L/local/linux-local/pgi/linux86-64/10.0/libso  
-L/local/linux-local/pgi/linux86-64/10.0/lib  
-L/usr/lib/gcc/x86_64-redhat-linux/4.1.2 -ldl -lmpi -lopen-rte  
-lopen-pal -lnsl -lutil -lpthread -lnspgc -lpgc -lmpi_f90 -lmpi_f77  
-lpgf90 -lpgf90_rpm1 -lpgf902 -lpgftnrtl -lpgf90rtl -lrt -lm -lmpi_cxx  
-lstd -lC -ldl -lmpi -lopen-rte -lopen-pal -lnsl -lutil -lpthread  
-lnspgc -lpgc -ldl
-----------------------------------------



-- 
With Best Regards;
Foad


Quoting Barry Smith <bsmith at mcs.anl.gov>:

>
>   Please run with the additional options -ksp_max_it 500  
> -ksp_gmres_restart 500 -ksp_monitor_true_residual  
> -ksp_monitor_singular_value and send back all the output (that would  
> include the 500 residual norms as it tries to converge.)
>
>   Barry
>
> On Apr 28, 2014, at 1:21 PM, Foad Hassaninejadfarahani  
> <umhassa5 at cc.umanitoba.ca> wrote:
>
>> Hello Again;
>>
>> I used -ksp_rtol 1.e-12 and it took way way longer to get the  
>> result for one iteration and it did not converge:
>>
>> Linear solve did not converge due to DIVERGED_ITS iterations 10000
>> KSP Object: 8 MPI processes
>>  type: gmres
>>    GMRES: restart=300, using Classical (unmodified) Gram-Schmidt  
>> Orthogonalization with no iterative refinement
>>    GMRES: happy breakdown tolerance 1e-30
>>  maximum iterations=10000, initial guess is zero
>>  tolerances:  relative=1e-12, absolute=1e-50, divergence=10000
>>  left preconditioning
>>  using PRECONDITIONED norm type for convergence test
>> PC Object: 8 MPI processes
>>  type: asm
>>    Additive Schwarz: total subdomain blocks = 8, amount of overlap = 1
>>    Additive Schwarz: restriction/interpolation type - RESTRICT
>>    Local solve is same for all blocks, in the following KSP and PC objects:
>>  KSP Object:  (sub_)   1 MPI processes
>>    type: preonly
>>    maximum iterations=10000, initial guess is zero
>>    tolerances:  relative=1e-05, absolute=1e-50, divergence=10000
>>    left preconditioning
>>    using NONE norm type for convergence test
>>  PC Object:  (sub_)   1 MPI processes
>>    type: lu
>>      LU: out-of-place factorization
>>      tolerance for zero pivot 1e-12
>>      matrix ordering: nd
>>      factor fill ratio given 5, needed 3.70575
>>        Factored matrix follows:
>>          Matrix Object:           1 MPI processes
>>            type: seqaij
>>            rows=5630, cols=5630
>>            package used to perform factorization: petsc
>>            total: nonzeros=877150, allocated nonzeros=877150
>>            total number of mallocs used during MatSetValues calls =0
>>              using I-node routines: found 1126 nodes, limit used is 5
>>    linear system matrix = precond matrix:
>>    Matrix Object:     1 MPI processes
>>      type: seqaij
>>      rows=5630, cols=5630
>>      total: nonzeros=236700, allocated nonzeros=236700
>>      total number of mallocs used during MatSetValues calls =0
>>        using I-node routines: found 1126 nodes, limit used is 5
>>  linear system matrix = precond matrix:
>>  Matrix Object:   8 MPI processes
>>    type: mpiaij
>>    rows=41000, cols=41000
>>    total: nonzeros=1817800, allocated nonzeros=2555700
>>    total number of mallocs used during MatSetValues calls =121180
>>      using I-node (on process 0) routines: found 1025 nodes, limit used is 5
>>
>>
>> Well, let me clear everything. I am solving the whole system (air  
>> and water) coupled at once. Although originally the system is not  
>> linear, but I linearized the equations, so I have some lagged  
>> terms. In addition the interface (between two phases) location is  
>> wrong at the beginning and should be corrected in each iteration  
>> after getting the solution. Therefore, I solve the whole domain,  
>> move the interface and again solve the whole domain. This should  
>> continue until the interface movement becomes from the order of  
>> 1E-12.
>>
>> My problem is after getting the converged solution. Restarting from  
>> the converged solution, if I use Superlu, it gives me back the  
>> converged solution and stops after one iteration. But, if I use any  
>> iterative solver, it does not give me back the converged solution  
>> and starts moving the interface cause the wrong solution ask for  
>> new interface location. This leads to oscillation for ever and for  
>> some cases divergence.
>>
>> --
>> With Best Regards;
>> Foad
>>
>>
>> Quoting Barry Smith <bsmith at mcs.anl.gov>:
>>
>>>
>>> On Apr 28, 2014, at 12:59 PM, Barry Smith <bsmith at mcs.anl.gov> wrote:
>>>
>>>>
>>>> First try a much tighter tolerance on the linear solver. Use  
>>>> -ksp_rtol 1.e-12
>>>>
>>>> I don?t fully understand. Is the coupled system nonlinear? Are  
>>>> you solving a nonlinear system, how are you doing that since you  
>>>> seem to be only solving a single linear system? Does the linear  
>>>> system involve all unknowns in the fluid and air?
>>>>
>>>> Barry
>>>>
>>>>
>>>>
>>>> On Apr 28, 2014, at 11:19 AM, Foad Hassaninejadfarahani  
>>>> <umhassa5 at cc.umanitoba.ca> wrote:
>>>>
>>>>> Hello PETSc team;
>>>>>
>>>>> The PETSc setup in my code is working now. I have issues with  
>>>>> using the iterative solver instead of direct solver.
>>>>>
>>>>> I am solving a 2D, two-phase flow. Two fluids (air and water)  
>>>>> flow into a channel and there is interaction between two phases.  
>>>>> I am solving for the velocities in x and y directions, pressure  
>>>>> and two scalars. They are all coupled together. I am looking for  
>>>>> the steady-state solution. Since there is interface between the  
>>>>> phases which needs updating, there are many iterations to reach  
>>>>> the steady-state solution. "A" is a nine-banded non-symmetric  
>>>>> matrix and each node has five unknowns. I am storing the  
>>>>> non-zero coefficients and their locations in three separate  
>>>>> vectors.
>>>>>
>>>>> I started using the direct solver. Superlu works fine and gives  
>>>>> me good results compared to the previous works. However it is  
>>>>> not cheap and applicable for fine grids. But, the iterative  
>>>>> solver did not work and here is what I did:
>>>>>
>>>>> I got the converged solution by using Superlu. After that I  
>>>>> restarted from the converged solution and did one iteration  
>>>>> using  -pc_type lu -pc_factor_mat_solver_package superlu_dist  
>>>>> -log_summary. Again, it gave me the same converged solution.
>>>>>
>>>>> After that I started from the converged solution once more and  
>>>>> this time I tried different combinations of iterative solvers  
>>>>> and preconditions like the followings:
>>>>> -ksp_type gmres -ksp_gmres_restart 300 -pc_type asm -sub_pc_type  
>>>>> lu ksp_monitor_true_residual -ksp_converged_reason -ksp_view  
>>>>> -log_summary
>>>>>
>>>>> and here is the report:
>>>>> Linear solve converged due to CONVERGED_RTOL iterations 41
>>>>> KSP Object: 8 MPI processes
>>>>> type: gmres
>>>>>  GMRES: restart=300, using Classical (unmodified) Gram-Schmidt  
>>>>> Orthogonalization with no iterative refinement
>>>>>  GMRES: happy breakdown tolerance 1e-30
>>>>> maximum iterations=10000, initial guess is zero
>>>>> tolerances:  relative=1e-06, absolute=1e-50, divergence=10000
>>>>> left preconditioning
>>>>> using PRECONDITIONED norm type for convergence test
>>>>> PC Object: 8 MPI processes
>>>>> type: asm
>>>>>  Additive Schwarz: total subdomain blocks = 8, amount of overlap = 1
>>>>>  Additive Schwarz: restriction/interpolation type - RESTRICT
>>>>>  Local solve is same for all blocks, in the following KSP and PC objects:
>>>>> KSP Object:  (sub_)   1 MPI processes
>>>>>  type: preonly
>>>>>  maximum iterations=10000, initial guess is zero
>>>>>  tolerances:  relative=1e-05, absolute=1e-50, divergence=10000
>>>>>  left preconditioning
>>>>>  using NONE norm type for convergence test
>>>>> PC Object:  (sub_)   1 MPI processes
>>>>>  type: lu
>>>>>    LU: out-of-place factorization
>>>>>    tolerance for zero pivot 1e-12
>>>>>    matrix ordering: nd
>>>>>    factor fill ratio given 5, needed 3.70575
>>>>>      Factored matrix follows:
>>>>>        Matrix Object:           1 MPI processes
>>>>>          type: seqaij
>>>>>          rows=5630, cols=5630
>>>>>          package used to perform factorization: petsc
>>>>>          total: nonzeros=877150, allocated nonzeros=877150
>>>>>          total number of mallocs used during MatSetValues calls =0
>>>>>            using I-node routines: found 1126 nodes, limit used is 5
>>>>>  linear system matrix = precond matrix:
>>>>>  Matrix Object:     1 MPI processes
>>>>>    type: seqaij
>>>>>    rows=5630, cols=5630
>>>>>    total: nonzeros=236700, allocated nonzeros=236700
>>>>>    total number of mallocs used during MatSetValues calls =0
>>>>>      using I-node routines: found 1126 nodes, limit used is 5
>>>>> linear system matrix = precond matrix:
>>>>> Matrix Object:   8 MPI processes
>>>>>  type: mpiaij
>>>>>  rows=41000, cols=41000
>>>>>  total: nonzeros=1817800, allocated nonzeros=2555700
>>>>>  total number of mallocs used during MatSetValues calls =121180
>>>>>    using I-node (on process 0) routines: found 1025 nodes, limit  
>>>>> used is 5
>>>>>
>>>>> But, the results are far from the converged solution. For  
>>>>> example two reference nodes for the pressure are compared:
>>>>>
>>>>> Based on Superlu
>>>>> Channel Inlet pressure (MIXTURE):      0.38890D-01
>>>>> Channel Inlet pressure (LIQUID):       0.38416D-01
>>>>>
>>>>> Based on Gmres
>>>>> Channel Inlet pressure (MIXTURE):     -0.87214D+00
>>>>> Channel Inlet pressure (LIQUID):      -0.87301D+00
>>>>>
>>>>>
>>>>> I also tried this:
>>>>> -ksp_type gcr -pc_type asm -ksp_diagonal_scale  
>>>>> -ksp_diagonal_scale_fix -ksp_monitor_true_residual  
>>>>> -ksp_converged_reason -ksp_view -log_summary
>>>>>
>>>>> and here is the report:
>>>>> 0 KSP unpreconditioned resid norm 2.248340888101e+05 true resid  
>>>>> norm 2.248340888101e+05 ||r(i)||/||b|| 1.000000000000e+00
>>>>> 1 KSP unpreconditioned resid norm 4.900010460179e+04 true resid  
>>>>> norm 4.900010460179e+04 ||r(i)||/||b|| 2.179389471637e-01
>>>>> 2 KSP unpreconditioned resid norm 4.267761572746e+04 true resid  
>>>>> norm 4.267761572746e+04 ||r(i)||/||b|| 1.898182608933e-01
>>>>> 3 KSP unpreconditioned resid norm 2.041242251471e+03 true resid  
>>>>> norm 2.041242251471e+03 ||r(i)||/||b|| 9.078882398457e-03
>>>>> 4 KSP unpreconditioned resid norm 1.852885420564e+03 true resid  
>>>>> norm 1.852885420564e+03 ||r(i)||/||b|| 8.241123178296e-03
>>>>> 5 KSP unpreconditioned resid norm 1.748965594395e+02 true resid  
>>>>> norm 1.748965594395e+02 ||r(i)||/||b|| 7.778916460804e-04
>>>>> 6 KSP unpreconditioned resid norm 5.664539353996e+01 true resid  
>>>>> norm 5.664539353996e+01 ||r(i)||/||b|| 2.519430831852e-04
>>>>> 7 KSP unpreconditioned resid norm 3.607535692806e+01 true resid  
>>>>> norm 3.607535692806e+01 ||r(i)||/||b|| 1.604532351788e-04
>>>>> 8 KSP unpreconditioned resid norm 1.041501303366e+01 true resid  
>>>>> norm 1.041501303366e+01 ||r(i)||/||b|| 4.632310468924e-05
>>>>> 9 KSP unpreconditioned resid norm 3.089920380322e+00 true resid  
>>>>> norm 3.089920380322e+00 ||r(i)||/||b|| 1.374311340720e-05
>>>>> 10 KSP unpreconditioned resid norm 1.456883209806e+00 true resid  
>>>>> norm 1.456883209806e+00 ||r(i)||/||b|| 6.479814593583e-06
>>>>> 11 KSP unpreconditioned resid norm 5.566902714391e-01 true resid  
>>>>> norm 5.566902714391e-01 ||r(i)||/||b|| 2.476004748147e-06
>>>>> 12 KSP unpreconditioned resid norm 2.403913756663e-01 true resid  
>>>>> norm 2.403913756663e-01 ||r(i)||/||b|| 1.069194520006e-06
>>>>> 13 KSP unpreconditioned resid norm 1.650435118839e-01 true resid  
>>>>> norm 1.650435118839e-01 ||r(i)||/||b|| 7.340680088032e-07
>>>>> Linear solve converged due to CONVERGED_RTOL iterations 13
>>>>> KSP Object: 8 MPI processes
>>>>> type: gcr
>>>>>  GCR: restart = 30
>>>>>  GCR: restarts performed = 1
>>>>> maximum iterations=10000, initial guess is zero
>>>>> tolerances:  relative=1e-06, absolute=1e-50, divergence=10000
>>>>> right preconditioning
>>>>> diagonally scaled system
>>>>> using UNPRECONDITIONED norm type for convergence test
>>>>> PC Object: 8 MPI processes
>>>>> type: asm
>>>>>  Additive Schwarz: total subdomain blocks = 8, amount of overlap = 1
>>>>>  Additive Schwarz: restriction/interpolation type - RESTRICT
>>>>>  Local solve is same for all blocks, in the following KSP and PC objects:
>>>>> KSP Object:  (sub_)   1 MPI processes
>>>>>  type: preonly
>>>>>  maximum iterations=10000, initial guess is zero
>>>>>  tolerances:  relative=1e-05, absolute=1e-50, divergence=10000
>>>>>  left preconditioning
>>>>>  using NONE norm type for convergence test
>>>>> PC Object:  (sub_)   1 MPI processes
>>>>>  type: ilu
>>>>>    ILU: out-of-place factorization
>>>>>    0 levels of fill
>>>>>    tolerance for zero pivot 1e-12
>>>>>    using diagonal shift to prevent zero pivot
>>>>>    matrix ordering: natural
>>>>>    factor fill ratio given 1, needed 1
>>>>>      Factored matrix follows:
>>>>>        Matrix Object:           1 MPI processes
>>>>>          type: seqaij
>>>>>          rows=5630, cols=5630
>>>>>          package used to perform factorization: petsc
>>>>>          total: nonzeros=236700, allocated nonzeros=236700
>>>>>          total number of mallocs used during MatSetValues calls =0
>>>>>            using I-node routines: found 1126 nodes, limit used is 5
>>>>>  linear system matrix = precond matrix:
>>>>>  Matrix Object:     1 MPI processes
>>>>>    type: seqaij
>>>>>    rows=5630, cols=5630
>>>>>    total: nonzeros=236700, allocated nonzeros=236700
>>>>>    total number of mallocs used during MatSetValues calls =0
>>>>>      using I-node routines: found 1126 nodes, limit used is 5
>>>>> linear system matrix = precond matrix:
>>>>> Matrix Object:   8 MPI processes
>>>>>  type: mpiaij
>>>>>  rows=41000, cols=41000
>>>>>  total: nonzeros=1817800, allocated nonzeros=2555700
>>>>>  total number of mallocs used during MatSetValues calls =121180
>>>>>    using I-node (on process 0) routines: found 1025 nodes, limit  
>>>>> used is 5
>>>>>
>>>>> Channel Inlet pressure (MIXTURE):      -0.90733D+00
>>>>> Channel Inlet pressure (LIQUID):      -0.10118D+01
>>>>>
>>>>>
>>>>> As you may see these are complete different results which are  
>>>>> not close to the converged solution.
>>>>>
>>>>> Since, I want to have fine grids I need to use iterative solver.  
>>>>> I wonder if I am missing something or using wrong  
>>>>> solver/precondition/option. I would appreciate if you could help  
>>>>> me (like always).
>>>>>
>>>>> --
>>>>> With Best Regards;
>>>>> Foad
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>>
>>
>>
>
>
>




More information about the petsc-users mailing list