<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">The output is 55 megs. Is there some specific portion you’re looking for? <div class=""><br class=""><div class="">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; ">-gideon</span>
</div>
<br class=""><div style=""><blockquote type="cite" class=""><div class="">On Sep 9, 2015, at 6:39 PM, Barry Smith <<a href="mailto:bsmith@mcs.anl.gov" class="">bsmith@mcs.anl.gov</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><br class=""> Ok, it is able to solve the linear systems with very small residuals so I don't believe the Jacobian is single at this location.<br class=""><br class=""> Please make the same run again but with the additional option -info and send all the output.<br class=""><br class=""> Barry<br class=""><br class=""><br class=""><blockquote type="cite" class="">On Sep 9, 2015, at 5:29 PM, Gideon Simpson <<a href="mailto:gideon.simpson@gmail.com" class="">gideon.simpson@gmail.com</a>> wrote:<br class=""><br class="">I did a fresh install of 3.6.1 against gcc 5.2 with —download-mpi and —download-f2cblas with quad math support. I then ran my code with the solver flags:<br class="">-snes_max_it 100 -snes_converged_reason -snes_monitor \<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span><span class="Apple-tab-span" style="white-space:pre"> </span>-pc_type lu \<br class=""><span class="Apple-tab-span" style="white-space:pre"> </span><span class="Apple-tab-span" style="white-space:pre"> </span>-snes_max_funcs 500000 -snes_fd -snes_monitor -ksp_monitor_true_residual -binary_read_double<br class=""><br class="">I get similar results as before, but, clearly, at higher precision:<br class=""><br class=""> 0 SNES Function norm 2.528207888951e-12 <br class=""> 0 KSP preconditioned resid norm 3.518112956043e-12 true resid norm 2.528207888951e-12 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 0.000000000000e+00 true resid norm 1.904732438038e-41 ||r(i)||/||b|| 7.533923323167e-30<br class=""> 1 SNES Function norm 2.299665925647e-23 <br class=""> Nonlinear solve converged due to CONVERGED_FNORM_RELATIVE iterations 1<br class=""> 0 SNES Function norm 5.066222213176e+03 <br class=""> 0 KSP preconditioned resid norm 3.135087050102e+01 true resid norm 5.066222213176e+03 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.700962799224e-30 true resid norm 5.578720034265e-27 ||r(i)||/||b|| 1.101159759585e-30<br class=""> 1 SNES Function norm 8.484697184455e+02 <br class=""> 0 KSP preconditioned resid norm 2.668083368285e+02 true resid norm 8.484697184455e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 8.794084418808e-29 true resid norm 2.437641286218e-26 ||r(i)||/||b|| 2.872985603639e-29<br class=""> 2 SNES Function norm 6.549559723473e+02 <br class=""> 0 KSP preconditioned resid norm 1.552154272986e+02 true resid norm 6.549559723473e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.507070573051e-29 true resid norm 4.361978496405e-27 ||r(i)||/||b|| 6.659956822398e-30<br class=""> 3 SNES Function norm 5.770723278332e+02 <br class=""> 0 KSP preconditioned resid norm 1.348596652974e+02 true resid norm 5.770723278332e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.578833635012e-28 true resid norm 1.182025127733e-26 ||r(i)||/||b|| 2.048313652764e-29<br class=""> 4 SNES Function norm 5.237702240779e+02 <br class=""> 0 KSP preconditioned resid norm 1.524401223281e+02 true resid norm 5.237702240779e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.348074578423e-29 true resid norm 3.851281508331e-27 ||r(i)||/||b|| 7.352998187537e-30<br class=""> 5 SNES Function norm 4.753909020039e+02 <br class=""> 0 KSP preconditioned resid norm 1.864261890236e+02 true resid norm 4.753909020039e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 7.878414198958e-29 true resid norm 5.419935080688e-26 ||r(i)||/||b|| 1.140100716661e-28<br class=""> 6 SNES Function norm 4.221784590918e+02 <br class=""> 0 KSP preconditioned resid norm 2.550992139992e+02 true resid norm 4.221784590918e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 4.075971594113e-29 true resid norm 7.094679472303e-27 ||r(i)||/||b|| 1.680493004680e-29<br class=""> 7 SNES Function norm 3.806525080588e+02 <br class=""> 0 KSP preconditioned resid norm 5.183605289859e+02 true resid norm 3.806525080588e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.103573513147e-28 true resid norm 2.144465704039e-26 ||r(i)||/||b|| 5.633657098375e-29<br class=""> 8 SNES Function norm 3.762054656159e+02 <br class=""> 0 KSP preconditioned resid norm 5.320776223634e+03 true resid norm 3.762054656159e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.585030728289e-27 true resid norm 5.530627313578e-25 ||r(i)||/||b|| 1.470108177329e-27<br class=""> 9 SNES Function norm 3.758975227011e+02 <br class=""> 0 KSP preconditioned resid norm 6.252711433929e+03 true resid norm 3.758975227011e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 6.414696869631e-28 true resid norm 2.875693139366e-25 ||r(i)||/||b|| 7.650205084359e-28<br class=""> 10 SNES Function norm 3.757032042685e+02 <br class=""> 0 KSP preconditioned resid norm 5.890497158679e+02 true resid norm 3.757032042685e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.912199122959e-28 true resid norm 4.765625322483e-26 ||r(i)||/||b|| 1.268454798452e-28<br class=""> 11 SNES Function norm 3.728798164350e+02 <br class=""> 0 KSP preconditioned resid norm 1.081356529363e+03 true resid norm 3.728798164350e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.465322278036e-27 true resid norm 8.948779168104e-26 ||r(i)||/||b|| 2.399909776201e-28<br class=""> 12 SNES Function norm 3.723078740346e+02 <br class=""> 0 KSP preconditioned resid norm 3.745127665225e+03 true resid norm 3.723078740346e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 6.682508949012e-28 true resid norm 2.402288617952e-26 ||r(i)||/||b|| 6.452424956579e-29<br class=""> 13 SNES Function norm 3.721848058457e+02 <br class=""> 0 KSP preconditioned resid norm 3.495477557738e+03 true resid norm 3.721848058457e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.389031769454e-28 true resid norm 4.589073952100e-26 ||r(i)||/||b|| 1.233009483467e-28<br class=""> 14 SNES Function norm 3.720227574913e+02 <br class=""> 0 KSP preconditioned resid norm 1.265999878583e+04 true resid norm 3.720227574913e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.936728612764e-27 true resid norm 6.774363900864e-26 ||r(i)||/||b|| 1.820954165962e-28<br class=""> 15 SNES Function norm 3.720051997704e+02 <br class=""> 0 KSP preconditioned resid norm 2.912354770053e+03 true resid norm 3.720051997704e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.193330450218e-26 true resid norm 9.007685186918e-25 ||r(i)||/||b|| 2.421386903322e-27<br class=""> 16 SNES Function norm 3.718945465838e+02 <br class=""> 0 KSP preconditioned resid norm 1.082057529463e+03 true resid norm 3.718945465838e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.143696537658e-28 true resid norm 1.173159164030e-26 ||r(i)||/||b|| 3.154547908288e-29<br class=""> 17 SNES Function norm 3.700412588801e+02 <br class=""> 0 KSP preconditioned resid norm 3.676198400599e+01 true resid norm 3.700412588801e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.884191202285e-29 true resid norm 8.141362804702e-28 ||r(i)||/||b|| 2.200122988810e-30<br class=""> 18 SNES Function norm 3.351964193518e+02 <br class=""> 0 KSP preconditioned resid norm 1.071494896915e+02 true resid norm 3.351964193518e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 5.159408051956e-29 true resid norm 3.785844889574e-27 ||r(i)||/||b|| 1.129440731168e-29<br class=""> 19 SNES Function norm 3.096020694819e+02 <br class=""> 0 KSP preconditioned resid norm 3.361110777562e+02 true resid norm 3.096020694819e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.067163043170e-28 true resid norm 3.097548865490e-26 ||r(i)||/||b|| 1.000493591879e-28<br class=""> 20 SNES Function norm 3.008463400554e+02 <br class=""> 0 KSP preconditioned resid norm 7.151989169521e+01 true resid norm 3.008463400554e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.963021196462e-29 true resid norm 3.267842047327e-27 ||r(i)||/||b|| 1.086216321171e-29<br class=""> 21 SNES Function norm 2.752372240183e+02 <br class=""> 0 KSP preconditioned resid norm 1.737818994441e+02 true resid norm 2.752372240183e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.355051821355e-29 true resid norm 1.159582173983e-27 ||r(i)||/||b|| 4.213028154600e-30<br class=""> 22 SNES Function norm 2.707638991136e+02 <br class=""> 0 KSP preconditioned resid norm 4.095365990261e+02 true resid norm 2.707638991136e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.313462531085e-29 true resid norm 2.326415447553e-27 ||r(i)||/||b|| 8.592044416441e-30<br class=""> 23 SNES Function norm 2.698513655244e+02 <br class=""> 0 KSP preconditioned resid norm 7.571732975899e+01 true resid norm 2.698513655244e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 4.706642213758e-29 true resid norm 5.275659070101e-28 ||r(i)||/||b|| 1.955024040679e-30<br class=""> 24 SNES Function norm 2.617973287453e+02 <br class=""> 0 KSP preconditioned resid norm 1.781133707863e+02 true resid norm 2.617973287453e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 7.624863846438e-29 true resid norm 1.041367251217e-27 ||r(i)||/||b|| 3.977761179642e-30<br class=""> 25 SNES Function norm 2.600135095660e+02 <br class=""> 0 KSP preconditioned resid norm 1.377746106386e+02 true resid norm 2.600135095660e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.148291819547e-28 true resid norm 1.521069513901e-27 ||r(i)||/||b|| 5.849963397822e-30<br class=""> 26 SNES Function norm 2.584547548464e+02 <br class=""> 0 KSP preconditioned resid norm 1.778914250872e+02 true resid norm 2.584547548464e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.300336366195e-28 true resid norm 2.069166109298e-27 ||r(i)||/||b|| 8.005912332807e-30<br class=""> 27 SNES Function norm 2.570427136855e+02 <br class=""> 0 KSP preconditioned resid norm 9.377626460831e+01 true resid norm 2.570427136855e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 5.766637486688e-29 true resid norm 5.436682842489e-28 ||r(i)||/||b|| 2.115089264557e-30<br class=""> 28 SNES Function norm 2.553675835085e+02 <br class=""> 0 KSP preconditioned resid norm 3.196813637571e+02 true resid norm 2.553675835085e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 5.412882946976e-28 true resid norm 4.755028260087e-26 ||r(i)||/||b|| 1.862032837041e-28<br class=""> 29 SNES Function norm 2.543107878046e+02 <br class=""> 0 KSP preconditioned resid norm 3.373192219793e+02 true resid norm 2.543107878046e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.620724126195e-29 true resid norm 2.234654091065e-27 ||r(i)||/||b|| 8.787099085950e-30<br class=""> 30 SNES Function norm 2.539436050245e+02 <br class=""> 0 KSP preconditioned resid norm 3.351117240495e+02 true resid norm 2.539436050245e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.229207196291e-29 true resid norm 3.225569644851e-27 ||r(i)||/||b|| 1.270191326354e-29<br class=""> 31 SNES Function norm 2.536651625665e+02 <br class=""> 0 KSP preconditioned resid norm 3.687817755461e+02 true resid norm 2.536651625665e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.233376086959e-29 true resid norm 2.522505835235e-27 ||r(i)||/||b|| 9.944234398264e-30<br class=""> 32 SNES Function norm 2.536237446853e+02 <br class=""> 0 KSP preconditioned resid norm 6.074223711615e+02 true resid norm 2.536237446853e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.047078682230e-28 true resid norm 5.038976546196e-27 ||r(i)||/||b|| 1.986792109094e-29<br class=""> 33 SNES Function norm 2.535658772687e+02 <br class=""> 0 KSP preconditioned resid norm 8.774992658126e+02 true resid norm 2.535658772687e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.036350427238e-28 true resid norm 4.058678859635e-27 ||r(i)||/||b|| 1.600640789428e-29<br class=""> 34 SNES Function norm 2.535415069989e+02 <br class=""> 0 KSP preconditioned resid norm 1.619728779960e+03 true resid norm 2.535415069989e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.173925947581e-28 true resid norm 1.460901190689e-26 ||r(i)||/||b|| 5.761980387282e-29<br class=""> 35 SNES Function norm 2.535362549500e+02 <br class=""> 0 KSP preconditioned resid norm 4.120252504215e+03 true resid norm 2.535362549500e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.482004320762e-27 true resid norm 2.515988923022e-26 ||r(i)||/||b|| 9.923586366447e-29<br class=""> 36 SNES Function norm 2.535350372131e+02 <br class=""> 0 KSP preconditioned resid norm 7.065615798134e+03 true resid norm 2.535350372131e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.267231805260e-27 true resid norm 9.127341716497e-26 ||r(i)||/||b|| 3.600031702452e-28<br class=""> 37 SNES Function norm 2.535346214155e+02 <br class=""> 0 KSP preconditioned resid norm 1.200630987401e+04 true resid norm 2.535346214155e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 6.331744826877e-27 true resid norm 3.434648364475e-25 ||r(i)||/||b|| 1.354705856462e-27<br class=""> 38 SNES Function norm 2.535344771151e+02 <br class=""> 0 KSP preconditioned resid norm 2.045653956385e+04 true resid norm 2.535344771151e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.729474459326e-27 true resid norm 4.809771115033e-25 ||r(i)||/||b|| 1.897087595250e-27<br class=""> 39 SNES Function norm 2.535344273428e+02 <br class=""> 0 KSP preconditioned resid norm 3.496422852684e+04 true resid norm 2.535344273428e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.413460430546e-26 true resid norm 2.800309113539e-25 ||r(i)||/||b|| 1.104508426287e-27<br class=""> 40 SNES Function norm 2.535344102918e+02 <br class=""> 0 KSP preconditioned resid norm 5.986286390122e+04 true resid norm 2.535344102918e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.071099626460e-25 true resid norm 2.269549087060e-24 ||r(i)||/||b|| 8.951641256299e-27<br class=""> 41 SNES Function norm 2.535344046223e+02 <br class=""> 0 KSP preconditioned resid norm 1.158888344932e+05 true resid norm 2.535344046223e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 9.362165764120e-26 true resid norm 5.723929359721e-24 ||r(i)||/||b|| 2.257653894448e-26<br class=""> 42 SNES Function norm 2.535344044297e+02 <br class=""> 0 KSP preconditioned resid norm 6.015343562155e+05 true resid norm 2.535344044297e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.045273774078e-24 true resid norm 5.965631634103e-23 ||r(i)||/||b|| 2.352987022618e-25<br class=""> 43 SNES Function norm 2.535344043720e+02 <br class=""> 0 KSP preconditioned resid norm 1.032398569969e+06 true resid norm 2.535344043720e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 6.133229797301e-24 true resid norm 2.132052198244e-22 ||r(i)||/||b|| 8.409321028933e-25<br class=""> 44 SNES Function norm 2.535344043525e+02 <br class=""> 0 KSP preconditioned resid norm 1.771990642532e+06 true resid norm 2.535344043525e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.399736530559e-23 true resid norm 2.816123472957e-22 ||r(i)||/||b|| 1.110746085980e-24<br class=""> 45 SNES Function norm 2.535344043458e+02 <br class=""> 0 KSP preconditioned resid norm 3.041524303674e+06 true resid norm 2.535344043458e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 6.700523240131e-24 true resid norm 1.214940402127e-21 ||r(i)||/||b|| 4.792013948806e-24<br class=""> 46 SNES Function norm 2.535344043436e+02 <br class=""> 0 KSP preconditioned resid norm 5.220719804889e+06 true resid norm 2.535344043436e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 7.749472721038e-24 true resid norm 9.462448677416e-22 ||r(i)||/||b|| 3.732214845522e-24<br class=""> 47 SNES Function norm 2.535344043428e+02 <br class=""> 0 KSP preconditioned resid norm 8.961379294572e+06 true resid norm 2.535344043428e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.735576070962e-23 true resid norm 3.261102152175e-21 ||r(i)||/||b|| 1.286256261997e-23<br class=""> 48 SNES Function norm 2.535344043425e+02 <br class=""> 0 KSP preconditioned resid norm 1.538234198056e+07 true resid norm 2.535344043425e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 5.924165850746e-23 true resid norm 3.890747245316e-21 ||r(i)||/||b|| 1.534603264360e-23<br class=""> 49 SNES Function norm 2.535344043424e+02 <br class=""> 0 KSP preconditioned resid norm 2.640413180607e+07 true resid norm 2.535344043424e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.163013019454e-23 true resid norm 5.034396892612e-21 ||r(i)||/||b|| 1.985685889719e-23<br class="">Nonlinear solve did not converge due to DIVERGED_LINE_SEARCH iterations 49<br class="">-gideon<br class=""><br class=""><blockquote type="cite" class="">On Sep 9, 2015, at 3:15 PM, Barry Smith <<a href="mailto:bsmith@mcs.anl.gov" class="">bsmith@mcs.anl.gov</a>> wrote:<br class=""><br class=""><br class=""> Thanks. I think you should try running this with __float128 (quad precision) to see what happens.<br class=""><br class=""> Do you have access to a relatively recent (last couple of years) gcc (and gfortran) compiler?<br class=""><br class=""> Select a new PETSC_ARCH name say arch-quad<br class=""><br class=""> and run configure with the additional option -with-precision=__float128 <br class=""><br class=""> not use --download-mumps or other such packages since they don't work with __float128. If you get everything build then run<br class="">with the same options except do not use pc_factor_mat_solver_package mumps just use the default PETSc solver LU<br class=""><br class=""> Note that if your program is reading in binary files this will be slightly tricky since you will need to convert the result to __float128 format. If you use PETSc VecLoad() or PetscBinaryRead() etc you can just use the flag -binary_read_double and will read from a double binary file and automatically put the results into the PETSc __float128 matrices.<br class=""><br class="">Interpreting results. You may get convergence which might likely indicate the scaling and conditioning of your problem are very nasty but can be overcome with more precision or you may get the same lack of convergence you get now and I don't have a good explanation for that :-)<br class=""><br class=""> Note: it could also be that your SNES function evaluation has a problem.<br class=""><br class=""><br class=""><br class=""> Barry<br class=""><br class=""><blockquote type="cite" class="">On Sep 9, 2015, at 1:48 PM, Gideon Simpson <<a href="mailto:gideon.simpson@gmail.com" class="">gideon.simpson@gmail.com</a>> wrote:<br class=""><br class="">So here’s one grid sequence with these solver flags:<br class="">-snes_max_it 100 -snes_converged_reason -snes_monitor \<br class="">-pc_type lu \<br class="">-pc_factor_mat_solver_package mumps -mat_mumps_icntl_28 1 -mat_mumps_icntl_7 6 \<br class="">-snes_max_funcs 500000 -snes_fd -snes_monitor -ksp_monitor_true_residual<br class=""><br class="">By the way, the problem, I believe is approaching something that is singular, so it is not unreasonable to think there is some kind of inherent ill conditioning in the problem.<br class=""><br class=""> 0 SNES Function norm 2.977789375068e-12 <br class=""> 0 KSP preconditioned resid norm 9.487609584353e-12 true resid norm 2.977789375068e-12 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.713064216887e-24 true resid norm 9.247299640119e-23 ||r(i)||/||b|| 3.105424351885e-11<br class=""> 1 SNES Function norm 2.511921299174e-12 <br class=""> Nonlinear solve converged due to CONVERGED_SNORM_RELATIVE iterations 1<br class=""> 0 SNES Function norm 5.066222213175e+03 <br class=""> 0 KSP preconditioned resid norm 3.135073899423e+01 true resid norm 5.066222213175e+03 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 4.667575811795e-11 true resid norm 2.582648659172e-07 ||r(i)||/||b|| 5.097780062738e-11<br class=""> 1 SNES Function norm 8.484664416715e+02 <br class=""> 0 KSP preconditioned resid norm 2.668033649331e+02 true resid norm 8.484664416715e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.096350794450e-10 true resid norm 1.126402252137e-08 ||r(i)||/||b|| 1.327574311505e-11<br class=""> 2 SNES Function norm 6.549557200006e+02 <br class=""> 0 KSP preconditioned resid norm 1.552337314505e+02 true resid norm 6.549557200006e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.781790941843e-09 true resid norm 5.596253874028e-08 ||r(i)||/||b|| 8.544476677024e-11<br class=""> 3 SNES Function norm 5.770704424482e+02 <br class=""> 0 KSP preconditioned resid norm 1.348464485234e+02 true resid norm 5.770704424482e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.909040505447e-10 true resid norm 6.992127254821e-09 ||r(i)||/||b|| 1.211659225719e-11<br class=""> 4 SNES Function norm 5.237674957045e+02 <br class=""> 0 KSP preconditioned resid norm 1.524393824592e+02 true resid norm 5.237674957045e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.664845931493e-10 true resid norm 5.713325641481e-09 ||r(i)||/||b|| 1.090813326206e-11<br class=""> 5 SNES Function norm 4.753878819749e+02 <br class=""> 0 KSP preconditioned resid norm 1.864281909532e+02 true resid norm 4.753878819749e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.409973828386e-10 true resid norm 4.289369979836e-09 ||r(i)||/||b|| 9.022884559061e-12<br class=""> 6 SNES Function norm 4.221755368773e+02 <br class=""> 0 KSP preconditioned resid norm 2.551073925659e+02 true resid norm 4.221755368773e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 5.540011959843e-10 true resid norm 1.441047729187e-08 ||r(i)||/||b|| 3.413385199545e-11<br class=""> 7 SNES Function norm 3.806522663388e+02 <br class=""> 0 KSP preconditioned resid norm 5.183358055470e+02 true resid norm 3.806522663388e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.063740790885e-09 true resid norm 3.530342872323e-08 ||r(i)||/||b|| 9.274456464634e-11<br class=""> 8 SNES Function norm 3.762033603907e+02 <br class=""> 0 KSP preconditioned resid norm 5.324397409227e+03 true resid norm 3.762033603907e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 6.352530213970e-09 true resid norm 9.590500220593e-08 ||r(i)||/||b|| 2.549286165502e-10<br class=""> 9 SNES Function norm 3.758953286234e+02 <br class=""> 0 KSP preconditioned resid norm 6.246847657999e+03 true resid norm 3.758953286234e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 5.367419000872e-08 true resid norm 8.213904234688e-07 ||r(i)||/||b|| 2.185157305564e-09<br class="">10 SNES Function norm 3.756870388529e+02 <br class=""> 0 KSP preconditioned resid norm 5.901626862375e+02 true resid norm 3.756870388529e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.330043229228e-09 true resid norm 1.418363475093e-08 ||r(i)||/||b|| 3.775385702481e-11<br class="">11 SNES Function norm 3.728715884883e+02 <br class=""> 0 KSP preconditioned resid norm 1.069749399855e+03 true resid norm 3.728715884883e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.911440821785e-10 true resid norm 9.552819316154e-09 ||r(i)||/||b|| 2.561959562241e-11<br class="">12 SNES Function norm 3.722328158041e+02 <br class=""> 0 KSP preconditioned resid norm 3.064673278570e+03 true resid norm 3.722328158041e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.105090853307e-08 true resid norm 1.085271466536e-07 ||r(i)||/||b|| 2.915571707969e-10<br class="">13 SNES Function norm 3.720989356426e+02 <br class=""> 0 KSP preconditioned resid norm 9.068377570178e+03 true resid norm 3.720989356426e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.784084466576e-08 true resid norm 3.777243066339e-07 ||r(i)||/||b|| 1.015117944322e-09<br class="">14 SNES Function norm 3.720707403757e+02 <br class=""> 0 KSP preconditioned resid norm 7.198056009453e+04 true resid norm 3.720707403757e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 7.120525808630e-08 true resid norm 1.054867000686e-06 ||r(i)||/||b|| 2.835124846476e-09<br class="">15 SNES Function norm 3.720707293983e+02 <br class=""> 0 KSP preconditioned resid norm 4.134314655599e+03 true resid norm 3.720707293983e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.003141582850e-08 true resid norm 2.046203596859e-07 ||r(i)||/||b|| 5.499501667784e-10<br class="">16 SNES Function norm 3.719027845818e+02 <br class=""> 0 KSP preconditioned resid norm 2.545115269075e+03 true resid norm 3.719027845818e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 4.965948884734e-08 true resid norm 5.071610656715e-07 ||r(i)||/||b|| 1.363692574235e-09<br class="">17 SNES Function norm 3.714400762925e+02 <br class=""> 0 KSP preconditioned resid norm 1.109601826815e+03 true resid norm 3.714400762925e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 6.169052076803e-09 true resid norm 6.563603648295e-08 ||r(i)||/||b|| 1.767069324832e-10<br class="">18 SNES Function norm 3.701626928766e+02 <br class=""> 0 KSP preconditioned resid norm 2.447547395077e+02 true resid norm 3.701626928766e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.250579098159e-09 true resid norm 1.218652092692e-08 ||r(i)||/||b|| 3.292206686799e-11<br class="">19 SNES Function norm 3.556442798407e+02 <br class=""> 0 KSP preconditioned resid norm 1.418496111605e+02 true resid norm 3.556442798407e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.627252384359e-10 true resid norm 1.951334080585e-09 ||r(i)||/||b|| 5.486757952241e-12<br class="">20 SNES Function norm 3.496125058841e+02 <br class=""> 0 KSP preconditioned resid norm 6.543042326746e+01 true resid norm 3.496125058841e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.377371559702e-10 true resid norm 1.295256556885e-09 ||r(i)||/||b|| 3.704834738706e-12<br class="">21 SNES Function norm 3.146776071310e+02 <br class=""> 0 KSP preconditioned resid norm 4.667517635820e+01 true resid norm 3.146776071310e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.743789267634e-09 true resid norm 1.644758285998e-08 ||r(i)||/||b|| 5.226804350630e-11<br class="">22 SNES Function norm 2.855422195269e+02 <br class=""> 0 KSP preconditioned resid norm 2.243742065865e+02 true resid norm 2.855422195269e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.047816533727e-10 true resid norm 2.299887594213e-09 ||r(i)||/||b|| 8.054457228859e-12<br class="">23 SNES Function norm 2.806777486780e+02 <br class=""> 0 KSP preconditioned resid norm 1.561899503179e+03 true resid norm 2.806777486780e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.972680147986e-09 true resid norm 7.239772649903e-08 ||r(i)||/||b|| 2.579389596790e-10<br class="">24 SNES Function norm 2.805893466480e+02 <br class=""> 0 KSP preconditioned resid norm 1.722111652119e+03 true resid norm 2.805893466480e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 5.170553469009e-09 true resid norm 6.273773919075e-08 ||r(i)||/||b|| 2.235927341513e-10<br class="">25 SNES Function norm 2.805171735939e+02 <br class=""> 0 KSP preconditioned resid norm 8.024869901472e+03 true resid norm 2.805171735939e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.741187759948e-08 true resid norm 3.211723859501e-07 ||r(i)||/||b|| 1.144929495173e-09<br class="">26 SNES Function norm 2.805136061483e+02 <br class=""> 0 KSP preconditioned resid norm 3.239737262200e+04 true resid norm 2.805136061483e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 2.317708795749e-08 true resid norm 3.672739850558e-07 ||r(i)||/||b|| 1.309291160949e-09<br class="">27 SNES Function norm 2.805134008969e+02 <br class=""> 0 KSP preconditioned resid norm 6.920567009699e+04 true resid norm 2.805134008969e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.101785240910e-07 true resid norm 1.523556762078e-06 ||r(i)||/||b|| 5.431315428092e-09<br class="">28 SNES Function norm 2.805133530790e+02 <br class=""> 0 KSP preconditioned resid norm 3.265182256725e+05 true resid norm 2.805133530790e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.903754744633e-07 true resid norm 6.654431764515e-06 ||r(i)||/||b|| 2.372233510980e-08<br class="">29 SNES Function norm 2.805133509342e+02 <br class=""> 0 KSP preconditioned resid norm 1.312587966212e+06 true resid norm 2.805133509342e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 1.990958223875e-07 true resid norm 1.311133369898e-05 ||r(i)||/||b|| 4.674049793106e-08<br class="">30 SNES Function norm 2.805133508006e+02 <br class=""> 0 KSP preconditioned resid norm 2.049236485623e+07 true resid norm 2.805133508006e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 3.432837714993e-05 true resid norm 4.348842776781e-04 ||r(i)||/||b|| 1.550315792232e-06<br class="">31 SNES Function norm 2.805133508001e+02 <br class=""> 0 KSP preconditioned resid norm 7.694877106483e+06 true resid norm 2.805133508001e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 4.401952388358e-06 true resid norm 1.008598135500e-04 ||r(i)||/||b|| 3.595544142990e-07<br class="">32 SNES Function norm 2.805133507963e+02 <br class=""> 0 KSP preconditioned resid norm 1.116553807875e+08 true resid norm 2.805133507963e+02 ||r(i)||/||b|| 1.000000000000e+00<br class=""> 1 KSP preconditioned resid norm 7.718443445086e-06 true resid norm 1.327187421086e-03 ||r(i)||/||b|| 4.731280765492e-06<br class="">Nonlinear solve did not converge due to DIVERGED_LINE_SEARCH iterations 32<br class=""><br class="">-gideon<br class=""><br class=""><blockquote type="cite" class="">On Sep 9, 2015, at 1:52 PM, Barry Smith <<a href="mailto:bsmith@mcs.anl.gov" class="">bsmith@mcs.anl.gov</a>> wrote:<br class=""><br class=""><br class="">Please run with the -snes_fd and one level of grid sequencing (where Newton was having trouble converging on the second level) with -snes_monitor -ksp_monitor_true_residual and send the output. Too much speculation and not enough data.<br class=""><br class=""></blockquote><br class=""></blockquote><br class=""></blockquote><br class=""></blockquote><br class=""></div></blockquote></div><br class=""></div></body></html>