<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class="">Thanks, Matt. </div><div class=""><br class=""></div><div class="">Following is the output with: <span style="background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class="">-ksp_monitor_lg_residualnorm -ksp_log -ksp_view -ksp_monitor_true_residual -ksp_converged_reason</span></div><div class=""><br class=""></div><div class=""><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> 0 KSP preconditioned resid norm inf true resid norm 2.709083260443e+06 ||r(i)||/||b|| 1.000000000000e+00</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class="">Linear solve did not converge due to DIVERGED_NANORINF iterations 0</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class="">KSP Object: 12 MPI processes</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> type: gmres</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> GMRES: restart=30, using Classical (unmodified) Gram-Schmidt Orthogonalization with no iterative refinement</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> GMRES: happy breakdown tolerance 1e-30</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> maximum iterations=1000</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> tolerances: relative=1e-10, absolute=1e-50, divergence=10000</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> left preconditioning</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> using nonzero initial guess</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> using PRECONDITIONED norm type for convergence test</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class="">PC Object: 12 MPI processes</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> type: bjacobi</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> block Jacobi: number of blocks = 12</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> Local solve is same for all blocks, in the following KSP and PC objects:</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> KSP Object: (sub_) 1 MPI processes</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> type: preonly</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> maximum iterations=10000, initial guess is zero</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> tolerances: relative=1e-05, absolute=1e-50, divergence=10000</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> left preconditioning</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> using NONE norm type for convergence test</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> PC Object: (sub_) 1 MPI processes</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> type: ilu</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> ILU: out-of-place factorization</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> 0 levels of fill</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> tolerance for zero pivot 2.22045e-14</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> using diagonal shift on blocks to prevent zero pivot [INBLOCKS]</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> matrix ordering: natural</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> factor fill ratio given 1, needed 1</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> Factored matrix follows:</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> Mat Object: 1 MPI processes</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> type: seqaij</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> rows=667070, cols=667070</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> package used to perform factorization: petsc</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> total: nonzeros=4.6765e+07, allocated nonzeros=4.6765e+07</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> total number of mallocs used during MatSetValues calls =0</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> using I-node routines: found 133414 nodes, limit used is 5</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> linear system matrix = precond matrix:</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> Mat Object: () 1 MPI processes</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> type: seqaij</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> rows=667070, cols=667070</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> total: nonzeros=4.6765e+07, allocated nonzeros=5.473e+07</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> total number of mallocs used during MatSetValues calls =0</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> using I-node routines: found 133414 nodes, limit used is 5</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> linear system matrix = precond matrix:</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> Mat Object: () 12 MPI processes</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> type: mpiaij</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> rows=6723030, cols=6723030</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> total: nonzeros=4.98852e+08, allocated nonzeros=5.38983e+08</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> total number of mallocs used during MatSetValues calls =0</div><div style="margin: 0px; background-color: rgb(0, 0, 0); color: rgb(245, 245, 245);" class=""> using I-node (on process 0) routines: found 133414 nodes, limit used is 5</div></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""> Anything jumps out at you as odd? </div><div class=""><br class=""></div><div class="">-Manav</div><div class=""><br class=""></div><div class=""><br class=""></div><br class=""><div><blockquote type="cite" class=""><div class="">On Mar 26, 2015, at 9:34 AM, Matthew Knepley <<a href="mailto:knepley@gmail.com" class="">knepley@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><div class="gmail_extra"><div class="gmail_quote">On Thu, Mar 26, 2015 at 9:21 AM, Manav Bhatia <span dir="ltr" class=""><<a href="mailto:bhatiamanav@gmail.com" target="_blank" class="">bhatiamanav@gmail.com</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi,<br class="">
<br class="">
I am using the KSP linear solver for my system of equations, without any command line options at this point. I have checked that the L1 norms of my system matrix and the force vector are finite values, but the KSP solver is returning with an “inf” residual in the very first iteration.<br class="">
<br class="">
The problem has 6.7M dofs and I have tried this on multiple machines with different number of nodes with the same result.<br class="">
<br class="">
Is there a reason why the solver would return after the first iteration with an inf?<br class="">
<br class="">
I am not sure on where to start debugging this case, so I would appreciate any pointers.<br class=""></blockquote><div class=""><br class=""></div><div class="">For all solver questions, we want to see the output of</div><div class=""><br class=""></div><div class=""> -ksp_view -ksp_monitor_true_residual -ksp_converged_reason</div><div class=""><br class=""></div><div class="">The problem here would be that there is an error, so we would never see the output</div><div class="">of -ksp_view and know what solver you are using. If you are using something complex,</div><div class="">can you try using</div><div class=""><br class=""></div><div class=""> -pc_type jacobi</div><div class=""><br class=""></div><div class="">and send the output from the options above? Then we can figure out why the other solver</div><div class="">gets an inf.</div><div class=""><br class=""></div><div class=""> Thanks,</div><div class=""><br class=""></div><div class=""> Matt</div><div class=""> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Thanks,<br class="">
Manav<br class="">
<br class="">
<br class="">
</blockquote></div><br class=""><br clear="all" class=""><div class=""><br class=""></div>-- <br class=""><div class="gmail_signature">What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br class="">-- Norbert Wiener</div>
</div></div>
</div></blockquote></div><br class=""></body></html>