<div class="gmail_quote">On Thu, Nov 10, 2011 at 10:25, Konstantinos Kontzialis <span dir="ltr"><<a href="mailto:ckontzialis@lycos.com">ckontzialis@lycos.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div id=":oa">mpiexec -n 8 ./hoac cylinder -snes_mf_operator -llf_flux -n_out 2 -end_time 0.4 -implicit -pc_type asm -sub_pc_type ilu -sub_pc_factor_mat_ordering_<u></u>type rcm -sub_pc_factor_reuse_ordering -sub_pc_factor_reuse_fill -gll -ksp_type fgmres -sub_pc_factor_levels 0 -snes_monitor -snes_converged_reason -ksp_converged_reason -ts_view -ksp_pc_side right -sub_pc_factor_nonzeros_along_<u></u>diagonal -dt 1.0e-3 -ts_type arkimex -ksp_gmres_restart 100 -ksp_max_it 500 -snes_max_fail 100 -snes_max_linear_solve_fail 100<br>
<br><br></div></blockquote><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><div id=":oa">
Approximation order = 2<br>
# DOF = 115200<br>
# nodes in mesh = 1680<br>
# elements in mesh = 1600<br>
Navier-Stokes solution<br>
Using LLF flux<br></div></blockquote><div><br></div><div>Are you using a limiter?</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;"><div id=":oa">
<br>
<br>
Linear solve converged due to CONVERGED_RTOL iterations 1<br>
<br>
<br>
Timestep 0: dt = 0.001, T = 0, Res[rho] = 0.966549, Res[rhou] = 6.11366, Res[rhov] = 0.507325, Res[E] = 2.44463, CFL = 0.942045<br>
0 SNES Function norm 3.203604511352e+03<br>
Linear solve did not converge due to DIVERGED_ITS iterations 500<br>
1 SNES Function norm 3.440800722147e+02<br>
Linear solve did not converge due to DIVERGED_ITS iterations 500<br>
2 SNES Function norm 2.008355246473e+02<br>
Linear solve did not converge due to DIVERGED_ITS iterations 500<br>
3 SNES Function norm 1.177925999321e+02<br>
<br>
as you may see the step size is quite small for this problem and I use and inexact solution for the linear part of the newton iterations. Furthermore, I compute numerically the jacobian of the matrix using coloring.</div>
</blockquote></div><br><div>No need for -snes_mf_operator if you use coloring. What functions did you use for coloring? See if "-mat_fd_type ds" affects the results (good or bad).</div><div><br></div><div>How are you ordering degrees of freedom? I would not rely on RCM with AIJ to coalesce all blocks so they can be solved together.</div>
<div><br></div><div>I would try -sub_pc_type lu to see if it's the ILU or something else that is responsible for the lack of convergence.</div><div><br></div><div>What units are you using for state variables and residuals? It is important to choose units so that the system is well-scaled when using implicit methods.</div>
<div><br></div><div>How did you implement boundary conditions?</div><div><br></div><div>Is your system written in conservative or primitive variables? You can do a "low-Mach" preconditioner using PCFieldSplit if the system is in primitve variables. For conservative variables, the preconditioner needs a change of variables and we don't have an interface to do it automatically, so you have to use PCShell. While this might eventually be more efficient than ASM, you should be able to make ASM work adequately.</div>