<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Mark<div class=""><br class=""></div><div class="">I have fixed few things in the solver and it is tested with the current master.</div><div class="">Can you write a MWE to reproduce the issue? Which version of CUDA and CUSPARSE are you using?</div><div class="">I was planning to reorganize the factor code in AIJCUSPARSE in the next days.</div><div class=""><br class=""></div><div class=""><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures;" class=""><font size="1" class="">kl-18967:petsc zampins$ git grep "solver_type cusparse"</font></span></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tests/ex43.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -f ${DATAFILESPATH}/matrices/cfd.2.10 -mat_type seqaijcusparse -pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -mat_cusparse_storage_format ell -vec_type cuda -pc_type ilu</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tests/ex43.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -f ${DATAFILESPATH}/matrices/shallow_water1 -mat_type seqaijcusparse -pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -mat_cusparse_storage_format hyb -vec_type cuda -ksp_type cg -pc_type icc</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tests/ex43.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -f ${DATAFILESPATH}/matrices/cfd.2.10 -mat_type seqaijcusparse -pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -mat_cusparse_storage_format csr -vec_type cuda -ksp_type bicg -pc_type ilu</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tests/ex43.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -f ${DATAFILESPATH}/matrices/cfd.2.10 -mat_type seqaijcusparse -pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -mat_cusparse_storage_format csr -vec_type cuda -ksp_type bicg -pc_type ilu -pc_factor_mat_ordering_type nd</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tutorials/ex46.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -dm_mat_type aijcusparse -dm_vec_type cuda -random_exact_sol -pc_type ilu -pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tutorials/ex59.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -subdomain_mat_type aijcusparse -physical_pc_bddc_dirichlet_pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tutorials/ex7.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -ksp_monitor_short -mat_type aijcusparse -sub_pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -vec_type cuda -sub_ksp_type preonly -sub_pc_type ilu</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tutorials/ex7.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -ksp_monitor_short -mat_type aijcusparse -sub_pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -vec_type cuda -sub_ksp_type preonly -sub_pc_type ilu</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tutorials/ex7.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -ksp_monitor_short -mat_type aijcusparse -sub_pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -vec_type cuda</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tutorials/ex7.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -ksp_monitor_short -mat_type aijcusparse -sub_pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -vec_type cuda</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tutorials/ex71.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -pde_type Poisson -cells 7,9,8 -dim 3 -ksp_view -pc_bddc_coarse_redundant_pc_type svd -ksp_error_if_not_converged -pc_bddc_dirichlet_pc_type cholesky -pc_bddc_dirichlet_pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -pc_bddc_dirichlet_pc_factor_mat_ordering_type nd -pc_bddc_neumann_pc_type cholesky -pc_bddc_neumann_pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -pc_bddc_neumann_pc_factor_mat_ordering_type nd -matis_localmat_type aijcusparse</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">src/ksp/ksp/examples/tutorials/ex72.c</span><span style="font-variant-ligatures: no-common-ligatures; color: #2eaebb" class="">:</span><span style="font-variant-ligatures: no-common-ligatures" class=""> args: -f0 ${DATAFILESPATH}/matrices/medium -ksp_monitor_short -ksp_view -mat_view ascii::ascii_info -mat_type aijcusparse -pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: #b42419" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures" class=""> -pc_type ilu -vec_type cuda</span></font></div><div style="margin: 0px; font-stretch: normal; line-height: normal; font-family: Menlo;" class=""><font size="1" class=""><span style="font-variant-ligatures: no-common-ligatures;" class="">src/snes/examples/tutorials/ex12.c</span><span style="font-variant-ligatures: no-common-ligatures; color: rgb(46, 174, 187);" class="">:</span><span style="font-variant-ligatures: no-common-ligatures;" class=""> args: -matis_localmat_type aijcusparse -pc_bddc_dirichlet_pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: rgb(180, 36, 25);" class=""><b class="">solver_type cusparse</b></span><span style="font-variant-ligatures: no-common-ligatures;" class=""> -pc_bddc_neumann_pc_factor_mat_</span><span style="font-variant-ligatures: no-common-ligatures; color: rgb(180, 36, 25);" class=""><b class="">solver_type cusparse</b></span></font></div><div><br class=""><blockquote type="cite" class=""><div class="">On Apr 15, 2020, at 2:20 PM, Mark Adams <<a href="mailto:mfadams@lbl.gov" class="">mfadams@lbl.gov</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">I tried using a serial direct solver in cusparse and got bad numerics:<div class=""><br class=""></div><div class="">-vector_type cuda -mat_type aijcusparse -pc_factor_mat_solver_type cusparse <br class=""></div><div class=""><br class=""></div><div class="">Before I start debugging this I wanted to see if there are any known issues that I should be aware of.</div><div class=""><br class=""></div><div class="">Thanks,</div></div>
</div></blockquote></div><br class=""></div></body></html>