<div dir="ltr"><div><br></div><div><br></div><div>Note that if you have a call to TSSetFromOptions() in your code (again, see TS ex19 in src/ts/tutorials/ex19.c) then you can supply command line options and see a lot of information about the timestepper. If you run the example with the -help argument you'll get a big list of options which may apply. Here's an example with ex19 which sets a small initial timestep and then lets TSBDF adapt:</div><div><br></div><div>$ ./ex19 -ts_view -ts_monitor -ts_type bdf -ts_initial_timestep 0.0001 -ts_dt 1e-8 </div><div>0 TS dt 1e-08 time 0.<br>1 TS dt 2e-08 time 1e-08<br>2 TS dt 4e-08 time 3e-08<br>3 TS dt 8e-08 time 7e-08<br>4 TS dt 1.6e-07 time 1.5e-07<br>5 TS dt 3.2e-07 time 3.1e-07<br>6 TS dt 6.4e-07 time 6.3e-07<br>7 TS dt 1.28e-06 time 1.27e-06<br>8 TS dt 2.56e-06 time 2.55e-06<br>9 TS dt 5.12e-06 time 5.11e-06<br>10 TS dt 1.024e-05 time 1.023e-05<br>11 TS dt 2.048e-05 time 2.047e-05<br>12 TS dt 4.096e-05 time 4.095e-05<br>13 TS dt 8.192e-05 time 8.191e-05<br>14 TS dt 0.00016384 time 0.00016383<br>15 TS dt 0.00032768 time 0.00032767<br>16 TS dt 0.00065536 time 0.00065535<br>17 TS dt 0.00131072 time 0.00131071<br>18 TS dt 0.00262144 time 0.00262143<br>19 TS dt 0.00524288 time 0.00524287<br>20 TS dt 0.0104858 time 0.0104858<br>21 TS dt 0.0209715 time 0.0209715<br>22 TS dt 0.041943 time 0.041943<br>23 TS dt 0.0838861 time 0.0838861<br>24 TS dt 0.167772 time 0.167772<br>25 TS dt 0.177781 time 0.335544<br>26 TS dt 0.14402 time 0.482242<br>27 TS dt 0.130984 time 0.626262<br>TS Object: 1 MPI processes<br> type: bdf<br> Order=2<br> maximum time=0.5<br> total number of I function evaluations=120<br> total number of I Jacobian evaluations=91<br> total number of nonlinear solver iterations=91<br> total number of linear solver iterations=91<br> total number of nonlinear solve failures=0<br> total number of rejected steps=1<br> using relative error tolerance of 0.0001, using absolute error tolerance of 0.0001<br> TSAdapt Object: 1 MPI processes<br> type: basic<br> safety factor 0.9<br> extra safety factor after step rejection 0.5<br> clip fastest increase 2.<br> clip fastest decrease 0.1<br> maximum allowed timestep 1e+20<br> minimum allowed timestep 1e-20<br> maximum solution absolute value to be ignored -1.<br> SNES Object: 1 MPI processes<br> type: newtonls<br> maximum iterations=50, maximum function evaluations=10000<br> tolerances: relative=1e-08, absolute=1e-50, solution=1e-08<br> total number of linear solver iterations=13<br> total number of function evaluations=14<br> norm schedule ALWAYS<br> SNESLineSearch Object: 1 MPI processes<br> type: bt<br> interpolation: cubic<br> alpha=1.000000e-04<br> maxstep=1.000000e+08, minlambda=1.000000e-12<br> tolerances: relative=1.000000e-08, absolute=1.000000e-15, lambda=1.000000e-08<br> maximum iterations=40<br> KSP Object: 1 MPI processes<br> type: gmres<br> restart=30, using Classical (unmodified) Gram-Schmidt Orthogonalization with no iterative refinement<br> happy breakdown tolerance 1e-30<br> maximum iterations=10000, initial guess is zero<br> tolerances: relative=1e-05, absolute=1e-50, divergence=10000.<br> left preconditioning<br> using PRECONDITIONED norm type for convergence test<br> PC Object: 1 MPI processes<br> type: ilu<br> out-of-place factorization<br> 0 levels of fill<br> tolerance for zero pivot 2.22045e-14<br> matrix ordering: natural<br> factor fill ratio given 1., needed 1.<br> Factored matrix follows:<br> Mat Object: 1 MPI processes<br> type: seqaij<br> rows=2, cols=2<br> package used to perform factorization: petsc<br> total: nonzeros=4, allocated nonzeros=4<br> using I-node routines: found 1 nodes, limit used is 5<br> linear system matrix = precond matrix:<br> Mat Object: 1 MPI processes<br> type: seqaij<br> rows=2, cols=2<br> total: nonzeros=4, allocated nonzeros=4<br> total number of mallocs used during MatSetValues calls=0<br> using I-node routines: found 1 nodes, limit used is 5<br>steps 27, ftime 0.626262<br>Vec Object: 1 MPI processes<br> type: seq<br>-0.635304<br>-1.98947<br></div><div><br></div><div><br></div><div>As a bit of an aside, we actually just merged an option for TSSUNDIALS into the
main branch which might possibly give extra data here. If you supply
the -ts_sundials_use_dense option, it will perform a dense linear solve
instead of an iterative one. This is of course inefficient in most cases
and only works in serial, but it can be very helpful to eliminate the
possibility that the issue arises from the parameters of the iterative linear solve. </div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Am Mo., 6. Dez. 2021 um 20:30 Uhr schrieb Matthew Knepley <<a href="mailto:knepley@gmail.com">knepley@gmail.com</a>>:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">On Mon, Dec 6, 2021 at 2:04 PM Sanjoy Kumar Mazumder <<a href="mailto:mazumder@purdue.edu" target="_blank">mazumder@purdue.edu</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<div style="color:rgb(33,33,33);background-color:rgb(255,255,255)" dir="auto">
Thank you for your suggestion. I will look into the documentation of ts_type bdf and try implementing the same. However, it seems like there is not much example on TSBDF available. If you can kindly share with me an example on the implementation of TSBDF it
would be helpful.</div></div></blockquote><div><br></div><div>If your problem is defined using IFunction, then it works like any other implicit solver. You can look at any example that uses -ts_type bdf, such as TS ex19.</div><div><br></div><div> Thanks,</div><div><br></div><div> Matt</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>
<div style="color:rgb(33,33,33);background-color:rgb(255,255,255)" dir="auto">
Thank You</div>
<div style="color:rgb(33,33,33);background-color:rgb(255,255,255)" dir="auto">
<br>
</div>
<div style="color:rgb(33,33,33);background-color:rgb(255,255,255)" dir="auto">
Sanjoy</div>
<div id="gmail-m_-2782439687417932788gmail-m_2287636658232067310ms-outlook-mobile-signature" dir="auto">
<div><br>
</div>
Get <a href="https://aka.ms/AAb9ysg" target="_blank">Outlook for Android</a></div>
<hr style="display:inline-block;width:98%">
<div id="gmail-m_-2782439687417932788gmail-m_2287636658232067310divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Matthew Knepley <<a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>><br>
<b>Sent:</b> Monday, December 6, 2021 1:00:49 PM<br>
<b>To:</b> Sanjoy Kumar Mazumder <<a href="mailto:mazumder@purdue.edu" target="_blank">mazumder@purdue.edu</a>><br>
<b>Cc:</b> <a href="mailto:petsc-users@mcs.anl.gov" target="_blank">petsc-users@mcs.anl.gov</a> <<a href="mailto:petsc-users@mcs.anl.gov" target="_blank">petsc-users@mcs.anl.gov</a>><br>
<b>Subject:</b> Re: [petsc-users] CV_CONV_FAILURE with TSSUNDIALS in PETSc</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div dir="ltr">On Mon, Dec 6, 2021 at 12:17 PM Sanjoy Kumar Mazumder <<a href="mailto:mazumder@purdue.edu" target="_blank">mazumder@purdue.edu</a>> wrote:<br>
</div>
<div>
<blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<span style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">Hi all,</span><span style="background-color:rgb(255,255,255);display:inline"></span>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
<br>
</div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
I am trying to solve a set of coupled stiff ODEs in parallel using TSSUNDIALS with SUNDIALS_BDF as 'TSSundialsSetType' in PETSc. I am using a sparse Jacobian matrix of type MATMPIAIJ with no preconditioner. It runs for some time with a very small initial timestep
(~10^-18) and then terminates abruptly with the following error:</div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
<br>
</div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
[CVODE ERROR] CVode<br>
At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
<br>
</div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
<span style="background-color:rgb(255,255,255);display:inline">Is there anything I am missing out or not doing properly? Given below is the complete error that is showing up after the termination.</span></div>
</div>
</div>
</blockquote>
<div><br>
</div>
<div>It is hard to know for us. BDF is implicit, so CVODE has to solve a (non)linear system, and it looks like this is what fails. I would send it to the CVODE team.</div>
<div>Alternatively, you can run with -ts_type bdf and we would have more information to help you with.</div>
<div><br>
</div>
<div> Thanks,</div>
<div><br>
</div>
<div> Matt</div>
<div> </div>
<blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
<span style="background-color:rgb(255,255,255);display:inline">------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------</span></div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
<span style="background-color:rgb(255,255,255);display:inline"><br>
</span></div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
<span style="background-color:rgb(255,255,255);display:inline">[CVODE ERROR] CVode
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div>[5]PETSC ERROR: </div>
<div>[CVODE ERROR] CVode</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div>[7]PETSC ERROR: </div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div>[16]PETSC ERROR: </div>
<div>[CVODE ERROR] CVode</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div><br>
</div>
<div>[CVODE ERROR] CVode</div>
At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.<br>
</span></div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
<br>
</div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
[19]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
<div>[19]PETSC ERROR: Error in external library</div>
<div>[19]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[19]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[19]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[19]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[19]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[19]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[19]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[19]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[19]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[0]PETSC ERROR: Error in external library</div>
<div>[0]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[0]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[0]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[0]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[0]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[0]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[0]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[0]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[0]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[1]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[1]PETSC ERROR: Error in external library</div>
<div>[1]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[1]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[1]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[1]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[1]PETSC ERROR: [2]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[2]PETSC ERROR: Error in external library</div>
<div>[2]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[2]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[2]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[2]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[2]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[2]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[2]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[2]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[2]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[3]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[3]PETSC ERROR: Error in external library</div>
<div>[3]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[3]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[3]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[3]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[3]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[3]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[3]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[3]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[3]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[4]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[4]PETSC ERROR: Error in external library</div>
<div>[4]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[4]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[4]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[4]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[4]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[4]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>--------------------- Error Message --------------------------------------------------------------</div>
<div>[5]PETSC ERROR: Error in external library</div>
<div>[5]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[5]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[5]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[5]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[5]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[5]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[5]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[5]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[5]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>--------------------- Error Message --------------------------------------------------------------</div>
<div>[7]PETSC ERROR: Error in external library</div>
<div>[7]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[7]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[7]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[7]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[7]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[7]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[7]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[7]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[7]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[8]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[8]PETSC ERROR: Error in external library</div>
<div>[8]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[8]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[8]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[8]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[9]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[9]PETSC ERROR: Error in external library</div>
<div>[9]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[9]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[9]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[9]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[9]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[9]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[9]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[9]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[10]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[10]PETSC ERROR: Error in external library</div>
<div>[10]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[10]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[10]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[10]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[10]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[10]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[10]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[10]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[10]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[11]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[11]PETSC ERROR: Error in external library</div>
<div>[11]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[11]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[11]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[11]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[11]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[11]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[11]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[11]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[11]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[12]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[12]PETSC ERROR: Error in external library</div>
<div>[12]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[12]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[12]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[12]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[12]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[12]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[12]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[12]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[12]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[14]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[14]PETSC ERROR: Error in external library</div>
<div>[14]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[14]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[14]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[14]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[14]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[14]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[15]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[15]PETSC ERROR: Error in external library</div>
<div>[15]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[15]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[15]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>--------------------- Error Message --------------------------------------------------------------</div>
<div>[16]PETSC ERROR: Error in external library</div>
<div>[16]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[16]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[16]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[16]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[16]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[16]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[16]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[16]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[16]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[17]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[17]PETSC ERROR: Error in external library</div>
<div>[17]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[17]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[17]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[17]PETSC ERROR: [18]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[18]PETSC ERROR: Error in external library</div>
<div>[18]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[18]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[18]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[18]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[18]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[17]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[17]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[17]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[17]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[17]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[1]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[1]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[1]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[1]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[4]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[4]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[4]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[8]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[8]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[8]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[8]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[8]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[9]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[13]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[13]PETSC ERROR: Error in external library</div>
<div>[13]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[13]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[13]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[13]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[13]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[13]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[13]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[13]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[13]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[14]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[14]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[14]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>[15]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[15]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[15]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[15]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[15]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[15]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[18]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[18]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[18]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[18]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div> At t = 1.83912e-06 and h = 3.74248e-13, the corrector convergence test failed repeatedly or with |h| = hmin.</div>
<div><br>
</div>
<div>[6]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div>[6]PETSC ERROR: Error in external library</div>
<div>[6]PETSC ERROR: CVode() fails, CV_CONV_FAILURE</div>
<div>[6]PETSC ERROR: See <a href="https://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">
https://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.</div>
<div>[6]PETSC ERROR: Petsc Release Version 3.14.5, Mar 03, 2021 </div>
<div>[6]PETSC ERROR: ./ThO2_CD2_P on a arch-linux-c-debug named <a href="http://bell-a027.rcac.purdue.edu" target="_blank">
bell-a027.rcac.purdue.edu</a> by mazumder Mon Dec 6 11:45:05 2021</div>
<div>[6]PETSC ERROR: Configure options --with-cc-mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-fblaslapack --download-sundials=yes --with-debugging</div>
<div>[6]PETSC ERROR: #1 TSStep_Sundials() line 156 in /home/mazumder/petsc-3.14.5/src/ts/impls/implicit/sundials/sundials.c</div>
<div>[6]PETSC ERROR: #2 TSStep() line 3759 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[6]PETSC ERROR: #3 TSSolve() line 4156 in /home/mazumder/petsc-3.14.5/src/ts/interface/ts.c</div>
<div>[6]PETSC ERROR: #4 User provided function() line 0 in User file</div>
<div>--------------------------------------------------------------------------</div>
<div>MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_SELF</div>
<div>with errorcode 76.</div>
<div><br>
</div>
<div>NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.</div>
<div>You may or may not see output from other processes, depending on</div>
<div>exactly when Open MPI kills them.</div>
<div>--------------------------------------------------------------------------</div>
<div>[<a href="http://bell-a027.rcac.purdue.edu:29752" target="_blank">bell-a027.rcac.purdue.edu:29752</a>] 15 more processes have sent help message help-mpi-api.txt / mpi-abort</div>
[<a href="http://bell-a027.rcac.purdue.edu:29752" target="_blank">bell-a027.rcac.purdue.edu:29752</a>] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages</div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
<br>
</div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
Thanks</div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
<br>
</div>
<div style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">
With regards,<br>
</div>
<span style="margin:0px;font-size:12pt;color:black;background-color:rgb(255,255,255)">Sanjoy</span><br>
</div>
</div>
</blockquote>
</div>
<br clear="all">
<div><br>
</div>
-- <br>
<div dir="ltr">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>
-- Norbert Wiener</div>
<div><br>
</div>
<div><a href="http://www.cse.buffalo.edu/~knepley/" target="_blank">https://www.cse.buffalo.edu/~knepley/</a><br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>-- Norbert Wiener</div><div><br></div><div><a href="http://www.cse.buffalo.edu/~knepley/" target="_blank">https://www.cse.buffalo.edu/~knepley/</a><br></div></div></div></div></div></div></div></div>
</blockquote></div>