<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body style="overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div><br></div> Pierre,<div><br></div><div> Sorry, I was not clear. What I meant was that the PETSc code that calls MUMPS could change the value of <span style="background-color: rgb(255, 255, 255);">ICNTL(6) under certain conditions before calling MUMPS, thus the MUMPS warning might not be triggered. I am basing this on a guess from looking at the MUMPS manual and the warning message that the particular value of ICNTL(6) is incompatible with the given matrix state. But I could easily be wrong.</span></div><div><span style="background-color: rgb(255, 255, 255);"><br></span></div><div><span style="background-color: rgb(255, 255, 255);"> Barry</span></div><div><span style="background-color: rgb(255, 255, 255);"><br></span><div><br><blockquote type="cite"><div>On Nov 1, 2023, at 1:33 PM, Pierre Jolivet <pierre@joliv.et> wrote:</div><br class="Apple-interchange-newline"><div><meta http-equiv="content-type" content="text/html; charset=utf-8"><div style="overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div>Victoria, please keep the list in copy.</div><div><br></div><div><blockquote type="cite">I am not understanding how can I switch to ParMetis if it does not appear in the options of -mat_mumps_icntl_7.In the options I only have Metis and not ParMetis.</blockquote></div><div><br></div><div>You need to use -mat_mumps_icntl_28 2 -mat_mumps_icntl_29 2</div><div><br></div><div>Barry, I don’t think we can programmatically shut off this warning, it’s guarded by a bunch of KEEP() values, see src/dana_driver.F:4707, which are only settable/gettable by people with access to consortium releases.</div><div>I’ll ask the MUMPS people for confirmation.</div><div>Note that this warning is only printed to screen with the option -mat_mumps_icntl_4 2 (or higher), so this won’t show up for standard runs.</div><div><br></div><div>Thanks,</div><div>Pierre</div><div><br></div><div><blockquote type="cite"><div>On 1 Nov 2023, at 5:52 PM, Barry Smith <bsmith@petsc.dev> wrote:</div><br class="Apple-interchange-newline"><div><meta http-equiv="content-type" content="text/html; charset=utf-8"><div style="overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><div><br></div> Pierre,<div><br></div><div> Could the PETSc MUMPS interface "turn-off" <span style="background-color: rgb(255, 255, 255);">ICNTL(6) in this situation so as to not trigger the confusing warning message from MUMPS?</span></div><div><span style="background-color: rgb(255, 255, 255);"><br></span></div><div><span style="background-color: rgb(255, 255, 255);"> Barry<br></span><div><br><blockquote type="cite"><div>On Nov 1, 2023, at 12:17 PM, Pierre Jolivet <pierre@joliv.et> wrote:</div><br class="Apple-interchange-newline"><div><meta http-equiv="content-type" content="text/html; charset=utf-8"><div style="overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;"><br id="lineBreakAtBeginningOfMessage"><div><br><blockquote type="cite"><div>On 1 Nov 2023, at 3:33 PM, Zhang, Hong via petsc-users <petsc-users@mcs.anl.gov> wrote:</div><br class="Apple-interchange-newline"><div><meta charset="UTF-8"><div class="elementToProof" style="font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt;"><span class="ContentPasted0" style="font-family: "Segoe UI Web (West European)", "Segoe UI", -apple-system, system-ui, Roboto, "Helvetica Neue", sans-serif; font-size: 12px; background-color: rgb(255, 255, 255); display: inline !important;">Victoria,</span><br></div><div class="elementToProof" style="font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt;"><span class="ContentPasted0" style="font-family: "Segoe UI Web (West European)", "Segoe UI", -apple-system, system-ui, Roboto, "Helvetica Neue", sans-serif; font-size: 12px; background-color: rgb(255, 255, 255); display: inline !important;"><span class="ContentPasted1" style="background-color: rgb(255, 255, 255); display: inline !important;">"** Maximum transversal (ICNTL(6)) not allowed because matrix is distributed</span></span></div><div class="elementToProof" style="font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt;"><span class="ContentPasted0" style="font-family: "Segoe UI Web (West European)", "Segoe UI", -apple-system, system-ui, Roboto, "Helvetica Neue", sans-serif; font-size: 12px; background-color: rgb(255, 255, 255); display: inline !important;"><span class="ContentPasted1" style="background-color: rgb(255, 255, 255); display: inline !important;"><span class="ContentPasted2" style="background-color: rgb(255, 255, 255); display: inline !important;">Ordering based on METIS</span>"</span></span></div></div></blockquote><div><br></div><div>This warning is benign and appears for every run using a sequential partitioner in MUMPS with a MATMPIAIJ.</div><div>(I’m not saying switching to ParMETIS will not make the issue go away)</div><div><br></div><div>Thanks,</div><div>Pierre</div><div><br></div><div><div>$ ../../../../arch-darwin-c-debug-real/bin/mpirun -n 2 ./ex2 -pc_type lu -mat_mumps_icntl_4 2</div><div>Entering DMUMPS 5.6.2 from C interface with JOB, N = 1 56</div><div> executing #MPI = 2, without OMP</div><div><br></div><div> =================================================</div><div> MUMPS compiled with option -Dmetis</div><div> MUMPS compiled with option -Dparmetis</div><div> MUMPS compiled with option -Dpord</div><div> MUMPS compiled with option -Dptscotch</div><div> MUMPS compiled with option -Dscotch</div><div> =================================================</div><div>L U Solver for unsymmetric matrices</div><div>Type of parallelism: Working host</div><div><br></div><div> ****** ANALYSIS STEP ********</div><div><br></div><div> ** Maximum transversal (ICNTL(6)) not allowed because matrix is distributed</div><div> Processing a graph of size: 56 with 194 edges</div><div> Ordering based on AMF </div><div> WARNING: Largest root node of size 26 not selected for parallel execution</div><div><br></div><div>Leaving analysis phase with ...</div><div> INFOG(1) = 0</div><div> INFOG(2) = 0</div><div>[…]</div></div><br><blockquote type="cite"><div><div class="elementToProof" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><font face="Segoe UI Web (West European), Segoe UI, -apple-system, system-ui, Roboto, Helvetica Neue, sans-serif"><span style="font-size: 12px;">Try parmetis.</span></font></div><div class="elementToProof" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><font face="Segoe UI Web (West European), Segoe UI, -apple-system, system-ui, Roboto, Helvetica Neue, sans-serif"><span style="font-size: 12px;">Hong</span></font></div><hr tabindex="-1" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; display: inline-block; width: 806.53125px;"><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;"></span><div id="divRplyFwdMsg" dir="ltr" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><font face="Calibri, sans-serif" style="font-size: 11pt;"><b>From:</b><span class="Apple-converted-space"> </span>petsc-users <petsc-users-bounces@mcs.anl.gov> on behalf of Victoria Rolandi <victoria.rolandi93@gmail.com><br><b>Sent:</b><span class="Apple-converted-space"> </span>Tuesday, October 31, 2023 10:30 PM<br><b>To:</b><span class="Apple-converted-space"> </span>petsc-users@mcs.anl.gov <petsc-users@mcs.anl.gov><br><b>Subject:</b><span class="Apple-converted-space"> </span>[petsc-users] Error using Metis with PETSc installed with MUMPS</font><div> </div></div><div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><div dir="ltr">Hi, <div><br></div><div>I'm solving a large sparse linear system in parallel and I am using PETSc with MUMPS. I am trying to test different options, like the ordering of the matrix. Everything works if I use the <span style="box-sizing: border-box;"><span style="box-sizing: border-box;"><font style=""><i>-mat_mumps_icntl_7 2 </i>or<i> </i></font></span></span><span style="box-sizing: border-box;"><span style="box-sizing: border-box;"><font style=""><i>-mat_mumps_icntl_7 0 </i></font></span></span>options<i style=""> </i><span style="">(with the first one, AMF, performing better than AMD), however when I test METIS </span><span style=""><i>-mat_mumps_icntl_7</i><span class="x_gmail-Apple-converted-space"><i> 5<span class="Apple-converted-space"> </span></i>I get an error (reported at the end of the email).</span></span></div><div><span style=""><span class="x_gmail-Apple-converted-space"><br></span></span></div><div>I have configured PETSc with the following options: </div><div><br></div><div>--with-cc=mpiicc --with-cxx=mpiicpc --with-fc=mpiifort --with-scalar-type=complex --with-debugging=0 --with-precision=single --download-mumps --download-scalapack --download-parmetis --download-metis<br></div><div><br></div><div>and the installation didn't give any problems.</div><div><br></div><div>Could you help me understand why metis is not working? </div><div><br></div><div>Thank you in advance,</div><div>Victoria </div><div><br></div><div>Error:</div><div><br></div><div> ****** ANALYSIS STEP ********<br> ** Maximum transversal (ICNTL(6)) not allowed because matrix is distributed<br> Processing a graph of size: 699150 with 69238690 edges<br> Ordering based on METIS<br>510522 37081376 [100] [10486 699150]<br>Error! Unknown CType: -1</div></div></div></div></blockquote></div><br></div></div></blockquote></div><br></div></div></div></blockquote></div><br></div></div></blockquote></div><br></div></body></html>