<div dir="ltr">Barry, <div><br></div><div>HEM is experimental and not intended to be fully supported. That said, I don't mind hardening it up. I don't know what PETSc's policy is, if any, on this sort of thing. </div><div><br></div><div>Anyway, I am trying to pound on HEM, but I get this error:</div><div><br></div><div>[63]PETSC ERROR: matB must have compressed row usage <br></div><div><br></div><div>I have seen this before, but I forget what to do about it. That is getting the B matrix to have compressed row storage. Do you recall?</div><div><br></div><div>Thanks,</div><div>Mark</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 23, 2016 at 7:59 PM, Mark Adams <span dir="ltr"><<a href="mailto:mfadams@lbl.gov" target="_blank">mfadams@lbl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span class="">On Wed, Jun 22, 2016 at 11:27 PM, Barry Smith <span dir="ltr"><<a href="mailto:bsmith@mcs.anl.gov" target="_blank">bsmith@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><br>
Mark,<br>
<br>
If I use the hem coarsen type I get this error. </blockquote><div><br></div></span><div>Does this go away with mis? Don't bother testing, it probably does.</div><span class=""><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Note that I am setting the -pc_gamg_sym_graph true flag I the debugger I do see that PCGAMGFilterGraph() has the<br>
sym flag set so it seems to me either<br>
<br>
1) the symmetrizer doesn't actually make it symmetric or<br></blockquote><div><br></div></span><div>It should be symmetric, even with roundoff, I think.</div><div><br></div><div>You have an unsymmetric matrix structurally? </div><span class=""><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
2) the detector of lack of symmetry thinks it is not symmetric when it is.<br></blockquote><div><br></div></span><div>The edge weights are used to drop edges and if there is an error then you can get a structurally unsymmetric graph. Then the parallel graph algorithms barf (they assume if I know you, you know me, symmetric). </div><span class=""><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
Thoughts on how to debug this?<br></blockquote><div><br></div></span><div>Try with a threshold of 0. I need to take a look at it. Can I run it?</div><div><br></div><div>I have to run for the night (in Vienna)</div><div><div class="h5"><div><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
Thanks<br>
<br>
barry<br>
<br>
<br>
<br>
$ petscmpiexec -n 2 ./ex19 -pc_type gamg -da_refine 3 -mat_coarsen_type hem -pc_gamg_sym_graph true<br>
lid velocity = 0.0016, prandtl # = 1., grashof # = 1.<br>
[1]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------<br>
[1]PETSC ERROR: Petsc has generated inconsistent data<br>
[1]PETSC ERROR: Have un-symmetric graph (apparently). Use '-pc_gamg_sym_graph true' to symetrize the graph or '-pc_gamg_threshold -1.0' if the matrix is structurally symmetric.<br>
[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------<br>
[0]PETSC ERROR: Petsc has generated inconsistent data<br>
[0]PETSC ERROR: Have un-symmetric graph (apparently). Use '-pc_gamg_sym_graph true' to symetrize the graph or '-pc_gamg_threshold -1.0' if the matrix is structurally symmetric.<br>
[0]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" rel="noreferrer" target="_blank">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.<br>
[0]PETSC ERROR: Petsc Development GIT revision: v3.7.2-596-g05491f7 GIT Date: 2016-06-22 13:31:47 -0500<br>
[0]PETSC ERROR: ./ex19 on a arch-single named Barrys-MacBook-Pro.local by barrysmith Wed Jun 22 16:24:13 2016<br>
[0]PETSC ERROR: [1]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" rel="noreferrer" target="_blank">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.<br>
[1]PETSC ERROR: Petsc Development GIT revision: v3.7.2-596-g05491f7 GIT Date: 2016-06-22 13:31:47 -0500<br>
[1]PETSC ERROR: ./ex19 on a arch-single named Barrys-MacBook-Pro.local by barrysmith Wed Jun 22 16:24:13 2016<br>
[1]PETSC ERROR: Configure options --with-mpi-dir=/Users/barrysmith/libraries --with-precision=single<br>
[1]PETSC ERROR: #1 smoothAggs() line 463 in /Users/barrysmith/Src/petsc/src/ksp/pc/impls/gamg/agg.c<br>
Configure options --with-mpi-dir=/Users/barrysmith/libraries --with-precision=single<br>
[0]PETSC ERROR: #1 smoothAggs() line 463 in /Users/barrysmith/Src/petsc/src/ksp/pc/impls/gamg/agg.c<br>
[1]PETSC ERROR: #2 PCGAMGCoarsen_AGG() line 1021 in /Users/barrysmith/Src/petsc/src/ksp/pc/impls/gamg/agg.c<br>
[1]PETSC ERROR: [0]PETSC ERROR: #2 PCGAMGCoarsen_AGG() line 1021 in /Users/barrysmith/Src/petsc/src/ksp/pc/impls/gamg/agg.c<br>
[0]PETSC ERROR: #3 PCSetUp_GAMG() line 524 in /Users/barrysmith/Src/petsc/src/ksp/pc/impls/gamg/gamg.c<br>
#3 PCSetUp_GAMG() line 524 in /Users/barrysmith/Src/petsc/src/ksp/pc/impls/gamg/gamg.c<br>
[1]PETSC ERROR: #4 PCSetUp() line 968 in /Users/barrysmith/Src/petsc/src/ksp/pc/interface/precon.c<br>
[0]PETSC ERROR: #4 PCSetUp() line 968 in /Users/barrysmith/Src/petsc/src/ksp/pc/interface/precon.c<br>
[0]PETSC ERROR: #5 KSPSetUp() line 390 in /Users/barrysmith/Src/petsc/src/ksp/ksp/interface/itfunc.c<br>
[0]PETSC ERROR: #6 KSPSolve() line 599 in /Users/barrysmith/Src/petsc/src/ksp/ksp/interface/itfunc.c<br>
[1]PETSC ERROR: #5 KSPSetUp() line 390 in /Users/barrysmith/Src/petsc/src/ksp/ksp/interface/itfunc.c<br>
[1]PETSC ERROR: [0]PETSC ERROR: #7 SNESSolve_NEWTONLS() line 230 in /Users/barrysmith/Src/petsc/src/snes/impls/ls/ls.c<br>
[0]PETSC ERROR: #8 SNESSolve() line 4008 in /Users/barrysmith/Src/petsc/src/snes/interface/snes.c<br>
#6 KSPSolve() line 599 in /Users/barrysmith/Src/petsc/src/ksp/ksp/interface/itfunc.c<br>
[1]PETSC ERROR: #7 SNESSolve_NEWTONLS() line 230 in /Users/barrysmith/Src/petsc/src/snes/impls/ls/ls.c<br>
[0]PETSC ERROR: #9 main() line 159 in /Users/barrysmith/Src/petsc/src/snes/examples/tutorials/ex19.c<br>
[0]PETSC ERROR: [1]PETSC ERROR: #8 SNESSolve() line 4008 in /Users/barrysmith/Src/petsc/src/snes/interface/snes.c<br>
[1]PETSC ERROR: PETSc Option Table entries:<br>
<br>
<br>
</blockquote></div></div></div><br></div></div>
</blockquote></div><br></div>