<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Aug 17, 2016 at 4:33 PM, Ari Rappaport <span dir="ltr"><<a href="mailto:arir@vosssci.com" target="_blank">arir@vosssci.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Ok, thank you. So for AMS there is the option to use PCHYPRESetEdgeConstantVectors. Is there any example somewhere of how this function is supposed to be used? </blockquote><div><br></div><div>This is probably a wrapper for a hypre method so I'd check the hypre docs.</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Also, it is possible to set the pc type to hypre inside the code? e.g. PCSetType(pc, <HYPRE>)<br>
<span class="im HOEnZb"><br></span></blockquote><div><br></div><div>yes</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class="im HOEnZb">
-Ari<br>
<br>
----- Original Message -----<br>
From: "Satish Balay" <<a href="mailto:balay@mcs.anl.gov">balay@mcs.anl.gov</a>><br>
</span><div class="HOEnZb"><div class="h5">To: "Ari Rappaport" <<a href="mailto:arir@vosssci.com">arir@vosssci.com</a>><br>
Cc: "petsc-dev" <<a href="mailto:petsc-dev@mcs.anl.gov">petsc-dev@mcs.anl.gov</a>><br>
Sent: Wednesday, August 17, 2016 1:11:43 PM<br>
Subject: Re: [petsc-dev] Algebraic Multigrid<br>
<br>
balay@asterix /home/balay/petsc/src/ksp/ksp/<wbr>examples/tutorials (master=)<br>
$ ./ex2 -pc_type hypre -h |grep pc_hypre_type<br>
-pc_hypre_type <boomeramg> (choose one of) pilut parasails boomeramg ams (PCHYPRESetType)<br>
<br>
<br>
Satish<br>
<br>
On Wed, 17 Aug 2016, Ari Rappaport wrote:<br>
<br>
> Hi again,<br>
> I am having a problem with the database option -pc_hypre_set_type ams along with -pc_type hypre. When I run my simulation I get the message "Option left: name:-pc_hypre_set_type value: ams".<br>
><br>
> -Ari<br>
><br>
> ----- Original Message -----<br>
> From: "Satish Balay" <<a href="mailto:balay@mcs.anl.gov">balay@mcs.anl.gov</a>><br>
> To: "petsc-dev" <<a href="mailto:petsc-dev@mcs.anl.gov">petsc-dev@mcs.anl.gov</a>><br>
> Cc: "Ari Rappaport" <<a href="mailto:arir@vosssci.com">arir@vosssci.com</a>><br>
> Sent: Tuesday, August 16, 2016 3:31:16 PM<br>
> Subject: Re: [petsc-dev] Algebraic Multigrid<br>
><br>
> Or - not use '--with-fc=0'. For some reason '-lm' is getting pulled in via gfortran - not gcc [on this machine]<br>
><br>
> I've pushed the following fix - to maint/3.7<br>
><br>
> <a href="https://bitbucket.org/petsc/petsc/commits/2d90af56370c3153360ed340bfa06d4e662fceff" rel="noreferrer" target="_blank">https://bitbucket.org/petsc/<wbr>petsc/commits/<wbr>2d90af56370c3153360ed340bfa06d<wbr>4e662fceff</a><br>
><br>
> Satish<br>
><br>
> On Tue, 16 Aug 2016, Satish Balay wrote:<br>
><br>
> > >><br>
> > /home/mantis/petsc/petsc-3.6.<wbr>4/linux-gnu/externalpackages/<wbr>hypre-2.10.0b-p4/src/<wbr>utilities/exchange_data.c:205: undefined reference to `ceil'<br>
> > <<<br>
> ><br>
> > Try adding configure flag: LIBS=-lm<br>
> ><br>
> > BTW:<br>
> ><br>
> > >>>>>>><br>
> > Working directory: /home/mantis/petsc/petsc-3.6.4<br>
> ><br>
> > Executing: mpicc -show<br>
> > stdout: gcc -fPIC -g3 -I/home/mantis/petsc/petsc-3.<wbr>7.2/linux-gnu/include -L/home/mantis/petsc/petsc-3.<wbr>7.2/linux-gnu/lib -Wl,-rpath -Wl,/home/mantis/petsc/petsc-<wbr>3.7.2/linux-gnu/lib -Wl,--enable-new-dtags -lmpi<br>
> > <<<<<<<<br>
> ><br>
> > Mixing petsc versions might cause issues..<br>
> ><br>
> > Satish<br>
> ><br>
> > On Tue, 16 Aug 2016, Ari Rappaport wrote:<br>
> ><br>
> > > Hi Barry,<br>
> > > Sorry for the late reply. Here is my configure.log file. I am assuming you meant the configure.log in the petsc-3.6.4 home directory.<br>
> > ><br>
> > > -Ari<br>
> > ><br>
> > > ----- Original Message -----<br>
> > > From: "Barry Smith" <<a href="mailto:bsmith@mcs.anl.gov">bsmith@mcs.anl.gov</a>><br>
> > > To: "Ari Rappaport" <<a href="mailto:arir@vosssci.com">arir@vosssci.com</a>><br>
> > > Cc: "Mark Adams" <<a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a>>, "For users of the development version of PETSc" <<a href="mailto:petsc-dev@mcs.anl.gov">petsc-dev@mcs.anl.gov</a>><br>
> > > Sent: Thursday, August 11, 2016 3:59:47 PM<br>
> > > Subject: Re: [petsc-dev] Algebraic Multigrid<br>
> > ><br>
> > ><br>
> > > > On Aug 11, 2016, at 4:42 PM, Ari Rappaport <<a href="mailto:arir@vosssci.com">arir@vosssci.com</a>> wrote:<br>
> > > ><br>
> > > > Hi Guys,<br>
> > > > So the algebraic multigrid works great for a Poisson equation. However, it's choking on our Maxwell's Equations solver which is a form of curl/curl if I'm not mistaken.<br>
> > ><br>
> > > Maxwell's equations are tricky for multigrid. hypre has a solver specific for Maxwell's equation, you need to check it out; note this is not just running with hypre boomerAMG. If you run boomerAMG directly with Maxwell's you will not get satisfactory results.<br>
> > ><br>
> > > > I was going to give hypre AMS a try, but I'm having trouble installing it. I'm getting the error "Downloaded hypre could not be used".<br>
> > ><br>
> > > Send configure.log<br>
> > ><br>
> > ><br>
> > > > I'm using Ubuntu 14.04 if that makes a difference. Also, is non-algebraic multigrid a reasonable choice for Maxwell's Equations?<br>
> > ><br>
> > > Even with geometric multigrid Maxwell's equations are nontrivial; you will need to do some literature search to determine how to handle the restriction/interpolation and smoothing to work well for Maxwell.<br>
> > ><br>
> > > Barry<br>
> > ><br>
> > > ><br>
> > > > Thanks,<br>
> > > > Ari<br>
> > > ><br>
> > > > ----- Original Message -----<br>
> > > > From: "Barry Smith" <<a href="mailto:bsmith@mcs.anl.gov">bsmith@mcs.anl.gov</a>><br>
> > > > To: "Ari Rappaport" <<a href="mailto:arir@vosssci.com">arir@vosssci.com</a>><br>
> > > > Cc: "Mark Adams" <<a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a>>, "For users of the development version of PETSc" <<a href="mailto:petsc-dev@mcs.anl.gov">petsc-dev@mcs.anl.gov</a>><br>
> > > > Sent: Wednesday, August 10, 2016 2:02:10 PM<br>
> > > > Subject: Re: [petsc-dev] Algebraic Multigrid<br>
> > > ><br>
> > > ><br>
> > > >> On Aug 10, 2016, at 2:52 PM, Ari Rappaport <<a href="mailto:arir@vosssci.com">arir@vosssci.com</a>> wrote:<br>
> > > >><br>
> > > >> Hi Mark,<br>
> > > >> There was indeed a bug on our end. Now that we fixed it everything is working correctly even in parallel. I have one question still though. Is there a way to get the mg_levels_pc_type jacobi option<br>
> > > >> set in the code without passing it as an argument to PetscInitialize? I'm using PCGAMGSetType(pc, PCJACOBI) but it doesn't seem to be working.<br>
> > > ><br>
> > > > You can call PetscOptionsSetValue("-<<wbr>appropriate prefix>_mg_levels_pc_type","<wbr>jacobi") in the code anywhere before your code creates the SNES or KSP object you are using. This is equivalent to putting it on the command line.<br>
> > > ><br>
> > > > Barry<br>
> > > ><br>
> > > >><br>
> > > >><br>
> > > >> -Ari<br>
> > > >><br>
> > > >> ----- Original Message -----<br>
> > > >> From: "Mark Adams" <<a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a>><br>
> > > >> To: "Ari Rappaport" <<a href="mailto:arir@vosssci.com">arir@vosssci.com</a>><br>
> > > >> Cc: "For users of the development version of PETSc" <<a href="mailto:petsc-dev@mcs.anl.gov">petsc-dev@mcs.anl.gov</a>><br>
> > > >> Sent: Wednesday, July 27, 2016 7:24:24 PM<br>
> > > >> Subject: Re: [petsc-dev] Algebraic Multigrid<br>
> > > >><br>
> > > >> There is clearly something very wrong with your code. I would suggest starting with an example code for instance KSP/examples/tutorial/ex56.c and incrementally add your operator to get something that is working.<br>
> > > >><br>
> > > >><br>
> > > >> Also if you have multiple degrees of freedom per vertex, for instance elasticity, then you want to set the block size of the matrix accordingly.<br>
> > > >><br>
> > > >> On Wednesday, July 27, 2016, Ari Rappaport < <a href="mailto:arir@vosssci.com">arir@vosssci.com</a> > wrote:<br>
> > > >><br>
> > > >><br>
> > > >> Hi Mark,<br>
> > > >> We added the Jacobi line and it appears to accept that flag now. However, we are getting all zeros for the solution vector. And PETSc is claiming to have converged in 7 iterations to the relative tolerance.<br>
> > > >><br>
> > > >> -Ari<br>
> > > >><br>
> > > >> ----- Original Message -----<br>
> > > >> From: "Mark Adams" < <a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a> ><br>
> > > >> To: "Ari Rappaport" < <a href="mailto:arir@vosssci.com">arir@vosssci.com</a> >, "For users of the development version of PETSc" < <a href="mailto:petsc-dev@mcs.anl.gov">petsc-dev@mcs.anl.gov</a> ><br>
> > > >> Sent: Wednesday, July 27, 2016 3:26:03 PM<br>
> > > >> Subject: Re: [petsc-dev] Algebraic Multigrid<br>
> > > >><br>
> > > >><br>
> > > >> Please keep this on the Petsc list.<br>
> > > >><br>
> > > >> We seem to have lost Jacobi smoother again. I'm suspecting that you're some funny character in your line with Jacobi that is Confusing the parser. Get back to the old file with the two two Jacobi entries and delete the other line and get Jacobi in the KSP view output. There should be no SOR in the output.<br>
> > > >><br>
> > > >><br>
> > > >> On Wednesday, July 27, 2016, Ari Rappaport < <a href="mailto:arir@vosssci.com">arir@vosssci.com</a> > wrote:<br>
> > > >><br>
> > > >><br>
> > > >> Hi Mark,<br>
> > > >> I added all these new things. The PCAMG is now ending very quickly but the residual is unreasonably large by about 10 orders of magnitude. I noticed the line "Linear solve did not converge due to DIVERGED_INDEFINITE_PC iterations 2" in the output, could this be causing the problem? It only appears to be going for 2 iterations now.<br>
> > > >><br>
> > > >> -Ari<br>
> > > >><br>
> > > >> ----- Original Message -----<br>
> > > >> From: "Mark Adams" < <a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a> ><br>
> > > >> To: "Ari Rappaport" < <a href="mailto:arir@vosssci.com">arir@vosssci.com</a> ><br>
> > > >> Cc: "For users of the development version of PETSc" < <a href="mailto:petsc-dev@mcs.anl.gov">petsc-dev@mcs.anl.gov</a> ><br>
> > > >> Sent: Tuesday, July 26, 2016 5:07:34 PM<br>
> > > >> Subject: Re: [petsc-dev] Algebraic Multigrid<br>
> > > >><br>
> > > >><br>
> > > >> Ari, I would also check that your operator is not messed up in parallel. The solver is looking pretty solid.<br>
> > > >><br>
> > > >><br>
> > > >> Also, you can configure PETSc with hypre and use '-pc_type hypre'. If hypre is also good in serial but hosed on multi-proc then it is most probably your operator.<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> On Tue, Jul 26, 2016 at 6:58 PM, Mark Adams < <a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a> > wrote:<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> So remove one of the -mg_levels_pc_type jacobi and add -mg_coarse_ksp_type preonly, then verify that this works on one proc and then try two procs.<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> On Tue, Jul 26, 2016 at 6:56 PM, Mark Adams < <a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a> > wrote:<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> Oh, actually this worked. You have this ...pc_type jacobi in there twice, so one of them was "unused".<br>
> > > >><br>
> > > >><br>
> > > >> Try this with 2 processors now.<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> On Tue, Jul 26, 2016 at 6:42 PM, Mark Adams < <a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a> > wrote:<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> On Tue, Jul 26, 2016 at 6:24 PM, Ari Rappaport < <a href="mailto:arir@vosssci.com">arir@vosssci.com</a> > wrote:<br>
> > > >><br>
> > > >><br>
> > > >> So I commented out the line PCSetType(pc, PCGAMG). The line KSPSetFromOptions(ksp) was already in the code at the end of our initialization routine. I also added .petscrc to the working dir. Here is the current output. It seems as if Option left: name:-mg_levels_pc_type jacobi (no value) is still present in the output..I dunno.<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> Yea, I dunno either. If you use -help you will get printout of the available options. If you do this you will see stuff like -mg_levels_1_ ... you can also see this in the ksp_view. There is a shortcut that lets you _not_ put "_1" in. Try putting this in for each level like so:<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> -mg_levels_1_pc_type jacobi<br>
> > > >><br>
> > > >> -mg_levels_2_pc_type jacobi<br>
> > > >> -mg_levels_3_pc_type jacobi<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> I also notice that the coarse grid ksp is GMRES. This is our fault. It should be preonly. Add:<br>
> > > >><br>
> > > >><br>
> > > >> -mg_coarse_ksp_type preonly<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> -Ari<br>
> > > >><br>
> > > >> ----- Original Message -----<br>
> > > >> From: "Mark Adams" < <a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a> ><br>
> > > >> To: "Ari Rappaport" < <a href="mailto:arir@vosssci.com">arir@vosssci.com</a> >, "For users of the development version of PETSc" < <a href="mailto:petsc-dev@mcs.anl.gov">petsc-dev@mcs.anl.gov</a> ><br>
> > > >> Sent: Tuesday, July 26, 2016 4:03:03 PM<br>
> > > >> Subject: Re: [petsc-dev] Algebraic Multigrid<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> At the end of this you have:<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> #PETSc Option Table entries:<br>
> > > >> -ksp_view<br>
> > > >> -mg_levels_pc_type jacobi<br>
> > > >> -options_left<br>
> > > >> #End of PETSc Option Table entries<br>
> > > >> There is one unused database option. It is:<br>
> > > >> Option left: name:-mg_levels_pc_type jacobi (no value)<br>
> > > >><br>
> > > >><br>
> > > >> So this jacobi parameter is not being used.<br>
> > > >><br>
> > > >><br>
> > > >> Do you call KPSSetFromOptions? Do you set solver parameters in the code? Like PCGAMG?<br>
> > > >><br>
> > > >><br>
> > > >> You should not set anything in the code, it just confuses things at this point. Use KSPSetFromOptions(). You can hardwire stuff before this call, this just lets you set the defaults, but you should always call this last to let command line parameters override the defaults.<br>
> > > >><br>
> > > >><br>
> > > >> You can put this in a .petscrc file in the working directory and try again.<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >> -ksp_type cg<br>
> > > >> -ksp_max_it 50<br>
> > > >><br>
> > > >> -ksp_rtol 1.e-6<br>
> > > >> -ksp_converged_reason<br>
> > > >> -pc_type gamg<br>
> > > >> -pc_gamg_type agg<br>
> > > >> -pc_gamg_agg_nsmooths 1<br>
> > > >> -pc_gamg_coarse_eq_limit 10<br>
> > > >> -pc_gamg_reuse_interpolation true<br>
> > > >> -pc_gamg_square_graph 1<br>
> > > >> -pc_gamg_threshold -0.05<br>
> > > >> -mg_levels_ksp_max_it 2<br>
> > > >> -mg_levels_ksp_type chebyshev<br>
> > > >> -mg_levels_esteig_ksp_type cg<br>
> > > >> -mg_levels_esteig_ksp_max_it 10<br>
> > > >> -mg_levels_ksp_chebyshev_<wbr>esteig 0,.05,0,1.05<br>
> > > >> -mg_levels_pc_type jacobi<br>
> > > >> -pc_hypre_type boomeramg<br>
> > > >> -pc_hypre_boomeramg_no_CF<br>
> > > >> -pc_hypre_boomeramg_agg_nl 1<br>
> > > >> -pc_hypre_boomeramg_coarsen_<wbr>type HMIS<br>
> > > >> -pc_hypre_boomeramg_interp_<wbr>type ext+i<br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > >><br>
> > > ><br>
> > ><br>
> > ><br>
> ><br>
> ><br>
><br>
><br>
<br>
</div></div></blockquote></div><br></div></div>