<div dir="ltr">Mark,<div><br></div><div>So I had the following options:</div><br>-solver_fieldsplit_1_pc_type gamg<br>-solver_fieldsplit_1_pc_gamg_square_graph 10 <br>-solver_fieldsplit_1_mg_levels_ksp_type richardson <br>-solver_fieldsplit_1_pc_gamg_threshold <-0.02/0.00/0.02><br>-info <br>-log_summary<div><br></div><div>where I varied the gamg threshold from -0.02, 0.00, and 0.02. Richardson for the mg_levels_ksp_type option did improve the performance, but it seems using a non-zero threshold worsens the overall solver.</div><div><br></div><div>for "-solver_fieldsplit_1_pc_gamg_threshold 0.02":<br></div><div><br></div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">>> grep 'GAMG' positive_threshold </p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): level 0) N=162000, n data rows=1, n data cols=1, nnz/row (ave)=9, np=1</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 55.6621% nnz after filtering, with threshold 0.02, 8.863 nnz ave. (N=162000)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 1 of 10 to square</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 22085 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.955376e+00 min=8.260696e-03 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 1) N=22085, n data cols=1, nnz/row (ave)=704, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 2.20542% nnz after filtering, with threshold 0.02, 704.128 nnz ave. (N=22085)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 2 of 10 to square</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 798 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.311291e+00 min=1.484874e-02 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 2) N=798, n data cols=1, nnz/row (ave)=798, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 1.75564% nnz after filtering, with threshold 0.02, 798. nnz ave. (N=798)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 3 of 10 to square</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 44 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.668188e+00 min=1.402892e-01 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 3) N=44, n data cols=1, nnz/row (ave)=44, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 4 levels, grid complexity = 12.2755</p><br>For "-solver_fieldsplit_1_pc_gamg_threshold 0.00":<br></div><div><br></div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): level 0) N=162000, n data rows=1, n data cols=1, nnz/row (ave)=9, np=1</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 55.6621% nnz after filtering, with threshold 0., 8.863 nnz ave. (N=162000)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 1 of 10 to square</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 22085 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.955376e+00 min=8.260696e-03 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 1) N=22085, n data cols=1, nnz/row (ave)=704, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 3.1314% nnz after filtering, with threshold 0., 704.128 nnz ave. (N=22085)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 2 of 10 to square</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 545 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.311291e+00 min=1.484874e-02 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 2) N=545, n data cols=1, nnz/row (ave)=545, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 7.55997% nnz after filtering, with threshold 0., 545. nnz ave. (N=545)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 3 of 10 to square</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 11 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.368729e+00 min=1.563750e-01 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 3) N=11, n data cols=1, nnz/row (ave)=11, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 4 levels, grid complexity = 12.0376</p><br>and for "-solver_fieldsplit_1_pc_gamg_threshold -0.02":</div><div><br></div><div><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): level 0) N=162000, n data rows=1, n data cols=1, nnz/row (ave)=9, np=1</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 1 of 10 to square</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 10406 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.955376e+00 min=8.260696e-03 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 1) N=10406, n data cols=1, nnz/row (ave)=945, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 2 of 10 to square</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 1 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.248316e+00 min=9.020787e-02 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 2) N=1, n data cols=1, nnz/row (ave)=1, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): HARD stop of coarsening on level 1. Grid too small: 1 block nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 3 levels, grid complexity = 7.85162</p><br>Attached are the log summaries for the three respective cases (positive, zero, and negative). </div><div><br></div><div>1) From the log summaries, it seems positive negative threshold is extremely slow. Though not as slow as if I had no "square_graph 10" and zero threshold has the "best" performance. </div><div><br></div><div>2) I tried mg_levels_pc_type sor but it wasn't as good as richardson</div><div><br></div><div>3) I tried increasing the square_graph number to 100 and 1000 but saw no improvement</div><div><br></div><div>4) I could not find any way to identify the ML information from -info, so I simply attached the log_summary using ML for reference</div><div><br></div><div>5) Is there anything else I could try? Thanks again for all your help </div><div><br></div><div>Thanks,</div><div>Justin</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Mar 4, 2016 at 4:36 PM, Mark Adams <span dir="ltr"><<a href="mailto:mfadams@lbl.gov" target="_blank">mfadams@lbl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">And it looks like you have a well behaved Laplacian here (M-matrix) so I would guess 'richardson' would be faster as the smoother, instead of 'chebyshev'.</div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Mar 4, 2016 at 5:04 PM, Mark Adams <span dir="ltr"><<a href="mailto:mfadams@lbl.gov" target="_blank">mfadams@lbl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">You seem to have 3 of one type of solve that is give 'square_graph 1':<div><br></div><div><span style="font-size:12.8px"><span><p style="margin:0px;font-size:12px;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 1 of 1 to square</p><div><br></div></span><div>This has 9 nnz-row and 44% are zero:</div><span><div><br></div><div><span style="color:rgb(76,47,45);font-family:Courier;font-size:12px;background-color:rgb(223,219,196)">[0] PC</span><span style="font-family:Courier;font-size:12px;color:rgb(177,37,18)"><b>GAMG</b></span><span style="color:rgb(76,47,45);font-family:Courier;font-size:12px;background-color:rgb(223,219,196)">FilterGraph(): </span><span style="color:rgb(76,47,45);font-family:Courier;font-size:12px;white-space:pre-wrap"> </span><span style="color:rgb(76,47,45);font-family:Courier;font-size:12px;background-color:rgb(223,219,196)"> 55.7114% nnz after filtering, with threshold 0., 8.79533 nnz ave. </span><br></div></span></span><div><br></div><div>So you want to use a _negative_ threshold. This will keep zeros in the graph and help it to coarsen faster. And you could try adding more levels to square the graph.</div></div><div><br></div><div>The second type of solve has the 'square_graph 10'. It looks like the first solve. It should also use a negative threshold also.</div><div><br></div><div>ML has a default of zero for the threshold, but it seems to keep zeros whereas GAMG does not.</div><span><font color="#888888"><div><br></div><div>Mark</div><div><br></div></font></span></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Mar 4, 2016 at 10:38 AM, Justin Chang <span dir="ltr"><<a href="mailto:jychang48@gmail.com" target="_blank">jychang48@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Time to solution went from 100 seconds to 30 seconds once i used 10 graphs. Using 20 graphs started to increase in time slightly</div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Mar 4, 2016 at 8:35 AM, Justin Chang <span dir="ltr"><<a href="mailto:jychang48@gmail.com" target="_blank">jychang48@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">You're right. This is what I have:<div><br></div><div><span><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): level 0) N=48000, n data rows=1, n data cols=1, nnz/row (ave)=9, np=1</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 55.7114% nnz after filtering, with threshold 0., 8.79533 nnz ave. (N=48000)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 1 of 1 to square</p>
</span><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 6672 nodes</p><span>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.954700e+00 min=1.040410e-02 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 1) N=6672, n data cols=1, nnz/row (ave)=623, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 3.40099% nnz after filtering, with threshold 0., 623.135 nnz ave. (N=6672)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 724 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.313339e+00 min=2.474586e-02 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 2) N=724, n data cols=1, nnz/row (ave)=724, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 9.82914% nnz after filtering, with threshold 0., 724. nnz ave. (N=724)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 37 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=2.011784e+00 min=2.759552e-01 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 3) N=37, n data cols=1, nnz/row (ave)=37, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 4 levels, grid complexity = 12.0928</p>
</span><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): level 0) N=48000, n data rows=1, n data cols=1, nnz/row (ave)=9, np=1</p><span>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 55.7114% nnz after filtering, with threshold 0., 8.79533 nnz ave. (N=48000)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 1 of 1 to square</p>
</span><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 6672 nodes</p><span>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.954700e+00 min=1.040410e-02 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 1) N=6672, n data cols=1, nnz/row (ave)=623, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 3.40099% nnz after filtering, with threshold 0., 623.135 nnz ave. (N=6672)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 724 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.313339e+00 min=2.474586e-02 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 2) N=724, n data cols=1, nnz/row (ave)=724, 1 active pes</p>
</span><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 9.82914% nnz after filtering, with threshold 0., 724. nnz ave. (N=724)</p><span>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 37 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=2.011784e+00 min=2.759552e-01 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 3) N=37, n data cols=1, nnz/row (ave)=37, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 4 levels, grid complexity = 12.0928</p>
</span><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): level 0) N=162000, n data rows=1, n data cols=1, nnz/row (ave)=9, np=1</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 55.6621% nnz after filtering, with threshold 0., 8.863 nnz ave. (N=162000)</p><span>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 1 of 1 to square</p>
</span><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 22085 nodes</p><span>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.955376e+00 min=8.260696e-03 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 1) N=22085, n data cols=1, nnz/row (ave)=704, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 3.1314% nnz after filtering, with threshold 0., 704.128 nnz ave. (N=22085)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 2283 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.311291e+00 min=1.484874e-02 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 2) N=2283, n data cols=1, nnz/row (ave)=2283, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 3.64497% nnz after filtering, with threshold 0., 2283. nnz ave. (N=2283)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 97 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=2.043254e+00 min=1.321528e-01 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 3) N=97, n data cols=1, nnz/row (ave)=97, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 66.8403% nnz after filtering, with threshold 0., 97. nnz ave. (N=97)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 5 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.653762e+00 min=4.460582e-01 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 4) N=5, n data cols=1, nnz/row (ave)=5, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 5 levels, grid complexity = 15.4673</p>
</span><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): level 0) N=162000, n data rows=1, n data cols=1, nnz/row (ave)=9, np=1</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 55.6621% nnz after filtering, with threshold 0., 8.863 nnz ave. (N=162000)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 1 of 10 to square</p><span>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 22085 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.955376e+00 min=8.260696e-03 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 1) N=22085, n data cols=1, nnz/row (ave)=704, 1 active pes</p>
</span><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 3.1314% nnz after filtering, with threshold 0., 704.128 nnz ave. (N=22085)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 2 of 10 to square</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 545 nodes</p><span>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.311291e+00 min=1.484874e-02 PC=jacobi</p>
</span><p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 2) N=545, n data cols=1, nnz/row (ave)=545, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>FilterGraph(): <span style="white-space:pre-wrap"> </span> 7.55997% nnz after filtering, with threshold 0., 545. nnz ave. (N=545)</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Coarsen_AGG(): Square Graph on level 3 of 10 to square</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>Prolongator_AGG(): New grid 11 nodes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PC<span style="color:rgb(177,37,18)"><b>GAMG</b></span>OptProlongator_AGG(): Smooth P0: max eigen=1.368729e+00 min=1.563750e-01 PC=jacobi</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 3) N=11, n data cols=1, nnz/row (ave)=11, 1 active pes</p>
<p style="margin:0px;font-size:12px;line-height:normal;font-family:Courier;color:rgb(76,47,45);background-color:rgb(223,219,196)">[0] PCSetUp_<span style="color:rgb(177,37,18)"><b>GAMG</b></span>(): 4 levels, grid complexity = 12.0376</p></div></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Mar 4, 2016 at 8:31 AM, Lawrence Mitchell <span dir="ltr"><<a href="mailto:lawrence.mitchell@imperial.ac.uk" target="_blank">lawrence.mitchell@imperial.ac.uk</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span><br>
> On 4 Mar 2016, at 15:24, Justin Chang <<a href="mailto:jychang48@gmail.com" target="_blank">jychang48@gmail.com</a>> wrote:<br>
><br>
> So with -pc_gamg_square_graph 10 I get the following:<br>
<br>
</span>Because you're using gamg inside the fieldsplit, I think you need:<br>
<br>
-fieldsplit_1_pc_gamg_square_graph 10<br>
<span><br>
<br>
<br>
> [0] PCSetUp_GAMG(): level 0) N=48000, n data rows=1, n data cols=1, nnz/row (ave)=9, np=1<br>
> [0] PCGAMGFilterGraph(): 55.7114% nnz after filtering, with threshold 0., 8.79533 nnz ave. (N=48000)<br>
> [0] PCGAMGCoarsen_AGG(): Square Graph on level 1 of 1 to square<br>
</span> ^^^^^<br>
<br>
Cheers,<br>
<br>
Lawrence<br>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>