<html><head></head><body style="zoom: 0%;"><div dir="auto">Thank you for the response.<br><br></div>
<div dir="auto">I've just been running some tests with matrices up to 2e4 dimensions (dense). When I compared the solution times for "-mat_type elemental" and "-mat_type mpiaij" running with 4 cores, I found the mpidense versions running way faster than elemental. I have not been able to make the elemental version finish up for 2e4 so far (my patience runs out faster). <br><br></div>
<div dir="auto">What's going on here? I thought elemental was supposed to be superior for dense matrices.<br><br></div>
<div dir="auto">I can share the code if that's appropriate for this forum (sorry, I'm new here). <br><br></div>
<div dir="auto">Nidish</div>
<div class="gmail_quote" >On Aug 6, 2020, at 23:01, Barry Smith <<a href="mailto:bsmith@petsc.dev" target="_blank">bsmith@petsc.dev</a>> wrote:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<pre class="blue"><br><br><blockquote class="gmail_quote" style="margin: 0pt 0pt 1ex 0.8ex; border-left: 1px solid #729fcf; padding-left: 1ex;"> On Aug 6, 2020, at 7:32 PM, Nidish <nb25@rice.edu> wrote:<br> <br> I'm relatively new to PETSc, and my applications involve (for the most part) dense matrix solves.<br> <br> I read in the documentation that this is an area PETSc does not specialize in but instead recommends external libraries such as Elemental. I'm wondering if there are any "best" practices in this regard. Some questions I'd like answered are:<br> <br> 1. Can I just declare my dense matrix as a sparse one and fill the whole matrix up? Do any of the others go this route? What're possible pitfalls/unfavorable outcomes for this? I understand the memory overhead probably shoots up.<br></blockquote><br> No, this isn't practical, the performance will be terrible.<br><br><blockquote class="gmail_quote" style="margin: 0pt 0pt 1ex 0.8ex; border-left: 1px solid #729fcf; padding-left: 1ex;"> 2. Are there any specific guidelines on when I can expect elemental to perform better in parallel than in serial?<br></blockquote><br> Because the computation to communication ratio for dense matrices is higher than for sparse you will see better parallel performance for dense problems of a given size than sparse problems of a similar size. In other words parallelism can help for dense matrices for relatively small problems, of course the specifics of your machine hardware and software also play a role.<br><br> Barry<br><br><blockquote class="gmail_quote" style="margin: 0pt 0pt 1ex 0.8ex; border-left: 1px solid #729fcf; padding-left: 1ex;"> <br> Of course, I'm interesting in any other details that may be important in this regard.<br> <br> Thank you,<br> Nidish<br></blockquote><br></pre></blockquote></div></body></html>