<div dir="ltr"><div dir="ltr">On Sun, Jul 7, 2019 at 8:48 PM Matthew Knepley <<a href="mailto:knepley@gmail.com">knepley@gmail.com</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">On Sun, Jul 7, 2019 at 8:37 PM Adrian Croucher <<a href="mailto:a.croucher@auckland.ac.nz" target="_blank">a.croucher@auckland.ac.nz</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div bgcolor="#FFFFFF">
<p>hi Matt,<br>
</p>
<div class="gmail-m_-8684661936738753098gmail-m_-2479148903336121923moz-cite-prefix">On 29/06/19 12:07 AM, Matthew Knepley
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_quote"><br>
<div>Okay, I ran through this. I am attaching my C version
which was easier for me to play with in the debugger, but it
should not be</div>
<div>hard to put the few lines into yours. The problem comes
from using overlap in the redistribution. You can see this
by running</div>
<div><br>
</div>
<div> mpiexec -n 2 ./distgeom2 -overlap 1 -overlap2 0</div>
<div><br>
</div>
<div>which works fine. If overlap2 is 1, then the face data is
shifted.</div>
</div>
</div>
</blockquote>
<p><br>
</p>
<p>Yes, that's the same thing I found.<br>
</p>
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_quote">
<div>Something in DistributeField() does not know that we
changed</div>
<div>the topology after we distributed by adding overlap
cells. This is strange since DMPlexMigrate() works on the
coordinates for</div>
<div>the overlapped mesh, however they always start at 0 in
the vector, so it must be that some offset is missing. I am
looking for it now.</div>
</div>
</div>
</blockquote>
<p><br>
</p>
<p>It looked to me like the problem might lie not in
DMPlexDistributeField() but in DMPlexDistribute(), because if you
view the redistribution SF coming out of the second call to
DMPlexDistribute() it looks wrong.</p>
<p>DMPlexDistributeField() appeared to be doing what it was told,
but the SF it was given didn't look right to me.</p>
<p></p></div></blockquote><div>True. I fixed it, but I am just getting the PR in order. Should have it tomorrow morning.</div></div></div></blockquote><div><br></div><div>Sorry this took so long. I put in a PR for this:</div><div><br></div><div> <a href="https://bitbucket.org/petsc/petsc/pull-requests/1858/knepley-fix-plex-distribute-overlap/diff">https://bitbucket.org/petsc/petsc/pull-requests/1858/knepley-fix-plex-distribute-overlap/diff</a></div><div><br></div><div>I think it fixes your problem.</div><div><br></div><div> Thanks,</div><div><br></div><div> Matt</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_quote"><div> Thanks,</div><div><br></div><div> Matt </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div bgcolor="#FFFFFF"><p>- Adrian<br>
</p>
<pre class="gmail-m_-8684661936738753098gmail-m_-2479148903336121923moz-signature" cols="72">--
Dr Adrian Croucher
Senior Research Fellow
Department of Engineering Science
University of Auckland, New Zealand
email: <a class="gmail-m_-8684661936738753098gmail-m_-2479148903336121923moz-txt-link-abbreviated" href="mailto:a.croucher@auckland.ac.nz" target="_blank">a.croucher@auckland.ac.nz</a>
tel: +64 (0)9 923 4611
</pre>
</div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail-m_-8684661936738753098gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>-- Norbert Wiener</div><div><br></div><div><a href="http://www.cse.buffalo.edu/~knepley/" target="_blank">https://www.cse.buffalo.edu/~knepley/</a><br></div></div></div></div></div></div></div></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>-- Norbert Wiener</div><div><br></div><div><a href="http://www.cse.buffalo.edu/~knepley/" target="_blank">https://www.cse.buffalo.edu/~knepley/</a><br></div></div></div></div></div></div></div></div>