<div dir="ltr">> So in the beginning (without any ghosting), all shared vertices are owned by either task 0 or 1 <br><br>Aha, and since ghosting doesn't change ownership, after a ghosting step we do have shared vertices in the highest-rank process (but only about half as much as the other processes). Now makes all sense to me. Thanks!<div><br></div><div>--Nico<br><br><br><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Mon, Nov 2, 2015 at 5:51 AM Grindeanu, Iulian R. <<a href="mailto:iulian@mcs.anl.gov">iulian@mcs.anl.gov</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div style="direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt">Sorry,
<br>
I didn't see all these messages until now.<br>
these numbers refer only to vertices that are "shared" on each local task<br>
<br>
there are vertices on a task that are not shared with anybody, so they are owned by the local process<br>
<br>
The example, again, refers only to shared entities<br>
<br>
after ghosting, the number of shared entities grows (as ghost layers are exchanged too)<br>
<br>
In moab, the convention is in general that the lower rank task owns the vertex if it is shared with other tasks.<br>
<br>
So in the beginning (without any ghosting), all shared vertices are owned by either task 0 or 1
<br>
<div style="font-family:Times New Roman;color:#000000;font-size:16px">
<hr>
<div style="direction:ltr"><font face="Tahoma" color="#000000" size="2"><b>From:</b> <a href="mailto:moab-dev-bounces@mcs.anl.gov" target="_blank">moab-dev-bounces@mcs.anl.gov</a> [<a href="mailto:moab-dev-bounces@mcs.anl.gov" target="_blank">moab-dev-bounces@mcs.anl.gov</a>] on behalf of Nico Schlömer [<a href="mailto:nico.schloemer@gmail.com" target="_blank">nico.schloemer@gmail.com</a>]<br>
<b>Sent:</b> Sunday, November 01, 2015 10:27 PM<br>
<b>To:</b> Timothy Tautges<br>
<b>Cc:</b> <a href="mailto:moab-dev@mcs.anl.gov" target="_blank">moab-dev@mcs.anl.gov</a><br>
<b>Subject:</b> Re: [MOAB-dev] parallel i/o, not all vertices owned?<br>
</font><br>
</div></div></div></div><div><div style="direction:ltr;font-family:Tahoma;color:#000000;font-size:10pt"><div style="font-family:Times New Roman;color:#000000;font-size:16px">
<div></div>
<div>
<div dir="ltr">That's the thing: I only see 989+1078+679=2746 vertices out of a total 21218 owned. The rest is shared?
<div><br>
</div>
<div>Also, before ghosting, I see that process 3 doesn't own anything. Is that intentional?</div>
<div><br>
</div>
<div>--Nico</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr">On Mon, Nov 2, 2015 at 5:16 AM Timothy Tautges <<a href="mailto:timothy.tautges@cd-adapco.com" target="_blank">timothy.tautges@cd-adapco.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<p dir="ltr">Many verts are owned and not shared.</p>
<div class="gmail_quote">On Nov 1, 2015 10:12 PM, "Nico Schlömer" <<a href="mailto:nico.schloemer@gmail.com" target="_blank">nico.schloemer@gmail.com</a>> wrote:<br type="attribution">
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">When using MOAB's Parallel Hello-World example on [1], a mesh with over 20k vertices, I'm getting
<div>```</div>
<div>
<div>$ mpiexec -n 3 ./par-test</div>
<div> global rank:0 color:0 rank:0 of 3 processors</div>
<div> global rank:1 color:0 rank:1 of 3 processors</div>
<div>Reading file ./2.h5m</div>
<div> with options: PARALLEL=READ_PART;PARTITION=PARALLEL_PARTITION;PARALLEL_RESOLVE_SHARED_ENTS</div>
<div> on 3 processors on 1 communicator(s)</div>
<div> Shared, owned entities on proc 0: 452 verts, 1162 edges, 711 faces, 0 elements</div>
<div> Shared, owned entities on proc 1: 371 verts, 1037 edges, 666 faces, 0 elements</div>
<div> Shared, owned entities on proc 2: 0 verts, 0 edges, 0 faces, 0 elements</div>
<div> </div>
<div><br>
</div>
<div> After exchanging one ghost layer: </div>
<div> Shared, owned entities on proc 0: 989 verts, 1162 edges, 711 faces, 2301 elements</div>
<div> Shared, owned entities on proc 1: 1078 verts, 1037 edges, 666 faces, 3349 elements</div>
<div> Shared, owned entities on proc 2: 679 verts, 0 edges, 0 faces, 3182 elements</div>
</div>
<div>```<br>
<div>Only a few hundret owned vertices? That doesn't sum to to 20k. What's the issue here? Maybe I misunderstand the notion of ownage here.</div>
<div><br>
</div>
<div>Cheers,</div>
<div>Nico</div>
<div><br>
</div>
<div>[1] <a href="http://chunk.io/f/c3ee1eebbcbd4734a368ffb287f1f37f" target="_blank">
http://chunk.io/f/c3ee1eebbcbd4734a368ffb287f1f37f</a><br>
</div>
</div>
</div>
</blockquote>
</div>
</blockquote>
</div>
</div>
</div></div></div></blockquote></div>