<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
<div style="color: rgb(0, 0, 0); font-family: Calibri, sans-serif; font-size: 14px; ">
<div>
<div>Hi Iulian, </div>
</div>
</div>
<div style="color: rgb(0, 0, 0); font-family: Calibri, sans-serif; font-size: 14px; ">
<br>
</div>
<div style="color: rgb(0, 0, 0); font-family: Calibri, sans-serif; font-size: 14px; ">
Thanks for the quick response…</div>
<div style="color: rgb(0, 0, 0); font-family: Calibri, sans-serif; font-size: 14px; ">
<br>
</div>
<div><font face="Calibri,sans-serif" size="3">I am able to run that 'mbconvert' command in parallel as well without error. </font></div>
<div><font face="Calibri,sans-serif" size="3"><br>
</font></div>
<div><font face="Calibri,sans-serif" size="3">Where I am running into an issue is when I try to read the partitioned mesh file (</font>twoPolyhedra.p2.h5m) into a finite element code using the DMMoabLoadFromFile(…) function on two processors. I get the following
error after calling DMMoabLoadFromFile() : </div>
<div><br>
</div>
<div>
<div style="font-family: 'Times New Roman'; font-size: 16px; ">"</div>
<div style="font-family: 'Times New Roman'; font-size: 16px; ">ParallelComm.cpp:2928: moab::ErrorCode moab::ParallelComm::get_local_handles(moab::EntityHandle*, int, const std::vector<long unsigned int>&): Assertion `ID_FROM_HANDLE(from_vec[i]) < (int) new_ents.size()'
failed.</div>
<div style="font-family: 'Times New Roman'; font-size: 16px; ">"</div>
</div>
<div style="font-family: 'Times New Roman'; font-size: 16px; "><br>
</div>
<div style="font-family: 'Times New Roman'; font-size: 16px; "><span style="font-family: Calibri, sans-serif; font-size: medium; ">However, reading the unpartitioned mesh </span><font face="Calibri,sans-serif" size="3">(</font>twoPolyhedra.p1.h5m)<span style="font-family: Calibri, sans-serif; font-size: medium; "> on
one processor works fine. </span></div>
<div style="font-family: 'Times New Roman'; font-size: 16px; "><span style="font-family: Calibri, sans-serif; font-size: medium; "><br>
</span></div>
<div style="font-family: 'Times New Roman'; font-size: 16px; "><span style="font-family: Calibri, sans-serif; font-size: medium; ">-Jim</span></div>
<div style="font-family: 'Times New Roman'; font-size: 16px; "><br>
</div>
<div style="color: rgb(0, 0, 0); font-family: Calibri, sans-serif; font-size: 14px; ">
<br>
</div>
<span id="OLK_SRC_BODY_SECTION" style="color: rgb(0, 0, 0); font-family: Calibri, sans-serif; font-size: 14px; ">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span><Grindeanu>, "Iulian R." <<a href="mailto:iulian@mcs.anl.gov">iulian@mcs.anl.gov</a>><br>
<span style="font-weight:bold">Date: </span>Tuesday, April 28, 2015 2:58 PM<br>
<span style="font-weight:bold">To: </span>"WARNER, JAMES E. (LARC-D309)" <<a href="mailto:james.e.warner@nasa.gov">james.e.warner@nasa.gov</a>>, "<a href="mailto:moab-dev@mcs.anl.gov">moab-dev@mcs.anl.gov</a>" <<a href="mailto:moab-dev@mcs.anl.gov">moab-dev@mcs.anl.gov</a>><br>
<span style="font-weight:bold">Subject: </span>RE: [MOAB-dev] Polyhedra elements in parallell<br>
</div>
<div><br>
</div>
<div dir="ltr">
<div ocsi="0" fpstyle="1" style="word-wrap:break-word; color:rgb(0,0,0); font-size:14px; font-family:Calibri,sans-serif">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">Hi Jim,<br>
I was able to "mbconvert" in parallel your file, with a command like<br>
mpiexec -np 2 mbconvert -O PARALLEL=READ_PART -O PARTITION=PARALLEL_PARTITION -O PARALLEL_RESOLVE_SHARED_ENTS -o PARALLEL=WRITE_PART twoPolyhedra.p2.h5m jj.h5m
<br>
<br>
mbpart created correctly the partitions, (each with one element).<br>
<br>
What options do you use when you load the file in parallel?<br>
<br>
You can add also an option like -O DEBUG_IO=2, it will output more debug info during reading<br>
<br>
So what options do you pass when loading the file?<br>
<br>
Thanks,<br>
Iulian<br>
<br>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div style="direction: ltr;" id="divRpF766671"><font color="#000000" size="2" face="Tahoma"><b>From:</b> WARNER, JAMES E. (LARC-D309) [<a href="mailto:james.e.warner@nasa.gov">james.e.warner@nasa.gov</a>]<br>
<b>Sent:</b> Tuesday, April 28, 2015 12:47 PM<br>
<b>To:</b> Grindeanu, Iulian R.; <a href="mailto:moab-dev@mcs.anl.gov">moab-dev@mcs.anl.gov</a><br>
<b>Subject:</b> Re: [MOAB-dev] Polyhedra elements in parallell<br>
</font><br>
</div>
<div></div>
<div>
<div>
<div>Hi Iulian, </div>
<div><br>
</div>
<div>I fixed the bug I mentioned previously but still get the same MOAB error when reading the mesh with two partitions. Attached here are the original (.p1.) and partitioned (.p2.) meshes. Let me know if you have any suggestions when you get a chance to take
a look. Thanks a lot!</div>
<div><br>
</div>
<div>Best,</div>
<div>Jim</div>
<div><br>
</div>
</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; border-bottom:medium none; border-left:medium none; padding-bottom:0in; padding-left:0in; padding-right:0in; border-top:#b5c4df 1pt solid; border-right:medium none; padding-top:3pt">
<span style="font-weight:bold">From: </span><WARNER>, "WARNER, JAMES E. (LARC-D309)" <<a href="mailto:james.e.warner@nasa.gov" target="_blank">james.e.warner@nasa.gov</a>><br>
<span style="font-weight:bold">Date: </span>Monday, April 27, 2015 5:00 PM<br>
<span style="font-weight:bold">To: </span>"Grindeanu, Iulian R." <<a href="mailto:iulian@mcs.anl.gov" target="_blank">iulian@mcs.anl.gov</a>>, "<a href="mailto:moab-dev@mcs.anl.gov" target="_blank">moab-dev@mcs.anl.gov</a>" <<a href="mailto:moab-dev@mcs.anl.gov" target="_blank">moab-dev@mcs.anl.gov</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [MOAB-dev] Polyhedra elements in parallell<br>
</div>
<div><br>
</div>
<div>
<div style="word-wrap:break-word; color:rgb(0,0,0); font-size:14px; font-family:Calibri,sans-serif">
<div>
<div>
<div>Hi Iulian,</div>
</div>
</div>
<div><br>
</div>
<div>The face that the two polyhedron elements have in common was given a different ID in each element's connectivity… so that is probably the issue. I'm going to look into fixing that and I'll let you know if it's resolved afterwards. Sorry about that!</div>
<div><br>
</div>
<div>-Jim</div>
<div><br>
</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; border-bottom:medium none; border-left:medium none; padding-bottom:0in; padding-left:0in; padding-right:0in; border-top:#b5c4df 1pt solid; border-right:medium none; padding-top:3pt">
<span style="font-weight:bold">From: </span><Grindeanu>, "Iulian R." <<a href="mailto:iulian@mcs.anl.gov" target="_blank">iulian@mcs.anl.gov</a>><br>
<span style="font-weight:bold">Date: </span>Monday, April 27, 2015 4:42 PM<br>
<span style="font-weight:bold">To: </span>"WARNER, JAMES E. (LARC-D309)" <<a href="mailto:james.e.warner@nasa.gov" target="_blank">james.e.warner@nasa.gov</a>>, "<a href="mailto:moab-dev@mcs.anl.gov" target="_blank">moab-dev@mcs.anl.gov</a>" <<a href="mailto:moab-dev@mcs.anl.gov" target="_blank">moab-dev@mcs.anl.gov</a>><br>
<span style="font-weight:bold">Subject: </span>RE: [MOAB-dev] Polyhedra elements in parallell<br>
</div>
<div><br>
</div>
<div dir="ltr"><style id="owaParaStyle" type="text/css">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
BODY {direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;}P {margin-top:0;margin-bottom:0;}BODY {scrollbar-base-color:undefined;scrollbar-highlight-color:undefined;scrollbar-darkshadow-color:undefined;scrollbar-track-color:undefined;scrollbar-arrow-color:undefined}</style>
<div style="word-wrap:break-word; color:rgb(0,0,0); font-size:14px; font-family:Calibri,sans-serif">
<div style="direction:ltr; font-family:Tahoma; color:#000000; font-size:10pt"><br>
my guess is that mbpart (with default options) distributed all faces to different processors, so maybe meshes are not "complete" in the partition; I think that mbpart will need to change for polyhedral meshes.
<br>
As Rajeev said, can you send your mesh files (before and after partitioning) ?<br>
Thanks,<br>
Iulian<br>
<div style="font-family:Times New Roman; color:#000000; font-size:16px">
<hr tabindex="-1">
<div id="divRpF479283" style="direction:ltr"><font color="#000000" size="2" face="Tahoma"><b>From:</b><a href="mailto:moab-dev-bounces@mcs.anl.gov" target="_blank">moab-dev-bounces@mcs.anl.gov</a> [<a href="mailto:moab-dev-bounces@mcs.anl.gov" target="_blank">moab-dev-bounces@mcs.anl.gov</a>]
on behalf of WARNER, JAMES E. (LARC-D309) [<a href="mailto:james.e.warner@nasa.gov" target="_blank">james.e.warner@nasa.gov</a>]<br>
<b>Sent:</b> Monday, April 27, 2015 3:12 PM<br>
<b>To:</b> <a href="mailto:moab-dev@mcs.anl.gov" target="_blank">moab-dev@mcs.anl.gov</a><br>
<b>Subject:</b> [MOAB-dev] Polyhedra elements in parallell<br>
</font><br>
</div>
<div></div>
<div>
<div>
<div>
<div>Hello,</div>
</div>
</div>
<div><br>
</div>
<div>I generated a MOAB finite element mesh with polyhedra elements that works fine on one processor. However, when I use mbpart to generate two partitions and run my finite element code in parallel, I get the following error when calling DMMoabLoadFromFile()
:</div>
<div><br>
</div>
<div>"</div>
<div>ParallelComm.cpp:2928: moab::ErrorCode moab::ParallelComm::get_local_handles(moab::EntityHandle*, int, const std::vector<long unsigned int>&): Assertion `ID_FROM_HANDLE(from_vec[i]) < (int) new_ents.size()' failed.</div>
<div>"</div>
<div><br>
</div>
<div>Ultimately, I'd like to use MOAB's polyhedra elements to implement arbitrary user-defined finite elements in the code I work on, but as a simple initial test I am trying to create a mesh with just two 3D bricks using MBPOLYHEDRON rather than MBHEX. I first
generate 2D quad elements for the six facets of each 3D element and use an array of these facets as the connectivity for each polyhedron element, according to the documentation. I don't get any warning or error messages when generating the input mesh file
or when calling mbpart to partition the mesh, only when trying to read it into the finite element code in parallel. And again, it appears to be working correctly in serial. </div>
<div><br>
</div>
<div>It's possible I am overlooking something in my code for generating the mesh, so if you can provide any info about the error above and what may be causing it I'd appreciate it!</div>
<div><br>
</div>
<div>Thanks a lot,</div>
<div>-Jim </div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</div>
</span></div>
</div>
</span></div>
</div>
</div>
</div>
</div>
</span>
</body>
</html>