<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Menlo;
panose-1:2 11 6 9 3 8 4 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
p.p1, li.p1, div.p1
{mso-style-name:p1;
margin:0cm;
font-size:10.5pt;
font-family:Menlo;
color:black;}
span.s1
{mso-style-name:s1;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
.MsoPapDefault
{mso-style-type:export-only;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="FR-BE" link="#0563C1" vlink="#954F72" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR">Hello, <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR"> <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR">I am using the DMSwarm library in some Eulerian-Lagrangian approach to have vapor bubbles in water. <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR">I have obtained nice results recently and wanted to perform bigger simulations. Unfortunately, when I increase the number of processors used to run the simulation, I get the
following error:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR"><o:p> </o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">free(): invalid size</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] *** Process received signal ***</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] Signal: Aborted (6)</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] Signal code:</span></span><span class="apple-converted-space"><span lang="EN-US">
</span></span><span class="s1"><span lang="EN-US">(-6)</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [ 0] /lib64/libc.so.6(+0x4eb20)[0x7f56cd4c9b20]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [ 1] /lib64/libc.so.6(gsignal+0x10f)[0x7f56cd4c9a9f]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [ 2] /lib64/libc.so.6(abort+0x127)[0x7f56cd49ce05]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [ 3] /lib64/libc.so.6(+0x91037)[0x7f56cd50c037]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [ 4] /lib64/libc.so.6(+0x9819c)[0x7f56cd51319c]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [ 5] /lib64/libc.so.6(+0x99aac)[0x7f56cd514aac]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [ 6] /gpfs/home/acad/ucl-tfl/marichaj/marha/lib_petsc/lib/libpetsc.so.3.019(PetscSFSetUpRanks+0x4c4)[0x7f56cea71e64]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [ 7] /gpfs/home/acad/ucl-tfl/marichaj/marha/lib_petsc/lib/libpetsc.so.3.019(+0x841642)[0x7f56cea83642]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [ 8] /gpfs/home/acad/ucl-tfl/marichaj/marha/lib_petsc/lib/libpetsc.so.3.019(PetscSFSetUp+0x9e)[0x7f56cea7043e]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1">[cns136:590327] [ 9] /gpfs/home/acad/ucl-tfl/marichaj/marha/lib_petsc/lib/libpetsc.so.3.019(VecScatterCreate+0x164e)[0x7f56cea7bbde]</span><o:p></o:p></p>
<p class="p1"><span class="s1">[cns136:590327] [10] /gpfs/home/acad/ucl-tfl/marichaj/marha/lib_petsc/lib/libpetsc.so.3.019(DMSetUp_DA_3D+0x3e38)[0x7f56cee84dd8]</span><o:p></o:p></p>
<p class="p1"><span class="s1">[cns136:590327] [11] /gpfs/home/acad/ucl-tfl/marichaj/marha/lib_petsc/lib/libpetsc.so.3.019(DMSetUp_DA+0xd8)[0x7f56cee9b448]</span><o:p></o:p></p>
<p class="p1"><span class="s1">[cns136:590327] [12] /gpfs/home/acad/ucl-tfl/marichaj/marha/lib_petsc/lib/libpetsc.so.3.019(DMSetUp+0x20)[0x7f56cededa20]</span><o:p></o:p></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [13] ./cobpor[0x4418dc]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [14] ./cobpor[0x408b63]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [15] /lib64/libc.so.6(__libc_start_main+0xf3)[0x7f56cd4b5cf3]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] [16] ./cobpor[0x40bdee]</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">[cns136:590327] *** End of error message ***</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">--------------------------------------------------------------------------</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">Primary job</span></span><span class="apple-converted-space"><span lang="EN-US">
</span></span><span class="s1"><span lang="EN-US">terminated normally, but 1 process returned</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1">a non-zero exit code. </span><span class="s1"><span lang="EN-US">Per user-direction, the job has been aborted.</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">--------------------------------------------------------------------------</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">--------------------------------------------------------------------------</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">mpiexec noticed that process rank 84 with PID 590327 on node cns136 exited on signal 6 (Aborted).</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="p1"><span class="s1"><span lang="EN-US">--------------------------------------------------------------------------</span></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR">When I reduce the number of processors the error disappears and when I run my code without the vapor bubbles it also works.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR">The problem seems to take place at this moment:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR"><o:p> </o:p></span></p>
<p class="MsoNormal" style="line-height:13.5pt;background:#1E1E1E"><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#DCDCAA;mso-fareast-language:FR">DMCreate</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#D4D4D4;mso-fareast-language:FR">(PETSC_COMM_WORLD,swarm);<o:p></o:p></span></p>
<p class="MsoNormal" style="line-height:13.5pt;background:#1E1E1E"><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#D4D4D4;mso-fareast-language:FR">
</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#DCDCAA;mso-fareast-language:FR">DMSetType</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#D4D4D4;mso-fareast-language:FR">(*swarm,DMSWARM);<o:p></o:p></span></p>
<p class="MsoNormal" style="line-height:13.5pt;background:#1E1E1E"><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#D4D4D4;mso-fareast-language:FR">
</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#DCDCAA;mso-fareast-language:FR">DMSetDimension</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#D4D4D4;mso-fareast-language:FR">(*swarm,</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#B5CEA8;mso-fareast-language:FR">3</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#D4D4D4;mso-fareast-language:FR">);<o:p></o:p></span></p>
<p class="MsoNormal" style="line-height:13.5pt;background:#1E1E1E"><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#D4D4D4;mso-fareast-language:FR">
</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#DCDCAA;mso-fareast-language:FR">DMSwarmSetType</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#D4D4D4;mso-fareast-language:FR">(*swarm,DMSWARM_PIC);<o:p></o:p></span></p>
<p class="MsoNormal" style="line-height:13.5pt;background:#1E1E1E"><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#D4D4D4;mso-fareast-language:FR">
</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#DCDCAA;mso-fareast-language:FR">DMSwarmSetCellDM</span><span lang="EN-US" style="font-size:9.0pt;font-family:Menlo;color:#D4D4D4;mso-fareast-language:FR">(*swarm,*dmcell);<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR">Thanks a lot for your help. <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR"> <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR">Best regards, </span><span style="color:#212121;mso-fareast-language:FR"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR"> </span><span style="color:#212121;mso-fareast-language:FR"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:#212121;mso-fareast-language:FR">Joauma</span><span style="color:#212121;mso-fareast-language:FR"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="NL"><o:p></o:p></span></p>
</div>
</body>
</html>