<div><font><p data-start="185" data-end="203">Dear PETSc Team,</p>
<p data-start="205" data-end="491">I am encountering an issue when running PETSc with CUDA support on a cluster. When I set the vector type to <code data-start="315" data-end="324" style="">VECCUDA</code>, PETSc reports that my MPI is <span data-start="355" data-end="372">not GPU-aware</span>. However, the MPI library (OpenMPI 4.1.5) I used to configure PETSc was built with the <code data-start="460" data-end="473">--with-cuda</code> option enabled.</p></font></div><div><font><p data-start="493" data-end="517">Here are some details:</p><blockquote formatblock="1" style="margin: 0.8em 0px 0.8em 2em; padding: 0px 0px 0px 0.7em; border-left: 2px solid rgb(221, 221, 221);">PETSc version: 3.20.6<br>MPI: OpenMPI 4.1.5, configured with <code data-start="610" data-end="623">--with-cuda<br></code>GPU: RTX3090<br>CUDA version: 12.1</blockquote>
<p data-start="725" data-end="827">I have attached both my <span data-start="749" data-end="776">PETSc configure command</span> and <span data-start="781" data-end="810">OpenMPI configure command</span> for reference.</p><p data-start="829" data-end="848">My questions are:</p><p data-start="725" data-end="827">
</p><ol data-start="849" data-end="1217">
<li data-start="849" data-end="956">
<p data-start="852" data-end="956">Even though I enabled <code data-start="874" data-end="887">--with-cuda</code> in OpenMPI, why does PETSc still report that MPI is not GPU-aware?</p>
</li>
<li data-start="957" data-end="1105">
<p data-start="960" data-end="1105">Are there additional steps or specific configuration flags required (either in OpenMPI or PETSc) to ensure GPU-aware MPI is correctly detected?</p></li></ol><p data-start="1219" data-end="1278">Any guidance or suggestions would be greatly appreciated.</p><p data-start="725" data-end="827">
</p><p data-start="1280" data-end="1309">Best regards,</p><p data-start="1280" data-end="1309">Xinhai Yue</p><p data-start="725" data-end="827"><br></p>
<p data-start="829" data-end="848"></p></font></div><div><sign signid="99"><div><font><br></font><div style="color:#909090;font-family:Arial Narrow;font-size:12px"></div></div><div style="font-size:14px;font-family:Verdana;color:#000;" class="signRealArea"><div><div class="logo" style="width:305px;height:35px;line-height:35px;margin:20px 0 0 0;"><img src="https://exmail.qq.com/cgi-bin/viewfile?type=logo&domain=mail.sustech.edu.cn" onerror=""></div><div class="c_detail" style="margin:10px 0 0 0;"><h4 class="name" style="margin:0;font-size:14px;font-weight:bold;line-height:28px;zoom:1;">岳新海</h4><p class="position" style="margin:0;line-height:22px;color:#a0a0a0;"></p><p class="department" style="margin:0;line-height:22px;color:#a0a0a0;">南方科技大学/学生/研究生/2023级研究生</p><p class="phone" style="margin:0;line-height:22px;color:#a0a0a0;"></p><p class="addr" style="margin:0;line-height:22px;color:#a0a0a0;">广东省深圳市南山区学苑大道1088号</p></div></div></div></sign></div><div> </div><div><includetail><!--<![endif]--></includetail></div>