<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Hi,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I try to use darshan to profile the IO of fleunt.<o:p></o:p></p>
<p class="MsoNormal">For that I do<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">export LD_PRELOAD= /scratch/tgeenen/build/darshan-runtime-icc14.0/lib/libdarshan.so<o:p></o:p></p>
<p class="MsoNormal">and run fluent<o:p></o:p></p>
<p class="MsoNormal">fluent -mpi=intel -g 3ddp -t2 -i journal_lowb<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">this does not work.<o:p></o:p></p>
<p class="MsoNormal">After looking into it a bit more carefully I found that in the script<o:p></o:p></p>
<p class="MsoNormal">ansys/15.0.5/v150/fluent/fluent15.0.0/multiport/mpi_wrapper/bin/mpirun.fl<o:p></o:p></p>
<p class="MsoNormal">LD_PRELOAD Is overwritten<o:p></o:p></p>
<p class="MsoNormal">So I hacked it a little, <o:p></o:p></p>
<p class="MsoNormal">FS_MPIRUN_FLAGS="$FS_MPIRUN_FLAGS -genv LD_PRELOAD $LD_PRELOAD"<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Now I get some results but it seems that not all IO is intercepted.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">[tgeenen@ln001 30]$ darshan-job-summary.pl tgeenen_fluent_mpi.15.0.0_id24021_7-30-52184-13493803983035018749_1.darshan.gz<o:p></o:p></p>
<p class="MsoNormal">Slowest unique file time: 0<o:p></o:p></p>
<p class="MsoNormal">Slowest shared file time: 0.001565<o:p></o:p></p>
<p class="MsoNormal">Total bytes read and written by app (may be incorrect): 0<o:p></o:p></p>
<p class="MsoNormal">Total absolute I/O time: 0.001565<o:p></o:p></p>
<p class="MsoNormal">Warning: empty y range [0:0], adjusting to [-1:1]<o:p></o:p></p>
<p class="MsoNormal">Warning: empty y range [0:0], adjusting to [-1:1]<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">[tgeenen@ln001 30]$ darshan-summary-per-file.sh tgeenen_fluent_mpi.15.0.0_id24021_7-30-52184-13493803983035018749_1.darshan.gz output_directory<o:p></o:p></p>
<p class="MsoNormal">Status: Generating summary for file 1 of 1: thermo.db<o:p></o:p></p>
<p class="MsoNormal">=======================================================<o:p></o:p></p>
<p class="MsoNormal">Slowest unique file time: 0<o:p></o:p></p>
<p class="MsoNormal">Slowest shared file time: 0.001565<o:p></o:p></p>
<p class="MsoNormal">Total bytes read and written by app (may be incorrect): 0<o:p></o:p></p>
<p class="MsoNormal">Total absolute I/O time: 0.001565<o:p></o:p></p>
<p class="MsoNormal">Warning: empty y range [0:0], adjusting to [-1:1]<o:p></o:p></p>
<p class="MsoNormal">Warning: empty y range [0:0], adjusting to [-1:1]<o:p></o:p></p>
<p class="MsoNormal">=======================================================<o:p></o:p></p>
<p class="MsoNormal">darshan-summary-per-file.sh done. Results can be found in output_directory/*.pdf.<o:p></o:p></p>
<p class="MsoNormal">[tgeenen@ln001 30]$ ls output_directory/<o:p></o:p></p>
<p class="MsoNormal">thermo.db.gz thermo.db.pdf<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">seems that only io for thermo.db is captured<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I posted a question with Ansys support but they seem to be not very familiar with darshan.<o:p></o:p></p>
<p class="MsoNormal">I would be interested to understand if other users have experience with profiling fluent.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">thanks<o:p></o:p></p>
<p class="MsoNormal">Thomas Geenen<o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal">Project Lead High Performance Computing<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">HPC Application & Infrastucture Expert/Architect<o:p></o:p></p>
<p class="MsoNormal"><a href="mailto:thomas.geenen@asml.com">thomas.geenen@asml.com</a><o:p></o:p></p>
</div>
-- The information contained in this communication and any attachments is confidential and may be privileged, and is for the sole use of the intended recipient(s). Any unauthorized review, use, disclosure or distribution is prohibited. Unless explicitly stated
otherwise in the body of this communication or the attachment thereto (if any), the information is provided on an AS-IS basis without any express or implied warranties or liabilities. To the extent you are relying on this information, you are doing so at your
own risk. If you are not the intended recipient, please notify the sender immediately by replying to this message and destroy all copies of this message and any attachments. The sender nor the company/group of companies he or she represents shall be liable
for the proper and complete transmission of the information contained in this communication, or for any delay in its receipt.
</body>
</html>