<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Hi Wadud,<br>
<br>
I'm assuming this is a Fortran app, right?<br>
<br>
If so, I believe this is tied back to a known issue with Intel MPI's
Fortran bindings. Long story short, these bindings are calling the
PMPI variants of the MPI function calls directly which bypasses any
profiling tool that wraps the MPI interface at the C layer (e.g.,
Darshan). See this post for more details:
<a class="moz-txt-link-freetext" href="https://software.intel.com/en-us/forums/intel-clusters-and-hpc-technology/topic/279445">https://software.intel.com/en-us/forums/intel-clusters-and-hpc-technology/topic/279445</a><br>
<br>
I haven't personally confirmed this on Intel MPI 5.x versions (the
post I reference above is regarding a 4.x version of Intel MPI), but
I believe other users have reported the problem still exists.<br>
<br>
It should be possible to work around the issue by modifying Darshan
to provide an additional interface for intercepting Fortran MPI
calls natively at the Fortran layer, but we have not undertaken this
development effort as of yet. Lacking that, I'm not sure what, if
any, other solutions there are, unfortunately.<br>
<br>
Thanks,<br>
--Shane<br>
<br>
<div class="moz-cite-prefix">On 11/28/2016 02:58 PM, Wadud Miah
wrote:<br>
</div>
<blockquote
cite="mid:AM4PR0501MB270766FF9D73CE244C540D41C08A0@AM4PR0501MB2707.eurprd05.prod.outlook.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
<div id="divtagdefaultwrapper" style="font-size:12pt;
color:#000000; background-color:#FFFFFF;
font-family:Calibri,Arial,Helvetica,sans-serif">
<div class="wiki">
<p dir="auto">Hello, <br>
</p>
<p dir="auto"><br>
</p>
<p dir="auto">I built Darshan with Intel MPI 5.1.3 and gcc
4.3.4 with the following configure flags:</p>
<p dir="auto"><br>
</p>
<p dir="auto"><code><span style="font-size: 11pt;">./configure
--prefix=$HOME/darshan-3.1.2-impi --with-mem-align=8
--with-jobid-env=NONE
--with-log-path-by-env=DARSHAN_LOGPATH</span></code></p>
<p dir="auto"><code><br>
</code></p>
<p dir="auto">which built fine. I set <code>DARSHAN_LOGPATH</code>
to <code>darshan-trace-dir</code> and I created the
directory
<code>darshan-trace-dir</code>. I then executed my MPI code
which does I/O using:</p>
<p dir="auto"><br>
</p>
<p dir="auto"><code><span style="font-size: 11pt;">mpirun -n 9
-env LD_PRELOAD
/home/pr1ebt00/pr1ebt05/darshan-3.1.2-impi/lib/libdarshan.so
./bt.A.9.mpi_io_full</span></code></p>
<p dir="auto"><code><br>
</code></p>
<p dir="auto">in the same directory that has the <code>darshan-trace-dir</code>
directory. However, I do not see any tracefile in the
directory
<code>darshan-trace-dir</code> and no error messages. Any
help will be greatly appreciated.
<br>
</p>
<p dir="auto"><br>
</p>
<p dir="auto">Thanks in advance, <br>
</p>
<p dir="auto">Wadud.</p>
</div>
<br>
<div id="Signature">
<div id="divtagdefaultwrapper" style="font-size:12pt;
color:#000000; background-color:#FFFFFF;
font-family:Calibri,Arial,Helvetica,sans-serif">
<p>---------------------------------------<br>
</p>
<p>Dr. Wadud Miah</p>
<p>Computational Scientist</p>
<p>Numerical Algorithms Group</p>
<p>01865 518035</p>
<p><br>
</p>
</div>
</div>
</div>
<hr width="100%">
<p>The Numerical Algorithms Group Ltd is a company registered in
England and Wales with company number 1249803. The registered
office is:</p>
<p>Wilkinson House, Jordan Hill Road, Oxford OX2 8DR, United
Kingdom.</p>
<p> </p>
<p>This e-mail has been scanned for all viruses by Microsoft
Office 365. </p>
<hr width="100%">
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Darshan-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Darshan-users@lists.mcs.anl.gov">Darshan-users@lists.mcs.anl.gov</a>
<a class="moz-txt-link-freetext" href="https://lists.mcs.anl.gov/mailman/listinfo/darshan-users">https://lists.mcs.anl.gov/mailman/listinfo/darshan-users</a>
</pre>
</blockquote>
<br>
</body>
</html>