<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Sure. Here is a quick explanation of each of these:</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<ul>
<li>MPIIO_F_WRITE_TIME: cumulative amount of time consumed by all MPIIO write functions
<br>
</li><li>MPIIO_F_MAX_WRITE_TIME: the amount of time consumed by the one slowest MPIIO write call<br>
</li><li>MPIIO_F_WRITE_START_TIMESTAMP: the timestamp (relative to when MPI_Init() was called) that the very first write issued began</li><li>MPIIO_F_WRITE_END_TIMESTAMP: the timestamp (relative to when MPI_Init() was called) of the very last write completing</li></ul>
<div>In your example these counters are probably representing all processes (you can tell if the output shows the rank as -1). That's why, for example, the cumulative time (the first counter) is so much later than the interval between the start/end timestamps.
The former is being summed across all ranks.</div>
<div><br>
</div>
<div>thanks,</div>
<div>-Phil</div>
<div><br>
</div>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Piero LANUCARA <p.lanucara@cineca.it><br>
<b>Sent:</b> Thursday, February 13, 2020 10:21 AM<br>
<b>To:</b> Carns, Philip H. <carns@mcs.anl.gov>; Snyder, Shane <ssnyder@mcs.anl.gov>; Harms, Kevin <harms@alcf.anl.gov><br>
<b>Cc:</b> darshan-users@lists.mcs.anl.gov <darshan-users@lists.mcs.anl.gov><br>
<b>Subject:</b> Re: [Darshan-users] Darshan & EPCC benchio different behaviour</font>
<div> </div>
</div>
<div>
<p>Hi Phil</p>
<p>totally agree.</p>
<p>I really appreciated your support very much.</p>
<p>P.S is it possible to undestand at a more detailed level all the parser output?</p>
<p>I still have some problem while trying to relate some of those values. For example, running MPIIO version, the following appears:</p>
<p>1) MPIIO_F_WRITE_TIME 103.772865</p>
<p>2)MPIIO_F_MAX_WRITE_TIME 3.107764 <br>
</p>
<p>3)MPIIO_F_WRITE_START_TIMESTAMP 22.217328 <br>
</p>
<p> 4) MPIIO_F_CLOSE_START_TIMESTAMP 25.707373 <br>
</p>
<p>so, is difficult to relate one with two or one with three, four values.</p>
<p>thanks again</p>
<p>Piero<br>
</p>
<div class="x_moz-cite-prefix">Il 13/02/2020 14:18, Carns, Philip H. ha scritto:<br>
</div>
<blockquote type="cite">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255)">
Thanks Piero. I agree, but from a practical point of view, I don't see many options for improving Darshan's handling of this particular scenario. If something in the Fortran runtime is impacting perceived I/O performance, then the only way to observe it would
be to wrap/instrument at the Fortran level rather than at the system library (libc) level. Otherwise Darshan can't tell the difference between the Fortran calls being slow or the Fortran calls being fast with the app doing something else in between calls.<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255)">
We've been reluctant to pursue that approach (we've hit cases before where instrumenting the Fortran level would have been helpful) because of the development/maintenance cost, in part because there is so much variety in the Fortran compiler world, and in part
because our team simply doesn't have a lot of Fortran expertise.<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255)">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255)">
That said, we would entertain a contribution along these lines <span>��</span> Something like that could be enabled as a compile-time option.</div>
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255)">
The good news (as you've seen with the MPI tests from benchio) is that what you are describing isn't really a problem for the MPI-IO interface. Most of the existing MPI-IO Fortran bindings map almost directly to the underlying C MPI-IO bindings, meaning that
what we measure at that level should be a pretty accurate indication of what's going on at the Fortran level. The scenario you have hit is an issue because the Fortran I/O calls likely have more logic that actually resides in the Fortran runtime itself.<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255)">
thanks,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0); background-color:rgb(255,255,255)">
-Phil<br>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
</blockquote>
</div>
</body>
</html>