<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Hi Radita,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
That warning just means that Darshan stopped tracking new records at runtime, presumably because one of your modules generated over the maximum number of runtime records (currently 1024 per module) or because Darshan's maximum memory threshold was exceeded
(currently, 4 MiB per process). The warning messages in the darshan-parser output you mention should indicate which module(s) specifically ran out of memory. I.e.,:</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span># *WARNING*: The POSIX module contains incomplete data!<br>
</span>
<div># This happens when a module runs out of<br>
</div>
<span># memory to store new record data.</span></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
The record limit (1024) isn't configurable at runtime, so if you are hitting that (perhaps with the HDF5 module?), it might be worth trying to use the DARSHAN_EXCLUDE_DIRS environment variable to focus the instrumentation on files of interest in a particular
directory, for instance. You could share the log file with us to see if we have more specific recommendations for getting Darshan to hold on to the data that's most important to you.<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
The darshan-job-summary tool currently does not display any details from the HDF5 layer, unfortunately. We just recently added detailed HDF5 support to Darshan, but are also thinking about rewriting the darshan-job-summary tool in the near future, so decided
to hold off until then to include that information. We can share more details on the mailing list when we are further along on this effort.<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Thanks,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
--Shane<br>
</div>
<div id="appendonsend"></div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Darshan-users <darshan-users-bounces@lists.mcs.anl.gov> on behalf of Liem, Radita <Liem@itc.rwth-aachen.de><br>
<b>Sent:</b> Tuesday, July 21, 2020 5:40 AM<br>
<b>To:</b> darshan-users@lists.mcs.anl.gov <darshan-users@lists.mcs.anl.gov><br>
<b>Subject:</b> [Darshan-users] Cause of Darshan warning on the generated report</font>
<div> </div>
</div>
<div class="BodyFragment"><font size="2"><span style="font-size:11pt">
<div class="PlainText">Dear all, <br>
<br>
I tried to run Darshan on several programs and when I tried to generate<br>
Latex report, I got warning message: This Darshan log contains incomplete<br>
data which may skew results in this document. <br>
When I checked the parsed log result, the STDIO module data is always empty.<br>
Is this the cause of the warning message on the Latex output? And if that's<br>
the case, how to fix this problem? <br>
<br>
The programs also use HDF5 called from Fortran code, the Darshan log shows<br>
that there are H5D and H5F module data but it doesn't appear on the Latex<br>
output. <br>
I also wonder what is the cause for this and how to fix it. <br>
<br>
My Darshan version is 3.2.1 with hdf5 1.8.21 <br>
<br>
Best, <br>
Radita Liem, M. Sc.<br>
<br>
IT Center<br>
Group: High Performance Computing<br>
Division: Computational Science and Engineering<br>
RWTH Aachen University<br>
Seffenter Weg 23<br>
D 52074 Aachen (Germany)<br>
liem@itc.rwth-aachen.de <<a href="mailto:liem@itc.rwth-aachen.de">mailto:liem@itc.rwth-aachen.de</a>>
<br>
<a href="http://www.itc.rwth-aachen.de">www.itc.rwth-aachen.de</a> <<a href="http://www.itc.rwth-aachen.de">http://www.itc.rwth-aachen.de</a>><br>
</div>
</span></font></div>
</body>
</html>