[Darshan-users] Cause of Darshan warning on the generated report

[Snyder, Shane]

Hi Radita,

That warning just means that Darshan stopped tracking new records at runtime, presumably because one of your modules generated over the maximum number of runtime records (currently 1024 per module) or because Darshan's maximum memory threshold was exceeded (currently, 4 MiB per process). The warning messages in the darshan-parser output you mention should indicate which module(s) specifically ran out of memory. I.e.,:

# *WARNING*: The POSIX module contains incomplete data!
#            This happens when a module runs out of
#            memory to store new record data.

The record limit (1024) isn't configurable at runtime, so if you are hitting that (perhaps with the HDF5 module?), it might be worth trying to use the DARSHAN_EXCLUDE_DIRS environment variable to focus the instrumentation on files of interest in a particular directory, for instance. You could share the log file with us to see if we have more specific recommendations for getting Darshan to hold on to the data that's most important to you.

The darshan-job-summary tool currently does not display any details from the HDF5 layer, unfortunately. We just recently added detailed HDF5 support to Darshan, but are also thinking about rewriting the darshan-job-summary tool in the near future, so decided to hold off until then to include that information. We can share more details on the mailing list when we are further along on this effort.

Thanks,
--Shane
________________________________
From: Darshan-users <darshan-users-bounces at lists.mcs.anl.gov> on behalf of Liem, Radita <Liem at itc.rwth-aachen.de>
Sent: Tuesday, July 21, 2020 5:40 AM
To: darshan-users at lists.mcs.anl.gov <darshan-users at lists.mcs.anl.gov>
Subject: [Darshan-users] Cause of Darshan warning on the generated report

Dear all,

I tried to run Darshan on several programs and when I tried to generate
Latex report, I got warning message: This Darshan log contains incomplete
data which may skew results in this document.
When I checked the parsed log result, the STDIO module data is always empty.
Is this the cause of the warning message on the Latex output? And if that's
the case, how to fix this problem?

The programs also use HDF5 called from Fortran code, the Darshan log shows
that there are H5D and H5F module data but it doesn't appear on the Latex
output.
I also wonder what is the cause for this and how to fix it.

My Darshan version is 3.2.1 with hdf5 1.8.21

Best,
Radita Liem, M. Sc.

IT Center
Group: High Performance Computing
Division: Computational Science and Engineering
RWTH Aachen University
Seffenter Weg 23
D 52074  Aachen (Germany)
liem at itc.rwth-aachen.de <mailto:liem at itc.rwth-aachen.de>
www.itc.rwth-aachen.de<http://www.itc.rwth-aachen.de> <http://www.itc.rwth-aachen.de>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/darshan-users/attachments/20200722/8b0b18c8/attachment.html>