[Darshan-users] Error: unable to inflate darshan log data.

Harms, Kevin harms at alcf.anl.gov
Tue Jun 15 09:31:23 CDT 2021


Tin,

  it looks like something is wrong with the log file. How many clients and ranks did you run on? Are you writing the log file to local disk, NFS or a parallel file system?

kevin

________________________________________
From: Darshan-users <darshan-users-bounces at lists.mcs.anl.gov> on behalf of Tin mwo1 <tinmwo1 at gmail.com>
Sent: Tuesday, June 15, 2021 1:02 AM
To: darshan-users at lists.mcs.anl.gov
Subject: [Darshan-users] Error: unable to inflate darshan log data.

Hello all,

I've compiled darhan-3.3.0 on RHEL 7.8 and was able to follow along with the demo at https://github.com/kchasapis/esiwace_demo_darshan for dir1 up to the point where I able to create a darharn trace file:
root_ssf_exe_id55933_6-15-1667-14933317035636391624_1.darshan
 with a size of 2.3k

when I try running the darshan-job-summary.pl<http://darshan-job-summary.pl> I get the following error:

~/darshan-3.3.0/darshan-util/bin/darshan-job-summary.pl<http://darshan-job-summary.pl> root_ssf_exe_id55933_6-15-1667-14933317035636391624_1.darshan
Error: unable to inflate darshan log data.
Error: failed to read name hash from darshan log file.
darshan-parser failure:  65280 at /root/darshan-3.3.0/darshan-util/bin/darshan-job-summary.pl<http://darshan-job-summary.pl> line 358.

After looking at the perl script I proceed to run just the darshan-parser and I'm getting the same error below.

~/darshan-3.3.0/darshan-util/bin/darshan-parser root_ssf_exe_id55933_6-15-1667-14933317035636391624_1.darshan
Error: unable to inflate darshan log data.
Error: failed to read name hash from darshan log file.

Here's the output of the ./configure:

 ./configure CC=mpicc --prefix=`pwd`
checking for a BSD-compatible install... /usr/bin/install -c
checking for gcc... mpicc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether mpicc accepts -g... yes
checking for mpicc option to accept ISO C89... none needed
checking how to run the C preprocessor... mpicc -E
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking zlib.h usability... yes
checking zlib.h presence... yes
checking for zlib.h... yes
checking for inflateEnd in -lz... yes
checking if bzlib is wanted... yes
checking for BZ2_bzCompressInit in -lbz2... yes
checking bzlib.h usability... yes
checking bzlib.h presence... yes
checking for bzlib.h... yes
checking for BZ2_bzCompressInit in -lbz2... (cached) yes
checking bzlib in /usr... ok
checking for inttypes.h... (cached) yes
checking whether the inttypes.h PRIxNN macros are broken... no
checking for inttypes.h... (cached) yes
checking for pdflatex... yes
checking for -halt-on-error argument to pdflatex... yes
checking whether byte ordering is bigendian... no
checking for off64_t... yes
checking for python... /usr/bin/python
checking for python version... 2.7
checking for python platform... linux2
checking for python script directory... ${prefix}/lib/python2.7/site-packages
checking for python extension module directory... ${exec_prefix}/lib64/python2.7/site-packages
checking for strndup... yes
configure: creating ./config.status
config.status: creating Makefile
config.status: creating darshan-job-summary/bin/darshan-job-summary.pl<http://darshan-job-summary.pl>
config.status: creating maint/darshan-util.pc
config.status: creating darshan-util-config.h
config.status: darshan-util-config.h is unchanged

and here is the output of the make:

 make -j 32 && make install
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-logutils.c -o darshan-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-posix-logutils.c -o darshan-posix-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-mpiio-logutils.c -o darshan-mpiio-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-hdf5-logutils.c -o darshan-hdf5-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-pnetcdf-logutils.c -o darshan-pnetcdf-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-bgq-logutils.c -o darshan-bgq-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-lustre-logutils.c -o darshan-lustre-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-stdio-logutils.c -o darshan-stdio-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-dxt-logutils.c -o darshan-dxt-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-mdhim-logutils.c -o darshan-mdhim-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c  darshan-null-logutils.c -o darshan-null-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -c lookup3.c -o lookup3.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -L/usr/lib jenkins-hash-gen.c lookup3.o -o jenkins-hash-gen -lz -lbz2
ar rcs libdarshan-util.a darshan-logutils.o darshan-posix-logutils.o darshan-mpiio-logutils.o darshan-hdf5-logutils.o darshan-pnetcdf-logutils.o darshan-bgq-logutils.o darshan-lustre-logutils.o darshan-stdio-logutils.o darshan-dxt-logutils.o darshan-mdhim-logutils.o
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -L/usr/lib darshan-analyzer.c libdarshan-util.a -o darshan-analyzer -lz -lbz2
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -L/usr/lib darshan-convert.c lookup3.o libdarshan-util.a -o darshan-convert -lz -lbz2
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -L/usr/lib darshan-diff.c libdarshan-util.a -o darshan-diff -lz -lbz2
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -L/usr/lib darshan-parser.c libdarshan-util.a -o darshan-parser -lz -lbz2
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -L/usr/lib darshan-dxt-parser.c libdarshan-util.a -o darshan-dxt-parser -lz -lbz2
mpicc -I . -I .. -I . -I ./../ -DDARSHAN_CONFIG_H=\"darshan-util-config.h\" -g -O2  -I/usr/include  -L/usr/lib darshan-merge.c libdarshan-util.a -o darshan-merge -lz -lbz2
install -d /root/darshan-3.3.0/darshan-util/bin
install -d /root/darshan-3.3.0/darshan-util/lib
install -d /root/darshan-3.3.0/darshan-util/include
install -m 755 darshan-analyzer /root/darshan-3.3.0/darshan-util/bin
install -m 755 darshan-convert /root/darshan-3.3.0/darshan-util/bin
install -m 755 darshan-diff /root/darshan-3.3.0/darshan-util/bin
install -m 755 darshan-parser /root/darshan-3.3.0/darshan-util/bin
install -m 755 darshan-dxt-parser /root/darshan-3.3.0/darshan-util/bin
install -m 755 darshan-merge /root/darshan-3.3.0/darshan-util/bin
install -m 755 ./darshan-summary-per-file.sh /root/darshan-3.3.0/darshan-util/bin
install -m 755 ./dxt_analyzer.py /root/darshan-3.3.0/darshan-util/bin
install -m 755 libdarshan-util.a /root/darshan-3.3.0/darshan-util/lib
install -m 644 ./darshan-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./darshan-posix-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./darshan-mpiio-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./darshan-hdf5-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./darshan-pnetcdf-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./darshan-bgq-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./darshan-null-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./darshan-lustre-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./darshan-stdio-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./darshan-dxt-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./darshan-mdhim-logutils.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./../darshan-null-log-format.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./../darshan-posix-log-format.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./../darshan-mpiio-log-format.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./../darshan-hdf5-log-format.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./../darshan-pnetcdf-log-format.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./../darshan-bgq-log-format.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./../darshan-lustre-log-format.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./../darshan-stdio-log-format.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./../darshan-dxt-log-format.h /root/darshan-3.3.0/darshan-util/include
install -m 644 ./../darshan-mdhim-log-format.h /root/darshan-3.3.0/darshan-util/include
install -d /root/darshan-3.3.0/darshan-util/include/uthash-1.9.2
install -d /root/darshan-3.3.0/darshan-util/include/uthash-1.9.2/src
install -m 644 uthash-1.9.2/src/uthash.h /root/darshan-3.3.0/darshan-util/include/uthash-1.9.2/src/
install -m 644 ./../darshan-log-format.h /root/darshan-3.3.0/darshan-util/include
install -m 755 darshan-job-summary/bin/darshan-job-summary.pl<http://darshan-job-summary.pl> /root/darshan-3.3.0/darshan-util/bin
install -d /root/darshan-3.3.0/darshan-util/lib/TeX
install -m 644 ./darshan-job-summary/lib/TeX/Encode.pm /root/darshan-3.3.0/darshan-util/lib/TeX/
install -d /root/darshan-3.3.0/darshan-util/lib/Number
install -d /root/darshan-3.3.0/darshan-util/lib/Number/Bytes
install -m 644 ./darshan-job-summary/lib/Number/Bytes/Human.pm /root/darshan-3.3.0/darshan-util/lib/Number/Bytes
install -d /root/darshan-3.3.0/darshan-util/lib/Pod
install -m 644 ./darshan-job-summary/lib/Pod/Constants.pm /root/darshan-3.3.0/darshan-util/lib/Pod/
install -m 644 ./darshan-job-summary/lib/Pod/LaTeX.pm /root/darshan-3.3.0/darshan-util/lib/Pod/
install -d /root/darshan-3.3.0/darshan-util/share
install -m 644 ./darshan-job-summary/share/* /root/darshan-3.3.0/darshan-util/share
install -d /root/darshan-3.3.0/darshan-util/lib/pkgconfig
install -m 644 maint/darshan-util.pc /root/darshan-3.3.0/darshan-util/lib/pkgconfig/darshan-util.pc

Is there something I'm missing or not including when I'm building the tool?

Thanks!

Tin


More information about the Darshan-users mailing list