[Darshan-commits] [Git][darshan/darshan][autoperf-mod] 15 commits: Update darshan-job-summary.pl.in
Kevin Harms
xgitlab at cels.anl.gov
Thu Jan 18 15:56:05 CST 2018
Kevin Harms pushed to branch autoperf-mod at darshan / darshan
Commits:
5fd87b0b by Thomas Applencourt at 2017-12-14T16:26:57-06:00
Update darshan-job-summary.pl.in
- - - - -
5ff6955f by Shane Snyder at 2017-12-15T14:46:06-06:00
fix bug in darshan-merge
utility was trying to aggregate DXT records, which have no
record aggregation function
- - - - -
61a1fa01 by Shane Snyder at 2017-12-19T15:24:08-06:00
Merge branch 'master' into 'master'
Update darshan-job-summary.pl.in
See merge request darshan/darshan!17
- - - - -
604df8cc by Phil Carns at 2018-01-05T12:14:13-08:00
fix __wrap_H5get_libversion undefined reference
- reported by Jialin Liu
- triggered by some HDF5 programs
- solved by eliminating incomplete wrapper mechanisms for H5get_libversion()
and invoking it directly (Darshan needs to use, not wrap, this
function)
- - - - -
e0051df0 by Shane Snyder at 2018-01-08T14:12:53-06:00
Merge branch 'dev-H5get_libversion_symbol' into 'master'
fix __wrap_H5get_libversion undefined reference
See merge request darshan/darshan!18
- - - - -
8f4d1e21 by Shane Snyder at 2018-01-09T04:59:24+00:00
propagate dxt env setting on bgq tests
- - - - -
1415afc1 by Shane Snyder at 2018-01-09T14:59:41+00:00
dxt bug fix in cobalt runjob script
- - - - -
866fe3d6 by Shane Snyder at 2018-01-09T09:01:56-06:00
update config versions for 3.1.5 release
- - - - -
52844ca8 by Shane Snyder at 2018-01-09T09:01:56-06:00
consistent DXT capitalization in darshan-util docs
- - - - -
db84851e by Shane Snyder at 2018-01-09T09:43:55-06:00
replace old example output that didn't include dxt
we should probably always include logs that contain dxt data in
the example output directory so we can track that module over
releases
- - - - -
cb8b3689 by Shane Snyder at 2018-01-09T09:44:55-06:00
new example log files for 3.1.5 release
- - - - -
3341b61f by Shane Snyder at 2018-01-09T18:09:34+00:00
fix broken cray-module-alcf runjob scripts
- - - - -
f6ee8cca by Shane Snyder at 2018-01-09T17:33:56-06:00
get dxt_analyzer show arg working
- - - - -
2becd2dc by Shane Snyder at 2018-01-09T17:43:18-06:00
brief note about dxt_analyzer in docs
- - - - -
86500f11 by Kevin Harms at 2018-01-18T21:55:44+00:00
Merge remote-tracking branch 'origin/master' into autoperf-mod
- - - - -
19 changed files:
- ChangeLog
- darshan-runtime/configure
- darshan-runtime/configure.in
- darshan-runtime/lib/darshan-hdf5.c
- darshan-runtime/share/ld-opts/darshan-hdf5-ld-opts
- darshan-test/example-output/mpi-io-test-ppc64-3.1.3.darshan
- darshan-test/example-output/mpi-io-test-ppc64-3.1.4.darshan
- + darshan-test/example-output/mpi-io-test-ppc64-3.1.5.darshan
- darshan-test/example-output/mpi-io-test-x86_64-3.1.3.darshan
- darshan-test/example-output/mpi-io-test-x86_64-3.1.4.darshan
- + darshan-test/example-output/mpi-io-test-x86_64-3.1.5.darshan
- darshan-test/regression/bg-profile-conf-alcf/runjob.sh
- darshan-test/regression/cray-module-alcf/runjob.sh
- darshan-util/configure
- darshan-util/configure.in
- darshan-util/darshan-job-summary/bin/darshan-job-summary.pl.in
- darshan-util/darshan-merge.c
- darshan-util/doc/darshan-util.txt
- darshan-util/dxt_analyzer.py
Changes:
=====================================
ChangeLog
=====================================
--- a/ChangeLog
+++ b/ChangeLog
@@ -2,7 +2,7 @@
Darshan Release Change Log
--------------------------
-Darshan-3.1.5-pre1
+Darshan-3.1.5
=============
* modify Darshan MPI instrumentation method to intercept both MPI and
PMPI symbols to workaround MPI implementations that are calling
@@ -19,6 +19,10 @@ Darshan-3.1.5-pre1
* add support for DARSHAN_EXCLUDE_DIRS environment variable to
explicitly disable instrumentation for files in given
directories. Contributed by Cristian Simarro.
+* correct "undefined reference to `__wrap_H5get_libversion'" linker failure
+ when compiling some HDF5 programs, reported by Jialin Liu
+* bug fix in darshan-merge utility related to logs containing DXT trace
+ data. Reported by Glenn Lockwood.
Darshan-3.1.4
=============
=====================================
darshan-runtime/configure
=====================================
--- a/darshan-runtime/configure
+++ b/darshan-runtime/configure
@@ -1,6 +1,6 @@
#! /bin/sh
# Guess values for system-dependent variables and create Makefiles.
-# Generated by GNU Autoconf 2.69 for darshan-runtime 3.1.5-pre1.
+# Generated by GNU Autoconf 2.69 for darshan-runtime 3.1.5.
#
#
# Copyright (C) 1992-1996, 1998-2012 Free Software Foundation, Inc.
@@ -577,8 +577,8 @@ MAKEFLAGS=
# Identity of this package.
PACKAGE_NAME='darshan-runtime'
PACKAGE_TARNAME='darshan-runtime'
-PACKAGE_VERSION='3.1.5-pre1'
-PACKAGE_STRING='darshan-runtime 3.1.5-pre1'
+PACKAGE_VERSION='3.1.5'
+PACKAGE_STRING='darshan-runtime 3.1.5'
PACKAGE_BUGREPORT=''
PACKAGE_URL=''
@@ -1263,7 +1263,7 @@ if test "$ac_init_help" = "long"; then
# Omit some internal or obsolete options to make the list less imposing.
# This message is too long to be a string in the A/UX 3.1 sh.
cat <<_ACEOF
-\`configure' configures darshan-runtime 3.1.5-pre1 to adapt to many kinds of systems.
+\`configure' configures darshan-runtime 3.1.5 to adapt to many kinds of systems.
Usage: $0 [OPTION]... [VAR=VALUE]...
@@ -1325,7 +1325,7 @@ fi
if test -n "$ac_init_help"; then
case $ac_init_help in
- short | recursive ) echo "Configuration of darshan-runtime 3.1.5-pre1:";;
+ short | recursive ) echo "Configuration of darshan-runtime 3.1.5:";;
esac
cat <<\_ACEOF
@@ -1439,7 +1439,7 @@ fi
test -n "$ac_init_help" && exit $ac_status
if $ac_init_version; then
cat <<\_ACEOF
-darshan-runtime configure 3.1.5-pre1
+darshan-runtime configure 3.1.5
generated by GNU Autoconf 2.69
Copyright (C) 2012 Free Software Foundation, Inc.
@@ -1791,7 +1791,7 @@ cat >config.log <<_ACEOF
This file contains any messages produced by compilers while
running configure, to aid debugging if configure makes a mistake.
-It was created by darshan-runtime $as_me 3.1.5-pre1, which was
+It was created by darshan-runtime $as_me 3.1.5, which was
generated by GNU Autoconf 2.69. Invocation command line was
$ $0 $@
@@ -4400,7 +4400,7 @@ else
MPICH_LIB_OLD=0
fi
-DARSHAN_VERSION="3.1.5-pre1"
+DARSHAN_VERSION="3.1.5"
@@ -4922,7 +4922,7 @@ cat >>$CONFIG_STATUS <<\_ACEOF || ac_write_fail=1
# report actual input values of CONFIG_FILES etc. instead of their
# values after options handling.
ac_log="
-This file was extended by darshan-runtime $as_me 3.1.5-pre1, which was
+This file was extended by darshan-runtime $as_me 3.1.5, which was
generated by GNU Autoconf 2.69. Invocation command line was
CONFIG_FILES = $CONFIG_FILES
@@ -4984,7 +4984,7 @@ _ACEOF
cat >>$CONFIG_STATUS <<_ACEOF || ac_write_fail=1
ac_cs_config="`$as_echo "$ac_configure_args" | sed 's/^ //; s/[\\""\`\$]/\\\\&/g'`"
ac_cs_version="\\
-darshan-runtime config.status 3.1.5-pre1
+darshan-runtime config.status 3.1.5
configured by $0, generated by GNU Autoconf 2.69,
with options \\"\$ac_cs_config\\"
=====================================
darshan-runtime/configure.in
=====================================
--- a/darshan-runtime/configure.in
+++ b/darshan-runtime/configure.in
@@ -5,7 +5,7 @@ dnl Process this file with autoconf to produce a configure script.
dnl You may need to use autoheader as well if changing any DEFINEs
dnl sanity checks, output header, location of scripts used here
-AC_INIT([darshan-runtime], [3.1.5-pre1])
+AC_INIT([darshan-runtime], [3.1.5])
AC_CONFIG_SRCDIR([darshan.h])
AC_CONFIG_AUX_DIR(../maint/config)
AC_CONFIG_HEADER(darshan-runtime-config.h)
=====================================
darshan-runtime/lib/darshan-hdf5.c
=====================================
--- a/darshan-runtime/lib/darshan-hdf5.c
+++ b/darshan-runtime/lib/darshan-hdf5.c
@@ -36,7 +36,11 @@ typedef int herr_t; //hf5-1.10.0p1: H5public.h:126
DARSHAN_FORWARD_DECL(H5Fcreate, hid_t, (const char *filename, unsigned flags, hid_t create_plist, hid_t access_plist));
DARSHAN_FORWARD_DECL(H5Fopen, hid_t, (const char *filename, unsigned flags, hid_t access_plist));
DARSHAN_FORWARD_DECL(H5Fclose, herr_t, (hid_t file_id));
-DARSHAN_FORWARD_DECL(H5get_libversion, herr_t, (unsigned *majnum, unsigned *minnum, unsigned *relnum));
+
+/* prototype for HDF symbols that we will call directly from within other
+ * wrappers if HDF is linked in
+ */
+extern herr_t H5get_libversion(unsigned *majnum, unsigned *minnum, unsigned *relnum);
/* structure that can track i/o stats for a given HDF5 file record at runtime */
struct hdf5_file_record_ref
@@ -122,8 +126,7 @@ hid_t DARSHAN_DECL(H5Fcreate)(const char *filename, unsigned flags,
double tm1;
unsigned majnum, minnum, relnum;
- MAP_OR_FAIL(H5get_libversion);
- __real_H5get_libversion(&majnum, &minnum, &relnum);
+ H5get_libversion(&majnum, &minnum, &relnum);
#ifdef __DARSHAN_ENABLE_HDF5110
if(majnum < 1 || (majnum == 1 && minnum < 10))
#else
@@ -171,8 +174,7 @@ hid_t DARSHAN_DECL(H5Fopen)(const char *filename, unsigned flags,
double tm1;
unsigned majnum, minnum, relnum;
- MAP_OR_FAIL(H5get_libversion);
- __real_H5get_libversion(&majnum, &minnum, &relnum);
+ H5get_libversion(&majnum, &minnum, &relnum);
#ifdef __DARSHAN_ENABLE_HDF5110
if(majnum < 1 || (majnum == 1 && minnum < 10))
#else
=====================================
darshan-runtime/share/ld-opts/darshan-hdf5-ld-opts
=====================================
--- a/darshan-runtime/share/ld-opts/darshan-hdf5-ld-opts
+++ b/darshan-runtime/share/ld-opts/darshan-hdf5-ld-opts
@@ -2,4 +2,3 @@
--wrap=H5Fcreate
--wrap=H5Fopen
--wrap=H5Fclose
---wrap=H5get_libversion
=====================================
darshan-test/example-output/mpi-io-test-ppc64-3.1.3.darshan
=====================================
Binary files a/darshan-test/example-output/mpi-io-test-ppc64-3.1.3.darshan and b/darshan-test/example-output/mpi-io-test-ppc64-3.1.3.darshan differ
=====================================
darshan-test/example-output/mpi-io-test-ppc64-3.1.4.darshan
=====================================
Binary files a/darshan-test/example-output/mpi-io-test-ppc64-3.1.4.darshan and b/darshan-test/example-output/mpi-io-test-ppc64-3.1.4.darshan differ
=====================================
darshan-test/example-output/mpi-io-test-ppc64-3.1.5.darshan
=====================================
Binary files /dev/null and b/darshan-test/example-output/mpi-io-test-ppc64-3.1.5.darshan differ
=====================================
darshan-test/example-output/mpi-io-test-x86_64-3.1.3.darshan
=====================================
Binary files a/darshan-test/example-output/mpi-io-test-x86_64-3.1.3.darshan and b/darshan-test/example-output/mpi-io-test-x86_64-3.1.3.darshan differ
=====================================
darshan-test/example-output/mpi-io-test-x86_64-3.1.4.darshan
=====================================
Binary files a/darshan-test/example-output/mpi-io-test-x86_64-3.1.4.darshan and b/darshan-test/example-output/mpi-io-test-x86_64-3.1.4.darshan differ
=====================================
darshan-test/example-output/mpi-io-test-x86_64-3.1.5.darshan
=====================================
Binary files /dev/null and b/darshan-test/example-output/mpi-io-test-x86_64-3.1.5.darshan differ
=====================================
darshan-test/regression/bg-profile-conf-alcf/runjob.sh
=====================================
--- a/darshan-test/regression/bg-profile-conf-alcf/runjob.sh
+++ b/darshan-test/regression/bg-profile-conf-alcf/runjob.sh
@@ -1,7 +1,12 @@
#!/bin/bash
+# convert DXT env setting
+if [ -n "${DXT_ENABLE_IO_TRACE+defined}" ]; then
+ DXT_ENV="--env DXT_ENABLE_IO_TRACE=$DXT_ENABLE_IO_TRACE"
+fi
+
# submit job and get job id
-jobid=`qsub --env DARSHAN_LOGFILE=$DARSHAN_LOGFILE --mode c16 --proccount $DARSHAN_DEFAULT_NPROCS -A radix-io -t 10 -n 1 --output $DARSHAN_TMP/$$-tmp.out --error $DARSHAN_TMP/$$-tmp.err --debuglog $DARSHAN_TMP/$$-tmp.debuglog "$@"`
+jobid=`qsub --env DARSHAN_LOGFILE=$DARSHAN_LOGFILE $DXT_ENV --mode c16 --proccount $DARSHAN_DEFAULT_NPROCS -A radix-io -t 10 -n 1 --output $DARSHAN_TMP/$$-tmp.out --error $DARSHAN_TMP/$$-tmp.err --debuglog $DARSHAN_TMP/$$-tmp.debuglog "$@"`
if [ $? -ne 0 ]; then
echo "Error: failed to qsub $@"
exit 1
=====================================
darshan-test/regression/cray-module-alcf/runjob.sh
=====================================
--- a/darshan-test/regression/cray-module-alcf/runjob.sh
+++ b/darshan-test/regression/cray-module-alcf/runjob.sh
@@ -1,7 +1,12 @@
#!/bin/bash
+# convert DXT env setting
+if [ -n "${DXT_ENABLE_IO_TRACE+defined}" ]; then
+ DXT_ENV="--env DXT_ENABLE_IO_TRACE=$DXT_ENABLE_IO_TRACE"
+fi
+
# submit job and get job id
-jobid=`qsub --env DARSHAN_LOGFILE=$DARSHAN_LOGFILE --env DARSHAN_DEFAULT_NPROCS=$DARSHAN_DEFAULT_NPROCS --proccount $DARSHAN_DEFAULT_NPROCS -A EarlyPerf_theta -t 20 -n 1 --output $DARSHAN_TMP/$$-tmp.out --error $DARSHAN_TMP/$$-tmp.err --debuglog $DARSHAN_TMP/$$-tmp.debuglog $DARSHAN_TESTDIR/$DARSHAN_PLATFORM/cobalt-submit.sh "$@"`
+jobid=`qsub --env DARSHAN_LOGFILE=$DARSHAN_LOGFILE --env DARSHAN_DEFAULT_NPROCS=$DARSHAN_DEFAULT_NPROCS $DXT_ENV --proccount $DARSHAN_DEFAULT_NPROCS -A radix-io -q debug-cache-quad -t 20 -n 1 --output $DARSHAN_TMP/$$-tmp.out --error $DARSHAN_TMP/$$-tmp.err --debuglog $DARSHAN_TMP/$$-tmp.debuglog $DARSHAN_TESTDIR/$DARSHAN_PLATFORM/cobalt-submit.sh "$@"`
if [ $? -ne 0 ]; then
echo "Error: failed to qsub $@"
=====================================
darshan-util/configure
=====================================
--- a/darshan-util/configure
+++ b/darshan-util/configure
@@ -1,6 +1,6 @@
#! /bin/sh
# Guess values for system-dependent variables and create Makefiles.
-# Generated by GNU Autoconf 2.69 for darshan-util 3.1.5-pre1.
+# Generated by GNU Autoconf 2.69 for darshan-util 3.1.5.
#
#
# Copyright (C) 1992-1996, 1998-2012 Free Software Foundation, Inc.
@@ -577,8 +577,8 @@ MAKEFLAGS=
# Identity of this package.
PACKAGE_NAME='darshan-util'
PACKAGE_TARNAME='darshan-util'
-PACKAGE_VERSION='3.1.5-pre1'
-PACKAGE_STRING='darshan-util 3.1.5-pre1'
+PACKAGE_VERSION='3.1.5'
+PACKAGE_STRING='darshan-util 3.1.5'
PACKAGE_BUGREPORT=''
PACKAGE_URL=''
@@ -1247,7 +1247,7 @@ if test "$ac_init_help" = "long"; then
# Omit some internal or obsolete options to make the list less imposing.
# This message is too long to be a string in the A/UX 3.1 sh.
cat <<_ACEOF
-\`configure' configures darshan-util 3.1.5-pre1 to adapt to many kinds of systems.
+\`configure' configures darshan-util 3.1.5 to adapt to many kinds of systems.
Usage: $0 [OPTION]... [VAR=VALUE]...
@@ -1309,7 +1309,7 @@ fi
if test -n "$ac_init_help"; then
case $ac_init_help in
- short | recursive ) echo "Configuration of darshan-util 3.1.5-pre1:";;
+ short | recursive ) echo "Configuration of darshan-util 3.1.5:";;
esac
cat <<\_ACEOF
@@ -1405,7 +1405,7 @@ fi
test -n "$ac_init_help" && exit $ac_status
if $ac_init_version; then
cat <<\_ACEOF
-darshan-util configure 3.1.5-pre1
+darshan-util configure 3.1.5
generated by GNU Autoconf 2.69
Copyright (C) 2012 Free Software Foundation, Inc.
@@ -1770,7 +1770,7 @@ cat >config.log <<_ACEOF
This file contains any messages produced by compilers while
running configure, to aid debugging if configure makes a mistake.
-It was created by darshan-util $as_me 3.1.5-pre1, which was
+It was created by darshan-util $as_me 3.1.5, which was
generated by GNU Autoconf 2.69. Invocation command line was
$ $0 $@
@@ -4117,7 +4117,7 @@ fi
done
-DARSHAN_UTIL_VERSION="3.1.5-pre1"
+DARSHAN_UTIL_VERSION="3.1.5"
@@ -4633,7 +4633,7 @@ cat >>$CONFIG_STATUS <<\_ACEOF || ac_write_fail=1
# report actual input values of CONFIG_FILES etc. instead of their
# values after options handling.
ac_log="
-This file was extended by darshan-util $as_me 3.1.5-pre1, which was
+This file was extended by darshan-util $as_me 3.1.5, which was
generated by GNU Autoconf 2.69. Invocation command line was
CONFIG_FILES = $CONFIG_FILES
@@ -4695,7 +4695,7 @@ _ACEOF
cat >>$CONFIG_STATUS <<_ACEOF || ac_write_fail=1
ac_cs_config="`$as_echo "$ac_configure_args" | sed 's/^ //; s/[\\""\`\$]/\\\\&/g'`"
ac_cs_version="\\
-darshan-util config.status 3.1.5-pre1
+darshan-util config.status 3.1.5
configured by $0, generated by GNU Autoconf 2.69,
with options \\"\$ac_cs_config\\"
=====================================
darshan-util/configure.in
=====================================
--- a/darshan-util/configure.in
+++ b/darshan-util/configure.in
@@ -5,7 +5,7 @@ dnl Process this file with autoconf to produce a configure script.
dnl You may need to use autoheader as well if changing any DEFINEs
dnl sanity checks, output header, location of scripts used here
-AC_INIT([darshan-util], [3.1.5-pre1])
+AC_INIT([darshan-util], [3.1.5])
AC_CONFIG_SRCDIR([darshan-logutils.h])
AC_CONFIG_AUX_DIR(../maint/config)
AC_CONFIG_HEADER(darshan-util-config.h)
=====================================
darshan-util/darshan-job-summary/bin/darshan-job-summary.pl.in
=====================================
--- a/darshan-util/darshan-job-summary/bin/darshan-job-summary.pl.in
+++ b/darshan-util/darshan-job-summary/bin/darshan-job-summary.pl.in
@@ -32,6 +32,7 @@ my $gnuplot = "gnuplot";
my $orig_dir = getcwd;
my $output_file = "summary.pdf";
my $verbose_flag = 0;
+my $summary_flag = 0;
my $input_file = "";
my %posix_access_hash = ();
my %mpiio_access_hash = ();
@@ -989,6 +990,12 @@ my $tmp_total_time = $slowest_uniq_time+$shared_file_time;
print("Total absolute I/O time: $tmp_total_time\n");
print("**NOTE: above shared and unique file times calculated using MPI-IO timers if MPI-IO interface used on a given file, POSIX timers otherwise.\n");
+#Exit here if user ask only for a summary
+if ($summary_flag)
+{
+ exit(0);
+}
+
# move to tmp_dir
chdir $tmp_dir;
@@ -1486,12 +1493,13 @@ sub process_file_record
sub process_args
{
- use vars qw( $opt_help $opt_output $opt_verbose );
+ use vars qw( $opt_help $opt_output $opt_verbose $opt_summary);
Getopt::Long::Configure("no_ignore_case", "bundling");
GetOptions( "help",
"output=s",
- "verbose");
+ "verbose",
+ "summary");
if($opt_help)
{
@@ -1509,6 +1517,11 @@ sub process_args
$verbose_flag = $opt_verbose;
}
+ if($opt_summary)
+ {
+ $summary_flag = $opt_summary;
+ }
+
# there should only be one remaining argument: the input file
if($#ARGV != 0)
{
@@ -1611,6 +1624,7 @@ Usage: $PROGRAM_NAME <options> input_file
--help Prints this help message
--output Specifies a file to write pdf output to
(defaults to ./summary.pdf)
+ --summary Print a very succinct I/O timing summary and exit
--verbose Prints and retains tmpdir used for LaTeX output
Purpose:
=====================================
darshan-util/darshan-merge.c
=====================================
--- a/darshan-util/darshan-merge.c
+++ b/darshan-util/darshan-merge.c
@@ -98,6 +98,10 @@ int build_mod_shared_rec_hash(char **infile_list, int n_infiles,
int ret;
int i;
+ /* if this module has no method for aggregating shared records, do nothing */
+ if(!(mod_logutils[mod_id]->log_agg_records))
+ return(0);
+
/* loop over each input log file */
for(i = 0; i < n_infiles; i++)
{
@@ -233,6 +237,8 @@ int main(int argc, char *argv[])
return(-1);
}
+#if 0
+ /* XXX: the darshan_shutdown tag is never set in darshan-core, currently */
/* if the input darshan log has metadata set indicating the darshan
* shutdown procedure was called on the log, then we error out. if the
* shutdown procedure was started, then it's possible the log has
@@ -246,6 +252,7 @@ int main(int argc, char *argv[])
darshan_log_close(in_fd);
return(-1);
}
+#endif
if(i == 0)
{
=====================================
darshan-util/doc/darshan-util.txt
=====================================
--- a/darshan-util/doc/darshan-util.txt
+++ b/darshan-util/doc/darshan-util.txt
@@ -589,9 +589,9 @@ This option is mainly useful for more detailed automated analysis.
=== darshan-dxt-parser
-The `darshan-dxt-parser` utility can be used to parse DxT traces out of Darshan
-log files, assuming the corresponding application was executed with the DxT
-modules enabled. The following example parses all DxT trace information out
+The `darshan-dxt-parser` utility can be used to parse DXT traces out of Darshan
+log files, assuming the corresponding application was executed with the DXT
+modules enabled. The following example parses all DXT trace information out
of a Darshan log file and stores it in a text file:
----
@@ -604,7 +604,7 @@ The preamble to `darshan-dxt-parser` output is identical to that of the traditio
`darshan-parser` utility, which is described above.
`darshan-dxt-parser` displays detailed trace information contained within a Darshan log
-that was generated with DxT instrumentation enabled. Trace data is captured from both
+that was generated with DXT instrumentation enabled. Trace data is captured from both
POSIX and MPI-IO interfaces. Example output is given below:
.Example output
@@ -646,15 +646,15 @@ POSIX and MPI-IO interfaces. Example output is given below:
X_MPIIO 0 read 3 262144 0.0050 0.0051
----
-===== DxT POSIX module
+===== DXT POSIX module
This module provides details on each read or write access at the POSIX layer.
The trace output is organized first by file then by process rank. So, for each
-file accessed by the application, DxT will provide each process's I/O trace
+file accessed by the application, DXT will provide each process's I/O trace
segments in separate blocks, ordered by increasing process rank. Within each
file/rank block, I/O trace segments are ordered chronologically.
-Before providing details on each I/O operation, DxT provides a short preamble
+Before providing details on each I/O operation, DXT provides a short preamble
for each file/rank trace block with the following bits of information: the Darshan
identifier for the file (which is equivalent to the identifers used by Darshan in its
traditional modules), the full file path, the corresponding MPI rank the current
@@ -668,7 +668,7 @@ The output format for each indvidual I/O operation segment is:
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s)
----
-* Module: corresponding DxT module (DXT_POSIX or DXT_MPIIO)
+* Module: corresponding DXT module (DXT_POSIX or DXT_MPIIO)
* Rank: process rank responsible for I/O operation
* Wt/Rd: whether the operation was a write or read
* Segment: The operation number for this segment (first operation is segment 0)
@@ -677,14 +677,14 @@ The output format for each indvidual I/O operation segment is:
* Start: timestamp of the start of the operation (w.r.t. application start time)
* End: timestamp of the end of the operation (w.r.t. application start time)
-===== DxT MPI-IO module
+===== DXT MPI-IO module
If the MPI-IO interface is used by an application, this module provides details on
each read or write access at the MPI-IO layer. This data is often useful in
understanding how MPI-IO read or write operations map to underlying POSIX read
or write operations issued to the traced file.
-The output format for the DxT MPI-IO module is essentially identical to the DxT
+The output format for the DXT MPI-IO module is essentially identical to the DXT
POSIX module, except that the offset of file operations is not tracked.
=== Other darshan-util utilities
@@ -706,4 +706,5 @@ provides a C interface for opening and parsing Darshan log files. This is
the recommended method for writing custom utilities, as darshan-logutils
provides a relatively stable interface across different versions of Darshan
and different log formats.
-
+* dxt_analyzer: plots the read or write activity of a job using data obtained
+from Darshan's DXT modules (if DXT is enabled).
=====================================
darshan-util/dxt_analyzer.py
=====================================
--- a/darshan-util/dxt_analyzer.py
+++ b/darshan-util/dxt_analyzer.py
@@ -75,7 +75,7 @@ python dxt_analyzer.py -i darshan_dxt-v.txt
import numpy as np
import matplotlib
-matplotlib.use('PDF')
+#matplotlib.use('PDF')
import matplotlib.pyplot as plt
import re
import argparse
View it on GitLab: https://xgitlab.cels.anl.gov/darshan/darshan/compare/ea7af5f33ef5ece946dbef81191fa19847512320...86500f11cbbf65289545c35bab7ad96b5958d336
---
View it on GitLab: https://xgitlab.cels.anl.gov/darshan/darshan/compare/ea7af5f33ef5ece946dbef81191fa19847512320...86500f11cbbf65289545c35bab7ad96b5958d336
You're receiving this email because of your account on xgitlab.cels.anl.gov.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/darshan-commits/attachments/20180118/c617d8cc/attachment-0001.html>
More information about the Darshan-commits
mailing list