[Darshan-commits] [Git][darshan/darshan][dev-better-error-handling] 67 commits: updated autoperf submodule for bug fix

Shane Snyder xgitlab at cels.anl.gov
Tue May 11 21:51:03 CDT 2021



Shane Snyder pushed to branch dev-better-error-handling at darshan / darshan


Commits:
c7d2fb20 by Shane Snyder at 2021-03-31T20:18:20+00:00
updated autoperf submodule for bug fix

- - - - -
d9fd34f3 by Shane Snyder at 2021-03-31T20:23:45+00:00
update autoperf submodule for one more bug fix

- - - - -
dcc18274 by Sudheer Chunduri at 2021-03-31T23:44:37+00:00
apmpi/pydarshan: update the pydarshan to process APMPI records

- - - - -
7e18ce28 by Sudheer Chunduri at 2021-04-01T21:16:57+00:00
autoperf few fixes and code cleanup

- - - - -
bdec8139 by Sudheer Chunduri at 2021-04-01T16:19:43-05:00
Merge branch 'apmpi-pydarshan-fixes' into 'master'

Apmpi pydarshan fixes

See merge request darshan/darshan!93
- - - - -
f16fd02f by Phil Carns at 2021-04-02T08:28:19-04:00
regenerate revision controlled configure scripts

- these will be removed soon when we can coordinate corresponding
  updates to CI test scripts and spack packaging

- - - - -
e3ec9e3e by Shane Snyder at 2021-04-06T08:47:33-05:00
autoperf submodule ssh->https

- - - - -
cf5cf73f by Sudheer Chunduri at 2021-04-06T17:04:53+00:00
Autoperf: apxc and apmpi submodule updates
Include sample analysis scripts for both
few bug fixes to make record processing work with pydarshan

- - - - -
767a6455 by Shane Snyder at 2021-04-06T17:48:42-05:00
Merge branch 'autoperf-updates' into 'master'

Autoperf: apxc and apmpi submodule updates

See merge request darshan/darshan!94
- - - - -
9d064ea9 by Shane Snyder at 2021-04-09T16:11:38-05:00
updated changelog for darshan-3.3.0-pre1

- - - - -
242538f3 by Shane Snyder at 2021-04-09T22:23:44+00:00
updated submodule for APXC bug fix

- - - - -
e2664495 by Shane Snyder at 2021-04-09T17:30:18-05:00
update configure scripts for 3.3.0-pre1

- - - - -
20f9503b by Tyler Reddy at 2021-04-15T15:09:01-06:00
TST: allow pytest coverage collection

* add `tests/__init__.py` file to allow `pytest-cov` to collect
test line coverage data via i.e.,
`pytest --cov-report=term-missing --cov=darshan tests/`

* on `master`, this currently fails to collect the coverage
data with this warning:
`coverage.py warning: No data was collected. (no-data-collected)`

* on this feature branch a complete coverage report is produced

- - - - -
65ff2d3f by Shane Snyder at 2021-04-15T16:19:22-05:00
bump pydarshan version numbers for release

- - - - -
caf1c297 by Tyler Reddy at 2021-04-15T15:56:53-06:00
TST: add test for unsupported rec

* add a test case that verifies that an appropriate
`logger` warning is produced for unsupported records
fed to the `mod_read_all_records()` method
of `DarshanReport`

* the warning code is not currently covered by tests
on `master`

- - - - -
634c50e9 by Tyler Reddy at 2021-04-15T16:28:47-06:00
TST: add test for info() method

* the `info()` method of the `pydarshan` `DarshanReport` class
is currently completely uncovered by tests in `master`

* add a regression guard for some of the string contents of
the `info()` printout--this method is used pretty commonly,
at least in my experience

- - - - -
141e2fa6 by Shane Snyder at 2021-04-15T17:43:52-05:00
Merge branch 'treddy_allow_pytest_cov_collection' into 'master'

TST: allow pytest coverage collection

See merge request darshan/darshan!96
- - - - -
ce78d6b2 by Tyler Reddy at 2021-04-15T16:49:28-06:00
MAINT: rm pass statements

* `darshan/report.py` contains many pointless `pass`
statements; they may have served a placeholding purpose
early in development, but they are no longer of any use
so remove them

- - - - -
7b764116 by Tyler Reddy at 2021-04-20T11:56:20-06:00
TST: add DarshanReport open test

* add test cases to cover previously untested scenario
of `DarshanReport()` properly handling invalid file paths

- - - - -
550f3a65 by Tyler Reddy at 2021-04-20T13:56:02-06:00
TST: add test for to_json() method

* add a regression test for the `to_json()` method
of the `DarshanReport` class, which was previously
uncovered by tests

- - - - -
31db1510 by Tyler Reddy at 2021-04-21T14:56:01-06:00
MAINT: rm extraneous return

* remove a `return` statement that cannot possibly
execute inside `__deepcopy__` method of `DarshanReport`

* the [vulture](https://github.com/jendrikseipp/vulture) static
code analyzer also agrees with this assessment

- - - - -
97699ea7 by Tyler Reddy at 2021-04-21T16:11:22-06:00
TST: add DarshanReport deepcopy test

* add a regression test for the `__deepcopy__` method
of `DarshanReport`; verifies floating point value
similarity to original data and lack of memory overlap

- - - - -
7c9df6ae by Tyler Reddy at 2021-04-21T17:22:13-06:00
TST: test for get_lib_version()

* add a regression test for `get_lib_version()`, which is
not covered by tests in `master` branch

* incidentally, instead of actually using `get_lib_version()`
the code base currently repeats the code inside the function

- - - - -
c877e9b2 by Tyler Reddy at 2021-04-22T10:48:18-06:00
TST: add DXT testing to pydarshan

* there is currently not a single DXT-enabled test
file in the `pydarshan` test suite; so, add a small
`6.5K` sample DXT-enabled darshan log file along with
a regression test

- - - - -
39dce232 by Shane Snyder at 2021-04-22T22:10:51+00:00
only call hyperslab fns on hyperslab selections

- - - - -
5b596ed1 by Shane Snyder at 2021-04-23T13:13:00-05:00
Merge branch 'snyder/dev-issue315-hdf5-selections' into 'master'

only call HDF5 hyperslab functions on hyperslab selections

Closes #315

See merge request darshan/darshan!107
- - - - -
6c5c6484 by Shane Snyder at 2021-04-23T13:20:43-05:00
don't call MPI_File_get_byte_offset for OpenMPI

A bug observed in some OpenMPI versions could lead to crashes
triggered by Darshan's own internal MPI-IO wrappers.

- - - - -
95678e94 by Shane Snyder at 2021-04-23T13:20:43-05:00
Merge branch 'snyder/dev-issue317-openmpi-check' into 'master'

Disable MPI-IO module offset tracking for OpenMPI builds

See merge request darshan/darshan!106
- - - - -
8b3771d4 by Shane Snyder at 2021-04-29T18:02:50+00:00
check lustre striping for all files

This attempts to work around issue #302, where Darshan can't
instrument Lustre striping information for symlinks to Lustre
files that reside on other file systems. The method for querying
Lustre striping info is general enough (based on xattrs) and
low-overhead enough that this should not create any issues for
Darshan users.

Closes #302

- - - - -
5ec3e5a9 by Shane Snyder at 2021-04-29T13:41:59-05:00
Merge branch 'snyder/dev-issue302-lustre-symlinks' into 'master'

check lustre striping for all files

Closes #302

See merge request darshan/darshan!108
- - - - -
2cbf7faf by Shane Snyder at 2021-04-29T14:41:26-05:00
update darshan-util docs to link to PyDarshan docs

- - - - -
be0ade39 by Shane Snyder at 2021-04-29T16:19:35-05:00
updated changelog for darshan-3.3.0-pre2

- - - - -
d0e606a0 by Shane Snyder at 2021-04-29T16:59:35-05:00
remove AutoPerf from changelog for now

- - - - -
7125643d by Shane Snyder at 2021-04-29T17:05:02-05:00
bump configure versions for 3.3.0-pre2

- - - - -
faadaaef by Shane Snyder at 2021-05-03T14:21:33-05:00
updated PyDarshan version numbers for 3.3.0-pre2

- - - - -
96b40da6 by Shane Snyder at 2021-05-05T16:25:49-05:00
small changelog fixups

- - - - -
2efe901a by Shane Snyder at 2021-05-05T16:29:57-05:00
update config versions for final 3.3.0 release

- - - - -
f4f9173f by Shane Snyder at 2021-05-05T16:40:30-05:00
updated changelog for 3.3.0 release

- - - - -
2f8a67e6 by Shane Snyder at 2021-05-05T22:54:06+00:00
update AutoPerf submodule commit

- - - - -
078cf4f3 by Shane Snyder at 2021-05-05T21:21:35-05:00
add example 3.3.0 darshan log

- - - - -
67df16e6 by Shane Snyder at 2021-05-05T22:22:47-05:00
updated PyDarshan versions for 3.3.0.2

- - - - -
abefb7de by Shane Snyder at 2021-05-05T22:23:13-05:00
initial PyDarshan changelog

- - - - -
84e660e0 by Jakob Luettgau at 2021-05-06T15:40:01-05:00
Pypa regression workaround

- - - - -
b0da9f03 by Shane Snyder at 2021-05-06T15:40:01-05:00
Merge branch 'pypa_regression_workaround' into 'master'

Pypa regression workaround

See merge request darshan/darshan!109
- - - - -
9f9eb7f9 by Shane Snyder at 2021-05-06T17:02:40-05:00
AutoPerf modules not supported in generic read_all routines for PyDarshan

- - - - -
48636ea5 by Shane Snyder at 2021-05-06T17:02:40-05:00
Merge branch 'snyder/pydarshan-report-read-all-autoperf' into 'master'

AutoPerf modules not supported in generic read_all routines for PyDarshan

See merge request darshan/darshan!110
- - - - -
b50b8dd0 by Shane Snyder at 2021-05-06T18:23:42-05:00
get pydarshan to properly build AutoPerf modules

- - - - -
d54f6c59 by Shane Snyder at 2021-05-07T09:09:22-05:00
Merge branch 'snyder/pydarshan-autoperf-support' into 'master'

get pydarshan to properly build AutoPerf modules

See merge request darshan/darshan!111
- - - - -
21362b6a by Shane Snyder at 2021-05-07T15:54:46-05:00
revert previous modifications to setup.py

- - - - -
feff6be8 by Shane Snyder at 2021-05-07T15:55:50-05:00
make targets for pydarshan autoperf modules

- - - - -
e930ea08 by Shane Snyder at 2021-05-11T14:37:00-05:00
Merge branch 'treddy_rm_pass_darshan_report' into 'master'

MAINT: rm pass statements

See merge request darshan/darshan!99
- - - - -
8fc5cb2c by Shane Snyder at 2021-05-11T14:42:16-05:00
Merge branch 'treddy_deepcopy_unused_return' into 'master'

MAINT: rm extraneous return

See merge request darshan/darshan!102
- - - - -
8049f2f9 by Shane Snyder at 2021-05-11T14:54:45-05:00
Merge branch 'treddy_unsupported_record_warn_test' into 'master'

TST: add test for unsupported rec

See merge request darshan/darshan!97
- - - - -
31bdb610 by Shane Snyder at 2021-05-11T14:56:34-05:00
added AutoPerf to pydarshan unsupported_rec test

- - - - -
147c469e by Shane Snyder at 2021-05-11T15:00:42-05:00
Merge branch 'treddy_test_darshanreport_info' into 'master'

TST: add test for info() method

See merge request darshan/darshan!98
- - - - -
65f4ed71 by Shane Snyder at 2021-05-11T15:03:22-05:00
fix typo in pydarshan output

- - - - -
18d1054a by Shane Snyder at 2021-05-11T15:30:57-05:00
Merge branch 'treddy/darshan-treddy_test_invalid_darshanreport_file_open' into HEAD

- - - - -
457b69ce by Shane Snyder at 2021-05-11T15:37:57-05:00
Merge branch 'treddy/darshan-treddy_test_to_json' into HEAD

- - - - -
f471874f by Shane Snyder at 2021-05-11T15:42:34-05:00
Merge branch 'treddy/darshan-treddy_test_darshanreport_deepcopy' into HEAD

- - - - -
da63fe1a by Shane Snyder at 2021-05-11T15:57:59-05:00
Merge branch 'treddy_test_get_lib_version' into 'master'

TST: test for get_lib_version()

See merge request darshan/darshan!104
- - - - -
1a6fdd9f by Shane Snyder at 2021-05-11T16:01:15-05:00
Merge branch 'treddy_test_dxt_simple' into 'master'

TST: add DXT testing to pydarshan

See merge request darshan/darshan!105
- - - - -
3034ae57 by Shane Snyder at 2021-05-11T16:46:47-05:00
Merge branch 'master' into dev-better-error-handling

- - - - -
ad4b0af6 by Shane Snyder at 2021-05-11T20:39:43-05:00
bug fix in fprintf statement

- - - - -
051b3fe5 by Shane Snyder at 2021-05-11T20:42:24-05:00
revert unneeded check for log handle = None

- - - - -
9d8ca7f0 by Shane Snyder at 2021-05-11T21:35:34-05:00
sanity check input darshan-util log file handle

necessary to avoid seg faults if user passes in NULL handle

- - - - -
ac36a9d7 by Shane Snyder at 2021-05-11T21:47:50-05:00
avoid keyerror when module isn't present in log

- - - - -
541f82bb by Shane Snyder at 2021-05-11T21:49:30-05:00
modify test to check correct return values

- - - - -


30 changed files:

- .gitmodules
- ChangeLog
- darshan-runtime/configure
- darshan-runtime/configure.in
- darshan-runtime/darshan-core.h
- darshan-runtime/darshan-runtime-config.h.in
- darshan-runtime/lib/darshan-core.c
- darshan-runtime/lib/darshan-hdf5.c
- darshan-runtime/lib/darshan-mpiio.c
- + darshan-test/example-output/mpi-io-test-x86_64-3.3.0.darshan
- darshan-util/configure
- darshan-util/configure.in
- darshan-util/darshan-logutils.c
- darshan-util/doc/darshan-util.txt
- + darshan-util/pydarshan/CHANGELOG.rst
- darshan-util/pydarshan/Makefile
- darshan-util/pydarshan/darshan/__init__.py
- darshan-util/pydarshan/darshan/backend/cffi_backend.py
- darshan-util/pydarshan/darshan/report.py
- darshan-util/pydarshan/devel/build-all.sh
- darshan-util/pydarshan/devel/build-wheels.sh
- − darshan-util/pydarshan/examples/apmpi_analysis.py
- darshan-util/pydarshan/setup.cfg
- darshan-util/pydarshan/setup.py
- + darshan-util/pydarshan/tests/__init__.py
- + darshan-util/pydarshan/tests/input/sample-dxt-simple.darshan
- + darshan-util/pydarshan/tests/test_cffi_misc.py
- darshan-util/pydarshan/tests/test_error.py
- + darshan-util/pydarshan/tests/test_moddxt.py
- darshan-util/pydarshan/tests/test_report.py


The diff was not included because it is too large.


View it on GitLab: https://xgitlab.cels.anl.gov/darshan/darshan/-/compare/71b300ffcfed440dd2f55164e8a321c47722efeb...541f82bba53fb5dd4504ea9c5fe53bb7dd0f80dd

-- 
View it on GitLab: https://xgitlab.cels.anl.gov/darshan/darshan/-/compare/71b300ffcfed440dd2f55164e8a321c47722efeb...541f82bba53fb5dd4504ea9c5fe53bb7dd0f80dd
You're receiving this email because of your account on xgitlab.cels.anl.gov.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/darshan-commits/attachments/20210511/9f884263/attachment-0001.html>


More information about the Darshan-commits mailing list