[petsc-users] Bus Error
Mark Lohry
mlohry at gmail.com
Sat Sep 5 07:54:27 CDT 2020
Root cause update: failing DIMMs. Kinda boring, but there it is.
On Thu, Aug 27, 2020 at 5:34 PM Barry Smith <bsmith at petsc.dev> wrote:
>
> Mark,
>
> No problem, we'll have a few more automatic checks in PETSc due to this
> to help everyone in the future debug these difficult situations a little
> easier.
>
> Barry
>
>
> On Aug 27, 2020, at 3:26 PM, Mark Lohry <mlohry at gmail.com> wrote:
>
> Alright, this time it crashed with a bus error before petsc had even been
> initialized or anything in blas had ever been called. I'm told there was
> also a known network failure on this cluster a few days ago that took out
> one rack, so now I'm reasonably convinced there are legitimate hardware
> faults elsewhere.
>
> Looking like a wild goose chase on the software side, but all the help is
> hugely appreciated.
>
> On Thu, Aug 27, 2020 at 10:52 AM Barry Smith <bsmith at petsc.dev> wrote:
>
>>
>> Thanks,
>>
>> So this means that all the double precision array pointers that PETSc
>> is passing into these BLAS calls are addressable. Which means nothing has
>> corrupted any of these pointers before the calls.
>>
>> What my patch did. Before each BLAS call, for each double array
>> argument it set a special exception handler and then accessed the first
>> entry in the array. Since the exception handler was never called this means
>> that the first entry of each array was accessible and would not produce a
>> SEGV or SIGBUS.
>>
>> What else could be corrupted.
>>
>> 1) the size arguments passed to the BLAS calls, if they were too large
>> they could result in accessing incorrect memory but IMHO that would usually
>> produce a SEGV not a SIGBUS. It is hard to put a check in the code because
>> these sizes are problem dependent and there is no way to know if they are
>> wrong.
>>
>> 2) corruption of the stack?
>>
>> 3) hardware issue due to overheating or bad memory etc. I assume the MPI
>> rank that crashes changes for each crashing run. I am adding code to our
>> patch branch to print the node name that hopefully is constant for all
>> runs, then one can see if the problem is always on the same node. Patch
>> attached
>>
>>
>> Can you try with a very different BLAS implementation? What are you
>> using now?
>>
>> For example you could configure PETSc with --download-f2cblaslapack or
>> if you are using MKL switch to non-MKL, or if you are using the system BLAS
>> switch to MKL.
>>
>> Barry
>>
>> We can also replace the BLAS calls with direct C and see what happens but
>> let's only do that after you try a different BLAS.
>>
>>
>>
>>
>>
>> On Aug 27, 2020, at 8:53 AM, Mark Lohry <mlohry at gmail.com> wrote:
>>
>> It was built with --with-debugging=1
>>
>> On Thu, Aug 27, 2020 at 9:44 AM Barry Smith <bsmith at petsc.dev> wrote:
>>
>>>
>>> Mark,
>>>
>>> Did i tell you that this has to be built with the configure option
>>> --with-debugging=1 and won't be turned off with --with-debugging=0 ?
>>>
>>> Barry
>>>
>>>
>>> On Aug 27, 2020, at 8:10 AM, Mark Lohry <mlohry at gmail.com> wrote:
>>>
>>> Barry, no output from that patch i'm afraid:
>>>
>>> 54 KSP Residual norm 3.215013886664e+03
>>> 55 KSP Residual norm 3.049105434513e+03
>>> 56 KSP Residual norm 2.859123916860e+03
>>> [929]PETSC ERROR:
>>> ------------------------------------------------------------------------
>>> [929]PETSC ERROR: Caught signal number 7 BUS: Bus Error, possibly
>>> illegal memory access
>>> [929]PETSC ERROR: Try option -start_in_debugger or
>>> -on_error_attach_debugger
>>> [929]PETSC ERROR: or see
>>> https://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind
>>> [929]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac
>>> OS X to find memory corruption errors
>>> [929]PETSC ERROR: likely location of problem given in stack below
>>> [929]PETSC ERROR: --------------------- Stack Frames
>>> ------------------------------------
>>> [929]PETSC ERROR: Note: The EXACT line numbers in the stack are not
>>> available,
>>> [929]PETSC ERROR: INSTEAD the line number of the start of the
>>> function
>>> [929]PETSC ERROR: is given.
>>> [929]PETSC ERROR: [929] BLASgemv line 1406
>>> /home/mlohry/petsc/src/mat/impls/baij/seq/baijfact.c
>>> [929]PETSC ERROR: [929] MatSolve_SeqBAIJ_N_NaturalOrdering line 1378
>>> /home/mlohry/petsc/src/mat/impls/baij/seq/baijfact.c
>>> [929]PETSC ERROR: [929] MatSolve line 3354
>>> /home/mlohry/petsc/src/mat/interface/matrix.c
>>> [929]PETSC ERROR: [929] PCApply_ILU line 201
>>> /home/mlohry/petsc/src/ksp/pc/impls/factor/ilu/ilu.c
>>> [929]PETSC ERROR: [929] PCApply line 426
>>> /home/mlohry/petsc/src/ksp/pc/interface/precon.c
>>> [929]PETSC ERROR: [929] KSP_PCApply line 279
>>> /home/mlohry/petsc/include/petsc/private/kspimpl.h
>>> [929]PETSC ERROR: [929] KSPSolve_PREONLY line 16
>>> /home/mlohry/petsc/src/ksp/ksp/impls/preonly/preonly.c
>>> [929]PETSC ERROR: [929] KSPSolve_Private line 590
>>> /home/mlohry/petsc/src/ksp/ksp/interface/itfunc.c
>>> [929]PETSC ERROR: [929] KSPSolve line 848
>>> /home/mlohry/petsc/src/ksp/ksp/interface/itfunc.c
>>> [929]PETSC ERROR: [929] PCApply_ASM line 441
>>> /home/mlohry/petsc/src/ksp/pc/impls/asm/asm.c
>>> [929]PETSC ERROR: [929] PCApply line 426
>>> /home/mlohry/petsc/src/ksp/pc/interface/precon.c
>>> [929]PETSC ERROR: [929] KSP_PCApply line 279
>>> /home/mlohry/petsc/include/petsc/private/kspimpl.h
>>> srun: Job step aborted: Waiting up to 47 seconds for job step to finish.
>>> [929]PETSC ERROR: [929] KSPFGMRESCycle line 108
>>> /home/mlohry/petsc/src/ksp/ksp/impls/gmres/fgmres/fgmres.c
>>> [929]PETSC ERROR: [929] KSPSolve_FGMRES line 274
>>> /home/mlohry/petsc/src/ksp/ksp/impls/gmres/fgmres/fgmres.c
>>> [929]PETSC ERROR: [929] KSPSolve_Private line 590
>>> /home/mlohry/petsc/src/ksp/ksp/interface/itfunc.c
>>>
>>> On Mon, Aug 24, 2020 at 6:47 PM Mark Lohry <mlohry at gmail.com> wrote:
>>>
>>>> I don't think I do. Running a much smaller case with the same models I
>>>> get the attached report from valgrind --show-leak-kinds=all
>>>> --leak-check=full --track-origins=yes. I only see some HDF5 stuff and
>>>> OpenMPI that I think are false positives.
>>>>
>>>> ==1286950== Memcheck, a memory error detector
>>>> ==1286950== Copyright (C) 2002-2017, and GNU GPL'd, by Julian Seward et
>>>> al.
>>>> ==1286950== Using Valgrind-3.15.0-608cb11914-20190413 and LibVEX; rerun
>>>> with -h for copyright info
>>>> ==1286950== Command: ./verification_testing
>>>> --gtest_filter=DrivenCavity3D.Re100_BackwardEulerILU1_16x16N2_Quadrature1
>>>> --petsc_time_integrator=arkimex --petsc_arkimex_type=l2
>>>> ==1286950== Parent PID: 1286932
>>>> ==1286950==
>>>> --1286950--
>>>> --1286950-- Valgrind options:
>>>> --1286950-- --show-leak-kinds=all
>>>> --1286950-- --leak-check=full
>>>> --1286950-- --track-origins=yes
>>>> --1286950-- --log-file=valgrind-out.txt
>>>> --1286950-- -v
>>>> --1286950-- Contents of /proc/version:
>>>> --1286950-- Linux version 5.4.0-29-generic (buildd at lgw01-amd64-035)
>>>> (gcc version 9.3.0 (Ubuntu 9.3.0-10ubuntu2)) #33-Ubuntu SMP Wed Apr 29
>>>> 14:32:27 UTC 2020
>>>> --1286950--
>>>> --1286950-- Arch and hwcaps: AMD64, LittleEndian,
>>>> amd64-cx16-rdtscp-sse3-ssse3-avx
>>>> --1286950-- Page sizes: currently 4096, max supported 4096
>>>> --1286950-- Valgrind library directory:
>>>> /usr/lib/x86_64-linux-gnu/valgrind
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/verification_testing
>>>> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/ld-2.31.so
>>>> --1286950-- Considering /usr/lib/x86_64-linux-gnu/ld-2.31.so ..
>>>> --1286950-- .. CRC mismatch (computed 387b17ea wanted d28cf5ef)
>>>> --1286950-- Considering /lib/x86_64-linux-gnu/ld-2.31.so ..
>>>> --1286950-- .. CRC mismatch (computed 387b17ea wanted d28cf5ef)
>>>> --1286950-- Considering /usr/lib/debug/lib/x86_64-linux-gnu/
>>>> ld-2.31.so ..
>>>> --1286950-- .. CRC is valid
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/valgrind/memcheck-amd64-linux
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- object doesn't have a dynamic symbol table
>>>> --1286950-- Scheduler: using generic scheduler lock implementation.
>>>> --1286950-- Reading suppressions file:
>>>> /usr/lib/x86_64-linux-gnu/valgrind/default.supp
>>>> ==1286950== embedded gdbserver: reading from
>>>> /tmp/vgdb-pipe-from-vgdb-to-1286950-by-mlohry-on-???
>>>> ==1286950== embedded gdbserver: writing to
>>>> /tmp/vgdb-pipe-to-vgdb-from-1286950-by-mlohry-on-???
>>>> ==1286950== embedded gdbserver: shared mem
>>>> /tmp/vgdb-pipe-shared-mem-vgdb-1286950-by-mlohry-on-???
>>>> ==1286950==
>>>> ==1286950== TO CONTROL THIS PROCESS USING vgdb (which you probably
>>>> ==1286950== don't want to do, unless you know exactly what you're doing,
>>>> ==1286950== or are doing some strange experiment):
>>>> ==1286950== /usr/lib/x86_64-linux-gnu/valgrind/../../bin/vgdb
>>>> --pid=1286950 ...command...
>>>> ==1286950==
>>>> ==1286950== TO DEBUG THIS PROCESS USING GDB: start GDB like this
>>>> ==1286950== /path/to/gdb ./verification_testing
>>>> ==1286950== and then give GDB the following command
>>>> ==1286950== target remote |
>>>> /usr/lib/x86_64-linux-gnu/valgrind/../../bin/vgdb --pid=1286950
>>>> ==1286950== --pid is optional if only one valgrind process is running
>>>> ==1286950==
>>>> --1286950-- REDIR: 0x4022d80 (ld-linux-x86-64.so.2:strlen) redirected
>>>> to 0x580c9ce2 (???)
>>>> --1286950-- REDIR: 0x4022b50 (ld-linux-x86-64.so.2:index) redirected to
>>>> 0x580c9cfc (???)
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_core-amd64-linux.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so
>>>> --1286950-- object doesn't have a symbol table
>>>> ==1286950== WARNING: new redirection conflicts with existing --
>>>> ignoring it
>>>> --1286950-- old: 0x04022d80 (strlen ) R-> (0000.0)
>>>> 0x580c9ce2 ???
>>>> --1286950-- new: 0x04022d80 (strlen ) R-> (2007.0)
>>>> 0x0483f060 strlen
>>>> --1286950-- REDIR: 0x401f560 (ld-linux-x86-64.so.2:strcmp) redirected
>>>> to 0x483ffd0 (strcmp)
>>>> --1286950-- REDIR: 0x40232e0 (ld-linux-x86-64.so.2:mempcpy) redirected
>>>> to 0x4843a20 (mempcpy)
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/initialization/libinitialization.so
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/governing_equations/libgoverning_equations.so
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/time_stepping/libtime_stepping.so
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/governing_equations/libboundary_conditions.so
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/governing_equations/libsolution_monitors.so
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/governing_equations/libfluxtypes.so
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/algebraic_solvers/libalgebraic_solvers.so
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/program_options/libprogram_options.so
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_filesystem.so.1.73.0
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so.40.20.1
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/
>>>> libpthread-2.31.so
>>>> --1286950-- Considering
>>>> /usr/lib/debug/.build-id/77/5cbbfff814456660786780b0b3b40096b4c05e.debug ..
>>>> --1286950-- .. build-id is valid
>>>> --1286948-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/external/petsc/arch-linux2-c-opt/lib/libpetsc.so.3.13.3
>>>> --1286937-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/parallel/libparallel.so
>>>> --1286937-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/logger/liblogger.so
>>>> --1286937-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/spatial_discretization/libdiscretization.so
>>>> --1286945-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/utils/libutils.so
>>>> --1286944-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28
>>>> --1286938-- object doesn't have a symbol table
>>>> --1286949-- Reading syms from /usr/lib/x86_64-linux-gnu/libm-2.31.so
>>>> --1286949-- Considering /usr/lib/x86_64-linux-gnu/libm-2.31.so ..
>>>> --1286947-- .. CRC mismatch (computed 327d785f wanted 751f5509)
>>>> --1286947-- Considering /lib/x86_64-linux-gnu/libm-2.31.so ..
>>>> --1286938-- .. CRC mismatch (computed 327d785f wanted 751f5509)
>>>> --1286937-- Considering /usr/lib/debug/lib/x86_64-linux-gnu/
>>>> libm-2.31.so ..
>>>> --1286950-- .. CRC is valid
>>>> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libgcc_s.so.1
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libc-2.31.so
>>>> --1286950-- Considering /usr/lib/x86_64-linux-gnu/libc-2.31.so ..
>>>> --1286951-- .. CRC mismatch (computed a6f43087 wanted 6555436e)
>>>> --1286951-- Considering /lib/x86_64-linux-gnu/libc-2.31.so ..
>>>> --1286947-- .. CRC mismatch (computed a6f43087 wanted 6555436e)
>>>> --1286947-- Considering /usr/lib/debug/lib/x86_64-linux-gnu/
>>>> libc-2.31.so ..
>>>> --1286950-- .. CRC is valid
>>>> --1286940-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/file_io/libfileio.so
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_program_options.so.1.73.0
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_serialization.so.1.73.0
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libhwloc.so.15.1.0
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/external/petsc/arch-linux2-c-opt/lib/libsuperlu_dist.so.6.3.0
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3.9.0
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286937-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/blas/libblas.so.3.9.0
>>>> --1286937-- object doesn't have a symbol table
>>>> --1286947-- Reading syms from /usr/lib/x86_64-linux-gnu/libX11.so.6.3.0
>>>> --1286939-- object doesn't have a symbol table
>>>> --1286947-- Reading syms from /usr/lib/x86_64-linux-gnu/libdl-2.31.so
>>>> --1286947-- Considering /usr/lib/x86_64-linux-gnu/libdl-2.31.so ..
>>>> --1286947-- .. CRC mismatch (computed 4fd191ca wanted df8dd39a)
>>>> --1286947-- Considering /lib/x86_64-linux-gnu/libdl-2.31.so ..
>>>> --1286947-- .. CRC mismatch (computed 4fd191ca wanted df8dd39a)
>>>> --1286947-- Considering /usr/lib/debug/lib/x86_64-linux-gnu/
>>>> libdl-2.31.so ..
>>>> --1286947-- .. CRC is valid
>>>> --1286937-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/external/petsc/arch-linux2-c-opt/lib/libmetis.so
>>>> --1286937-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_log.so.1.73.0
>>>> --1286942-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_log_setup.so.1.73.0
>>>> --1286942-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_thread.so.1.73.0
>>>> --1286942-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_regex.so.1.73.0
>>>> --1286949-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/basis_functions/libbasis_functions.so
>>>> --1286944-- Reading syms from /usr/lib/x86_64-linux-gnu/libgomp.so.1.0.0
>>>> --1286944-- object doesn't have a symbol table
>>>> --1286951-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/external_install/lib/libcgns.so
>>>> --1286951-- object doesn't have a symbol table
>>>> --1286943-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/external_install/lib/libhdf5.so.103.1.0
>>>> --1286951-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/external/tinyxml2-build/libtinyxml2.so.6.1.0
>>>> --1286944-- Reading syms from
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_iostreams.so.1.73.0
>>>> --1286944-- Reading syms from /usr/lib/x86_64-linux-gnu/libz.so.1.2.11
>>>> --1286944-- object doesn't have a symbol table
>>>> --1286951-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0
>>>> --1286951-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libutil-2.31.so
>>>> --1286946-- Considering /usr/lib/x86_64-linux-gnu/libutil-2.31.so ..
>>>> --1286946-- .. CRC mismatch (computed 4639aba5 wanted ceb246b4)
>>>> --1286946-- Considering /lib/x86_64-linux-gnu/libutil-2.31.so ..
>>>> --1286946-- .. CRC mismatch (computed 4639aba5 wanted ceb246b4)
>>>> --1286948-- Considering /usr/lib/debug/lib/x86_64-linux-gnu/
>>>> libutil-2.31.so ..
>>>> --1286939-- .. CRC is valid
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libltdl.so.7.3.1
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libxcb.so.1.1.0
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/librt-2.31.so
>>>> --1286950-- Considering /usr/lib/x86_64-linux-gnu/librt-2.31.so ..
>>>> --1286950-- .. CRC mismatch (computed a9acc0ce wanted cb4905a3)
>>>> --1286950-- Considering /lib/x86_64-linux-gnu/librt-2.31.so ..
>>>> --1286950-- .. CRC mismatch (computed a9acc0ce wanted cb4905a3)
>>>> --1286950-- Considering /usr/lib/debug/lib/x86_64-linux-gnu/
>>>> librt-2.31.so ..
>>>> --1286950-- .. CRC is valid
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286945-- Reading syms from /usr/lib/x86_64-linux-gnu/libXau.so.6.0.0
>>>> --1286945-- Considering /usr/lib/x86_64-linux-gnu/libXau.so.6.0.0 ..
>>>> --1286945-- .. CRC mismatch (computed 7de9b6ad wanted e8a17129)
>>>> --1286945-- Considering /lib/x86_64-linux-gnu/libXau.so.6.0.0 ..
>>>> --1286945-- .. CRC mismatch (computed 7de9b6ad wanted e8a17129)
>>>> --1286945-- object doesn't have a symbol table
>>>> --1286945-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libXdmcp.so.6.0.0
>>>> --1286942-- object doesn't have a symbol table
>>>> --1286942-- Reading syms from /usr/lib/x86_64-linux-gnu/libbsd.so.0.10.0
>>>> --1286942-- object doesn't have a symbol table
>>>> --1286950-- REDIR: 0x6516600 (libc.so.6:memmove) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6515900 (libc.so.6:strncpy) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6516930 (libc.so.6:strcasecmp) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6515220 (libc.so.6:strcat) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6515960 (libc.so.6:rindex) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6517dd0 (libc.so.6:rawmemchr) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6532e60 (libc.so.6:wmemchr) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65329a0 (libc.so.6:wcscmp) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6516760 (libc.so.6:mempcpy) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6516590 (libc.so.6:bcmp) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6515890 (libc.so.6:strncmp) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65152d0 (libc.so.6:strcmp) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65166c0 (libc.so.6:memset) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6532960 (libc.so.6:wcschr) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65157f0 (libc.so.6:strnlen) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65153b0 (libc.so.6:strcspn) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6516980 (libc.so.6:strncasecmp) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6515350 (libc.so.6:strcpy) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6516ad0 (libc.so.6:memcpy@@GLIBC_2.14) redirected
>>>> to 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65340d0 (libc.so.6:wcsnlen) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65329e0 (libc.so.6:wcscpy) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65159a0 (libc.so.6:strpbrk) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6515280 (libc.so.6:index) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65157b0 (libc.so.6:strlen) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x651ed20 (libc.so.6:memrchr) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65169d0 (libc.so.6:strcasecmp_l) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6516550 (libc.so.6:memchr) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6532ab0 (libc.so.6:wcslen) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6515c60 (libc.so.6:strspn) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65168d0 (libc.so.6:stpncpy) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6516870 (libc.so.6:stpcpy) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6517e10 (libc.so.6:strchrnul) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6516a20 (libc.so.6:strncasecmp_l) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x6516470 (libc.so.6:strstr) redirected to 0x48331d0
>>>> (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65a3750 (libc.so.6:__memcpy_chk) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286938-- REDIR: 0x6527a30 (libc.so.6:__strrchr_sse2) redirected to
>>>> 0x483ea70 (__strrchr_sse2)
>>>> --1286938-- REDIR: 0x6511c90 (libc.so.6:calloc) redirected to 0x483dce0
>>>> (calloc)
>>>> --1286938-- REDIR: 0x6510260 (libc.so.6:malloc) redirected to 0x483b780
>>>> (malloc)
>>>> --1286938-- REDIR: 0x6531c40 (libc.so.6:memcpy at GLIBC_2.2.5) redirected
>>>> to 0x4840100 (memcpy at GLIBC_2.2.5)
>>>> --1286938-- REDIR: 0x6527d30 (libc.so.6:__strlen_sse2) redirected to
>>>> 0x483efa0 (__strlen_sse2)
>>>> --1286938-- REDIR: 0x65f4ac0 (libc.so.6:__strncmp_sse42) redirected to
>>>> 0x483f7c0 (__strncmp_sse42)
>>>> --1286938-- REDIR: 0x6510850 (libc.so.6:free) redirected to 0x483c9d0
>>>> (free)
>>>> --1286938-- REDIR: 0x6532070 (libc.so.6:__memset_sse2_unaligned)
>>>> redirected to 0x48428e0 (memset)
>>>> --1286938-- REDIR: 0x6603350 (libc.so.6:__memcmp_sse4_1) redirected to
>>>> 0x4842150 (__memcmp_sse4_1)
>>>> --1286938-- REDIR: 0x6520520 (libc.so.6:__strcmp_sse2_unaligned)
>>>> redirected to 0x483fed0 (strcmp)
>>>> --1286938-- REDIR: 0x61d0c10 (libstdc++.so.6:operator new(unsigned
>>>> long)) redirected to 0x483bdf0 (operator new(unsigned long))
>>>> --1286938-- REDIR: 0x61cee60 (libstdc++.so.6:operator delete(void*))
>>>> redirected to 0x483cf50 (operator delete(void*))
>>>> --1286938-- REDIR: 0x61d0c70 (libstdc++.so.6:operator new[](unsigned
>>>> long)) redirected to 0x483c510 (operator new[](unsigned long))
>>>> --1286938-- REDIR: 0x61cee90 (libstdc++.so.6:operator delete[](void*))
>>>> redirected to 0x483d6e0 (operator delete[](void*))
>>>> --1286938-- REDIR: 0x65275f0 (libc.so.6:__strchr_sse2) redirected to
>>>> 0x483eb90 (__strchr_sse2)
>>>> --1286950-- REDIR: 0x6511000 (libc.so.6:realloc) redirected to
>>>> 0x483df30 (realloc)
>>>> --1286950-- REDIR: 0x6527820 (libc.so.6:__strchrnul_sse2) redirected to
>>>> 0x4843540 (strchrnul)
>>>> --1286950-- REDIR: 0x6531560 (libc.so.6:__strstr_sse2_unaligned)
>>>> redirected to 0x4843c20 (strstr)
>>>> --1286950-- REDIR: 0x6531c20 (libc.so.6:__mempcpy_sse2_unaligned)
>>>> redirected to 0x4843660 (mempcpy)
>>>> --1286950-- REDIR: 0x652d2a0 (libc.so.6:__strncpy_sse2_unaligned)
>>>> redirected to 0x483f560 (__strncpy_sse2_unaligned)
>>>> --1286950-- REDIR: 0x6515830 (libc.so.6:strncat) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> --1286950-- REDIR: 0x65305b0 (libc.so.6:__strncat_sse2_unaligned)
>>>> redirected to 0x483ede0 (strncat)
>>>> --1286950-- REDIR: 0x6516120 (libc.so.6:__GI_strstr) redirected to
>>>> 0x4843ca0 (__strstr_sse2)
>>>> --1286950-- REDIR: 0x6522360 (libc.so.6:__rawmemchr_sse2) redirected to
>>>> 0x4843580 (rawmemchr)
>>>> --1286950-- REDIR: 0x65faea0 (libc.so.6:__strcasecmp_avx) redirected to
>>>> 0x483f830 (strcasecmp)
>>>> --1286950-- REDIR: 0x65fc520 (libc.so.6:__strncasecmp_avx) redirected
>>>> to 0x483f910 (strncasecmp)
>>>> --1286950-- REDIR: 0x65f98a0 (libc.so.6:__strspn_sse42) redirected to
>>>> 0x4843ef0 (strspn)
>>>> --1286950-- REDIR: 0x65f9620 (libc.so.6:__strcspn_sse42) redirected to
>>>> 0x4843e10 (strcspn)
>>>> --1286948-- REDIR: 0x6522030 (libc.so.6:__memchr_sse2) redirected to
>>>> 0x4840050 (memchr)
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_mmap.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_posix.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_sysv.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Discarding syms at 0x4a96240-0x4a96d47 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_posix.so
>>>> (have_dinfo 1)
>>>> --1286948-- Discarding syms at 0x4a9b1c0-0x4a9b937 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_sysv.so
>>>> (have_dinfo 1)
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_reachable_weighted.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_reachable_netlink.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Discarding syms at 0x4a96120-0x4a966b0 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_reachable_weighted.so
>>>> (have_dinfo 1)
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_flux.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_orte.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_ompi.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_slurm.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- REDIR: 0x64bc670 (libc.so.6:setenv) redirected to 0x4844480
>>>> (setenv)
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_ess_pmi.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pmix_flux.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pmix_ext3x.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Discarding syms at 0x8d053e0-0x8d07391 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pmix_flux.so (have_dinfo
>>>> 1)
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v21.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v20.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v3.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286948-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v12.so
>>>> --1286948-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_ptl_usock.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_ptl_tcp.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_psec_native.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_psec_none.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Discarding syms at 0x8d04180-0x8d045b0 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_psec_none.so (have_dinfo 1)
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_ds21.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libmca_common_dstore.so.1.0.2
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_hash.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_ds12.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_pshmem_mmap.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_preg_native.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_stdfd.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_syslog.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286950-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_default.so
>>>> --1286950-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_tool.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_app.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_orted.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_hnp.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_novm.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Discarding syms at 0x9ebf0a0-0x9ebf490 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_tool.so
>>>> (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9eca300-0x9ecbee8 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_orted.so
>>>> (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9ed1220-0x9ed24e7 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_hnp.so (have_dinfo
>>>> 1)
>>>> --1286946-- Discarding syms at 0x9ed8240-0x9ed8c88 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_novm.so
>>>> (have_dinfo 1)
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_tool.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_app.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_hnp.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_orted.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Discarding syms at 0x9ebf0e0-0x9ebf417 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_tool.so
>>>> (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9ecf320-0x9ed1239 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_hnp.so
>>>> (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9ed73a0-0x9ed9ccc in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_orted.so
>>>> (have_dinfo 1)
>>>> --1286936-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_allocator_basic.so
>>>> --1286936-- object doesn't have a symbol table
>>>> --1286936-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_allocator_bucket.so
>>>> --1286936-- object doesn't have a symbol table
>>>> --1286936-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_rcache_grdma.so
>>>> --1286936-- object doesn't have a symbol table
>>>> --1286936-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mpool_hugepage.so
>>>> --1286936-- object doesn't have a symbol table
>>>> --1286936-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_bml_r2.so
>>>> --1286936-- object doesn't have a symbol table
>>>> --1286936-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_tcp.so
>>>> --1286936-- object doesn't have a symbol table
>>>> --1286936-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_sm.so
>>>> --1286936-- object doesn't have a symbol table
>>>> --1286936-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_vader.so
>>>> --1286936-- object doesn't have a symbol table
>>>> --1286936-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_openib.so
>>>> --1286936-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_verbs.so.40.20.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_self.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- REDIR: 0x652cc70 (libc.so.6:__strcpy_sse2_unaligned)
>>>> redirected to 0x483f090 (strcpy)
>>>> --1286946-- REDIR: 0x65a3810 (libc.so.6:__memmove_chk) redirected to
>>>> 0x48331d0 (_vgnU_ifunc_wrapper)
>>>> ==1286946== WARNING: new redirection conflicts with existing --
>>>> ignoring it
>>>> --1286946-- old: 0x06531c30 (__memcpy_chk_sse2_un) R-> (2030.0)
>>>> 0x04843b10 __memcpy_chk
>>>> --1286946-- new: 0x06531c30 (__memcpy_chk_sse2_un) R-> (2024.0)
>>>> 0x048434d0 __memmove_chk
>>>> --1286946-- REDIR: 0x6531c30 (libc.so.6:__memcpy_chk_sse2_unaligned)
>>>> redirected to 0x4843b10 (__memcpy_chk)
>>>> --1286946-- REDIR: 0x65129b0 (libc.so.6:posix_memalign) redirected to
>>>> 0x483e1e0 (posix_memalign)
>>>> --1286946-- Discarding syms at 0x9f15280-0x9f32932 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_openib.so
>>>> (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9f7c4c0-0x9f7ded8 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_verbs.so.40.20.0
>>>> (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9f620c0-0x9f71483 in
>>>> /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9f9ba10-0x9fd22ee in
>>>> /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 (have_dinfo 1)
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_cm.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_ob1.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_monitoring.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_monitoring.so.50.10.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_vprotocol_pessimist.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Discarding syms at 0x9f4d400-0x9f50c19 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_vprotocol_pessimist.so
>>>> (have_dinfo 1)
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_psm.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from /usr/lib/libpsm1/libpsm_infinipath.so.1.16
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libinfinipath.so.4.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_ofi.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libfabric.so.1.9.15
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libpsm2.so.2.1
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- REDIR: 0x6517140 (libc.so.6:strcasestr) redirected to
>>>> 0x4843f80 (strcasestr)
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_psm2.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Discarding syms at 0x9f4d5c0-0x9f4f5a1 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_psm.so (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9fee680-0x9ff096c in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_psm2.so (have_dinfo
>>>> 1)
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_inter.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_basic.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_sm.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_sm.so.40.20.0
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_self.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_sync.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_monitoring.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_libnbc.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_tuned.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_sm.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_pt2pt.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_rdma.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_monitoring.so
>>>> --1286946-- object doesn't have a symbol table
>>>> --1286946-- Discarding syms at 0x9f724a0-0x9f787b5 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_ofi.so (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0xa827f80-0xa8e14c4 in
>>>> /usr/lib/x86_64-linux-gnu/libfabric.so.1.9.15 (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9f94830-0x9fbafce in
>>>> /usr/lib/libpsm1/libpsm_infinipath.so.1.16 (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9fe5580-0x9fe8f71 in
>>>> /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9f56420-0x9f5cec0 in
>>>> /usr/lib/x86_64-linux-gnu/libinfinipath.so.4.0 (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0xa929f10-0xa93d5fc in
>>>> /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0xa94b0c0-0xa95a483 in
>>>> /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0xa968860-0xa9adf12 in
>>>> /usr/lib/x86_64-linux-gnu/libpsm2.so.2.1 (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0xa9e7a10-0xaa1e2ee in
>>>> /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9f80410-0x9f84e27 in
>>>> /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9f103e0-0x9f15fd5 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_cm.so (have_dinfo 1)
>>>> --1286946-- Discarding syms at 0x9f471e0-0x9f47ce0 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_monitoring.so
>>>> (have_dinfo 1)
>>>> ==1286946== Thread 3:
>>>> ==1286946== Syscall param writev(vector[...]) points to uninitialised
>>>> byte(s)
>>>> ==1286946== at 0x658A48D: __writev (writev.c:26)
>>>> ==1286946== by 0x658A48D: writev (writev.c:24)
>>>> ==1286946== by 0x8DF9B4C: pmix_ptl_base_send_handler (in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
>>>> ==1286946== by 0x7CC413E: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286946== by 0x7CC487E: event_base_loop (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286946== by 0x8DBDD55: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
>>>> ==1286946== by 0x4BF7608: start_thread (pthread_create.c:477)
>>>> ==1286946== by 0x6595102: clone (clone.S:95)
>>>> ==1286946== Address 0xa28fdcf is 127 bytes inside a block of size
>>>> 5,120 alloc'd
>>>> ==1286946== at 0x483DFAF: realloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286946== by 0x8DE155A: pmix_bfrop_buffer_extend (in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
>>>> ==1286946== by 0x8DE3F4A: pmix_bfrops_base_pack_byte (in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
>>>> ==1286946== by 0x8DE4900: pmix_bfrops_base_pack_buf (in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
>>>> ==1286946== by 0x8DE4175: pmix_bfrops_base_pack (in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
>>>> ==1286946== by 0x8D7CF91: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
>>>> ==1286946== by 0x7CC3FDD: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286946== by 0x7CC487E: event_base_loop (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286946== by 0x8DBDD55: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
>>>> ==1286946== by 0x4BF7608: start_thread (pthread_create.c:477)
>>>> ==1286946== by 0x6595102: clone (clone.S:95)
>>>> ==1286946== Uninitialised value was created by a stack allocation
>>>> ==1286946== at 0x9F048D6: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_vader.so)
>>>> ==1286946==
>>>> --1286944-- Discarding syms at 0xaa4d220-0xaa5796a in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmp--1286945-- Discarding syms at
>>>> 0xaa4d220---1286948-- Discarding syms at 0xaae1100-0xaae7d70 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmp--1286945-- Discarding syms at
>>>> 0xaae1100-0xaae7d70 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_monitoring.so
>>>> (have_dinfo 1)
>>>> --1286945-- Discarding syms at 0x9f69420-0x9f--1286938-- REDIR:
>>>> 0x61cee70 (libstdc++.so.6:operator delete(void*, unsigned long)) redirected
>>>> to --1286937-- REDIR: 0x61cee70 (libstdc++.so.6:opera--1286946-- REDIR:
>>>> 0x652e970 (libc.so.6:__stpncpy_sse2_unaligned) redirected to 0x48427e0
>>>> (stpncpy)
>>>> --1286942-- REDIR: 0x6527ed0 (libc.so.6:__strnlen_sse2) redirected to
>>>> 0x483eee0 (strnlen)
>>>> --1286944-- REDIR: 0x652fcc0 (libc.so.6:__strcat_sse2_unaligned)
>>>> redirected to 0x483ec20 (strcat)
>>>> --1286951-- REDIR: 0x65113d0 (libc.so.6:memalign) redirected to
>>>> 0x483e2a0 (memalign)
>>>> --1286951-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_io_romio321.so
>>>> --1286951-- object doesn't have a symbol table
>>>> --1286951-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_io_ompio.so
>>>> --1286951-- object doesn't have a symbol table
>>>> --1286941-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_ompio.so.41.19.3
>>>> --1286941-- object doesn't have a symbol table
>>>> --1286951-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fs_ufs.so
>>>> --1286951-- object doesn't have a symbol table
>>>> --1286939-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_two_phase.so
>>>> --1286939-- object doesn't have a symbol table
>>>> --1286939-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_individual.so
>>>> --1286939-- object doesn't have a symbol table
>>>> --1286939-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_dynamic.so
>>>> --1286939-- object doesn't have a symbol table
>>>> --1286939-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_dynamic_gen2.so
>>>> --1286939-- object doesn't have a symbol table
>>>> --1286939-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_vulcan.so
>>>> --1286939-- object doesn't have a symbol table
>>>> --1286939-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fbtl_posix.so
>>>> --1286939-- object doesn't have a symbol table
>>>> --1286943-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_sm.so
>>>> --1286943-- object doesn't have a symbol table
>>>> --1286943-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_individual.so
>>>> --1286943-- object doesn't have a symbol table
>>>> --1286943-- Reading syms from
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_lockedfile.so
>>>> --1286943-- object doesn't have a symbol table
>>>> --1286938-- REDIR: 0x65a3b00 (libc.so.6:__strcpy_chk) redirected to
>>>> 0x48435c0 (__strcpy_chk)
>>>> --1286939-- Discarding syms at 0x9f1d660-0x9f371d6 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_ob1.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9f5afa0-0x9f8f8b6 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_io_romio321.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9fa0640-0x9fa42d9 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_io_ompio.so (have_dinfo
>>>> 1)
>>>> --1286939-- Discarding syms at 0x9f4c160-0x9f4dc58 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_inter.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0xa7fc270-0xa804f00 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_basic.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9fee3a0-0x9ff134e in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_sm.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0xa80a240-0xa80aa8d in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_sm.so.40.20.0
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0xa80f0e0-0xa80f8bb in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_self.so (have_dinfo
>>>> 1)
>>>> --1286939-- Discarding syms at 0xaa460c0-0xaa47947 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_sync.so (have_dinfo
>>>> 1)
>>>> --1286939-- Discarding syms at 0xaa613e0-0xaa7730f in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_libnbc.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0xaa849c0-0xaa8a845 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_tuned.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9ee1320-0x9ee3567 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_bml_r2.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9eebc40-0x9ef4ad7 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_tcp.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9f02600-0x9f08cd8 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_vader.so (have_dinfo
>>>> 1)
>>>> --1286939-- Discarding syms at 0x9f40200-0x9f4126e in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_self.so (have_dinfo
>>>> 1)
>>>> --1286939-- Discarding syms at 0x9eda4e0-0x9edb4c5 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mpool_hugepage.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9ed32c0-0x9ed4afe in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_rcache_grdma.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9ebf160-0x9ebfe95 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_allocator_basic.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9ece140-0x9ecebed in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_allocator_bucket.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9ec92a0-0x9ec9aa2 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_app.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8eae0e0-0x8eae4a7 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_stdfd.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8eb3220-0x8eb3c27 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_syslog.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8eb80e0-0x8eb90b7 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_default.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8ea6380-0x8ea97b3 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_preg_native.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8e5a740-0x8e5f859 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_ptl_usock.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8e67be0-0x8e743f0 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_ptl_tcp.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x84da200-0x84daa5d in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_psec_native.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8d322b0-0x8d34bfc in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v21.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8e29480-0x8e3b70a in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v20.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8d3c2b0-0x8d3ed5c in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v3.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8e45340-0x8e502da in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v12.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8e901a0-0x8e908a7 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_pshmem_mmap.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8d05520-0x8d06783 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_ds21.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8e7b460-0x8e8aaa4 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_hash.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8d44520-0x8d4556a in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_ds12.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8e97600-0x8ea0fa1 in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libmca_common_dstore.so.1.0.2
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8d109c0-0x8d27dcf in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pmix_ext3x.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x8d5b280-0x8dfdffb in
>>>> /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25 (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9ec40a0-0x9ec4490 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_app.so (have_dinfo
>>>> 1)
>>>> --1286939-- Discarding syms at 0x84d2580-0x84d518f in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_ess_pmi.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x4a96120-0x4a9644f in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_flux.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x4aa0100-0x4aa03e7 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_orte.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x84c74a0-0x84c901f in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_ompi.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x4aa5260-0x4aa58e9 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_slurm.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x4a9b420-0x4a9bcdf in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_reachable_netlink.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x84e7460-0x84f52ca in
>>>> /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x4a90360-0x4a91107 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_mmap.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9f46220-0x9f474cc in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fbtl_posix.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9f0f180-0x9f0f78d in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fs_ufs.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0xaa94540-0xaa96a4a in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_sm.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0xaa9f6c0-0xaab44d0 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_pt2pt.so (have_dinfo
>>>> 1)
>>>> --1286939-- Discarding syms at 0xaabe820-0xaad8ee0 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_rdma.so (have_dinfo
>>>> 1)
>>>> --1286939-- Discarding syms at 0x9efc080-0x9efc1e1 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_sm.so (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9fab2a0-0x9fb1341 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_two_phase.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9f140c0-0x9f14299 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_individual.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9fb72a0-0x9fbb791 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_dynamic.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9fd52a0-0x9fda794 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_dynamic_gen2.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9fe02e0-0x9fe59a5 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_vulcan.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0xa815460-0xa8177ab in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_sm.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0xa81e260-0xa82033d in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_individual.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0xa8273e0-0xa8297d8 in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_lockedfile.so
>>>> (have_dinfo 1)
>>>> --1286939-- Discarding syms at 0x9fc85e0-0x9fce8ef in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_ompio.so.41.19.3
>>>> (have_dinfo 1)
>>>> ==1286939==
>>>> ==1286939== HEAP SUMMARY:
>>>> ==1286939== in use at exit: 74,054 bytes in 223 blocks
>>>> ==1286939== total heap usage: 22,405,782 allocs, 22,405,559 frees,
>>>> 34,062,479,959 bytes allocated
>>>> ==1286939==
>>>> ==1286939== Searching for pointers to 223 not-freed blocks
>>>> ==1286939== Checked 3,415,912 bytes
>>>> ==1286939==
>>>> ==1286939== Thread 1:
>>>> ==1286939== 1 bytes in 1 blocks are definitely lost in loss record 1 of
>>>> 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x651550E: strdup (strdup.c:42)
>>>> ==1286939== by 0x9F6A4B6: ???
>>>> ==1286939== by 0x9F47373: ???
>>>> ==1286939== by 0x68E3B9B: mca_base_framework_components_register (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3F35: mca_base_framework_register (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3F93: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x4BA1734: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939==
>>>> ==1286939== 8 bytes in 1 blocks are still reachable in loss record 2 of
>>>> 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x764724C: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libgomp.so.1.0.0)
>>>> ==1286939== by 0x7657B9A: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libgomp.so.1.0.0)
>>>> ==1286939== by 0x7645679: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libgomp.so.1.0.0)
>>>> ==1286939== by 0x4011B89: call_init.part.0 (dl-init.c:72)
>>>> ==1286939== by 0x4011C90: call_init (dl-init.c:30)
>>>> ==1286939== by 0x4011C90: _dl_init (dl-init.c:119)
>>>> ==1286939== by 0x4001139: ??? (in /usr/lib/x86_64-linux-gnu/
>>>> ld-2.31.so)
>>>> ==1286939== by 0x3: ???
>>>> ==1286939== by 0x1FFEFFF926: ???
>>>> ==1286939== by 0x1FFEFFF93D: ???
>>>> ==1286939== by 0x1FFEFFF987: ???
>>>> ==1286939== by 0x1FFEFFF9A7: ???
>>>> ==1286939==
>>>> ==1286939== 8 bytes in 1 blocks are definitely lost in loss record 3 of
>>>> 44
>>>> ==1286939== at 0x483DD99: calloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x9F69B6F: ???
>>>> ==1286939== by 0x9F1CDED: ???
>>>> ==1286939== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9EE3527: ???
>>>> ==1286939== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286939==
>>>> ==1286939== 13 bytes in 2 blocks are still reachable in loss record 4
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x651550E: strdup (strdup.c:42)
>>>> ==1286939== by 0x7CC3657: event_config_avoid_method (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x68FEB5A: opal_event_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68FE8CA: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E4008: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68B8BCF: opal_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x6860120: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939==
>>>> ==1286939== 15 bytes in 1 blocks are indirectly lost in loss record 5
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x651550E: strdup (strdup.c:42)
>>>> ==1286939== by 0x9EDB189: ???
>>>> ==1286939== by 0x68D98FC: mca_base_framework_components_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x6907C25: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E4008: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x4BA16D5: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286939==
>>>> ==1286939== 15 bytes in 1 blocks are definitely lost in loss record 6
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x651550E: strdup (strdup.c:42)
>>>> ==1286939== by 0x9F5655C: ???
>>>> ==1286939== by 0x4011B89: call_init.part.0 (dl-init.c:72)
>>>> ==1286939== by 0x4011C90: call_init (dl-init.c:30)
>>>> ==1286939== by 0x4011C90: _dl_init (dl-init.c:119)
>>>> ==1286939== by 0x65D6784: _dl_catch_exception
>>>> (dl-error-skeleton.c:182)
>>>> ==1286939== by 0x401642C: dl_open_worker (dl-open.c:758)
>>>> ==1286939== by 0x65D6727: _dl_catch_exception
>>>> (dl-error-skeleton.c:208)
>>>> ==1286939== by 0x40155F9: _dl_open (dl-open.c:837)
>>>> ==1286939== by 0x72DE34B: dlopen_doit (dlopen.c:66)
>>>> ==1286939== by 0x65D6727: _dl_catch_exception
>>>> (dl-error-skeleton.c:208)
>>>> ==1286939== by 0x65D67F2: _dl_catch_error (dl-error-skeleton.c:227)
>>>> ==1286939==
>>>> ==1286939== 16 bytes in 1 blocks are definitely lost in loss record 7
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x9F1CBEB: ???
>>>> ==1286939== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9EE3527: ???
>>>> ==1286939== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286939==
>>>> ==1286939== 16 bytes in 1 blocks are definitely lost in loss record 8
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x9F1CC66: ???
>>>> ==1286939== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9EE3527: ???
>>>> ==1286939== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286939==
>>>> ==1286939== 16 bytes in 1 blocks are definitely lost in loss record 9
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x9F1CCDA: ???
>>>> ==1286939== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9EE3527: ???
>>>> ==1286939== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286939==
>>>> ==1286939== 25 bytes in 1 blocks are still reachable in loss record 10
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x651550E: strdup (strdup.c:42)
>>>> ==1286939== by 0x68F27BD: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x4B956B6: ompi_pml_v_output_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B95259: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x68D98FC: mca_base_framework_components_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x4B93FAE: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x68E4008: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x4BA1734: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939==
>>>> ==1286939== 30 bytes in 1 blocks are definitely lost in loss record 11
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0xA9A859B: ???
>>>> ==1286939== by 0x4011B89: call_init.part.0 (dl-init.c:72)
>>>> ==1286939== by 0x4011C90: call_init (dl-init.c:30)
>>>> ==1286939== by 0x4011C90: _dl_init (dl-init.c:119)
>>>> ==1286939== by 0x65D6784: _dl_catch_exception
>>>> (dl-error-skeleton.c:182)
>>>> ==1286939== by 0x401642C: dl_open_worker (dl-open.c:758)
>>>> ==1286939== by 0x65D6727: _dl_catch_exception
>>>> (dl-error-skeleton.c:208)
>>>> ==1286939== by 0x40155F9: _dl_open (dl-open.c:837)
>>>> ==1286939== by 0x72DE34B: dlopen_doit (dlopen.c:66)
>>>> ==1286939== by 0x65D6727: _dl_catch_exception
>>>> (dl-error-skeleton.c:208)
>>>> ==1286939== by 0x65D67F2: _dl_catch_error (dl-error-skeleton.c:227)
>>>> ==1286939== by 0x72DEB58: _dlerror_run (dlerror.c:170)
>>>> ==1286939==
>>>> ==1286939== 32 bytes in 1 blocks are still reachable in loss record 12
>>>> of 44
>>>> ==1286939== at 0x483DD99: calloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x7CC353E: event_get_supported_methods (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x68FEA98: opal_event_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68FE8CA: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E4008: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68B8BCF: opal_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x6860120: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939==
>>>> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 13
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A5EB: ???
>>>> ==1286939== by 0x84D2B0A: ???
>>>> ==1286939== by 0x68602FB: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 14
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A5EB: ???
>>>> ==1286939== by 0x84D2BCE: ???
>>>> ==1286939== by 0x68602FB: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 15
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A5EB: ???
>>>> ==1286939== by 0x84D2CB2: ???
>>>> ==1286939== by 0x68602FB: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 16
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A5EB: ???
>>>> ==1286939== by 0x84D2D91: ???
>>>> ==1286939== by 0x68602FB: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 17
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E81BD8: ???
>>>> ==1286939== by 0x8E89F4B: ???
>>>> ==1286939== by 0x8D84A0D: ???
>>>> ==1286939== by 0x8DF79C1: ???
>>>> ==1286939== by 0x7CC3FDD: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CC487E: event_base_loop (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x8DBDD55: ???
>>>> ==1286939== by 0x4BF7608: start_thread (pthread_create.c:477)
>>>> ==1286939== by 0x6595102: clone (clone.S:95)
>>>> ==1286939==
>>>> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 18
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A767: ???
>>>> ==1286939== by 0x84D330E: ???
>>>> ==1286939== by 0x68602FB: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== 36 (32 direct, 4 indirect) bytes in 1 blocks are definitely
>>>> lost in loss record 19 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A5EB: ???
>>>> ==1286939== by 0x4B94C09: mca_pml_base_pml_check_selected (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x9F1E1E1: ???
>>>> ==1286939== by 0x4BA1A09: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== 40 bytes in 1 blocks are still reachable in loss record 20
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x7CFF4B6: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CC5E26: event_global_setup_locks_ (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CFF68F: evthread_use_pthreads (in
>>>> /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
>>>> ==1286939== by 0x68FE8E4: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E4008: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68B8BCF: opal_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x6860120: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939==
>>>> ==1286939== 40 bytes in 1 blocks are still reachable in loss record 21
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x7CFF4B6: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CCF377: evsig_global_setup_locks_ (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CC5E39: event_global_setup_locks_ (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CFF68F: evthread_use_pthreads (in
>>>> /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
>>>> ==1286939== by 0x68FE8E4: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E4008: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68B8BCF: opal_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x6860120: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939==
>>>> ==1286939== 40 bytes in 1 blocks are still reachable in loss record 22
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x7CFF4B6: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CCB997: evutil_secure_rng_global_setup_locks_ (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CC5E4F: event_global_setup_locks_ (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CFF68F: evthread_use_pthreads (in
>>>> /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
>>>> ==1286939== by 0x68FE8E4: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E4008: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68B8BCF: opal_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x6860120: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939==
>>>> ==1286939== 48 bytes in 1 blocks are still reachable in loss record 23
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x68D9043: mca_base_component_repository_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68D7F7A: mca_base_component_find (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3A4D: mca_base_framework_components_register (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3F35: mca_base_framework_register (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3F93: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x4B8560C: mca_io_base_file_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B0E68A: ompi_file_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B3ADB8: PMPI_File_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x7B6F1AC: H5FD_mpio_open (H5FDmpio.c:997)
>>>> ==1286939== by 0x78D4B23: H5FD_open (H5FD.c:733)
>>>> ==1286939== by 0x78B953B: H5F_open (H5Fint.c:1493)
>>>> ==1286939==
>>>> ==1286939== 48 bytes in 1 blocks are still reachable in loss record 24
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x68D9043: mca_base_component_repository_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68D7F7A: mca_base_component_find (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3A4D: mca_base_framework_components_register (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3F35: mca_base_framework_register (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3F93: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x4B85638: mca_io_base_file_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B0E68A: ompi_file_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B3ADB8: PMPI_File_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x7B6F1AC: H5FD_mpio_open (H5FDmpio.c:997)
>>>> ==1286939== by 0x78D4B23: H5FD_open (H5FD.c:733)
>>>> ==1286939== by 0x78B953B: H5F_open (H5Fint.c:1493)
>>>> ==1286939==
>>>> ==1286939== 48 bytes in 2 blocks are still reachable in loss record 25
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x7CC3647: event_config_avoid_method (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x68FEB5A: opal_event_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68FE8CA: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E4008: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68B8BCF: opal_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x6860120: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939==
>>>> ==1286939== 55 (32 direct, 23 indirect) bytes in 1 blocks are
>>>> definitely lost in loss record 26 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A767: ???
>>>> ==1286939== by 0x4AF6CD6: ompi_comm_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA194D: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939==
>>>> ==1286939== 56 bytes in 1 blocks are still reachable in loss record 27
>>>> of 44
>>>> ==1286939== at 0x483DD99: calloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x7CC1C86: event_config_new (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x68FEAC0: opal_event_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68FE8CA: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E4008: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68B8BCF: opal_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x6860120: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939==
>>>> ==1286939== 56 bytes in 1 blocks are definitely lost in loss record 28
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x9F6E008: ???
>>>> ==1286939== by 0x9F7C654: ???
>>>> ==1286939== by 0x9F1CD3E: ???
>>>> ==1286939== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9EE3527: ???
>>>> ==1286939== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939==
>>>> ==1286939== 56 bytes in 1 blocks are definitely lost in loss record 29
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0xA957008: ???
>>>> ==1286939== by 0xA86B017: ???
>>>> ==1286939== by 0xA862FD8: ???
>>>> ==1286939== by 0xA828E15: ???
>>>> ==1286939== by 0xA829624: ???
>>>> ==1286939== by 0x9F77910: ???
>>>> ==1286939== by 0x4B85C53: ompi_mtl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x9F13E4D: ???
>>>> ==1286939== by 0x4B94673: mca_pml_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA1789: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== 76 (32 direct, 44 indirect) bytes in 1 blocks are
>>>> definitely lost in loss record 30 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A767: ???
>>>> ==1286939== by 0x84D387F: ???
>>>> ==1286939== by 0x68602FB: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== 79 (64 direct, 15 indirect) bytes in 1 blocks are
>>>> definitely lost in loss record 31 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x9EDB12E: ???
>>>> ==1286939== by 0x68D98FC: mca_base_framework_components_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x6907C25: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E4008: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x4BA16D5: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286939==
>>>> ==1286939== 144 bytes in 3 blocks are still reachable in loss record 32
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x68D9043: mca_base_component_repository_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68D7F7A: mca_base_component_find (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3A4D: mca_base_framework_components_register (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3F35: mca_base_framework_register (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3F93: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x4B8564E: mca_io_base_file_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B0E68A: ompi_file_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B3ADB8: PMPI_File_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x7B6F1AC: H5FD_mpio_open (H5FDmpio.c:997)
>>>> ==1286939== by 0x78D4B23: H5FD_open (H5FD.c:733)
>>>> ==1286939== by 0x78B953B: H5F_open (H5Fint.c:1493)
>>>> ==1286939==
>>>> ==1286939== 231 bytes in 12 blocks are definitely lost in loss record
>>>> 33 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x651550E: strdup (strdup.c:42)
>>>> ==1286939== by 0x9F2B4B3: ???
>>>> ==1286939== by 0x9F2B85C: ???
>>>> ==1286939== by 0x9F2BBD7: ???
>>>> ==1286939== by 0x9F1CAAC: ???
>>>> ==1286939== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9EE3527: ???
>>>> ==1286939== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939==
>>>> ==1286939== 240 bytes in 5 blocks are still reachable in loss record 34
>>>> of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x68D9043: mca_base_component_repository_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68D7F7A: mca_base_component_find (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3A4D: mca_base_framework_components_register (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3F35: mca_base_framework_register (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x68E3F93: mca_base_framework_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x4B85622: mca_io_base_file_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B0E68A: ompi_file_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B3ADB8: PMPI_File_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x7B6F1AC: H5FD_mpio_open (H5FDmpio.c:997)
>>>> ==1286939== by 0x78D4B23: H5FD_open (H5FD.c:733)
>>>> ==1286939== by 0x78B953B: H5F_open (H5Fint.c:1493)
>>>> ==1286939==
>>>> ==1286939== 272 bytes in 44 blocks are definitely lost in loss record
>>>> 35 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x9FCAEDB: ???
>>>> ==1286939== by 0x9FE42B2: ???
>>>> ==1286939== by 0x9FE47BB: ???
>>>> ==1286939== by 0x9FCDDBF: ???
>>>> ==1286939== by 0x9FA324A: ???
>>>> ==1286939== by 0x4B3DD7F: PMPI_File_write_at_all (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x7B6DB32: H5FD_mpio_write (H5FDmpio.c:1833)
>>>> ==1286939== by 0x78DF11D: H5FD_write (H5FDint.c:257)
>>>> ==1286939== by 0x78AE86B: H5F__accum_write (H5Faccum.c:825)
>>>> ==1286939== by 0x7A1FBE9: H5PB_write (H5PB.c:1027)
>>>> ==1286939== by 0x78BBC7A: H5F_block_write (H5Fio.c:164)
>>>> ==1286939==
>>>> ==1286939== 585 (480 direct, 105 indirect) bytes in 15 blocks are
>>>> definitely lost in loss record 36 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A767: ???
>>>> ==1286939== by 0x4B14036: ompi_proc_complete_init_single (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B146C3: ompi_proc_complete_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA19A9: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== 776 bytes in 32 blocks are indirectly lost in loss record
>>>> 37 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8DE9816: ???
>>>> ==1286939== by 0x8DEB1D2: ???
>>>> ==1286939== by 0x8DEB49A: ???
>>>> ==1286939== by 0x8DE8B12: ???
>>>> ==1286939== by 0x8E9D492: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A767: ???
>>>> ==1286939==
>>>> ==1286939== 840 (480 direct, 360 indirect) bytes in 15 blocks are
>>>> definitely lost in loss record 38 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A5EB: ???
>>>> ==1286939== by 0x9EF2F00: ???
>>>> ==1286939== by 0x9EEBF17: ???
>>>> ==1286939== by 0x9EE2F54: ???
>>>> ==1286939== by 0x9F1E1FB: ???
>>>> ==1286939==
>>>> ==1286939== 1,084 (480 direct, 604 indirect) bytes in 15 blocks are
>>>> definitely lost in loss record 39 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A767: ???
>>>> ==1286939== by 0x84D4800: ???
>>>> ==1286939== by 0x68602FB: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286939== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== 1,344 bytes in 1 blocks are definitely lost in loss record
>>>> 40 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x68AE702: opal_free_list_grow_st (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9F1CD2D: ???
>>>> ==1286939== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9EE3527: ???
>>>> ==1286939== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286939==
>>>> ==1286939== 2,752 bytes in 1 blocks are definitely lost in loss record
>>>> 41 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x68AE702: opal_free_list_grow_st (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9F1CC50: ???
>>>> ==1286939== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9EE3527: ???
>>>> ==1286939== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286939==
>>>> ==1286939== 2,752 bytes in 1 blocks are definitely lost in loss record
>>>> 42 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x68AE702: opal_free_list_grow_st (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9F1CCC4: ???
>>>> ==1286939== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286939== by 0x9EE3527: ???
>>>> ==1286939== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286939== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286939== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286939== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286939==
>>>> ==1286939== 62,644 bytes in 31 blocks are indirectly lost in loss
>>>> record 43 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8DE9FA8: ???
>>>> ==1286939== by 0x8DEB032: ???
>>>> ==1286939== by 0x8DEB49A: ???
>>>> ==1286939== by 0x8DE8B12: ???
>>>> ==1286939== by 0x8E9D492: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A5EB: ???
>>>> ==1286939==
>>>> ==1286939== 62,760 (480 direct, 62,280 indirect) bytes in 15 blocks are
>>>> definitely lost in loss record 44 of 44
>>>> ==1286939== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8E9D3EB: ???
>>>> ==1286939== by 0x8E9F1C1: ???
>>>> ==1286939== by 0x8D0578C: ???
>>>> ==1286939== by 0x8D8605A: ???
>>>> ==1286939== by 0x8D87FE8: ???
>>>> ==1286939== by 0x8D88E4D: ???
>>>> ==1286939== by 0x8D1A5EB: ???
>>>> ==1286939== by 0x9F0398A: ???
>>>> ==1286939== by 0x9EE2F54: ???
>>>> ==1286939== by 0x9F1E1FB: ???
>>>> ==1286939== by 0x4BA1A09: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286939==
>>>> ==1286939== LEAK SUMMARY:
>>>> ==1286939== definitely lost: 9,837 bytes in 138 blocks
>>>> ==1286939== indirectly lost: 63,435 bytes in 64 blocks
>>>> ==1286939== possibly lost: 0 bytes in 0 blocks
>>>> ==1286939== still reachable: 782 bytes in 21 blocks
>>>> ==1286939== suppressed: 0 bytes in 0 blocks
>>>> ==1286939==
>>>> ==1286939== ERROR SUMMARY: 29 errors from 29 contexts (suppressed: 0
>>>> from 0)
>>>> ==1286939==
>>>> ==1286939== 1 errors in context 1 of 29:
>>>> ==1286939== Thread 3:
>>>> ==1286939== Syscall param writev(vector[...]) points to uninitialised
>>>> byte(s)
>>>> ==1286939== at 0x658A48D: __writev (writev.c:26)
>>>> ==1286939== by 0x658A48D: writev (writev.c:24)
>>>> ==1286939== by 0x8DF9B4C: ???
>>>> ==1286939== by 0x7CC413E: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CC487E: event_base_loop (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x8DBDD55: ???
>>>> ==1286939== by 0x4BF7608: start_thread (pthread_create.c:477)
>>>> ==1286939== by 0x6595102: clone (clone.S:95)
>>>> ==1286939== Address 0xa28ee1f is 127 bytes inside a block of size
>>>> 5,120 alloc'd
>>>> ==1286939== at 0x483DFAF: realloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286939== by 0x8DE155A: ???
>>>> ==1286939== by 0x8DE3F4A: ???
>>>> ==1286939== by 0x8DE4900: ???
>>>> ==1286939== by 0x8DE4175: ???
>>>> ==1286939== by 0x8D7CF91: ???
>>>> ==1286939== by 0x7CC3FDD: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x7CC487E: event_base_loop (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286939== by 0x8DBDD55: ???
>>>> ==1286939== by 0x4BF7608: start_thread (pthread_create.c:477)
>>>> ==1286939== by 0x6595102: clone (clone.S:95)
>>>> ==1286939== Uninitialised value was created by a stack allocation
>>>> ==1286939== at 0x9F048D6: ???
>>>> ==1286939==
>>>> ==1286939== ERROR SUMMARY: 29 errors from 29 contexts (suppressed: 0
>>>> from 0)
>>>> mpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286936== by 0x4B85622: mca_io_base_file_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4B0E68A: ompi_file_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4B3ADB8: PMPI_File_open (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x7B6F1AC: H5FD_mpio_open (H5FDmpio.c:997)
>>>> ==1286936== by 0x78D4B23: H5FD_open (H5FD.c:733)
>>>> ==1286936== by 0x78B953B: H5F_open (H5Fint.c:1493)
>>>> ==1286936==
>>>> ==1286936== 272 bytes in 44 blocks are definitely lost in loss record
>>>> 39 of 49
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x9FCAEDB: ???
>>>> ==1286936== by 0x9FE42B2: ???
>>>> ==1286936== by 0x9FE47BB: ???
>>>> ==1286936== by 0x9FCDDBF: ???
>>>> ==1286936== by 0x9FA324A: ???
>>>> ==1286936== by 0x4B3DD7F: PMPI_File_write_at_all (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x7B6DB32: H5FD_mpio_write (H5FDmpio.c:1833)
>>>> ==1286936== by 0x78DF11D: H5FD_write (H5FDint.c:257)
>>>> ==1286936== by 0x78AE86B: H5F__accum_write (H5Faccum.c:825)
>>>> ==1286936== by 0x7A1FBE9: H5PB_write (H5PB.c:1027)
>>>> ==1286936== by 0x78BBC7A: H5F_block_write (H5Fio.c:164)
>>>> ==1286936==
>>>> ==1286936== 312 bytes in 1 blocks are still reachable in loss record 40
>>>> of 49
>>>> ==1286936== at 0x483BE63: operator new(unsigned long) (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x74E78EB: boost::detail::make_external_thread_data()
>>>> (in
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_thread.so.1.73.0)
>>>> ==1286936== by 0x74E7C74:
>>>> boost::detail::add_thread_exit_function(boost::detail::thread_exit_function_base*)
>>>> (in
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_thread.so.1.73.0)
>>>> ==1286936== by 0x73AFCEA:
>>>> boost::log::v2_mt_posix::sources::aux::get_severity_level() (in
>>>> /home/mlohry/dev/cmake-build/boost_install/lib/libboost_log.so.1.73.0)
>>>> ==1286936== by 0x5F71A6C: set_value (severity_feature.hpp:135)
>>>> ==1286936== by 0x5F71A6C:
>>>> open_record_unlocked<boost::parameter::aux::tagged_argument_list_of_1<boost::parameter::aux::tagged_argument<boost::log::v2_mt_posix::keywords::tag::severity,
>>>> const boost::log::v2_mt_posix::trivial::severity_level> > >
>>>> (severity_feature.hpp:252)
>>>> ==1286936== by 0x5F71A6C:
>>>> open_record<boost::parameter::aux::tagged_argument_list_of_1<boost::parameter::aux::tagged_argument<boost::log::v2_mt_posix::keywords::tag::severity,
>>>> const boost::log::v2_mt_posix::trivial::severity_level> > >
>>>> (basic_logger.hpp:459)
>>>> ==1286936== by 0x5F71A6C:
>>>> Logger::TraceMessage(std::__cxx11::basic_string<char,
>>>> std::char_traits<char>, std::allocator<char> >) (logger.cpp:328)
>>>> ==1286936== by 0x5F729C7:
>>>> Logger::Message(std::__cxx11::basic_string<char, std::char_traits<char>,
>>>> std::allocator<char> > const&, LogLevel) (logger.cpp:280)
>>>> ==1286936== by 0x5F73CF1:
>>>> Logger::Timer::Timer(std::__cxx11::basic_string<char,
>>>> std::char_traits<char>, std::allocator<char> > const&, LogLevel)
>>>> (logger.cpp:426)
>>>> ==1286936== by 0x15718A: timer (logger.hpp:98)
>>>> ==1286936== by 0x15718A: main (testing_main.cpp:9)
>>>> ==1286936==
>>>> ==1286936== 585 (480 direct, 105 indirect) bytes in 15 blocks are
>>>> definitely lost in loss record 41 of 49
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x8E9D3EB: ???
>>>> ==1286936== by 0x8E9F1C1: ???
>>>> ==1286936== by 0x8D0578C: ???
>>>> ==1286936== by 0x8D8605A: ???
>>>> ==1286936== by 0x8D87FE8: ???
>>>> ==1286936== by 0x8D88E4D: ???
>>>> ==1286936== by 0x8D1A767: ???
>>>> ==1286936== by 0x4B14036: ompi_proc_complete_init_single (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4B146C3: ompi_proc_complete_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4BA19A9: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936==
>>>> ==1286936== 776 bytes in 32 blocks are indirectly lost in loss record
>>>> 42 of 49
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x8DE9816: ???
>>>> ==1286936== by 0x8DEB1D2: ???
>>>> ==1286936== by 0x8DEB49A: ???
>>>> ==1286936== by 0x8DE8B12: ???
>>>> ==1286936== by 0x8E9D492: ???
>>>> ==1286936== by 0x8E9F1C1: ???
>>>> ==1286936== by 0x8D0578C: ???
>>>> ==1286936== by 0x8D8605A: ???
>>>> ==1286936== by 0x8D87FE8: ???
>>>> ==1286936== by 0x8D88E4D: ???
>>>> ==1286936== by 0x8D1A767: ???
>>>> ==1286936==
>>>> ==1286936== 840 (480 direct, 360 indirect) bytes in 15 blocks are
>>>> definitely lost in loss record 43 of 49
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x8E9D3EB: ???
>>>> ==1286936== by 0x8E9F1C1: ???
>>>> ==1286936== by 0x8D0578C: ???
>>>> ==1286936== by 0x8D8605A: ???
>>>> ==1286936== by 0x8D87FE8: ???
>>>> ==1286936== by 0x8D88E4D: ???
>>>> ==1286936== by 0x8D1A5EB: ???
>>>> ==1286936== by 0x9EF2F00: ???
>>>> ==1286936== by 0x9EEBF17: ???
>>>> ==1286936== by 0x9EE2F54: ???
>>>> ==1286936== by 0x9F1E1FB: ???
>>>> ==1286936==
>>>> ==1286936== 1,091 (480 direct, 611 indirect) bytes in 15 blocks are
>>>> definitely lost in loss record 44 of 49
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x8E9D3EB: ???
>>>> ==1286936== by 0x8E9F1C1: ???
>>>> ==1286936== by 0x8D0578C: ???
>>>> ==1286936== by 0x8D8605A: ???
>>>> ==1286936== by 0x8D87FE8: ???
>>>> ==1286936== by 0x8D88E4D: ???
>>>> ==1286936== by 0x8D1A767: ???
>>>> ==1286936== by 0x84D4800: ???
>>>> ==1286936== by 0x68602FB: orte_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
>>>> ==1286936== by 0x4BA1322: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936==
>>>> ==1286936== 1,344 bytes in 1 blocks are definitely lost in loss record
>>>> 45 of 49
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x68AE702: opal_free_list_grow_st (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286936== by 0x9F1CD2D: ???
>>>> ==1286936== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286936== by 0x9EE3527: ???
>>>> ==1286936== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286936== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286936== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286936== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286936==
>>>> ==1286936== 2,752 bytes in 1 blocks are definitely lost in loss record
>>>> 46 of 49
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x68AE702: opal_free_list_grow_st (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286936== by 0x9F1CC50: ???
>>>> ==1286936== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286936== by 0x9EE3527: ???
>>>> ==1286936== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286936== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286936== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286936== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286936==
>>>> ==1286936== 2,752 bytes in 1 blocks are definitely lost in loss record
>>>> 47 of 49
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x68AE702: opal_free_list_grow_st (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286936== by 0x9F1CCC4: ???
>>>> ==1286936== by 0x68FC9C8: mca_btl_base_select (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
>>>> ==1286936== by 0x9EE3527: ???
>>>> ==1286936== by 0x4B6170A: mca_bml_base_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4BA1714: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4B450B0: PMPI_Init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x4A7BA77: boost::mpi::environment::environment(bool)
>>>> (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
>>>> ==1286936== by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
>>>> ==1286936== by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
>>>> ==1286936== by 0x15710D: main (testing_main.cpp:8)
>>>> ==1286936==
>>>> ==1286936== 62,640 bytes in 30 blocks are indirectly lost in loss
>>>> record 48 of 49
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x8DE9FA8: ???
>>>> ==1286936== by 0x8DEB032: ???
>>>> ==1286936== by 0x8DEB49A: ???
>>>> ==1286936== by 0x8DE8B12: ???
>>>> ==1286936== by 0x8E9D492: ???
>>>> ==1286936== by 0x8E9F1C1: ???
>>>> ==1286936== by 0x8D0578C: ???
>>>> ==1286936== by 0x8D8605A: ???
>>>> ==1286936== by 0x8D87FE8: ???
>>>> ==1286936== by 0x8D88E4D: ???
>>>> ==1286936== by 0x8D1A5EB: ???
>>>> ==1286936==
>>>> ==1286936== 62,760 (480 direct, 62,280 indirect) bytes in 15 blocks are
>>>> definitely lost in loss record 49 of 49
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x8E9D3EB: ???
>>>> ==1286936== by 0x8E9F1C1: ???
>>>> ==1286936== by 0x8D0578C: ???
>>>> ==1286936== by 0x8D8605A: ???
>>>> ==1286936== by 0x8D87FE8: ???
>>>> ==1286936== by 0x8D88E4D: ???
>>>> ==1286936== by 0x8D1A5EB: ???
>>>> ==1286936== by 0x9F0398A: ???
>>>> ==1286936== by 0x9EE2F54: ???
>>>> ==1286936== by 0x9F1E1FB: ???
>>>> ==1286936== by 0x4BA1A09: ompi_mpi_init (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936==
>>>> ==1286936== LEAK SUMMARY:
>>>> ==1286936== definitely lost: 9,805 bytes in 137 blocks
>>>> ==1286936== indirectly lost: 63,431 bytes in 63 blocks
>>>> ==1286936== possibly lost: 0 bytes in 0 blocks
>>>> ==1286936== still reachable: 1,174 bytes in 27 blocks
>>>> ==1286936== suppressed: 0 bytes in 0 blocks
>>>> ==1286936==
>>>> ==1286936== ERROR SUMMARY: 34 errors from 29 contexts (suppressed: 0
>>>> from 0)
>>>> ==1286936==
>>>> ==1286936== 1 errors in context 1 of 29:
>>>> ==1286936== Thread 3:
>>>> ==1286936== Syscall param writev(vector[...]) points to uninitialised
>>>> byte(s)
>>>> ==1286936== at 0x658A48D: __writev (writev.c:26)
>>>> ==1286936== by 0x658A48D: writev (writev.c:24)
>>>> ==1286936== by 0x8DF9B4C: ???
>>>> ==1286936== by 0x7CC413E: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286936== by 0x7CC487E: event_base_loop (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286936== by 0x8DBDD55: ???
>>>> ==1286936== by 0x4BF7608: start_thread (pthread_create.c:477)
>>>> ==1286936== by 0x6595102: clone (clone.S:95)
>>>> ==1286936== Address 0xa290cbf is 127 bytes inside a block of size
>>>> 5,120 alloc'd
>>>> ==1286936== at 0x483DFAF: realloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x8DE155A: ???
>>>> ==1286936== by 0x8DE3F4A: ???
>>>> ==1286936== by 0x8DE4900: ???
>>>> ==1286936== by 0x8DE4175: ???
>>>> ==1286936== by 0x8D7CF91: ???
>>>> ==1286936== by 0x7CC3FDD: ??? (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286936== by 0x7CC487E: event_base_loop (in
>>>> /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
>>>> ==1286936== by 0x8DBDD55: ???
>>>> ==1286936== by 0x4BF7608: start_thread (pthread_create.c:477)
>>>> ==1286936== by 0x6595102: clone (clone.S:95)
>>>> ==1286936== Uninitialised value was created by a stack allocation
>>>> ==1286936== at 0x9F048D6: ???
>>>> ==1286936==
>>>> ==1286936==
>>>> ==1286936== 6 errors in context 2 of 29:
>>>> ==1286936== Thread 1:
>>>> ==1286936== Syscall param pwritev(vector[...]) points to uninitialised
>>>> byte(s)
>>>> ==1286936== at 0x658A608: pwritev64 (pwritev64.c:30)
>>>> ==1286936== by 0x658A608: pwritev (pwritev64.c:28)
>>>> ==1286936== by 0x9F46E25: ???
>>>> ==1286936== by 0x9FCE33B: ???
>>>> ==1286936== by 0x9FCDDBF: ???
>>>> ==1286936== by 0x9FA324A: ???
>>>> ==1286936== by 0x4B3DD7F: PMPI_File_write_at_all (in
>>>> /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
>>>> ==1286936== by 0x7B6DB32: H5FD_mpio_write (H5FDmpio.c:1833)
>>>> ==1286936== by 0x78DF11D: H5FD_write (H5FDint.c:257)
>>>> ==1286936== by 0x78AE86B: H5F__accum_write (H5Faccum.c:825)
>>>> ==1286936== by 0x7A1FBE9: H5PB_write (H5PB.c:1027)
>>>> ==1286936== by 0x78BBC7A: H5F_block_write (H5Fio.c:164)
>>>> ==1286936== by 0x7B5ED15: H5C__collective_write (H5Cmpio.c:1020)
>>>> ==1286936== by 0x7B5ED15: H5C_apply_candidate_list (H5Cmpio.c:394)
>>>> ==1286936== Address 0xedf91b0 is 96 bytes inside a block of size 216
>>>> alloc'd
>>>> ==1286936== at 0x483B7F3: malloc (in
>>>> /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
>>>> ==1286936== by 0x7980C45: H5MM_malloc (H5MM.c:292)
>>>> ==1286936== by 0x7980C45: H5MM_malloc (H5MM.c:267)
>>>> ==1286936== by 0x77FC8FF: H5C__flush_single_entry (H5C.c:6045)
>>>> ==1286936== by 0x7B5DC7E: H5C__flush_candidates_in_ring
>>>> (H5Cmpio.c:1371)
>>>> ==1286936== by 0x7B5DC7E: H5C__flush_candidate_entries
>>>> (H5Cmpio.c:1192)
>>>> ==1286936== by 0x7B5DC7E: H5C_apply_candidate_list (H5Cmpio.c:385)
>>>> ==1286936== by 0x7B5BA18: H5AC__rsp__dist_md_write__flush
>>>> (H5ACmpio.c:1709)
>>>> ==1286936== by 0x7B5BA18: H5AC__run_sync_point (H5ACmpio.c:2164)
>>>> ==1286936== by 0x7B5C9D2: H5AC__flush_entries (H5ACmpio.c:2307)
>>>> ==1286936== by 0x77C95E4: H5AC_flush (H5AC.c:681)
>>>> ==1286936== by 0x78B306A: H5F__flush_phase2 (H5Fint.c:1831)
>>>> ==1286936== by 0x78B5D7A: H5F__dest (H5Fint.c:1152)
>>>> ==1286936== by 0x78B6603: H5F_try_close (H5Fint.c:2180)
>>>> ==1286936== by 0x78B69F5: H5F__close_cb (H5Fint.c:2009)
>>>> ==1286936== by 0x7965797: H5I_dec_ref (H5I.c:1254)
>>>> ==1286936== Uninitialised value was created by a stack allocation
>>>> ==1286936== at 0x7695AF0: ??? (in
>>>> /home/mlohry/dev/cmake-build/external_install/lib/libcgns.so)
>>>> ==1286936==
>>>> ==1286936== ERROR SUMMARY: 34 errors from 29 contexts (suppressed: 0
>>>> from 0)
>>>>
>>>> On Mon, Aug 24, 2020 at 5:00 PM Jed Brown <jed at jedbrown.org> wrote:
>>>>
>>>>> Do you potentially have a memory or other resource leak? SIGBUS would
>>>>> be an odd result, but the symptom of crashing after running for a long time
>>>>> sometimes fits with a resource leak.
>>>>>
>>>>> Mark Lohry <mlohry at gmail.com> writes:
>>>>>
>>>>> > I queued up some jobs with Barry's patch, so we'll see.
>>>>> >
>>>>> > Re Jed's suggestion at checkpointing, I don't *think* this is
>>>>> something
>>>>> > coming from the state of the solution -- running from the same point
>>>>> I'm
>>>>> > seeing it crash anywhere between 1 hour and 20 hours in. I'll
>>>>> increase my
>>>>> > file save frequency in case I'm wrong there though.
>>>>> >
>>>>> > My intel build with different blas just made it through a 6 hour
>>>>> time slot
>>>>> > without crash, whereas yesterday the same thing crashed after 3
>>>>> hours. But
>>>>> > given the randomness so far I'd bet that's just dumb luck.
>>>>> >
>>>>> > On Mon, Aug 24, 2020 at 4:22 PM Barry Smith <bsmith at petsc.dev>
>>>>> wrote:
>>>>> >
>>>>> >>
>>>>> >>
>>>>> >> > On Aug 24, 2020, at 2:34 PM, Jed Brown <jed at jedbrown.org> wrote:
>>>>> >> >
>>>>> >> > I'm thinking of something such as writing floating point data
>>>>> into the
>>>>> >> return address, which would be unaligned/garbage.
>>>>> >>
>>>>> >> Ok, my patch will detect this. This is what I was talking about,
>>>>> messing
>>>>> >> up the BLAS arguments which are the addresses of arrays.
>>>>> >>
>>>>> >> Valgrind is by far the preferred approach.
>>>>> >>
>>>>> >> Barry
>>>>> >>
>>>>> >> Another feature we could add to the malloc checking is when a
>>>>> SEGV or
>>>>> >> BUS error is encountered and we catch it we should run the
>>>>> >> PetscMallocVerify() and check our memory for corruption reporting
>>>>> any we
>>>>> >> find.
>>>>> >>
>>>>> >>
>>>>> >>
>>>>> >> >
>>>>> >> > Reproducing under Valgrind would help a lot. Perhaps it's
>>>>> possible to
>>>>> >> checkpoint such that the breakage can be reproduced more quickly?
>>>>> >> >
>>>>> >> > Barry Smith <bsmith at petsc.dev> writes:
>>>>> >> >
>>>>> >> >> https://en.wikipedia.org/wiki/Bus_error <
>>>>> >> https://en.wikipedia.org/wiki/Bus_error>
>>>>> >> >>
>>>>> >> >> But perhaps not true for Intel?
>>>>> >> >>
>>>>> >> >>
>>>>> >> >>
>>>>> >> >>> On Aug 24, 2020, at 1:06 PM, Matthew Knepley <knepley at gmail.com
>>>>> >
>>>>> >> wrote:
>>>>> >> >>>
>>>>> >> >>> On Mon, Aug 24, 2020 at 1:46 PM Barry Smith <bsmith at petsc.dev
>>>>> <mailto:
>>>>> >> bsmith at petsc.dev>> wrote:
>>>>> >> >>>
>>>>> >> >>>
>>>>> >> >>>> On Aug 24, 2020, at 12:39 PM, Jed Brown <jed at jedbrown.org
>>>>> <mailto:
>>>>> >> jed at jedbrown.org>> wrote:
>>>>> >> >>>>
>>>>> >> >>>> Barry Smith <bsmith at petsc.dev <mailto:bsmith at petsc.dev>>
>>>>> writes:
>>>>> >> >>>>
>>>>> >> >>>>>> On Aug 24, 2020, at 12:31 PM, Jed Brown <jed at jedbrown.org
>>>>> <mailto:
>>>>> >> jed at jedbrown.org>> wrote:
>>>>> >> >>>>>>
>>>>> >> >>>>>> Barry Smith <bsmith at petsc.dev <mailto:bsmith at petsc.dev>>
>>>>> writes:
>>>>> >> >>>>>>
>>>>> >> >>>>>>> So if a BLAS errors with SIGBUS then it is always an input
>>>>> error
>>>>> >> of just not proper double/complex alignment? Or some other very
>>>>> strange
>>>>> >> thing?
>>>>> >> >>>>>>
>>>>> >> >>>>>> I would suspect memory corruption.
>>>>> >> >>>>>
>>>>> >> >>>>>
>>>>> >> >>>>> Corruption meaning what specifically?
>>>>> >> >>>>>
>>>>> >> >>>>> The routines crashing are dgemv which only take double
>>>>> precision
>>>>> >> arrays, regardless of what garbage is in those arrays i don't think
>>>>> there
>>>>> >> can be BUS errors resulting. They don't take integer arrays whose
>>>>> >> corruption could result in bad indexing and then BUS errors.
>>>>> >> >>>>>
>>>>> >> >>>>> So then it can only be corruption of the pointers passed in,
>>>>> correct?
>>>>> >> >>>>
>>>>> >> >>>> Such as those pointers pointing into data on the stack with
>>>>> incorrect
>>>>> >> sizes.
>>>>> >> >>>
>>>>> >> >>> But won't incorrect sizes "usually" lead to SEGV not SEGBUS?
>>>>> >> >>>
>>>>> >> >>> My understanding was that roughly memory errors in the heap are
>>>>> SEGV
>>>>> >> and memory errors on the stack are SIGBUS. Is that not true?
>>>>> >> >>>
>>>>> >> >>> Matt
>>>>> >> >>>
>>>>> >> >>> --
>>>>> >> >>> What most experimenters take for granted before they begin their
>>>>> >> experiments is infinitely more interesting than any results to
>>>>> which their
>>>>> >> experiments lead.
>>>>> >> >>> -- Norbert Wiener
>>>>> >> >>>
>>>>> >> >>> https://www.cse.buffalo.edu/~knepley/ <
>>>>> >> http://www.cse.buffalo.edu/~knepley/>
>>>>> >>
>>>>> >>
>>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20200905/c7ebdafb/attachment-0001.html>
More information about the petsc-users
mailing list