[petsc-users] Bus Error

Thu Aug 27 08:44:18 CDT 2020

Mark,

   Did i tell you that this has to be built with the configure option --with-debugging=1 and won't be turned off with --with-debugging=0 ?

  Barry

> On Aug 27, 2020, at 8:10 AM, Mark Lohry <mlohry at gmail.com> wrote:
> 
> Barry, no output from that patch i'm afraid:
> 
>      54 KSP Residual norm 3.215013886664e+03 
>      55 KSP Residual norm 3.049105434513e+03 
>      56 KSP Residual norm 2.859123916860e+03 
> [929]PETSC ERROR: ------------------------------------------------------------------------
> [929]PETSC ERROR: Caught signal number 7 BUS: Bus Error, possibly illegal memory access
> [929]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
> [929]PETSC ERROR: or see https://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind <https://www.mcs.anl.gov/petsc/documentation/faq.html#valgrind>
> [929]PETSC ERROR: or try http://valgrind.org <http://valgrind.org/> on GNU/linux and Apple Mac OS X to find memory corruption errors
> [929]PETSC ERROR: likely location of problem given in stack below
> [929]PETSC ERROR: ---------------------  Stack Frames ------------------------------------
> [929]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,
> [929]PETSC ERROR:       INSTEAD the line number of the start of the function
> [929]PETSC ERROR:       is given.
> [929]PETSC ERROR: [929] BLASgemv line 1406 /home/mlohry/petsc/src/mat/impls/baij/seq/baijfact.c
> [929]PETSC ERROR: [929] MatSolve_SeqBAIJ_N_NaturalOrdering line 1378 /home/mlohry/petsc/src/mat/impls/baij/seq/baijfact.c
> [929]PETSC ERROR: [929] MatSolve line 3354 /home/mlohry/petsc/src/mat/interface/matrix.c
> [929]PETSC ERROR: [929] PCApply_ILU line 201 /home/mlohry/petsc/src/ksp/pc/impls/factor/ilu/ilu.c
> [929]PETSC ERROR: [929] PCApply line 426 /home/mlohry/petsc/src/ksp/pc/interface/precon.c
> [929]PETSC ERROR: [929] KSP_PCApply line 279 /home/mlohry/petsc/include/petsc/private/kspimpl.h
> [929]PETSC ERROR: [929] KSPSolve_PREONLY line 16 /home/mlohry/petsc/src/ksp/ksp/impls/preonly/preonly.c
> [929]PETSC ERROR: [929] KSPSolve_Private line 590 /home/mlohry/petsc/src/ksp/ksp/interface/itfunc.c
> [929]PETSC ERROR: [929] KSPSolve line 848 /home/mlohry/petsc/src/ksp/ksp/interface/itfunc.c
> [929]PETSC ERROR: [929] PCApply_ASM line 441 /home/mlohry/petsc/src/ksp/pc/impls/asm/asm.c
> [929]PETSC ERROR: [929] PCApply line 426 /home/mlohry/petsc/src/ksp/pc/interface/precon.c
> [929]PETSC ERROR: [929] KSP_PCApply line 279 /home/mlohry/petsc/include/petsc/private/kspimpl.h
> srun: Job step aborted: Waiting up to 47 seconds for job step to finish.
> [929]PETSC ERROR: [929] KSPFGMRESCycle line 108 /home/mlohry/petsc/src/ksp/ksp/impls/gmres/fgmres/fgmres.c
> [929]PETSC ERROR: [929] KSPSolve_FGMRES line 274 /home/mlohry/petsc/src/ksp/ksp/impls/gmres/fgmres/fgmres.c
> [929]PETSC ERROR: [929] KSPSolve_Private line 590 /home/mlohry/petsc/src/ksp/ksp/interface/itfunc.c
> 
> On Mon, Aug 24, 2020 at 6:47 PM Mark Lohry <mlohry at gmail.com <mailto:mlohry at gmail.com>> wrote:
> I don't think I do. Running a much smaller case with the same models I get the attached report from valgrind --show-leak-kinds=all --leak-check=full --track-origins=yes. I only see some HDF5 stuff and OpenMPI that I think are false positives.
> 
> ==1286950== Memcheck, a memory error detector
> ==1286950== Copyright (C) 2002-2017, and GNU GPL'd, by Julian Seward et al.
> ==1286950== Using Valgrind-3.15.0-608cb11914-20190413 and LibVEX; rerun with -h for copyright info
> ==1286950== Command: ./verification_testing --gtest_filter=DrivenCavity3D.Re100_BackwardEulerILU1_16x16N2_Quadrature1 --petsc_time_integrator=arkimex --petsc_arkimex_type=l2
> ==1286950== Parent PID: 1286932
> ==1286950== 
> --1286950-- 
> --1286950-- Valgrind options:
> --1286950--    --show-leak-kinds=all
> --1286950--    --leak-check=full
> --1286950--    --track-origins=yes
> --1286950--    --log-file=valgrind-out.txt
> --1286950--    -v
> --1286950-- Contents of /proc/version:
> --1286950--   Linux version 5.4.0-29-generic (buildd at lgw01-amd64-035) (gcc version 9.3.0 (Ubuntu 9.3.0-10ubuntu2)) #33-Ubuntu SMP Wed Apr 29 14:32:27 UTC 2020
> --1286950-- 
> --1286950-- Arch and hwcaps: AMD64, LittleEndian, amd64-cx16-rdtscp-sse3-ssse3-avx
> --1286950-- Page sizes: currently 4096, max supported 4096
> --1286950-- Valgrind library directory: /usr/lib/x86_64-linux-gnu/valgrind
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/verification_testing
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/ld-2.31.so <http://ld-2.31.so/>
> --1286950--   Considering /usr/lib/x86_64-linux-gnu/ld-2.31.so <http://ld-2.31.so/> ..
> --1286950--   .. CRC mismatch (computed 387b17ea wanted d28cf5ef)
> --1286950--   Considering /lib/x86_64-linux-gnu/ld-2.31.so <http://ld-2.31.so/> ..
> --1286950--   .. CRC mismatch (computed 387b17ea wanted d28cf5ef)
> --1286950--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/ld-2.31.so <http://ld-2.31.so/> ..
> --1286950--   .. CRC is valid
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/valgrind/memcheck-amd64-linux
> --1286950--    object doesn't have a symbol table
> --1286950--    object doesn't have a dynamic symbol table
> --1286950-- Scheduler: using generic scheduler lock implementation.
> --1286950-- Reading suppressions file: /usr/lib/x86_64-linux-gnu/valgrind/default.supp
> ==1286950== embedded gdbserver: reading from /tmp/vgdb-pipe-from-vgdb-to-1286950-by-mlohry-on-???
> ==1286950== embedded gdbserver: writing to   /tmp/vgdb-pipe-to-vgdb-from-1286950-by-mlohry-on-???
> ==1286950== embedded gdbserver: shared mem   /tmp/vgdb-pipe-shared-mem-vgdb-1286950-by-mlohry-on-???
> ==1286950== 
> ==1286950== TO CONTROL THIS PROCESS USING vgdb (which you probably
> ==1286950== don't want to do, unless you know exactly what you're doing,
> ==1286950== or are doing some strange experiment):
> ==1286950==   /usr/lib/x86_64-linux-gnu/valgrind/../../bin/vgdb --pid=1286950 ...command...
> ==1286950== 
> ==1286950== TO DEBUG THIS PROCESS USING GDB: start GDB like this
> ==1286950==   /path/to/gdb ./verification_testing
> ==1286950== and then give GDB the following command
> ==1286950==   target remote | /usr/lib/x86_64-linux-gnu/valgrind/../../bin/vgdb --pid=1286950
> ==1286950== --pid is optional if only one valgrind process is running
> ==1286950== 
> --1286950-- REDIR: 0x4022d80 (ld-linux-x86-64.so.2:strlen) redirected to 0x580c9ce2 (???)
> --1286950-- REDIR: 0x4022b50 (ld-linux-x86-64.so.2:index) redirected to 0x580c9cfc (???)
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_core-amd64-linux.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so
> --1286950--    object doesn't have a symbol table
> ==1286950== WARNING: new redirection conflicts with existing -- ignoring it
> --1286950--     old: 0x04022d80 (strlen              ) R-> (0000.0) 0x580c9ce2 ???
> --1286950--     new: 0x04022d80 (strlen              ) R-> (2007.0) 0x0483f060 strlen
> --1286950-- REDIR: 0x401f560 (ld-linux-x86-64.so.2:strcmp) redirected to 0x483ffd0 (strcmp)
> --1286950-- REDIR: 0x40232e0 (ld-linux-x86-64.so.2:mempcpy) redirected to 0x4843a20 (mempcpy)
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/initialization/libinitialization.so
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/governing_equations/libgoverning_equations.so
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/time_stepping/libtime_stepping.so
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/governing_equations/libboundary_conditions.so
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/governing_equations/libsolution_monitors.so
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/governing_equations/libfluxtypes.so
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/algebraic_solvers/libalgebraic_solvers.so
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/program_options/libprogram_options.so
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/boost_install/lib/libboost_filesystem.so.1.73.0
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so.40.20.1
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libpthread-2.31.so <http://libpthread-2.31.so/>
> --1286950--   Considering /usr/lib/debug/.build-id/77/5cbbfff814456660786780b0b3b40096b4c05e.debug ..
> --1286950--   .. build-id is valid
> --1286948-- Reading syms from /home/mlohry/dev/cmake-build/external/petsc/arch-linux2-c-opt/lib/libpetsc.so.3.13.3
> --1286937-- Reading syms from /home/mlohry/dev/cmake-build/parallel/libparallel.so
> --1286937-- Reading syms from /home/mlohry/dev/cmake-build/logger/liblogger.so
> --1286937-- Reading syms from /home/mlohry/dev/cmake-build/spatial_discretization/libdiscretization.so
> --1286945-- Reading syms from /home/mlohry/dev/cmake-build/utils/libutils.so
> --1286944-- Reading syms from /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28
> --1286938--    object doesn't have a symbol table
> --1286949-- Reading syms from /usr/lib/x86_64-linux-gnu/libm-2.31.so <http://libm-2.31.so/>
> --1286949--   Considering /usr/lib/x86_64-linux-gnu/libm-2.31.so <http://libm-2.31.so/> ..
> --1286947--   .. CRC mismatch (computed 327d785f wanted 751f5509)
> --1286947--   Considering /lib/x86_64-linux-gnu/libm-2.31.so <http://libm-2.31.so/> ..
> --1286938--   .. CRC mismatch (computed 327d785f wanted 751f5509)
> --1286937--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/libm-2.31.so <http://libm-2.31.so/> ..
> --1286950--   .. CRC is valid
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libgcc_s.so.1
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libc-2.31.so <http://libc-2.31.so/>
> --1286950--   Considering /usr/lib/x86_64-linux-gnu/libc-2.31.so <http://libc-2.31.so/> ..
> --1286951--   .. CRC mismatch (computed a6f43087 wanted 6555436e)
> --1286951--   Considering /lib/x86_64-linux-gnu/libc-2.31.so <http://libc-2.31.so/> ..
> --1286947--   .. CRC mismatch (computed a6f43087 wanted 6555436e)
> --1286947--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/libc-2.31.so <http://libc-2.31.so/> ..
> --1286950--   .. CRC is valid
> --1286940-- Reading syms from /home/mlohry/dev/cmake-build/file_io/libfileio.so
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/boost_install/lib/libboost_program_options.so.1.73.0
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/boost_install/lib/libboost_serialization.so.1.73.0
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libhwloc.so.15.1.0
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /home/mlohry/dev/cmake-build/external/petsc/arch-linux2-c-opt/lib/libsuperlu_dist.so.6.3.0
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3.9.0
> --1286950--    object doesn't have a symbol table
> --1286937-- Reading syms from /usr/lib/x86_64-linux-gnu/blas/libblas.so.3.9.0
> --1286937--    object doesn't have a symbol table
> --1286947-- Reading syms from /usr/lib/x86_64-linux-gnu/libX11.so.6.3.0
> --1286939--    object doesn't have a symbol table
> --1286947-- Reading syms from /usr/lib/x86_64-linux-gnu/libdl-2.31.so <http://libdl-2.31.so/>
> --1286947--   Considering /usr/lib/x86_64-linux-gnu/libdl-2.31.so <http://libdl-2.31.so/> ..
> --1286947--   .. CRC mismatch (computed 4fd191ca wanted df8dd39a)
> --1286947--   Considering /lib/x86_64-linux-gnu/libdl-2.31.so <http://libdl-2.31.so/> ..
> --1286947--   .. CRC mismatch (computed 4fd191ca wanted df8dd39a)
> --1286947--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/libdl-2.31.so <http://libdl-2.31.so/> ..
> --1286947--   .. CRC is valid
> --1286937-- Reading syms from /home/mlohry/dev/cmake-build/external/petsc/arch-linux2-c-opt/lib/libmetis.so
> --1286937-- Reading syms from /home/mlohry/dev/cmake-build/boost_install/lib/libboost_log.so.1.73.0
> --1286942-- Reading syms from /home/mlohry/dev/cmake-build/boost_install/lib/libboost_log_setup.so.1.73.0
> --1286942-- Reading syms from /home/mlohry/dev/cmake-build/boost_install/lib/libboost_thread.so.1.73.0
> --1286942-- Reading syms from /home/mlohry/dev/cmake-build/boost_install/lib/libboost_regex.so.1.73.0
> --1286949-- Reading syms from /home/mlohry/dev/cmake-build/basis_functions/libbasis_functions.so
> --1286944-- Reading syms from /usr/lib/x86_64-linux-gnu/libgomp.so.1.0.0
> --1286944--    object doesn't have a symbol table
> --1286951-- Reading syms from /home/mlohry/dev/cmake-build/external_install/lib/libcgns.so
> --1286951--    object doesn't have a symbol table
> --1286943-- Reading syms from /home/mlohry/dev/cmake-build/external_install/lib/libhdf5.so.103.1.0
> --1286951-- Reading syms from /home/mlohry/dev/cmake-build/external/tinyxml2-build/libtinyxml2.so.6.1.0
> --1286944-- Reading syms from /home/mlohry/dev/cmake-build/boost_install/lib/libboost_iostreams.so.1.73.0
> --1286944-- Reading syms from /usr/lib/x86_64-linux-gnu/libz.so.1.2.11
> --1286944--    object doesn't have a symbol table
> --1286951-- Reading syms from /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0
> --1286951--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libutil-2.31.so <http://libutil-2.31.so/>
> --1286946--   Considering /usr/lib/x86_64-linux-gnu/libutil-2.31.so <http://libutil-2.31.so/> ..
> --1286946--   .. CRC mismatch (computed 4639aba5 wanted ceb246b4)
> --1286946--   Considering /lib/x86_64-linux-gnu/libutil-2.31.so <http://libutil-2.31.so/> ..
> --1286946--   .. CRC mismatch (computed 4639aba5 wanted ceb246b4)
> --1286948--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/libutil-2.31.so <http://libutil-2.31.so/> ..
> --1286939--   .. CRC is valid
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libltdl.so.7.3.1
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libgfortran.so.5.0.0
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libxcb.so.1.1.0
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/librt-2.31.so <http://librt-2.31.so/>
> --1286950--   Considering /usr/lib/x86_64-linux-gnu/librt-2.31.so <http://librt-2.31.so/> ..
> --1286950--   .. CRC mismatch (computed a9acc0ce wanted cb4905a3)
> --1286950--   Considering /lib/x86_64-linux-gnu/librt-2.31.so <http://librt-2.31.so/> ..
> --1286950--   .. CRC mismatch (computed a9acc0ce wanted cb4905a3)
> --1286950--   Considering /usr/lib/debug/lib/x86_64-linux-gnu/librt-2.31.so <http://librt-2.31.so/> ..
> --1286950--   .. CRC is valid
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0
> --1286950--    object doesn't have a symbol table
> --1286945-- Reading syms from /usr/lib/x86_64-linux-gnu/libXau.so.6.0.0
> --1286945--   Considering /usr/lib/x86_64-linux-gnu/libXau.so.6.0.0 ..
> --1286945--   .. CRC mismatch (computed 7de9b6ad wanted e8a17129)
> --1286945--   Considering /lib/x86_64-linux-gnu/libXau.so.6.0.0 ..
> --1286945--   .. CRC mismatch (computed 7de9b6ad wanted e8a17129)
> --1286945--    object doesn't have a symbol table
> --1286945-- Reading syms from /usr/lib/x86_64-linux-gnu/libXdmcp.so.6.0.0
> --1286942--    object doesn't have a symbol table
> --1286942-- Reading syms from /usr/lib/x86_64-linux-gnu/libbsd.so.0.10.0
> --1286942--    object doesn't have a symbol table
> --1286950-- REDIR: 0x6516600 (libc.so.6:memmove) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6515900 (libc.so.6:strncpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6516930 (libc.so.6:strcasecmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6515220 (libc.so.6:strcat) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6515960 (libc.so.6:rindex) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6517dd0 (libc.so.6:rawmemchr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6532e60 (libc.so.6:wmemchr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65329a0 (libc.so.6:wcscmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6516760 (libc.so.6:mempcpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6516590 (libc.so.6:bcmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6515890 (libc.so.6:strncmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65152d0 (libc.so.6:strcmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65166c0 (libc.so.6:memset) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6532960 (libc.so.6:wcschr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65157f0 (libc.so.6:strnlen) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65153b0 (libc.so.6:strcspn) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6516980 (libc.so.6:strncasecmp) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6515350 (libc.so.6:strcpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6516ad0 (libc.so.6:memcpy@@GLIBC_2.14) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65340d0 (libc.so.6:wcsnlen) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65329e0 (libc.so.6:wcscpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65159a0 (libc.so.6:strpbrk) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6515280 (libc.so.6:index) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65157b0 (libc.so.6:strlen) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x651ed20 (libc.so.6:memrchr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65169d0 (libc.so.6:strcasecmp_l) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6516550 (libc.so.6:memchr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6532ab0 (libc.so.6:wcslen) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6515c60 (libc.so.6:strspn) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65168d0 (libc.so.6:stpncpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6516870 (libc.so.6:stpcpy) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6517e10 (libc.so.6:strchrnul) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6516a20 (libc.so.6:strncasecmp_l) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x6516470 (libc.so.6:strstr) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65a3750 (libc.so.6:__memcpy_chk) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286938-- REDIR: 0x6527a30 (libc.so.6:__strrchr_sse2) redirected to 0x483ea70 (__strrchr_sse2)
> --1286938-- REDIR: 0x6511c90 (libc.so.6:calloc) redirected to 0x483dce0 (calloc)
> --1286938-- REDIR: 0x6510260 (libc.so.6:malloc) redirected to 0x483b780 (malloc)
> --1286938-- REDIR: 0x6531c40 (libc.so.6:memcpy at GLIBC_2.2.5) redirected to 0x4840100 (memcpy at GLIBC_2.2.5)
> --1286938-- REDIR: 0x6527d30 (libc.so.6:__strlen_sse2) redirected to 0x483efa0 (__strlen_sse2)
> --1286938-- REDIR: 0x65f4ac0 (libc.so.6:__strncmp_sse42) redirected to 0x483f7c0 (__strncmp_sse42)
> --1286938-- REDIR: 0x6510850 (libc.so.6:free) redirected to 0x483c9d0 (free)
> --1286938-- REDIR: 0x6532070 (libc.so.6:__memset_sse2_unaligned) redirected to 0x48428e0 (memset)
> --1286938-- REDIR: 0x6603350 (libc.so.6:__memcmp_sse4_1) redirected to 0x4842150 (__memcmp_sse4_1)
> --1286938-- REDIR: 0x6520520 (libc.so.6:__strcmp_sse2_unaligned) redirected to 0x483fed0 (strcmp)
> --1286938-- REDIR: 0x61d0c10 (libstdc++.so.6:operator new(unsigned long)) redirected to 0x483bdf0 (operator new(unsigned long))
> --1286938-- REDIR: 0x61cee60 (libstdc++.so.6:operator delete(void*)) redirected to 0x483cf50 (operator delete(void*))
> --1286938-- REDIR: 0x61d0c70 (libstdc++.so.6:operator new[](unsigned long)) redirected to 0x483c510 (operator new[](unsigned long))
> --1286938-- REDIR: 0x61cee90 (libstdc++.so.6:operator delete[](void*)) redirected to 0x483d6e0 (operator delete[](void*))
> --1286938-- REDIR: 0x65275f0 (libc.so.6:__strchr_sse2) redirected to 0x483eb90 (__strchr_sse2)
> --1286950-- REDIR: 0x6511000 (libc.so.6:realloc) redirected to 0x483df30 (realloc)
> --1286950-- REDIR: 0x6527820 (libc.so.6:__strchrnul_sse2) redirected to 0x4843540 (strchrnul)
> --1286950-- REDIR: 0x6531560 (libc.so.6:__strstr_sse2_unaligned) redirected to 0x4843c20 (strstr)
> --1286950-- REDIR: 0x6531c20 (libc.so.6:__mempcpy_sse2_unaligned) redirected to 0x4843660 (mempcpy)
> --1286950-- REDIR: 0x652d2a0 (libc.so.6:__strncpy_sse2_unaligned) redirected to 0x483f560 (__strncpy_sse2_unaligned)
> --1286950-- REDIR: 0x6515830 (libc.so.6:strncat) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> --1286950-- REDIR: 0x65305b0 (libc.so.6:__strncat_sse2_unaligned) redirected to 0x483ede0 (strncat)
> --1286950-- REDIR: 0x6516120 (libc.so.6:__GI_strstr) redirected to 0x4843ca0 (__strstr_sse2)
> --1286950-- REDIR: 0x6522360 (libc.so.6:__rawmemchr_sse2) redirected to 0x4843580 (rawmemchr)
> --1286950-- REDIR: 0x65faea0 (libc.so.6:__strcasecmp_avx) redirected to 0x483f830 (strcasecmp)
> --1286950-- REDIR: 0x65fc520 (libc.so.6:__strncasecmp_avx) redirected to 0x483f910 (strncasecmp)
> --1286950-- REDIR: 0x65f98a0 (libc.so.6:__strspn_sse42) redirected to 0x4843ef0 (strspn)
> --1286950-- REDIR: 0x65f9620 (libc.so.6:__strcspn_sse42) redirected to 0x4843e10 (strcspn)
> --1286948-- REDIR: 0x6522030 (libc.so.6:__memchr_sse2) redirected to 0x4840050 (memchr)
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_mmap.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_posix.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_sysv.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Discarding syms at 0x4a96240-0x4a96d47 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_posix.so (have_dinfo 1)
> --1286948-- Discarding syms at 0x4a9b1c0-0x4a9b937 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_sysv.so (have_dinfo 1)
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_reachable_weighted.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_reachable_netlink.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0
> --1286948--    object doesn't have a symbol table
> --1286948-- Discarding syms at 0x4a96120-0x4a966b0 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_reachable_weighted.so (have_dinfo 1)
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_flux.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_orte.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_ompi.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_slurm.so
> --1286948--    object doesn't have a symbol table
> --1286948-- REDIR: 0x64bc670 (libc.so.6:setenv) redirected to 0x4844480 (setenv)
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_ess_pmi.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pmix_flux.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pmix_ext3x.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25
> --1286948--    object doesn't have a symbol table
> --1286948-- Discarding syms at 0x8d053e0-0x8d07391 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pmix_flux.so (have_dinfo 1)
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v21.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v20.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v3.so
> --1286948--    object doesn't have a symbol table
> --1286948-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v12.so
> --1286948--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_ptl_usock.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_ptl_tcp.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_psec_native.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_psec_none.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Discarding syms at 0x8d04180-0x8d045b0 in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_psec_none.so (have_dinfo 1)
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_ds21.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/libmca_common_dstore.so.1.0.2
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_hash.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_ds12.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_pshmem_mmap.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_preg_native.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_stdfd.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_syslog.so
> --1286950--    object doesn't have a symbol table
> --1286950-- Reading syms from /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_default.so
> --1286950--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_tool.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_app.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_orted.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_hnp.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_novm.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Discarding syms at 0x9ebf0a0-0x9ebf490 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_tool.so (have_dinfo 1)
> --1286946-- Discarding syms at 0x9eca300-0x9ecbee8 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_orted.so (have_dinfo 1)
> --1286946-- Discarding syms at 0x9ed1220-0x9ed24e7 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_hnp.so (have_dinfo 1)
> --1286946-- Discarding syms at 0x9ed8240-0x9ed8c88 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_novm.so (have_dinfo 1)
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_tool.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_app.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_hnp.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_orted.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Discarding syms at 0x9ebf0e0-0x9ebf417 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_tool.so (have_dinfo 1)
> --1286946-- Discarding syms at 0x9ecf320-0x9ed1239 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_hnp.so (have_dinfo 1)
> --1286946-- Discarding syms at 0x9ed73a0-0x9ed9ccc in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_orted.so (have_dinfo 1)
> --1286936-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_allocator_basic.so
> --1286936--    object doesn't have a symbol table
> --1286936-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_allocator_bucket.so
> --1286936--    object doesn't have a symbol table
> --1286936-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_rcache_grdma.so
> --1286936--    object doesn't have a symbol table
> --1286936-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mpool_hugepage.so
> --1286936--    object doesn't have a symbol table
> --1286936-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_bml_r2.so
> --1286936--    object doesn't have a symbol table
> --1286936-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_tcp.so
> --1286936--    object doesn't have a symbol table
> --1286936-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_sm.so
> --1286936--    object doesn't have a symbol table
> --1286936-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_vader.so
> --1286936--    object doesn't have a symbol table
> --1286936-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_openib.so
> --1286936--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_verbs.so.40.20.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_self.so
> --1286946--    object doesn't have a symbol table
> --1286946-- REDIR: 0x652cc70 (libc.so.6:__strcpy_sse2_unaligned) redirected to 0x483f090 (strcpy)
> --1286946-- REDIR: 0x65a3810 (libc.so.6:__memmove_chk) redirected to 0x48331d0 (_vgnU_ifunc_wrapper)
> ==1286946== WARNING: new redirection conflicts with existing -- ignoring it
> --1286946--     old: 0x06531c30 (__memcpy_chk_sse2_un) R-> (2030.0) 0x04843b10 __memcpy_chk
> --1286946--     new: 0x06531c30 (__memcpy_chk_sse2_un) R-> (2024.0) 0x048434d0 __memmove_chk
> --1286946-- REDIR: 0x6531c30 (libc.so.6:__memcpy_chk_sse2_unaligned) redirected to 0x4843b10 (__memcpy_chk)
> --1286946-- REDIR: 0x65129b0 (libc.so.6:posix_memalign) redirected to 0x483e1e0 (posix_memalign)
> --1286946-- Discarding syms at 0x9f15280-0x9f32932 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_openib.so (have_dinfo 1)
> --1286946-- Discarding syms at 0x9f7c4c0-0x9f7ded8 in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_verbs.so.40.20.0 (have_dinfo 1)
> --1286946-- Discarding syms at 0x9f620c0-0x9f71483 in /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 (have_dinfo 1)
> --1286946-- Discarding syms at 0x9f9ba10-0x9fd22ee in /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 (have_dinfo 1)
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_cm.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_ob1.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_monitoring.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_monitoring.so.50.10.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_vprotocol_pessimist.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Discarding syms at 0x9f4d400-0x9f50c19 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_vprotocol_pessimist.so (have_dinfo 1)
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_psm.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/libpsm1/libpsm_infinipath.so.1.16
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libinfinipath.so.4.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_ofi.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libfabric.so.1.9.15
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libpsm2.so.2.1
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0
> --1286946--    object doesn't have a symbol table
> --1286946-- REDIR: 0x6517140 (libc.so.6:strcasestr) redirected to 0x4843f80 (strcasestr)
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_psm2.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Discarding syms at 0x9f4d5c0-0x9f4f5a1 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_psm.so (have_dinfo 1)
> --1286946-- Discarding syms at 0x9fee680-0x9ff096c in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_psm2.so (have_dinfo 1)
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_inter.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_basic.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_sm.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_sm.so.40.20.0
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_self.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_sync.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_monitoring.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_libnbc.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_tuned.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_sm.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_pt2pt.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_rdma.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_monitoring.so
> --1286946--    object doesn't have a symbol table
> --1286946-- Discarding syms at 0x9f724a0-0x9f787b5 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mtl_ofi.so (have_dinfo 1)
> --1286946-- Discarding syms at 0xa827f80-0xa8e14c4 in /usr/lib/x86_64-linux-gnu/libfabric.so.1.9.15 (have_dinfo 1)
> --1286946-- Discarding syms at 0x9f94830-0x9fbafce in /usr/lib/libpsm1/libpsm_infinipath.so.1.16 (have_dinfo 1)
> --1286946-- Discarding syms at 0x9fe5580-0x9fe8f71 in /usr/lib/x86_64-linux-gnu/libuuid.so.1.3.0 (have_dinfo 1)
> --1286946-- Discarding syms at 0x9f56420-0x9f5cec0 in /usr/lib/x86_64-linux-gnu/libinfinipath.so.4.0 (have_dinfo 1)
> --1286946-- Discarding syms at 0xa929f10-0xa93d5fc in /usr/lib/x86_64-linux-gnu/librdmacm.so.1.2.28.0 (have_dinfo 1)
> --1286946-- Discarding syms at 0xa94b0c0-0xa95a483 in /usr/lib/x86_64-linux-gnu/libibverbs.so.1.8.28.0 (have_dinfo 1)
> --1286946-- Discarding syms at 0xa968860-0xa9adf12 in /usr/lib/x86_64-linux-gnu/libpsm2.so.2.1 (have_dinfo 1)
> --1286946-- Discarding syms at 0xa9e7a10-0xaa1e2ee in /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.26.0 (have_dinfo 1)
> --1286946-- Discarding syms at 0x9f80410-0x9f84e27 in /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0 (have_dinfo 1)
> --1286946-- Discarding syms at 0x9f103e0-0x9f15fd5 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_cm.so (have_dinfo 1)
> --1286946-- Discarding syms at 0x9f471e0-0x9f47ce0 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_monitoring.so (have_dinfo 1)
> ==1286946== Thread 3:
> ==1286946== Syscall param writev(vector[...]) points to uninitialised byte(s)
> ==1286946==    at 0x658A48D: __writev (writev.c:26)
> ==1286946==    by 0x658A48D: writev (writev.c:24)
> ==1286946==    by 0x8DF9B4C: pmix_ptl_base_send_handler (in /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
> ==1286946==    by 0x7CC413E: ??? (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286946==    by 0x7CC487E: event_base_loop (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286946==    by 0x8DBDD55: ??? (in /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
> ==1286946==    by 0x4BF7608: start_thread (pthread_create.c:477)
> ==1286946==    by 0x6595102: clone (clone.S:95)
> ==1286946==  Address 0xa28fdcf is 127 bytes inside a block of size 5,120 alloc'd
> ==1286946==    at 0x483DFAF: realloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286946==    by 0x8DE155A: pmix_bfrop_buffer_extend (in /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
> ==1286946==    by 0x8DE3F4A: pmix_bfrops_base_pack_byte (in /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
> ==1286946==    by 0x8DE4900: pmix_bfrops_base_pack_buf (in /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
> ==1286946==    by 0x8DE4175: pmix_bfrops_base_pack (in /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
> ==1286946==    by 0x8D7CF91: ??? (in /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
> ==1286946==    by 0x7CC3FDD: ??? (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286946==    by 0x7CC487E: event_base_loop (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286946==    by 0x8DBDD55: ??? (in /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25)
> ==1286946==    by 0x4BF7608: start_thread (pthread_create.c:477)
> ==1286946==    by 0x6595102: clone (clone.S:95)
> ==1286946==  Uninitialised value was created by a stack allocation
> ==1286946==    at 0x9F048D6: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_vader.so)
> ==1286946== 
> --1286944-- Discarding syms at 0xaa4d220-0xaa5796a in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmp--1286945-- Discarding syms at 0xaa4d220---1286948-- Discarding syms at 0xaae1100-0xaae7d70 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmp--1286945-- Discarding syms at 0xaae1100-0xaae7d70 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_monitoring.so (have_dinfo 1)
> --1286945-- Discarding syms at 0x9f69420-0x9f--1286938-- REDIR: 0x61cee70 (libstdc++.so.6:operator delete(void*, unsigned long)) redirected to --1286937-- REDIR: 0x61cee70 (libstdc++.so.6:opera--1286946-- REDIR: 0x652e970 (libc.so.6:__stpncpy_sse2_unaligned) redirected to 0x48427e0 (stpncpy)
> --1286942-- REDIR: 0x6527ed0 (libc.so.6:__strnlen_sse2) redirected to 0x483eee0 (strnlen)
> --1286944-- REDIR: 0x652fcc0 (libc.so.6:__strcat_sse2_unaligned) redirected to 0x483ec20 (strcat)
> --1286951-- REDIR: 0x65113d0 (libc.so.6:memalign) redirected to 0x483e2a0 (memalign)
> --1286951-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_io_romio321.so
> --1286951--    object doesn't have a symbol table
> --1286951-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_io_ompio.so
> --1286951--    object doesn't have a symbol table
> --1286941-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_ompio.so.41.19.3
> --1286941--    object doesn't have a symbol table
> --1286951-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fs_ufs.so
> --1286951--    object doesn't have a symbol table
> --1286939-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_two_phase.so
> --1286939--    object doesn't have a symbol table
> --1286939-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_individual.so
> --1286939--    object doesn't have a symbol table
> --1286939-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_dynamic.so
> --1286939--    object doesn't have a symbol table
> --1286939-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_dynamic_gen2.so
> --1286939--    object doesn't have a symbol table
> --1286939-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_vulcan.so
> --1286939--    object doesn't have a symbol table
> --1286939-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fbtl_posix.so
> --1286939--    object doesn't have a symbol table
> --1286943-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_sm.so
> --1286943--    object doesn't have a symbol table
> --1286943-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_individual.so
> --1286943--    object doesn't have a symbol table
> --1286943-- Reading syms from /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_lockedfile.so
> --1286943--    object doesn't have a symbol table
> --1286938-- REDIR: 0x65a3b00 (libc.so.6:__strcpy_chk) redirected to 0x48435c0 (__strcpy_chk)
> --1286939-- Discarding syms at 0x9f1d660-0x9f371d6 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pml_ob1.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9f5afa0-0x9f8f8b6 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_io_romio321.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9fa0640-0x9fa42d9 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_io_ompio.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9f4c160-0x9f4dc58 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_inter.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xa7fc270-0xa804f00 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_basic.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9fee3a0-0x9ff134e in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_sm.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xa80a240-0xa80aa8d in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_sm.so.40.20.0 (have_dinfo 1)
> --1286939-- Discarding syms at 0xa80f0e0-0xa80f8bb in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_self.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xaa460c0-0xaa47947 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_sync.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xaa613e0-0xaa7730f in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_libnbc.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xaa849c0-0xaa8a845 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_coll_tuned.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9ee1320-0x9ee3567 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_bml_r2.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9eebc40-0x9ef4ad7 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_tcp.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9f02600-0x9f08cd8 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_vader.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9f40200-0x9f4126e in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_self.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9eda4e0-0x9edb4c5 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_mpool_hugepage.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9ed32c0-0x9ed4afe in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_rcache_grdma.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9ebf160-0x9ebfe95 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_allocator_basic.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9ece140-0x9ecebed in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_allocator_bucket.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9ec92a0-0x9ec9aa2 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_errmgr_default_app.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8eae0e0-0x8eae4a7 in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_stdfd.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8eb3220-0x8eb3c27 in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_syslog.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8eb80e0-0x8eb90b7 in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_plog_default.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8ea6380-0x8ea97b3 in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_preg_native.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8e5a740-0x8e5f859 in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_ptl_usock.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8e67be0-0x8e743f0 in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_ptl_tcp.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x84da200-0x84daa5d in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_psec_native.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8d322b0-0x8d34bfc in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v21.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8e29480-0x8e3b70a in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v20.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8d3c2b0-0x8d3ed5c in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v3.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8e45340-0x8e502da in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_bfrops_v12.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8e901a0-0x8e908a7 in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_pshmem_mmap.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8d05520-0x8d06783 in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_ds21.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8e7b460-0x8e8aaa4 in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_hash.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8d44520-0x8d4556a in /usr/lib/x86_64-linux-gnu/pmix/lib/pmix/mca_gds_ds12.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8e97600-0x8ea0fa1 in /usr/lib/x86_64-linux-gnu/pmix/lib/libmca_common_dstore.so.1.0.2 (have_dinfo 1)
> --1286939-- Discarding syms at 0x8d109c0-0x8d27dcf in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_pmix_ext3x.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x8d5b280-0x8dfdffb in /usr/lib/x86_64-linux-gnu/pmix/lib/libpmix.so.2.2.25 (have_dinfo 1)
> --1286939-- Discarding syms at 0x9ec40a0-0x9ec4490 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_state_app.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x84d2580-0x84d518f in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_ess_pmi.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x4a96120-0x4a9644f in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_flux.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x4aa0100-0x4aa03e7 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_orte.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x84c74a0-0x84c901f in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_ompi.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x4aa5260-0x4aa58e9 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_schizo_slurm.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x4a9b420-0x4a9bcdf in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_reachable_netlink.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x84e7460-0x84f52ca in /usr/lib/x86_64-linux-gnu/libnl-3.so.200.26.0 (have_dinfo 1)
> --1286939-- Discarding syms at 0x4a90360-0x4a91107 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_shmem_mmap.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9f46220-0x9f474cc in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fbtl_posix.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9f0f180-0x9f0f78d in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fs_ufs.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xaa94540-0xaa96a4a in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_sm.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xaa9f6c0-0xaab44d0 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_pt2pt.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xaabe820-0xaad8ee0 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_osc_rdma.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9efc080-0x9efc1e1 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_btl_sm.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9fab2a0-0x9fb1341 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_two_phase.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9f140c0-0x9f14299 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_individual.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9fb72a0-0x9fbb791 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_dynamic.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9fd52a0-0x9fda794 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_dynamic_gen2.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9fe02e0-0x9fe59a5 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_fcoll_vulcan.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xa815460-0xa8177ab in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_sm.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xa81e260-0xa82033d in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_individual.so (have_dinfo 1)
> --1286939-- Discarding syms at 0xa8273e0-0xa8297d8 in /usr/lib/x86_64-linux-gnu/openmpi/lib/openmpi3/mca_sharedfp_lockedfile.so (have_dinfo 1)
> --1286939-- Discarding syms at 0x9fc85e0-0x9fce8ef in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmca_common_ompio.so.41.19.3 (have_dinfo 1)
> ==1286939== 
> ==1286939== HEAP SUMMARY:
> ==1286939==     in use at exit: 74,054 bytes in 223 blocks
> ==1286939==   total heap usage: 22,405,782 allocs, 22,405,559 frees, 34,062,479,959 bytes allocated
> ==1286939== 
> ==1286939== Searching for pointers to 223 not-freed blocks
> ==1286939== Checked 3,415,912 bytes
> ==1286939== 
> ==1286939== Thread 1:
> ==1286939== 1 bytes in 1 blocks are definitely lost in loss record 1 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x651550E: strdup (strdup.c:42)
> ==1286939==    by 0x9F6A4B6: ???
> ==1286939==    by 0x9F47373: ???
> ==1286939==    by 0x68E3B9B: mca_base_framework_components_register (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3F35: mca_base_framework_register (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3F93: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x4BA1734: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939== 
> ==1286939== 8 bytes in 1 blocks are still reachable in loss record 2 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x764724C: ??? (in /usr/lib/x86_64-linux-gnu/libgomp.so.1.0.0)
> ==1286939==    by 0x7657B9A: ??? (in /usr/lib/x86_64-linux-gnu/libgomp.so.1.0.0)
> ==1286939==    by 0x7645679: ??? (in /usr/lib/x86_64-linux-gnu/libgomp.so.1.0.0)
> ==1286939==    by 0x4011B89: call_init.part.0 (dl-init.c:72)
> ==1286939==    by 0x4011C90: call_init (dl-init.c:30)
> ==1286939==    by 0x4011C90: _dl_init (dl-init.c:119)
> ==1286939==    by 0x4001139: ??? (in /usr/lib/x86_64-linux-gnu/ld-2.31.so <http://ld-2.31.so/>)
> ==1286939==    by 0x3: ???
> ==1286939==    by 0x1FFEFFF926: ???
> ==1286939==    by 0x1FFEFFF93D: ???
> ==1286939==    by 0x1FFEFFF987: ???
> ==1286939==    by 0x1FFEFFF9A7: ???
> ==1286939== 
> ==1286939== 8 bytes in 1 blocks are definitely lost in loss record 3 of 44
> ==1286939==    at 0x483DD99: calloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x9F69B6F: ???
> ==1286939==    by 0x9F1CDED: ???
> ==1286939==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9EE3527: ???
> ==1286939==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939==    by 0x15710D: main (testing_main.cpp:8)
> ==1286939== 
> ==1286939== 13 bytes in 2 blocks are still reachable in loss record 4 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x651550E: strdup (strdup.c:42)
> ==1286939==    by 0x7CC3657: event_config_avoid_method (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x68FEB5A: opal_event_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68FE8CA: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E4008: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68B8BCF: opal_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x6860120: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939== 
> ==1286939== 15 bytes in 1 blocks are indirectly lost in loss record 5 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x651550E: strdup (strdup.c:42)
> ==1286939==    by 0x9EDB189: ???
> ==1286939==    by 0x68D98FC: mca_base_framework_components_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x6907C25: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E4008: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x4BA16D5: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939==    by 0x15710D: main (testing_main.cpp:8)
> ==1286939== 
> ==1286939== 15 bytes in 1 blocks are definitely lost in loss record 6 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x651550E: strdup (strdup.c:42)
> ==1286939==    by 0x9F5655C: ???
> ==1286939==    by 0x4011B89: call_init.part.0 (dl-init.c:72)
> ==1286939==    by 0x4011C90: call_init (dl-init.c:30)
> ==1286939==    by 0x4011C90: _dl_init (dl-init.c:119)
> ==1286939==    by 0x65D6784: _dl_catch_exception (dl-error-skeleton.c:182)
> ==1286939==    by 0x401642C: dl_open_worker (dl-open.c:758)
> ==1286939==    by 0x65D6727: _dl_catch_exception (dl-error-skeleton.c:208)
> ==1286939==    by 0x40155F9: _dl_open (dl-open.c:837)
> ==1286939==    by 0x72DE34B: dlopen_doit (dlopen.c:66)
> ==1286939==    by 0x65D6727: _dl_catch_exception (dl-error-skeleton.c:208)
> ==1286939==    by 0x65D67F2: _dl_catch_error (dl-error-skeleton.c:227)
> ==1286939== 
> ==1286939== 16 bytes in 1 blocks are definitely lost in loss record 7 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x9F1CBEB: ???
> ==1286939==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9EE3527: ???
> ==1286939==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939==    by 0x15710D: main (testing_main.cpp:8)
> ==1286939== 
> ==1286939== 16 bytes in 1 blocks are definitely lost in loss record 8 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x9F1CC66: ???
> ==1286939==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9EE3527: ???
> ==1286939==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939==    by 0x15710D: main (testing_main.cpp:8)
> ==1286939== 
> ==1286939== 16 bytes in 1 blocks are definitely lost in loss record 9 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x9F1CCDA: ???
> ==1286939==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9EE3527: ???
> ==1286939==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939==    by 0x15710D: main (testing_main.cpp:8)
> ==1286939== 
> ==1286939== 25 bytes in 1 blocks are still reachable in loss record 10 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x651550E: strdup (strdup.c:42)
> ==1286939==    by 0x68F27BD: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x4B956B6: ompi_pml_v_output_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B95259: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x68D98FC: mca_base_framework_components_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x4B93FAE: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x68E4008: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x4BA1734: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939== 
> ==1286939== 30 bytes in 1 blocks are definitely lost in loss record 11 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0xA9A859B: ???
> ==1286939==    by 0x4011B89: call_init.part.0 (dl-init.c:72)
> ==1286939==    by 0x4011C90: call_init (dl-init.c:30)
> ==1286939==    by 0x4011C90: _dl_init (dl-init.c:119)
> ==1286939==    by 0x65D6784: _dl_catch_exception (dl-error-skeleton.c:182)
> ==1286939==    by 0x401642C: dl_open_worker (dl-open.c:758)
> ==1286939==    by 0x65D6727: _dl_catch_exception (dl-error-skeleton.c:208)
> ==1286939==    by 0x40155F9: _dl_open (dl-open.c:837)
> ==1286939==    by 0x72DE34B: dlopen_doit (dlopen.c:66)
> ==1286939==    by 0x65D6727: _dl_catch_exception (dl-error-skeleton.c:208)
> ==1286939==    by 0x65D67F2: _dl_catch_error (dl-error-skeleton.c:227)
> ==1286939==    by 0x72DEB58: _dlerror_run (dlerror.c:170)
> ==1286939== 
> ==1286939== 32 bytes in 1 blocks are still reachable in loss record 12 of 44
> ==1286939==    at 0x483DD99: calloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x7CC353E: event_get_supported_methods (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x68FEA98: opal_event_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68FE8CA: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E4008: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68B8BCF: opal_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x6860120: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939== 
> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 13 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A5EB: ???
> ==1286939==    by 0x84D2B0A: ???
> ==1286939==    by 0x68602FB: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 14 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A5EB: ???
> ==1286939==    by 0x84D2BCE: ???
> ==1286939==    by 0x68602FB: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 15 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A5EB: ???
> ==1286939==    by 0x84D2CB2: ???
> ==1286939==    by 0x68602FB: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 16 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A5EB: ???
> ==1286939==    by 0x84D2D91: ???
> ==1286939==    by 0x68602FB: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 17 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E81BD8: ???
> ==1286939==    by 0x8E89F4B: ???
> ==1286939==    by 0x8D84A0D: ???
> ==1286939==    by 0x8DF79C1: ???
> ==1286939==    by 0x7CC3FDD: ??? (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x7CC487E: event_base_loop (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x8DBDD55: ???
> ==1286939==    by 0x4BF7608: start_thread (pthread_create.c:477)
> ==1286939==    by 0x6595102: clone (clone.S:95)
> ==1286939== 
> ==1286939== 32 bytes in 1 blocks are definitely lost in loss record 18 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A767: ???
> ==1286939==    by 0x84D330E: ???
> ==1286939==    by 0x68602FB: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== 36 (32 direct, 4 indirect) bytes in 1 blocks are definitely lost in loss record 19 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A5EB: ???
> ==1286939==    by 0x4B94C09: mca_pml_base_pml_check_selected (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x9F1E1E1: ???
> ==1286939==    by 0x4BA1A09: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== 40 bytes in 1 blocks are still reachable in loss record 20 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x7CFF4B6: ??? (in /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
> ==1286939==    by 0x7CC5E26: event_global_setup_locks_ (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x7CFF68F: evthread_use_pthreads (in /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
> ==1286939==    by 0x68FE8E4: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E4008: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68B8BCF: opal_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x6860120: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939== 
> ==1286939== 40 bytes in 1 blocks are still reachable in loss record 21 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x7CFF4B6: ??? (in /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
> ==1286939==    by 0x7CCF377: evsig_global_setup_locks_ (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x7CC5E39: event_global_setup_locks_ (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x7CFF68F: evthread_use_pthreads (in /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
> ==1286939==    by 0x68FE8E4: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E4008: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68B8BCF: opal_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x6860120: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939== 
> ==1286939== 40 bytes in 1 blocks are still reachable in loss record 22 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x7CFF4B6: ??? (in /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
> ==1286939==    by 0x7CCB997: evutil_secure_rng_global_setup_locks_ (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x7CC5E4F: event_global_setup_locks_ (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x7CFF68F: evthread_use_pthreads (in /usr/lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7.0.0)
> ==1286939==    by 0x68FE8E4: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E4008: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68B8BCF: opal_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x6860120: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939== 
> ==1286939== 48 bytes in 1 blocks are still reachable in loss record 23 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x68D9043: mca_base_component_repository_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68D7F7A: mca_base_component_find (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3A4D: mca_base_framework_components_register (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3F35: mca_base_framework_register (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3F93: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x4B8560C: mca_io_base_file_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B0E68A: ompi_file_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B3ADB8: PMPI_File_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x7B6F1AC: H5FD_mpio_open (H5FDmpio.c:997)
> ==1286939==    by 0x78D4B23: H5FD_open (H5FD.c:733)
> ==1286939==    by 0x78B953B: H5F_open (H5Fint.c:1493)
> ==1286939== 
> ==1286939== 48 bytes in 1 blocks are still reachable in loss record 24 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x68D9043: mca_base_component_repository_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68D7F7A: mca_base_component_find (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3A4D: mca_base_framework_components_register (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3F35: mca_base_framework_register (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3F93: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x4B85638: mca_io_base_file_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B0E68A: ompi_file_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B3ADB8: PMPI_File_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x7B6F1AC: H5FD_mpio_open (H5FDmpio.c:997)
> ==1286939==    by 0x78D4B23: H5FD_open (H5FD.c:733)
> ==1286939==    by 0x78B953B: H5F_open (H5Fint.c:1493)
> ==1286939== 
> ==1286939== 48 bytes in 2 blocks are still reachable in loss record 25 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x7CC3647: event_config_avoid_method (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x68FEB5A: opal_event_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68FE8CA: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E4008: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68B8BCF: opal_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x6860120: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939== 
> ==1286939== 55 (32 direct, 23 indirect) bytes in 1 blocks are definitely lost in loss record 26 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A767: ???
> ==1286939==    by 0x4AF6CD6: ompi_comm_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA194D: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939== 
> ==1286939== 56 bytes in 1 blocks are still reachable in loss record 27 of 44
> ==1286939==    at 0x483DD99: calloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x7CC1C86: event_config_new (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x68FEAC0: opal_event_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68FE8CA: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E4008: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68B8BCF: opal_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x6860120: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939== 
> ==1286939== 56 bytes in 1 blocks are definitely lost in loss record 28 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x9F6E008: ???
> ==1286939==    by 0x9F7C654: ???
> ==1286939==    by 0x9F1CD3E: ???
> ==1286939==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9EE3527: ???
> ==1286939==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939== 
> ==1286939== 56 bytes in 1 blocks are definitely lost in loss record 29 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0xA957008: ???
> ==1286939==    by 0xA86B017: ???
> ==1286939==    by 0xA862FD8: ???
> ==1286939==    by 0xA828E15: ???
> ==1286939==    by 0xA829624: ???
> ==1286939==    by 0x9F77910: ???
> ==1286939==    by 0x4B85C53: ompi_mtl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x9F13E4D: ???
> ==1286939==    by 0x4B94673: mca_pml_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA1789: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== 76 (32 direct, 44 indirect) bytes in 1 blocks are definitely lost in loss record 30 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A767: ???
> ==1286939==    by 0x84D387F: ???
> ==1286939==    by 0x68602FB: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== 79 (64 direct, 15 indirect) bytes in 1 blocks are definitely lost in loss record 31 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x9EDB12E: ???
> ==1286939==    by 0x68D98FC: mca_base_framework_components_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x6907C25: ??? (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E4008: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x4BA16D5: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939==    by 0x15710D: main (testing_main.cpp:8)
> ==1286939== 
> ==1286939== 144 bytes in 3 blocks are still reachable in loss record 32 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x68D9043: mca_base_component_repository_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68D7F7A: mca_base_component_find (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3A4D: mca_base_framework_components_register (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3F35: mca_base_framework_register (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3F93: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x4B8564E: mca_io_base_file_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B0E68A: ompi_file_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B3ADB8: PMPI_File_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x7B6F1AC: H5FD_mpio_open (H5FDmpio.c:997)
> ==1286939==    by 0x78D4B23: H5FD_open (H5FD.c:733)
> ==1286939==    by 0x78B953B: H5F_open (H5Fint.c:1493)
> ==1286939== 
> ==1286939== 231 bytes in 12 blocks are definitely lost in loss record 33 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x651550E: strdup (strdup.c:42)
> ==1286939==    by 0x9F2B4B3: ???
> ==1286939==    by 0x9F2B85C: ???
> ==1286939==    by 0x9F2BBD7: ???
> ==1286939==    by 0x9F1CAAC: ???
> ==1286939==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9EE3527: ???
> ==1286939==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939== 
> ==1286939== 240 bytes in 5 blocks are still reachable in loss record 34 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x68D9043: mca_base_component_repository_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68D7F7A: mca_base_component_find (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3A4D: mca_base_framework_components_register (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3F35: mca_base_framework_register (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x68E3F93: mca_base_framework_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x4B85622: mca_io_base_file_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B0E68A: ompi_file_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B3ADB8: PMPI_File_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x7B6F1AC: H5FD_mpio_open (H5FDmpio.c:997)
> ==1286939==    by 0x78D4B23: H5FD_open (H5FD.c:733)
> ==1286939==    by 0x78B953B: H5F_open (H5Fint.c:1493)
> ==1286939== 
> ==1286939== 272 bytes in 44 blocks are definitely lost in loss record 35 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x9FCAEDB: ???
> ==1286939==    by 0x9FE42B2: ???
> ==1286939==    by 0x9FE47BB: ???
> ==1286939==    by 0x9FCDDBF: ???
> ==1286939==    by 0x9FA324A: ???
> ==1286939==    by 0x4B3DD7F: PMPI_File_write_at_all (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x7B6DB32: H5FD_mpio_write (H5FDmpio.c:1833)
> ==1286939==    by 0x78DF11D: H5FD_write (H5FDint.c:257)
> ==1286939==    by 0x78AE86B: H5F__accum_write (H5Faccum.c:825)
> ==1286939==    by 0x7A1FBE9: H5PB_write (H5PB.c:1027)
> ==1286939==    by 0x78BBC7A: H5F_block_write (H5Fio.c:164)
> ==1286939== 
> ==1286939== 585 (480 direct, 105 indirect) bytes in 15 blocks are definitely lost in loss record 36 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A767: ???
> ==1286939==    by 0x4B14036: ompi_proc_complete_init_single (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B146C3: ompi_proc_complete_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA19A9: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== 776 bytes in 32 blocks are indirectly lost in loss record 37 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8DE9816: ???
> ==1286939==    by 0x8DEB1D2: ???
> ==1286939==    by 0x8DEB49A: ???
> ==1286939==    by 0x8DE8B12: ???
> ==1286939==    by 0x8E9D492: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A767: ???
> ==1286939== 
> ==1286939== 840 (480 direct, 360 indirect) bytes in 15 blocks are definitely lost in loss record 38 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A5EB: ???
> ==1286939==    by 0x9EF2F00: ???
> ==1286939==    by 0x9EEBF17: ???
> ==1286939==    by 0x9EE2F54: ???
> ==1286939==    by 0x9F1E1FB: ???
> ==1286939== 
> ==1286939== 1,084 (480 direct, 604 indirect) bytes in 15 blocks are definitely lost in loss record 39 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A767: ???
> ==1286939==    by 0x84D4800: ???
> ==1286939==    by 0x68602FB: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286939==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== 1,344 bytes in 1 blocks are definitely lost in loss record 40 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x68AE702: opal_free_list_grow_st (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9F1CD2D: ???
> ==1286939==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9EE3527: ???
> ==1286939==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939==    by 0x15710D: main (testing_main.cpp:8)
> ==1286939== 
> ==1286939== 2,752 bytes in 1 blocks are definitely lost in loss record 41 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x68AE702: opal_free_list_grow_st (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9F1CC50: ???
> ==1286939==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9EE3527: ???
> ==1286939==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939==    by 0x15710D: main (testing_main.cpp:8)
> ==1286939== 
> ==1286939== 2,752 bytes in 1 blocks are definitely lost in loss record 42 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x68AE702: opal_free_list_grow_st (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9F1CCC4: ???
> ==1286939==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286939==    by 0x9EE3527: ???
> ==1286939==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286939==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286939==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286939==    by 0x15710D: main (testing_main.cpp:8)
> ==1286939== 
> ==1286939== 62,644 bytes in 31 blocks are indirectly lost in loss record 43 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8DE9FA8: ???
> ==1286939==    by 0x8DEB032: ???
> ==1286939==    by 0x8DEB49A: ???
> ==1286939==    by 0x8DE8B12: ???
> ==1286939==    by 0x8E9D492: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A5EB: ???
> ==1286939== 
> ==1286939== 62,760 (480 direct, 62,280 indirect) bytes in 15 blocks are definitely lost in loss record 44 of 44
> ==1286939==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8E9D3EB: ???
> ==1286939==    by 0x8E9F1C1: ???
> ==1286939==    by 0x8D0578C: ???
> ==1286939==    by 0x8D8605A: ???
> ==1286939==    by 0x8D87FE8: ???
> ==1286939==    by 0x8D88E4D: ???
> ==1286939==    by 0x8D1A5EB: ???
> ==1286939==    by 0x9F0398A: ???
> ==1286939==    by 0x9EE2F54: ???
> ==1286939==    by 0x9F1E1FB: ???
> ==1286939==    by 0x4BA1A09: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286939== 
> ==1286939== LEAK SUMMARY:
> ==1286939==    definitely lost: 9,837 bytes in 138 blocks
> ==1286939==    indirectly lost: 63,435 bytes in 64 blocks
> ==1286939==      possibly lost: 0 bytes in 0 blocks
> ==1286939==    still reachable: 782 bytes in 21 blocks
> ==1286939==         suppressed: 0 bytes in 0 blocks
> ==1286939== 
> ==1286939== ERROR SUMMARY: 29 errors from 29 contexts (suppressed: 0 from 0)
> ==1286939== 
> ==1286939== 1 errors in context 1 of 29:
> ==1286939== Thread 3:
> ==1286939== Syscall param writev(vector[...]) points to uninitialised byte(s)
> ==1286939==    at 0x658A48D: __writev (writev.c:26)
> ==1286939==    by 0x658A48D: writev (writev.c:24)
> ==1286939==    by 0x8DF9B4C: ???
> ==1286939==    by 0x7CC413E: ??? (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x7CC487E: event_base_loop (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x8DBDD55: ???
> ==1286939==    by 0x4BF7608: start_thread (pthread_create.c:477)
> ==1286939==    by 0x6595102: clone (clone.S:95)
> ==1286939==  Address 0xa28ee1f is 127 bytes inside a block of size 5,120 alloc'd
> ==1286939==    at 0x483DFAF: realloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286939==    by 0x8DE155A: ???
> ==1286939==    by 0x8DE3F4A: ???
> ==1286939==    by 0x8DE4900: ???
> ==1286939==    by 0x8DE4175: ???
> ==1286939==    by 0x8D7CF91: ???
> ==1286939==    by 0x7CC3FDD: ??? (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x7CC487E: event_base_loop (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286939==    by 0x8DBDD55: ???
> ==1286939==    by 0x4BF7608: start_thread (pthread_create.c:477)
> ==1286939==    by 0x6595102: clone (clone.S:95)
> ==1286939==  Uninitialised value was created by a stack allocation
> ==1286939==    at 0x9F048D6: ???
> ==1286939== 
> ==1286939== ERROR SUMMARY: 29 errors from 29 contexts (suppressed: 0 from 0)
> mpi/lib/libopen-pal.so.40.20.3)
> ==1286936==    by 0x4B85622: mca_io_base_file_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4B0E68A: ompi_file_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4B3ADB8: PMPI_File_open (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x7B6F1AC: H5FD_mpio_open (H5FDmpio.c:997)
> ==1286936==    by 0x78D4B23: H5FD_open (H5FD.c:733)
> ==1286936==    by 0x78B953B: H5F_open (H5Fint.c:1493)
> ==1286936== 
> ==1286936== 272 bytes in 44 blocks are definitely lost in loss record 39 of 49
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x9FCAEDB: ???
> ==1286936==    by 0x9FE42B2: ???
> ==1286936==    by 0x9FE47BB: ???
> ==1286936==    by 0x9FCDDBF: ???
> ==1286936==    by 0x9FA324A: ???
> ==1286936==    by 0x4B3DD7F: PMPI_File_write_at_all (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x7B6DB32: H5FD_mpio_write (H5FDmpio.c:1833)
> ==1286936==    by 0x78DF11D: H5FD_write (H5FDint.c:257)
> ==1286936==    by 0x78AE86B: H5F__accum_write (H5Faccum.c:825)
> ==1286936==    by 0x7A1FBE9: H5PB_write (H5PB.c:1027)
> ==1286936==    by 0x78BBC7A: H5F_block_write (H5Fio.c:164)
> ==1286936== 
> ==1286936== 312 bytes in 1 blocks are still reachable in loss record 40 of 49
> ==1286936==    at 0x483BE63: operator new(unsigned long) (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x74E78EB: boost::detail::make_external_thread_data() (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_thread.so.1.73.0)
> ==1286936==    by 0x74E7C74: boost::detail::add_thread_exit_function(boost::detail::thread_exit_function_base*) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_thread.so.1.73.0)
> ==1286936==    by 0x73AFCEA: boost::log::v2_mt_posix::sources::aux::get_severity_level() (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_log.so.1.73.0)
> ==1286936==    by 0x5F71A6C: set_value (severity_feature.hpp:135)
> ==1286936==    by 0x5F71A6C: open_record_unlocked<boost::parameter::aux::tagged_argument_list_of_1<boost::parameter::aux::tagged_argument<boost::log::v2_mt_posix::keywords::tag::severity, const boost::log::v2_mt_posix::trivial::severity_level> > > (severity_feature.hpp:252)
> ==1286936==    by 0x5F71A6C: open_record<boost::parameter::aux::tagged_argument_list_of_1<boost::parameter::aux::tagged_argument<boost::log::v2_mt_posix::keywords::tag::severity, const boost::log::v2_mt_posix::trivial::severity_level> > > (basic_logger.hpp:459)
> ==1286936==    by 0x5F71A6C: Logger::TraceMessage(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >) (logger.cpp:328)
> ==1286936==    by 0x5F729C7: Logger::Message(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, LogLevel) (logger.cpp:280)
> ==1286936==    by 0x5F73CF1: Logger::Timer::Timer(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, LogLevel) (logger.cpp:426)
> ==1286936==    by 0x15718A: timer (logger.hpp:98)
> ==1286936==    by 0x15718A: main (testing_main.cpp:9)
> ==1286936== 
> ==1286936== 585 (480 direct, 105 indirect) bytes in 15 blocks are definitely lost in loss record 41 of 49
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x8E9D3EB: ???
> ==1286936==    by 0x8E9F1C1: ???
> ==1286936==    by 0x8D0578C: ???
> ==1286936==    by 0x8D8605A: ???
> ==1286936==    by 0x8D87FE8: ???
> ==1286936==    by 0x8D88E4D: ???
> ==1286936==    by 0x8D1A767: ???
> ==1286936==    by 0x4B14036: ompi_proc_complete_init_single (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4B146C3: ompi_proc_complete_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4BA19A9: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936== 
> ==1286936== 776 bytes in 32 blocks are indirectly lost in loss record 42 of 49
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x8DE9816: ???
> ==1286936==    by 0x8DEB1D2: ???
> ==1286936==    by 0x8DEB49A: ???
> ==1286936==    by 0x8DE8B12: ???
> ==1286936==    by 0x8E9D492: ???
> ==1286936==    by 0x8E9F1C1: ???
> ==1286936==    by 0x8D0578C: ???
> ==1286936==    by 0x8D8605A: ???
> ==1286936==    by 0x8D87FE8: ???
> ==1286936==    by 0x8D88E4D: ???
> ==1286936==    by 0x8D1A767: ???
> ==1286936== 
> ==1286936== 840 (480 direct, 360 indirect) bytes in 15 blocks are definitely lost in loss record 43 of 49
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x8E9D3EB: ???
> ==1286936==    by 0x8E9F1C1: ???
> ==1286936==    by 0x8D0578C: ???
> ==1286936==    by 0x8D8605A: ???
> ==1286936==    by 0x8D87FE8: ???
> ==1286936==    by 0x8D88E4D: ???
> ==1286936==    by 0x8D1A5EB: ???
> ==1286936==    by 0x9EF2F00: ???
> ==1286936==    by 0x9EEBF17: ???
> ==1286936==    by 0x9EE2F54: ???
> ==1286936==    by 0x9F1E1FB: ???
> ==1286936== 
> ==1286936== 1,091 (480 direct, 611 indirect) bytes in 15 blocks are definitely lost in loss record 44 of 49
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x8E9D3EB: ???
> ==1286936==    by 0x8E9F1C1: ???
> ==1286936==    by 0x8D0578C: ???
> ==1286936==    by 0x8D8605A: ???
> ==1286936==    by 0x8D87FE8: ???
> ==1286936==    by 0x8D88E4D: ???
> ==1286936==    by 0x8D1A767: ???
> ==1286936==    by 0x84D4800: ???
> ==1286936==    by 0x68602FB: orte_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-rte.so.40.20.3)
> ==1286936==    by 0x4BA1322: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936== 
> ==1286936== 1,344 bytes in 1 blocks are definitely lost in loss record 45 of 49
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x68AE702: opal_free_list_grow_st (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286936==    by 0x9F1CD2D: ???
> ==1286936==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286936==    by 0x9EE3527: ???
> ==1286936==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286936==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286936==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286936==    by 0x15710D: main (testing_main.cpp:8)
> ==1286936== 
> ==1286936== 2,752 bytes in 1 blocks are definitely lost in loss record 46 of 49
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x68AE702: opal_free_list_grow_st (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286936==    by 0x9F1CC50: ???
> ==1286936==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286936==    by 0x9EE3527: ???
> ==1286936==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286936==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286936==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286936==    by 0x15710D: main (testing_main.cpp:8)
> ==1286936== 
> ==1286936== 2,752 bytes in 1 blocks are definitely lost in loss record 47 of 49
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x68AE702: opal_free_list_grow_st (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286936==    by 0x9F1CCC4: ???
> ==1286936==    by 0x68FC9C8: mca_btl_base_select (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libopen-pal.so.40.20.3)
> ==1286936==    by 0x9EE3527: ???
> ==1286936==    by 0x4B6170A: mca_bml_base_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4BA1714: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4B450B0: PMPI_Init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x4A7BA77: boost::mpi::environment::environment(bool) (in /home/mlohry/dev/cmake-build/boost_install/lib/libboost_mpi.so.1.73.0)
> ==1286936==    by 0x5F1F232: Parallel::Parallel() (parallel.cpp:19)
> ==1286936==    by 0x16CDDB: Parallel::Get() (parallel.hpp:40)
> ==1286936==    by 0x15710D: main (testing_main.cpp:8)
> ==1286936== 
> ==1286936== 62,640 bytes in 30 blocks are indirectly lost in loss record 48 of 49
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x8DE9FA8: ???
> ==1286936==    by 0x8DEB032: ???
> ==1286936==    by 0x8DEB49A: ???
> ==1286936==    by 0x8DE8B12: ???
> ==1286936==    by 0x8E9D492: ???
> ==1286936==    by 0x8E9F1C1: ???
> ==1286936==    by 0x8D0578C: ???
> ==1286936==    by 0x8D8605A: ???
> ==1286936==    by 0x8D87FE8: ???
> ==1286936==    by 0x8D88E4D: ???
> ==1286936==    by 0x8D1A5EB: ???
> ==1286936== 
> ==1286936== 62,760 (480 direct, 62,280 indirect) bytes in 15 blocks are definitely lost in loss record 49 of 49
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x8E9D3EB: ???
> ==1286936==    by 0x8E9F1C1: ???
> ==1286936==    by 0x8D0578C: ???
> ==1286936==    by 0x8D8605A: ???
> ==1286936==    by 0x8D87FE8: ???
> ==1286936==    by 0x8D88E4D: ???
> ==1286936==    by 0x8D1A5EB: ???
> ==1286936==    by 0x9F0398A: ???
> ==1286936==    by 0x9EE2F54: ???
> ==1286936==    by 0x9F1E1FB: ???
> ==1286936==    by 0x4BA1A09: ompi_mpi_init (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936== 
> ==1286936== LEAK SUMMARY:
> ==1286936==    definitely lost: 9,805 bytes in 137 blocks
> ==1286936==    indirectly lost: 63,431 bytes in 63 blocks
> ==1286936==      possibly lost: 0 bytes in 0 blocks
> ==1286936==    still reachable: 1,174 bytes in 27 blocks
> ==1286936==         suppressed: 0 bytes in 0 blocks
> ==1286936== 
> ==1286936== ERROR SUMMARY: 34 errors from 29 contexts (suppressed: 0 from 0)
> ==1286936== 
> ==1286936== 1 errors in context 1 of 29:
> ==1286936== Thread 3:
> ==1286936== Syscall param writev(vector[...]) points to uninitialised byte(s)
> ==1286936==    at 0x658A48D: __writev (writev.c:26)
> ==1286936==    by 0x658A48D: writev (writev.c:24)
> ==1286936==    by 0x8DF9B4C: ???
> ==1286936==    by 0x7CC413E: ??? (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286936==    by 0x7CC487E: event_base_loop (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286936==    by 0x8DBDD55: ???
> ==1286936==    by 0x4BF7608: start_thread (pthread_create.c:477)
> ==1286936==    by 0x6595102: clone (clone.S:95)
> ==1286936==  Address 0xa290cbf is 127 bytes inside a block of size 5,120 alloc'd
> ==1286936==    at 0x483DFAF: realloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x8DE155A: ???
> ==1286936==    by 0x8DE3F4A: ???
> ==1286936==    by 0x8DE4900: ???
> ==1286936==    by 0x8DE4175: ???
> ==1286936==    by 0x8D7CF91: ???
> ==1286936==    by 0x7CC3FDD: ??? (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286936==    by 0x7CC487E: event_base_loop (in /usr/lib/x86_64-linux-gnu/libevent-2.1.so.7.0.0)
> ==1286936==    by 0x8DBDD55: ???
> ==1286936==    by 0x4BF7608: start_thread (pthread_create.c:477)
> ==1286936==    by 0x6595102: clone (clone.S:95)
> ==1286936==  Uninitialised value was created by a stack allocation
> ==1286936==    at 0x9F048D6: ???
> ==1286936== 
> ==1286936== 
> ==1286936== 6 errors in context 2 of 29:
> ==1286936== Thread 1:
> ==1286936== Syscall param pwritev(vector[...]) points to uninitialised byte(s)
> ==1286936==    at 0x658A608: pwritev64 (pwritev64.c:30)
> ==1286936==    by 0x658A608: pwritev (pwritev64.c:28)
> ==1286936==    by 0x9F46E25: ???
> ==1286936==    by 0x9FCE33B: ???
> ==1286936==    by 0x9FCDDBF: ???
> ==1286936==    by 0x9FA324A: ???
> ==1286936==    by 0x4B3DD7F: PMPI_File_write_at_all (in /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi.so.40.20.3)
> ==1286936==    by 0x7B6DB32: H5FD_mpio_write (H5FDmpio.c:1833)
> ==1286936==    by 0x78DF11D: H5FD_write (H5FDint.c:257)
> ==1286936==    by 0x78AE86B: H5F__accum_write (H5Faccum.c:825)
> ==1286936==    by 0x7A1FBE9: H5PB_write (H5PB.c:1027)
> ==1286936==    by 0x78BBC7A: H5F_block_write (H5Fio.c:164)
> ==1286936==    by 0x7B5ED15: H5C__collective_write (H5Cmpio.c:1020)
> ==1286936==    by 0x7B5ED15: H5C_apply_candidate_list (H5Cmpio.c:394)
> ==1286936==  Address 0xedf91b0 is 96 bytes inside a block of size 216 alloc'd
> ==1286936==    at 0x483B7F3: malloc (in /usr/lib/x86_64-linux-gnu/valgrind/vgpreload_memcheck-amd64-linux.so)
> ==1286936==    by 0x7980C45: H5MM_malloc (H5MM.c:292)
> ==1286936==    by 0x7980C45: H5MM_malloc (H5MM.c:267)
> ==1286936==    by 0x77FC8FF: H5C__flush_single_entry (H5C.c:6045)
> ==1286936==    by 0x7B5DC7E: H5C__flush_candidates_in_ring (H5Cmpio.c:1371)
> ==1286936==    by 0x7B5DC7E: H5C__flush_candidate_entries (H5Cmpio.c:1192)
> ==1286936==    by 0x7B5DC7E: H5C_apply_candidate_list (H5Cmpio.c:385)
> ==1286936==    by 0x7B5BA18: H5AC__rsp__dist_md_write__flush (H5ACmpio.c:1709)
> ==1286936==    by 0x7B5BA18: H5AC__run_sync_point (H5ACmpio.c:2164)
> ==1286936==    by 0x7B5C9D2: H5AC__flush_entries (H5ACmpio.c:2307)
> ==1286936==    by 0x77C95E4: H5AC_flush (H5AC.c:681)
> ==1286936==    by 0x78B306A: H5F__flush_phase2 (H5Fint.c:1831)
> ==1286936==    by 0x78B5D7A: H5F__dest (H5Fint.c:1152)
> ==1286936==    by 0x78B6603: H5F_try_close (H5Fint.c:2180)
> ==1286936==    by 0x78B69F5: H5F__close_cb (H5Fint.c:2009)
> ==1286936==    by 0x7965797: H5I_dec_ref (H5I.c:1254)
> ==1286936==  Uninitialised value was created by a stack allocation
> ==1286936==    at 0x7695AF0: ??? (in /home/mlohry/dev/cmake-build/external_install/lib/libcgns.so)
> ==1286936== 
> ==1286936== ERROR SUMMARY: 34 errors from 29 contexts (suppressed: 0 from 0)
> 
> On Mon, Aug 24, 2020 at 5:00 PM Jed Brown <jed at jedbrown.org <mailto:jed at jedbrown.org>> wrote:
> Do you potentially have a memory or other resource leak?  SIGBUS would be an odd result, but the symptom of crashing after running for a long time sometimes fits with a resource leak.
> 
> Mark Lohry <mlohry at gmail.com <mailto:mlohry at gmail.com>> writes:
> 
> > I queued up some jobs with Barry's patch, so we'll see.
> >
> > Re Jed's suggestion at checkpointing, I don't *think* this is something
> > coming from the state of the solution -- running from the same point I'm
> > seeing it crash anywhere between 1 hour and 20 hours in. I'll increase my
> > file save frequency in case I'm wrong there though.
> >
> > My intel build with different blas just made it through a 6 hour time slot
> > without crash, whereas yesterday the same thing crashed after 3 hours. But
> > given the randomness so far I'd bet that's just dumb luck.
> >
> > On Mon, Aug 24, 2020 at 4:22 PM Barry Smith <bsmith at petsc.dev <mailto:bsmith at petsc.dev>> wrote:
> >
> >>
> >>
> >> > On Aug 24, 2020, at 2:34 PM, Jed Brown <jed at jedbrown.org <mailto:jed at jedbrown.org>> wrote:
> >> >
> >> > I'm thinking of something such as writing floating point data into the
> >> return address, which would be unaligned/garbage.
> >>
> >>   Ok, my patch will detect this. This is what I was talking about, messing
> >> up the BLAS arguments which are the addresses of arrays.
> >>
> >>   Valgrind is by far the preferred approach.
> >>
> >>   Barry
> >>
> >>   Another feature we could add to the malloc checking is when a SEGV or
> >> BUS error is encountered and we catch it we should run the
> >> PetscMallocVerify() and check our memory for corruption reporting any we
> >> find.
> >>
> >>
> >>
> >> >
> >> > Reproducing under Valgrind would help a lot.  Perhaps it's possible to
> >> checkpoint such that the breakage can be reproduced more quickly?
> >> >
> >> > Barry Smith <bsmith at petsc.dev <mailto:bsmith at petsc.dev>> writes:
> >> >
> >> >> https://en.wikipedia.org/wiki/Bus_error <https://en.wikipedia.org/wiki/Bus_error> <
> >> https://en.wikipedia.org/wiki/Bus_error <https://en.wikipedia.org/wiki/Bus_error>>
> >> >>
> >> >> But perhaps not true for Intel?
> >> >>
> >> >>
> >> >>
> >> >>> On Aug 24, 2020, at 1:06 PM, Matthew Knepley <knepley at gmail.com <mailto:knepley at gmail.com>>
> >> wrote:
> >> >>>
> >> >>> On Mon, Aug 24, 2020 at 1:46 PM Barry Smith <bsmith at petsc.dev <mailto:bsmith at petsc.dev> <mailto:
> >> bsmith at petsc.dev <mailto:bsmith at petsc.dev>>> wrote:
> >> >>>
> >> >>>
> >> >>>> On Aug 24, 2020, at 12:39 PM, Jed Brown <jed at jedbrown.org <mailto:jed at jedbrown.org> <mailto:
> >> jed at jedbrown.org <mailto:jed at jedbrown.org>>> wrote:
> >> >>>>
> >> >>>> Barry Smith <bsmith at petsc.dev <mailto:bsmith at petsc.dev> <mailto:bsmith at petsc.dev <mailto:bsmith at petsc.dev>>> writes:
> >> >>>>
> >> >>>>>> On Aug 24, 2020, at 12:31 PM, Jed Brown <jed at jedbrown.org <mailto:jed at jedbrown.org> <mailto:
> >> jed at jedbrown.org <mailto:jed at jedbrown.org>>> wrote:
> >> >>>>>>
> >> >>>>>> Barry Smith <bsmith at petsc.dev <mailto:bsmith at petsc.dev> <mailto:bsmith at petsc.dev <mailto:bsmith at petsc.dev>>> writes:
> >> >>>>>>
> >> >>>>>>> So if a BLAS errors with SIGBUS then it is always an input error
> >> of just not proper double/complex alignment? Or some other very strange
> >> thing?
> >> >>>>>>
> >> >>>>>> I would suspect memory corruption.
> >> >>>>>
> >> >>>>>
> >> >>>>> Corruption meaning what specifically?
> >> >>>>>
> >> >>>>> The routines crashing are dgemv which only take double precision
> >> arrays, regardless of what garbage is in those arrays i don't think there
> >> can be BUS errors resulting. They don't take integer arrays whose
> >> corruption could result in bad indexing and then BUS errors.
> >> >>>>>
> >> >>>>> So then it can only be corruption of the pointers passed in, correct?
> >> >>>>
> >> >>>> Such as those pointers pointing into data on the stack with incorrect
> >> sizes.
> >> >>>
> >> >>> But won't incorrect sizes "usually" lead to SEGV not SEGBUS?
> >> >>>
> >> >>> My understanding was that roughly memory errors in the heap are SEGV
> >> and memory errors on the stack are SIGBUS. Is that not true?
> >> >>>
> >> >>>   Matt
> >> >>>
> >> >>> --
> >> >>> What most experimenters take for granted before they begin their
> >> experiments is infinitely more interesting than any results to which their
> >> experiments lead.
> >> >>> -- Norbert Wiener
> >> >>>
> >> >>> https://www.cse.buffalo.edu/~knepley/ <https://www.cse.buffalo.edu/~knepley/> <
> >> http://www.cse.buffalo.edu/~knepley/ <http://www.cse.buffalo.edu/~knepley/>>
> >>
> >>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20200827/a5fd8da0/attachment-0001.html>