[Darshan-users] [EXTERNAL] Multiple MPI libraries on one system?
Christopher J. Morrone
morrone2 at llnl.gov
Thu Mar 5 16:37:19 CST 2020
Oh, great! Hopefully I can exploit lmod in the same way. Thanks!
Chris
On 3/5/20 1:56 PM, Curry, Matthew Leon wrote:
> Hi Chris,
>
> Our ThunderX2 systems have openmpi3, openmpi4, and hpempi. The general strategy is as you say: We build Darshan's runtime with each MPI (and some recent version of the GNU compiler). In the end, we have created one darshan-runtime package for each MPI, and a single darshan-util package that includes the analysis tools.
>
> Our lmod modules for our MPIs change the MODULEPATH to point to software compiled for that MPI. When we do a "module swap" to change MPIs, lmod is smart enough to change out the darshan module for one that is in the new MODULEPATH. We manage LD_PRELOAD in the Darshan module files, so it gets updated automatically.
>
> Matthew
>
>
> -----Original Message-----
> From: Darshan-users <darshan-users-bounces at lists.mcs.anl.gov> On Behalf Of Christopher J. Morrone
> Sent: Thursday, March 5, 2020 2:48 PM
> To: darshan-users at lists.mcs.anl.gov
> Subject: [EXTERNAL] [Darshan-users] Multiple MPI libraries on one system?
>
> Has anyone out there dealt with using darshan on a system that has multiple MPI libraries installed? Since various MPIs are not necessarily ABI compatible, I presume that I'll need multiple builds of darshan, and a mechanism to select the correct darshan LD_PRELOAD based on which MPI any particular application is using.
>
> Any tips for making this easier?
>
> Chris
> _______________________________________________
> Darshan-users mailing list
> Darshan-users at lists.mcs.anl.gov
> https://lists.mcs.anl.gov/mailman/listinfo/darshan-users
> .
>
More information about the Darshan-users
mailing list