[Darshan-users] Darshan and Intel MPI (x86_64)

[Phil Carns]

No, that part might be normal.  I think that stock builds with MPICH 
also do not produce any PMPI symbols unless you link in a library that 
is using the profiling interface.

-Phil

On 02/20/2012 04:50 PM, Harr, Cameron Contractor, SAIC wrote:
> Yes, it does call MPI_INIT and _FINALIZE.  Following your comments, I
> looked at several different versions of the executable compiled with
> different MPI stacks. Only the one compiled with MVAPICH had PMPI
> symbols (per the nm -A command). Are those symbols necessary for Darshan
> to work?
>
> On 02/20/2012 01:08 PM, Phil Carns wrote:
>> The program is calling MPI_INIT and MPI_FINALIZE, though right?
>> Fortran I/O should be captured just fine, but libdarshan.so still
>> relies on the MPI initialization and finalization routines to start
>> the tool up and write the log file.
>>
>> Assuming that the code is calling both of the above routines, it may
>> be that there is some additional step needed with Intel MPI for it to
>> use a library that relies on the MPI profiling (PMPI) interface.  When
>> Darshan is preloaded with LD_PRELOAD, it intercepts POSIX (Fortran I/O
>> in this case) calls directly, but for the MPI calls it still uses the
>> profiling interface to MPI.
>>
>> Have you tried using any more generic profiling libraries (like mpiP
>> or mpitrace) by any chance?
>>
>> -Phil
>>
>> On 02/20/2012 02:55 PM, Harr, Cameron Contractor, SAIC wrote:
>>> Interface is all Fortran calls, not using MPI_IO.
>>>
>>> On 02/20/2012 11:48 AM, Kevin Harms wrote:
>>>>      what interfaces are you using for I/O? Fortran calls, MPI_File_*
>>>> routines, something else?
>>>>
>>>> kevin
>>>>
>>>> On Feb 20, 2012, at 1:42 PM, Harr, Cameron Contractor, SAIC wrote:
>>>>
>>>>> Thanks Phil. Using the PRELOAD, I can get a sample output with one
>>>>> of the test C programs that comes with the Darshan source; however,
>>>>> I still don't get any output from my executable. Let me ask a basic
>>>>> question: My app is all Fortran; do I need to compile in any
>>>>> support into Darshan for Fortran compatibility? I see that it
>>>>> should support Fortran, but perhaps I'm doing something wrong.
>>>>>
>>>>> On 02/20/2012 10:44 AM, Phil Carns wrote:
>>>>>> I don't have any first-hand experience with Intel MPI, but in
>>>>>> principle it should work.
>>>>>>
>>>>>> Does your MPI compiler produces dynamic executables by default?
>>>>>> If so, can you try leaving your executable/binary unmodified and
>>>>>> load the libdarshan.so library at runtime using the LD_PRELOAD
>>>>>> environment variable, rather than directly linking it to your
>>>>>> application?  There is some more detail about this approach on
>>>>>> this page:
>>>>>>
>>>>>> http://wiki.mcs.anl.gov/Darshan/index.php/Dynamic_linking
>>>>>>
>>>>>> thanks,
>>>>>> -Phil
>>>>>>
>>>>>> On 02/20/2012 01:28 PM, Harr, Cameron Contractor, SAIC wrote:
>>>>>>> I'm trying to get Darshan running on a RedHat/X86_64 cluster with
>>>>>>> a few different flavors of MPI available. I'm most recently
>>>>>>> trying Intel MPI and gfortran (Intel Compilers didn't seem to
>>>>>>> work) and after a fair bit of tweaking, got the executable
>>>>>>> recompiled with libdarshan.so successfully linked in. In my job
>>>>>>> run script, I verify that libdarshan is linked in and the job
>>>>>>> runs to completion; however no output is generated. I also tried
>>>>>>> setting DARSHAN_INTERNAL_TIMING=1, but still no output. Should I
>>>>>>> be able to use Intel MPI and/or is there a place that documents
>>>>>>> which MPI stacks are supported?
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Darshan-users mailing list
>>>>>>>
>>>>>>> Darshan-users at lists.mcs.anl.gov
>>>>>>> https://lists.mcs.anl.gov/mailman/listinfo/darshan-users
>>>>>> _______________________________________________
>>>>>> Darshan-users mailing list
>>>>>>
>>>>>> Darshan-users at lists.mcs.anl.gov
>>>>>> https://lists.mcs.anl.gov/mailman/listinfo/darshan-users
>>>>> _______________________________________________
>>>>> Darshan-users mailing list
>>>>> Darshan-users at lists.mcs.anl.gov
>>>>> https://lists.mcs.anl.gov/mailman/listinfo/darshan-users
>>> _______________________________________________
>>> Darshan-users mailing list
>>> Darshan-users at lists.mcs.anl.gov
>>> https://lists.mcs.anl.gov/mailman/listinfo/darshan-users
>> _______________________________________________
>> Darshan-users mailing list
>> Darshan-users at lists.mcs.anl.gov
>> https://lists.mcs.anl.gov/mailman/listinfo/darshan-users