[Darshan-users] Darshan not tracing with tensorflow import.

Devarajan, Hariharan hdevarajan at anl.gov
Mon Jul 6 09:56:35 CDT 2020

The I/O is not through tensorflow. Its through h5py and numpy.load and I verified both without tensorflow import are getting traced. I already verified that import of tensorflow doesn’t change any environment variables.


From: Jeffrey Layton<mailto:laytonjb at gmail.com>
Sent: Monday, July 6, 2020 9:41 AM
To: Devarajan, Hariharan<mailto:hdevarajan at anl.gov>
Cc: darshan-users at lists.mcs.anl.gov<mailto:darshan-users at lists.mcs.anl.gov>
Subject: Re: [Darshan-users] Darshan not tracing with tensorflow import.

About 2 months ago, I tried using Darshan to trace a TensorFlow2 DL training. I could not trace the input. What I _think_ happens is the TF2 uses mmap() for reading the input files and I don't think Darshan can capture that file IO. But I'm not a Darshan expert so perhaps someone has tried this before and can help

(BTW - it's possible to build TensorFlow so it doesn't use mmap() for reading files.)


On Mon, Jul 6, 2020 at 1:08 PM Devarajan, Hariharan <hdevarajan at anl.gov<mailto:hdevarajan at anl.gov>> wrote:


I was able to run my test program with 3.2.1 darshan. However, when i trace an app which load tensorflow it seems darshan doesn't produce trace. I am attaching two tars one with working example and one without. The only difference between the two is in test.py where i import tensorflow on first line.

Can you please assist on how I can further debug the problem?


Darshan-users mailing list
Darshan-users at lists.mcs.anl.gov<mailto:Darshan-users at lists.mcs.anl.gov>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/darshan-users/attachments/20200706/3b339b30/attachment.html>

More information about the Darshan-users mailing list