[Darshan-users] Darshan not tracing with tensorflow import.

[Devarajan, Hariharan]

The I/O is not through tensorflow. Its through h5py and numpy.load and I verified both without tensorflow import are getting traced. I already verified that import of tensorflow doesn’t change any environment variables.

Hari

From: Jeffrey Layton<mailto:laytonjb at gmail.com>
Sent: Monday, July 6, 2020 9:41 AM
To: Devarajan, Hariharan<mailto:hdevarajan at anl.gov>
Cc: darshan-users at lists.mcs.anl.gov<mailto:darshan-users at lists.mcs.anl.gov>
Subject: Re: [Darshan-users] Darshan not tracing with tensorflow import.

About 2 months ago, I tried using Darshan to trace a TensorFlow2 DL training. I could not trace the input. What I _think_ happens is the TF2 uses mmap() for reading the input files and I don't think Darshan can capture that file IO. But I'm not a Darshan expert so perhaps someone has tried this before and can help

(BTW - it's possible to build TensorFlow so it doesn't use mmap() for reading files.)

Jeff



On Mon, Jul 6, 2020 at 1:08 PM Devarajan, Hariharan <hdevarajan at anl.gov<mailto:hdevarajan at anl.gov>> wrote:

Hello,

I was able to run my test program with 3.2.1 darshan. However, when i trace an app which load tensorflow it seems darshan doesn't produce trace. I am attaching two tars one with working example and one without. The only difference between the two is in test.py where i import tensorflow on first line.

Can you please assist on how I can further debug the problem?

Regards
Hariharan

_______________________________________________
Darshan-users mailing list
Darshan-users at lists.mcs.anl.gov<mailto:Darshan-users at lists.mcs.anl.gov>
https://lists.mcs.anl.gov/mailman/listinfo/darshan-users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/darshan-users/attachments/20200706/3b339b30/attachment.html>