[Darshan-users] Darshan not tracing with tensorflow import.

[Jeffrey Layton]

About 2 months ago, I tried using Darshan to trace a TensorFlow2 DL
training. I could not trace the input. What I _think_ happens is the TF2
uses mmap() for reading the input files and I don't think Darshan can
capture that file IO. But I'm not a Darshan expert so perhaps someone has
tried this before and can help

(BTW - it's possible to build TensorFlow so it doesn't use mmap() for
reading files.)

Jeff



On Mon, Jul 6, 2020 at 1:08 PM Devarajan, Hariharan <hdevarajan at anl.gov>
wrote:

>
>
> Hello,
>
>
>
> I was able to run my test program with 3.2.1 darshan. However, when i
> trace an app which load tensorflow it seems darshan doesn't produce trace.
> I am attaching two tars one with working example and one without. The only
> difference between the two is in test.py where i import tensorflow on first
> line.
>
>
>
> Can you please assist on how I can further debug the problem?
>
>
>
> Regards
>
> Hariharan
>
>
> _______________________________________________
> Darshan-users mailing list
> Darshan-users at lists.mcs.anl.gov
> https://lists.mcs.anl.gov/mailman/listinfo/darshan-users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/darshan-users/attachments/20200706/1594e751/attachment.html>