<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Hi Mahzad,<br>
<br>
I can think of a few possibilities off the top of my head, but none really strike me as the obvious solution here:<br>
<br>
1.) DXT is only supported in the POSIX and MPIIO modules in Darshan currently. So, it should be able to record information on files accessed using MPI-IO routines (MPI_File_open, MPI_FIle_write_all, etc.) or any POSIX calls that operate on file descriptors
(open, read/write, etc). It will not record trace data for files accessed using file pointers (FILE *), so things like fopen, fwrite, fread, etc.<br>
<br>
2.) Is it possible the file path for the untraced file is in Darshan's list of paths to ignore? I would guess that's not the case, as I'd expect it to be stored along side your other simulation files. Here's the list of paths Darshan is set to ignore:<br>
<br>
"/etc/",<br>
"/dev/",<br>
"/usr/",<br>
"/bin/",<br>
"/boot/",<br>
"/lib/",<br>
"/opt/",<br>
"/sbin/",<br>
"/sys/",<br>
"/proc/",<br>
"/var/",<br>
<br>
3.) Is it possible DXT is running out of trace memory before this particular file is accessed? It will stop tracing new accesses once it's exhausted all memory. You can increase the amount of DXT memory per process by setting the
<span style="font-variant-ligatures:
no-common-ligatures" class="">DXT_ENABLE_IO_TRACE variable like you show in your example (i.e., set it to 16 for 16 MiB per process).</span><br>
<br>
Any chance any of those are the issue?<br>
<br>
Thanks,<br>
--Shane<br>
<br>
<div class="moz-cite-prefix">On 1/25/19 5:54 PM, Mahzad Khoshlessan via Darshan-users wrote:<br>
</div>
<blockquote type="cite" cite="mid:30A180B7-E183-4334-B1EA-C2631D18440D@gmail.com">
Hi all,
<div class=""><br class="">
</div>
<div class="">I am trying to use dxt_analyzer to get the traces and the OSTs assigned to each of my files during my simulations. When I run dxt_analyzer on my darshan log file the I/O trace file get created. However, I noticed that the report is not complete
and does not provide the tracing info on all of my files. I have .XTC file which is my main file and all the data needs to be read are included in this file. I have .psf file and .npz file which is a hidden file and contains the offsets for my .XTC file. I
am able to see the tracing report for .psf and .npz files, but nothing for .XTC file which is weird. Does any one know why this is the case? Is not it supposed to report the tracing info for all the files?</div>
<div class=""><br class="">
</div>
<div class="">I set the following parameters in my submit script before I run my code.</div>
<div class=""><br class="">
</div>
<div class="">
<div style="margin: 0px; font-stretch: normal; font-size: 11px;
line-height: normal; font-family: Menlo;" class="">
<span style="font-variant-ligatures: no-common-ligatures; color:
#c1651c" class="">export</span><span style="font-variant-ligatures: no-common-ligatures; color:
#2eaebb" class=""> LD_PRELOAD=</span><span style="font-variant-ligatures: no-common-ligatures" class="">/home/mkhoshle/installs/darshan/lib/libdarshan.so:/home/mkhoshle/hdf5/v1.10.1/lib/libhdf5.so</span></div>
<div style="margin: 0px; font-stretch: normal; font-size: 11px;
line-height: normal; font-family: Menlo; color: rgb(64, 11,
217);" class="">
<span style="font-variant-ligatures:
no-common-ligatures" class="">#export LD_PRELOAD=/home/mkhoshle/installs/darshan/lib/libdarshan.so</span></div>
<div style="margin: 0px; font-stretch: normal; font-size: 11px;
line-height: normal; font-family: Menlo;" class="">
<span style="font-variant-ligatures: no-common-ligatures; color:
#c1651c" class="">export</span><span style="font-variant-ligatures: no-common-ligatures; color:
#2eaebb" class=""> DARSHAN_LOGPATH=</span><span style="font-variant-ligatures: no-common-ligatures" class="">/oasis/scratch/comet/mkhoshle/temp_project/darshan-logs</span></div>
<div style="margin: 0px; font-stretch: normal; font-size: 11px;
line-height: normal; font-family: Menlo; color: rgb(200, 20,
201);" class="">
<span style="font-variant-ligatures:
no-common-ligatures; color: #c1651c" class="">export</span><span style="font-variant-ligatures: no-common-ligatures; color:
#2eaebb" class=""> SLURM_NODEFILE=</span><span style="font-variant-ligatures: no-common-ligatures" class="">`generate_pbs_nodefile`</span></div>
<div style="margin: 0px; font-stretch: normal; font-size: 11px;
line-height: normal; font-family: Menlo; color: rgb(46, 174,
187);" class="">
<span style="font-variant-ligatures:
no-common-ligatures; color: #c1651c" class="">export</span><span style="font-variant-ligatures: no-common-ligatures" class=""> DARSHAN_DISABLE_SHARED_REDUCTION=</span><span style="font-variant-ligatures: no-common-ligatures; color:
#b42419" class="">1</span></div>
<div style="margin: 0px; font-stretch: normal; font-size: 11px;
line-height: normal; font-family: Menlo; color: rgb(46, 174,
187);" class="">
<span style="font-variant-ligatures:
no-common-ligatures; color: #c1651c" class="">export</span><span style="font-variant-ligatures: no-common-ligatures" class=""> DXT_ENABLE_IO_TRACE=</span><span style="font-variant-ligatures: no-common-ligatures; color:
#b42419" class="">8</span></div>
</div>
<div style="margin: 0px; font-stretch: normal; font-size: 11px;
line-height: normal; font-family: Menlo; color: rgb(46, 174,
187);" class="">
<span style="font-variant-ligatures:
no-common-ligatures; color: #b42419" class=""><br class="">
</span></div>
<div style="margin: 0px; font-stretch: normal; font-size: 11px;
line-height: normal; font-family: Menlo; color: rgb(46, 174,
187);" class="">
<br class="">
</div>
<div style="margin: 0px; font-stretch: normal; font-size: 11px;
line-height: normal; font-family: Menlo; color: rgb(46, 174,
187);" class="">
<span style="caret-color: rgb(0, 0, 0); color:
rgb(0, 0, 0); font-family: Helvetica; font-size: 12px;" class="">Thanks in advance,</span></div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Darshan-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Darshan-users@lists.mcs.anl.gov">Darshan-users@lists.mcs.anl.gov</a>
<a class="moz-txt-link-freetext" href="https://lists.mcs.anl.gov/mailman/listinfo/darshan-users">https://lists.mcs.anl.gov/mailman/listinfo/darshan-users</a>
</pre>
</blockquote>
<br>
</body>
</html>