<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-2">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Hi Ayse,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
I assume you aren't getting any stderr messages from Darshan in your job output, right?</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
I think maybe the LD_PRELOAD line needs an "export" to make sure it carries through to child processes? It may also be the case that your mpirun needs an explicit argument to carry it along to the compute node environment. I'm not sure if the default pulls
the whole environment or not (and maybe it depends on the underlying launcher). It looks like mpirun has a -x argument for this purpose if you need to force it.<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<a href="https://www.open-mpi.org/doc/v4.0/man1/mpirun.1.php" style="">https://www.open-mpi.org/doc/v4.0/man1/mpirun.1.php</a></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Another option if you are willing to rebuild Darshan is to try the new 3.2.0 release. With that release there is another possibility for instrumentation: don't set LD_PRELOAD at all, but instead add `darshan-config --dyn-ld-flags` to your link options when
compiling the application. That one may be easier to debug because you could inspect if Darshan is linked in with tools like ldd and nm. </div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
(technically that *might* work with 3.1.7 as well, but in 3.2.0 we more thoroughly vetted that approach and documented it)<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
thanks,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
-Phil<br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Darshan-users <darshan-users-bounces@lists.mcs.anl.gov> on behalf of Ayºe Arslan <aysearslan2491@gmail.com><br>
<b>Sent:</b> Tuesday, May 12, 2020 2:31 PM<br>
<b>To:</b> darshan-users@lists.mcs.anl.gov <darshan-users@lists.mcs.anl.gov><br>
<b>Subject:</b> [Darshan-users] trace files can not be created with Darshan</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
Hello, <br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
I can not create trace files under darshan log directory,</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
I built in that way,</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
----------------------------------------<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
DARSHAN_LOGPATH=/lustre/nec/ws2/ws/tuner/logs<br>
./configure --with-mem-align=8 --with-log-path-by-env=DARSHAN_LOGPATH --with-jobid-env=NONE CC=mpicc --prefix=/lustre/nec/ws2/ws/tuner/darshan-3.1.7-ompi</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
make <br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
make install</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
---------------------------------------<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
#! /bin/bash<br>
<br>
#PBS -N a <br>
#PBS -l nodes=1:ppn=24<br>
#PBS -l walltime=00:40:00<br>
#PBS -o a.txt<br>
cd $PBS_O_WORKDIR<br>
<br>
module load compiler/gnu/8.3.0<br>
module load mpi/openmpi/4.0.1-gnu-8.3.0<br>
module load tools/hdf5/1.10.5-openmpi-4.0.1-gnu-8.3.0<br>
<br>
export DARSHAN_LOGPATH=/lustre/nec/ws2/ws/tuner/logs<br>
<br>
cd /lustre/nec/ws2/tuner/benchmarks/Generators/mkTcTS<br>
<br>
LD_PRELOAD=/lustre/nec/ws2/ws/tuner/darshan-3.1.7-ompi/lib/libdarshan.so<br>
mpirun -n 24 ../../../src/MarDyn config.xml<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
-------------------------------------------------------------<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
I have 2020/5/12 folders under log directory, configuration was successful, I got no error after running script, but there is no trace file (.darshan files)<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
Any idea?</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
Thanks,</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
Ayse<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
<br>
</div>
<div class="x_gmail_default" style="font-family:verdana,sans-serif; color:#000000">
<br>
</div>
</div>
</div>
</body>
</html>