<div dir="auto">Ok, thank you so much. I try nfs.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, 22 Jun 2021, 2:58 am Phil Carns, <<a href="mailto:carns@mcs.anl.gov">carns@mcs.anl.gov</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

  
  <div>
    <p>Ah, Ok.  This is the problem then.  The log directory has to be
      on a shared file system (e.g. nfs, lustre, etc.) that is visible
      to all nodes.  The log is created and written using collective I/O
      operations, so all of the ranks need to be able to access the same
      file simultaneously.<br>
    </p>
    <p>I'll open a ticket to investigate if there is a way to produce a
      more helpful error message in this case.</p>
    <p>thanks,</p>
    <p>-Phil<br>
    </p>
    <div>On 6/21/21 5:50 PM, Hassan Asghar
      wrote:<br>
    </div>
    <blockquote type="cite">
      
      <div dir="ltr">
        <div class="gmail_default" style="font-family:arial,helvetica,sans-serif;font-size:small">it
          is not shared directory, but i have install the same version
          of darshan on the other nodes as well.</div>
        <div>
          <div dir="ltr" data-smartmail="gmail_signature">
            <div dir="ltr">
              <div dir="ltr">
                <div dir="ltr">
                  <div dir="ltr">
                    <div dir="ltr">
                      <div dir="ltr">
                        <div dir="ltr">
                          <div dir="ltr">
                            <div dir="ltr">
                              <div dir="ltr">
                                <div dir="ltr">
                                  <div dir="ltr">
                                    <div dir="ltr">
                                      <div dir="ltr">
                                        <div dir="ltr">
                                          <div dir="ltr">
                                            <div dir="ltr">
                                              <div dir="ltr">
                                                <div dir="ltr">
                                                  <div dir="ltr">
                                                    <div dir="ltr">
                                                      <div dir="ltr">
                                                        <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div dir="ltr">
                                                          <div>
                                                          <div style="font-size:12.8px;font-family:arial,sans-serif"><br>
                                                          </div>
                                                          <div style="font-size:12.8px;font-family:arial,sans-serif"><br>
                                                          </div>
                                                          <div style="font-size:12.8px;font-family:arial,sans-serif">--</div>
                                                          <div>
                                                          <div><span style="font-family:tahoma;font-size:13.3333px;color:rgb(0,0,0)">Regards,</span>
                                                          <div style="font-family:tahoma;font-size:13.3333px;color:rgb(0,0,0)"> </div>
                                                          <div style="font-family:tahoma;font-size:13.3333px;color:rgb(0,0,0)"><span style="color:rgb(51,0,102)"><b>Hassan Asghar</b></span></div>
                                                          <div style="font-family:tahoma;font-size:13.3333px;color:rgb(0,0,0)"><span style="color:rgb(51,51,102);font-size:13.3333px">MS Computer Science</span></div>
                                                          <div style="font-family:tahoma;font-size:13.3333px;color:rgb(0,0,0)"><span style="color:rgb(51,51,102)">Mobile: +92-321-1741755</span></div>
                                                          <span style="font-family:tahoma;font-size:13.3333px;color:rgb(51,51,102);font-size:13.3333px"></span><span style="color:rgb(0,0,0);font-family:tahoma;font-size:13.3333px;font-size:13.3333px"></span>
                                                          <div><span style="color:rgb(51,51,102);font-family:tahoma;font-size:13.3333px">Personal
                                                          Website: </span><font face="tahoma" color="#333366"><span style="font-size:13.3333px"><a href="http://bit.ly/2OQ0egs" target="_blank" rel="noreferrer">http://bit.ly/2OQ0egs</a></span></font></div>
                                                          <div style="font-family:tahoma;font-size:13.3333px;color:rgb(0,0,0)"><span style="color:rgb(51,51,102);font-size:13.3333px">Google Scholar</span>: <a href="https://bit.ly/3lVYuxF" target="_blank" rel="noreferrer">https://bit.ly/3lVYuxF</a></div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                          </div>
                                                        </div>
                                                      </div>
                                                    </div>
                                                  </div>
                                                </div>
                                              </div>
                                            </div>
                                          </div>
                                        </div>
                                      </div>
                                    </div>
                                  </div>
                                </div>
                              </div>
                            </div>
                          </div>
                        </div>
                      </div>
                    </div>
                  </div>
                </div>
              </div>
            </div>
          </div>
        </div>
        <br>
      </div>
      <br>
      <div class="gmail_quote">
        <div dir="ltr" class="gmail_attr">On Mon, Jun 21, 2021 at 10:30
          PM Phil Carns <<a href="mailto:carns@mcs.anl.gov" target="_blank" rel="noreferrer">carns@mcs.anl.gov</a>> wrote:<br>
        </div>
        <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
          <div>
            <p>Hi Hassan,</p>
            <p>Is /darshan-logs/ a shared directory? <br>
            </p>
            <p>thanks,</p>
            <p>-Phil<br>
            </p>
            <div>On 6/21/21 1:04 PM, Hassan Asghar wrote:<br>
            </div>
            <blockquote type="cite">
              <div dir="auto">Yes, I have set the log path and all
                permission are given when i run program on local machine
                it execute successfully but when i exceute on three
                nodes it show error.</div>
              <br>
              <div class="gmail_quote">
                <div dir="ltr" class="gmail_attr">On Tue, 22 Jun 2021,
                  1:18 am Harms, Kevin, <<a href="mailto:harms@alcf.anl.gov" target="_blank" rel="noreferrer">harms@alcf.anl.gov</a>>
                  wrote:<br>
                </div>
                <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hassan,<br>
                  <br>
                    did you create the  /darshan-logs directory? Looks
                  like it might not be writeable.<br>
                  <br>
                    try: /darshan-logs/2021/6/21<br>
                  <br>
                    if you want to try a quick test, set DARSHAN_LOGFILE
                  to the path/name of the log, like:<br>
                  <br>
                    DARSHAN_LOGFILE=/path/I/can/write/to/logfile.darshan<br>
                  <br>
                  kevin<br>
                  <br>
                  ________________________________________<br>
                  From: Darshan-users <<a href="mailto:darshan-users-bounces@lists.mcs.anl.gov" rel="noreferrer noreferrer" target="_blank">darshan-users-bounces@lists.mcs.anl.gov</a>>
                  on behalf of Hassan Asghar <<a href="mailto:haxxanasghar@gmail.com" rel="noreferrer noreferrer" target="_blank">haxxanasghar@gmail.com</a>><br>
                  Sent: Monday, June 21, 2021 12:35 AM<br>
                  To: <a href="mailto:darshan-users@lists.mcs.anl.gov" rel="noreferrer noreferrer" target="_blank">darshan-users@lists.mcs.anl.gov</a><br>
                  Subject: [Darshan-users] Logs not generated inspite
                  throwing warning message<br>
                  <br>
                  I am running darshan with mpich on a three-node
                  cluster and my job executed successfully but not
                  generated logs. error warning is given below at the
                  end of the execution.<br>
                  <br>
                  [haxxanasghar@gpuserver2 ~]$ mpiexec -n 64 -f
                  machinefile -env LD_PRELOAD /usr/l                   
                                                                       
                                                                       
                                               ocal/lib/libdarshan.so
                  ./MADbench2 640 80 4 8 8 4 4<br>
                  <br>
                  MADbench 2.0 IO-mode<br>
                  no_pe = 64  no_pix = 640  no_bin = 80  no_gang = 4 
                  sblocksize = 8  fblocksize =                         
                                                                       
                                                                       
                                          8  r_mod = 4  w_mod = 4<br>
                  IOMETHOD = POSIX  IOMODE = SYNC  FILETYPE = UNIQUE 
                  REMAP = CUSTOM<br>
                  <br>
                  S_cc         0.02   [      0.02:      0.03]<br>
                  S_bw         0.01   [      0.01:      0.01]<br>
                  S_w          0.03   [      0.03:      0.04]<br>
                            -------<br>
                  S_total      0.07   [      0.07:      0.07]<br>
                  <br>
                  W_cc         0.04   [      0.03:      0.05]<br>
                  W_bw         0.22   [      0.20:      0.23]<br>
                  W_r          0.02   [      0.02:      0.02]<br>
                  W_w          0.01   [      0.01:      0.01]<br>
                            -------<br>
                  W_total      0.28   [      0.28:      0.29]<br>
                  <br>
                  C_cc         0.01   [      0.01:      0.01]<br>
                  C_bw         0.00   [      0.00:      0.00]<br>
                  C_r          0.01   [      0.01:      0.01]<br>
                            -------<br>
                  C_total      0.02   [      0.02:      0.02]<br>
                  <br>
                  <br>
                  dC[0] = 0.00000e+00<br>
                  darshan_library_warning: unable to create log file
                  /darshan-logs/2021/6/21/haxxa                         
                                                                       
                                                                       
                                       
 nas_MADbench2_id29484-29484_6-21-52165-1341319014666854881.darshan_partial.<br>
                  [haxxanasghar@gpuserver2 ~]$<br>
                  <br>
                  <br>
                  --<br>
                  Regards,<br>
                  <br>
                  Hassan Asghar<br>
                  MS Computer Science<br>
                  Mobile: +92-321-1741755<br>
                  Personal Website: <a href="http://bit.ly/2OQ0egs" rel="noreferrer noreferrer noreferrer" target="_blank">http://bit.ly/2OQ0egs</a><br>
                  Google Scholar: <a href="https://bit.ly/3lVYuxF" rel="noreferrer noreferrer noreferrer" target="_blank">https://bit.ly/3lVYuxF</a><br>
                </blockquote>
              </div>
              <br>
              <fieldset></fieldset>
              <pre>_______________________________________________
Darshan-users mailing list
<a href="mailto:Darshan-users@lists.mcs.anl.gov" target="_blank" rel="noreferrer">Darshan-users@lists.mcs.anl.gov</a>
<a href="https://lists.mcs.anl.gov/mailman/listinfo/darshan-users" target="_blank" rel="noreferrer">https://lists.mcs.anl.gov/mailman/listinfo/darshan-users</a>
</pre>
            </blockquote>
          </div>
          _______________________________________________<br>
          Darshan-users mailing list<br>
          <a href="mailto:Darshan-users@lists.mcs.anl.gov" target="_blank" rel="noreferrer">Darshan-users@lists.mcs.anl.gov</a><br>
          <a href="https://lists.mcs.anl.gov/mailman/listinfo/darshan-users" rel="noreferrer noreferrer" target="_blank">https://lists.mcs.anl.gov/mailman/listinfo/darshan-users</a><br>
        </blockquote>
      </div>
    </blockquote>
  </div>

</blockquote></div>