[Darshan-users] Darshan-users Digest, Vol 58, Issue 3

[Casmira, Jason P]

This helps a lot.   Thanks very much.
Caz.

-----Original Message-----
From: darshan-users-bounces at lists.mcs.anl.gov [mailto:darshan-users-bounces at lists.mcs.anl.gov] On Behalf Of darshan-users-request at lists.mcs.anl.gov
Sent: Saturday, July 09, 2016 10:00 AM
To: darshan-users at lists.mcs.anl.gov
Subject: Darshan-users Digest, Vol 58, Issue 3

Send Darshan-users mailing list submissions to
	darshan-users at lists.mcs.anl.gov

To subscribe or unsubscribe via the World Wide Web, visit
	https://lists.mcs.anl.gov/mailman/listinfo/darshan-users
or, via email, send a message with subject or body 'help' to
	darshan-users-request at lists.mcs.anl.gov

You can reach the person managing the list at
	darshan-users-owner at lists.mcs.anl.gov

When replying, please edit your Subject line so it is more specific than "Re: Contents of Darshan-users digest..."


Today's Topics:

   1. Re: Q about darshan-analyzer and ranks (Shane Snyder)


----------------------------------------------------------------------

Message: 1
Date: Fri, 8 Jul 2016 12:49:58 -0500
From: Shane Snyder <ssnyder at mcs.anl.gov>
To: <darshan-users at lists.mcs.anl.gov>
Subject: Re: [Darshan-users] Q about darshan-analyzer and ranks
Message-ID: <577FE7C6.3070102 at mcs.anl.gov>
Content-Type: text/plain; charset="windows-1252"; Format="flowed"

Hi Caz,

Not silly at all, that is a little confusing :)

In 2.x versions of Darshan, 'multi' would indicate that a given Darshan log contained file records that were not opened collectively (across all ranks, denoted by rank == -1). 'single' would indicate that a log contained file records that were opened collectively across all ranks. I
*think* the thought process for naming that way is that files which are accessed by all ranks have a *single* record, whereas applications which open independent files on each process have *multiple* file records.

At any rate, in newer versions of Darshan (>=3.0.0), the wording has been changed to be more clear. We use 'shared' to denote applications which used a single, shared file for I/O (i.e., single=>shared) and we use 'fpp' (file-per-process) to indicate logs which have files that were opened independently by a certain process (i.e., multi=>fpp).

Also, note that a given log file can be viewed as both single/shared and multi/fpp by darshan-analyzer. Any log that has a shared file record in it will be classified as single/shared and similarly any log with a file that was accessed by either a single rank or a subset of ranks will be classified as multi/fpp. The tool is just meant to give a general overview of the type of access patterns a directory of logs used.

--Shane

On 07/08/2016 11:47 AM, Casmira, Jason P wrote:
>
> Hello.
>
> Hopefully this isn?t too silly of a question.
>
> I see this code in darshan-analyzer.c:
>
>         if (cp_file.rank == -1)
>
>             *used_single = 1;
>
>         else
>
>             *used_multi = 1;
>
> But from darshan_parser.c:
>
>         printf("\n# description of columns:\n");
>
>         printf("#   <rank>: MPI rank.  -1 indicates that the file is 
> shared\n");
>
>         printf("#      across all processes and statistics are 
> aggregated.\n");
>
> It?s not clear to me how to interpret darshan_analyzer?s use of the 
> rank field.
>
> Intuitively I?m thinking it would be the opposite (-1 == shared == 
> multi), so I think
>
> I?m missing something fundamental here, and I hope someone can clarify 
> for me.
>
> I tried searching on ?rank? and ?darshan-analyzer? but couldn?t find 
> an answer.
>
> Thanks.
>
> Caz.
>
> Jason Casmira
>
> Intel Corporation
>
> 503.712.5610
>
>
>
> _______________________________________________
> Darshan-users mailing list
> Darshan-users at lists.mcs.anl.gov
> https://lists.mcs.anl.gov/mailman/listinfo/darshan-users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/darshan-users/attachments/20160708/5545ecae/attachment-0001.html>

------------------------------

_______________________________________________
Darshan-users mailing list
Darshan-users at lists.mcs.anl.gov
https://lists.mcs.anl.gov/mailman/listinfo/darshan-users


End of Darshan-users Digest, Vol 58, Issue 3
********************************************