<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p>Hi Shane,</p>
<p><br>
</p>
<p>I will take a look at the script. <span style="font-size: 12pt;">This seems to be helpful !!!</span><span style="font-size: 12pt;"></span></p>
<p><span style="font-size: 12pt;"><br>
</span></p>
<p><span style="font-size: 12pt;">Thanks,</span></p>
<p><span style="font-size: 12pt;">George</span></p>
</div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Shane Snyder <ssnyder@mcs.anl.gov><br>
<b>Sent:</b> Wednesday, August 22, 2018 10:55:16 AM<br>
<b>To:</b> George Papadimitriou; Harms, Kevin; darshan-users@lists.mcs.anl.gov<br>
<b>Subject:</b> Re: [Darshan-users] darshan-parser output in json format</font>
<div> </div>
</div>
<div>Hi George,<br>
<br>
Adding to Kevin's comment -- we have found the ability to extract Darshan parser output in JSON format to be valuable in a couple of other external projects too, but it is not currently on any development roadmap for integration into Darshan proper. It is something
we can consider in the future though, especially since we are working on other features that will probably make this easier (namely, implementing a Python interface to the darshan-utils library).<br>
<br>
If it's useful in the meantime, I can point you at code from one of our projects (TOKIO) that implements a JSON parser for Darshan logs. TOKIO is a broader project concerned with holistic I/O analysis of HPC systems, and as part of it we have implemented a
number of different Python tools for analyzing different I/O logs (including Darshan), all in the pytokio repo:
<a class="moz-txt-link-freetext" href="https://github.com/NERSC/pytokio">https://github.com/NERSC/pytokio</a>.
<br>
<br>
'bin/cache_darshan.py' is the script that can take a Darshan log file and spit out JSON data for all of the counters, metadata, etc.<br>
<br>
Thanks,<br>
--Shane<br>
<br>
<div class="moz-cite-prefix">On 08/21/2018 06:16 PM, George Papadimitriou wrote:<br>
</div>
<blockquote type="cite" cite="mid:668281767a804a2a809fe455499913a3@ads.isi.edu">
<meta name="Generator" content="Microsoft Exchange Server">
<!-- converted from text --><style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left: #800000 2px solid; } --></style>
<meta content="text/html; charset=UTF-8">
<style type="text/css" style="">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div id="x_divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000;
font-family:Calibri,Helvetica,sans-serif">
<p>Hi Kevin,</p>
<p><span style="font-size:12pt"><br>
</span></p>
<p><span style="font-size:12pt">This is what we are</span><span style="font-size:12pt"> currently doing</span><span style="font-size:12pt">. But I've </span><span style="font-size:12pt">found that parsing the ascii output can be </span><span style="font-size:12pt">a
bit tedious and not an elegant solution to the problem.</span><br>
</p>
<p><br>
</p>
<p>George</p>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Harms, Kevin
<a class="moz-txt-link-rfc2396E" href="mailto:harms@alcf.anl.gov"><harms@alcf.anl.gov></a><br>
<b>Sent:</b> Tuesday, August 21, 2018 3:52:31 PM<br>
<b>To:</b> George Papadimitriou; <a class="moz-txt-link-abbreviated" href="mailto:darshan-users@lists.mcs.anl.gov">
darshan-users@lists.mcs.anl.gov</a><br>
<b>Subject:</b> Re: darshan-parser output in json format</font>
<div> </div>
</div>
</div>
<font size="2"><span style="font-size:10pt;">
<div class="PlainText"><br>
I don't think we have a plan for it right now. I think the easiest method would be to take the ASCII output and convert it to JSON using a separate tool.<br>
<br>
kevin<br>
<br>
________________________________________<br>
From: Darshan-users <a class="moz-txt-link-rfc2396E" href="mailto:darshan-users-bounces@lists.mcs.anl.gov">
<darshan-users-bounces@lists.mcs.anl.gov></a> on behalf of George Papadimitriou <a class="moz-txt-link-rfc2396E" href="mailto:georgpap@isi.edu">
<georgpap@isi.edu></a><br>
Sent: Tuesday, August 21, 2018 12:13:42 PM<br>
To: <a class="moz-txt-link-abbreviated" href="mailto:darshan-users@lists.mcs.anl.gov">
darshan-users@lists.mcs.anl.gov</a><br>
Subject: [Darshan-users] darshan-parser output in json format<br>
<br>
Hello,<br>
<br>
<br>
I'm aware of an open ticket (<a href="https://xgitlab.cels.anl.gov/darshan/darshan/issues/242" moz-do-not-send="true">https://xgitlab.cels.anl.gov/darshan/darshan/issues/242</a>) about having an option in darshan-parser to enable json output.<br>
<br>
Is this feature on darshan-parser's roadmap ?<br>
<br>
<br>
Thanks,<br>
<br>
George<br>
<br>
</div>
</span></font><br>
<fieldset class="mimeAttachmentHeader"></fieldset> <br>
<pre wrap="">_______________________________________________
Darshan-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Darshan-users@lists.mcs.anl.gov">Darshan-users@lists.mcs.anl.gov</a>
<a class="moz-txt-link-freetext" href="https://lists.mcs.anl.gov/mailman/listinfo/darshan-users">https://lists.mcs.anl.gov/mailman/listinfo/darshan-users</a>
</pre>
</blockquote>
<br>
</div>
</body>
</html>