<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Hi George,<br>
<br>
Adding to Kevin's comment -- we have found the ability to extract
Darshan parser output in JSON format to be valuable in a couple of
other external projects too, but it is not currently on any
development roadmap for integration into Darshan proper. It is
something we can consider in the future though, especially since we
are working on other features that will probably make this easier
(namely, implementing a Python interface to the darshan-utils
library).<br>
<br>
If it's useful in the meantime, I can point you at code from one of
our projects (TOKIO) that implements a JSON parser for Darshan logs.
TOKIO is a broader project concerned with holistic I/O analysis of
HPC systems, and as part of it we have implemented a number of
different Python tools for analyzing different I/O logs (including
Darshan), all in the pytokio repo: <a class="moz-txt-link-freetext" href="https://github.com/NERSC/pytokio">https://github.com/NERSC/pytokio</a>.
<br>
<br>
'bin/cache_darshan.py' is the script that can take a Darshan log
file and spit out JSON data for all of the counters, metadata, etc.<br>
<br>
Thanks,<br>
--Shane<br>
<br>
<div class="moz-cite-prefix">On 08/21/2018 06:16 PM, George
Papadimitriou wrote:<br>
</div>
<blockquote type="cite"
cite="mid:668281767a804a2a809fe455499913a3@ads.isi.edu">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<meta name="Generator" content="Microsoft Exchange Server">
<!-- converted from text -->
<style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left: #800000 2px solid; } --></style>
<meta content="text/html; charset=UTF-8">
<style type="text/css" style="">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div id="x_divtagdefaultwrapper" dir="ltr"
style="font-size:12pt; color:#000000;
font-family:Calibri,Helvetica,sans-serif">
<p>Hi Kevin,</p>
<p><span style="font-size:12pt"><br>
</span></p>
<p><span style="font-size:12pt">This is what we are</span><span
style="font-size:12pt"> currently doing</span><span
style="font-size:12pt">. But I've </span><span
style="font-size:12pt">found that parsing the ascii output
can be </span><span style="font-size:12pt">a bit tedious
and not an elegant solution to the problem.</span><br>
</p>
<p><br>
</p>
<p>George</p>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font style="font-size:11pt"
face="Calibri, sans-serif" color="#000000"><b>From:</b>
Harms, Kevin <a class="moz-txt-link-rfc2396E" href="mailto:harms@alcf.anl.gov"><harms@alcf.anl.gov></a><br>
<b>Sent:</b> Tuesday, August 21, 2018 3:52:31 PM<br>
<b>To:</b> George Papadimitriou;
<a class="moz-txt-link-abbreviated" href="mailto:darshan-users@lists.mcs.anl.gov">darshan-users@lists.mcs.anl.gov</a><br>
<b>Subject:</b> Re: darshan-parser output in json format</font>
<div> </div>
</div>
</div>
<font size="2"><span style="font-size:10pt;">
<div class="PlainText"><br>
I don't think we have a plan for it right now. I think the
easiest method would be to take the ASCII output and convert
it to JSON using a separate tool.<br>
<br>
kevin<br>
<br>
________________________________________<br>
From: Darshan-users
<a class="moz-txt-link-rfc2396E" href="mailto:darshan-users-bounces@lists.mcs.anl.gov"><darshan-users-bounces@lists.mcs.anl.gov></a> on behalf of
George Papadimitriou <a class="moz-txt-link-rfc2396E" href="mailto:georgpap@isi.edu"><georgpap@isi.edu></a><br>
Sent: Tuesday, August 21, 2018 12:13:42 PM<br>
To: <a class="moz-txt-link-abbreviated" href="mailto:darshan-users@lists.mcs.anl.gov">darshan-users@lists.mcs.anl.gov</a><br>
Subject: [Darshan-users] darshan-parser output in json
format<br>
<br>
Hello,<br>
<br>
<br>
I'm aware of an open ticket (<a
href="https://xgitlab.cels.anl.gov/darshan/darshan/issues/242"
moz-do-not-send="true">https://xgitlab.cels.anl.gov/darshan/darshan/issues/242</a>)
about having an option in darshan-parser to enable json
output.<br>
<br>
Is this feature on darshan-parser's roadmap ?<br>
<br>
<br>
Thanks,<br>
<br>
George<br>
<br>
</div>
</span></font>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Darshan-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Darshan-users@lists.mcs.anl.gov">Darshan-users@lists.mcs.anl.gov</a>
<a class="moz-txt-link-freetext" href="https://lists.mcs.anl.gov/mailman/listinfo/darshan-users">https://lists.mcs.anl.gov/mailman/listinfo/darshan-users</a>
</pre>
</blockquote>
<br>
</body>
</html>