<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
That's right. That particular code has moved around a bit over the years to accommodate refactoring (particularly in the 2.x to 3.x transition), but it hasn't fundamentally changed in a long time as far as I'm aware.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
There is actually a brief mention of what's going on in that path in a 2009 workshop paper:
<a href="https://www.mcs.anl.gov/uploads/cels/papers/P1660.pdf">https://www.mcs.anl.gov/uploads/cels/papers/P1660.pdf</a> (look for the part about tsearch).</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
thanks,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
-Phil<br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Markomanolis, George <markomanolig@ornl.gov><br>
<b>Sent:</b> Tuesday, July 28, 2020 9:37 AM<br>
<b>To:</b> Carns, Philip H. <carns@mcs.anl.gov>; darshan-users@lists.mcs.anl.gov <darshan-users@lists.mcs.anl.gov><br>
<b>Subject:</b> Re: [EXTERNAL] Re: Darshan error on Cray system with static compilation</font>
<div> </div>
</div>
<style>
<!--
@font-face
{font-family:"Cambria Math"}
@font-face
{font-family:Calibri}
p.x_MsoNormal, li.x_MsoNormal, div.x_MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif}
p.x_xmsonormal, li.x_xmsonormal, div.x_xmsonormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif}
span.x_EmailStyle21
{font-family:"Calibri",sans-serif;
color:windowtext}
.x_MsoChpDefault
{font-size:10.0pt}
@page WordSection1
{margin:1.0in 1.0in 1.0in 1.0in}
div.x_WordSection1
{}
-->
</style>
<div lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="x_WordSection1">
<p class="x_MsoNormal">Hi Phil,</p>
<p class="x_MsoNormal"> </p>
<p class="x_MsoNormal">Thanks for the answer. I assume this code is there for ages, right? Because they asked me if they should try a previous version and I was not so excited about that but better ask you if it is something new but from your words, I understand
that it’s not.</p>
<p class="x_MsoNormal"> </p>
<p class="x_MsoNormal">Regards,</p>
<p class="x_MsoNormal">George</p>
<p class="x_MsoNormal"> </p>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_MsoNormal"><b><span style="font-size:12.0pt; color:black">From: </span>
</b><span style="font-size:12.0pt; color:black">"Carns, Philip H." <carns@mcs.anl.gov><br>
<b>Date: </b>Saturday, July 25, 2020 at 2:24 PM<br>
<b>To: </b>"Markomanolis, George" <markomanolig@ornl.gov>, "darshan-users@lists.mcs.anl.gov" <darshan-users@lists.mcs.anl.gov><br>
<b>Subject: </b>[EXTERNAL] Re: Darshan error on Cray system with static compilation</span></p>
</div>
<div>
<p class="x_MsoNormal"> </p>
</div>
<div>
<p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black">Hi George,</span></p>
</div>
<div>
<p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p>
</div>
<div>
<p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black">We've ever seen that assertion triggered before as far as I know (it's just defensive programming, not something that is supposed to happen). It indicates that Darshan
observed inconsistent results out of a binary search tree; possibly brought on by a memory corruption of some sort?</span></p>
</div>
<div>
<p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p>
</div>
<div>
<p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black">Unfortunately I'm not sure what to suggest on this one; we might need more information or a reproducer.</span></p>
</div>
<div>
<p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p>
</div>
<div>
<p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black">The application might have an I/O workload that triggers a buggy code path in Darshan. It's also plausible that there is a memory corruption outside of Darshan (in
the application or another library) that is just impacting that Darshan data structure by chance.</span></p>
</div>
<div>
<p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p>
</div>
<div>
<p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black">-Phil</span></p>
</div>
<div>
<p class="x_MsoNormal" style="background:white"><span style="font-size:12.0pt; color:black"> </span></p>
</div>
<div class="x_MsoNormal" align="center" style="text-align:center">
<hr size="0" width="100%" align="center">
</div>
<div id="x_divRplyFwdMsg">
<p class="x_MsoNormal"><b><span style="color:black">From:</span></b><span style="color:black"> Darshan-users <darshan-users-bounces@lists.mcs.anl.gov> on behalf of Markomanolis, George <markomanolig@ornl.gov><br>
<b>Sent:</b> Thursday, July 23, 2020 2:36 PM<br>
<b>To:</b> darshan-users@lists.mcs.anl.gov <darshan-users@lists.mcs.anl.gov><br>
<b>Subject:</b> [Darshan-users] Darshan error on Cray system with static compilation</span>
</p>
<div>
<p class="x_MsoNormal"> </p>
</div>
</div>
<div>
<div>
<p class="x_xmsonormal">Hi,</p>
<p class="x_xmsonormal"> </p>
<p class="x_xmsonormal">I just send an error that we can’t reproduce, it happens sometimes and it is on a system that I don’t even have access but they informed me about this error:</p>
<p class="x_xmsonormal"> </p>
<p class="x_xmsonormal">fms_MOM6_SIS2_compile.x: lib/darshan-common.c:262: darshan_track_common_val_counters: Assertion `found == counter' failed. forrtl: error (76): Abort trap signal Image PC Routine Line Source</p>
<p class="x_xmsonormal"> </p>
<p class="x_xmsonormal">This is a Cray system with static compilation. This error kills the application. Do you have any idea or it is difficult with so minimal information?</p>
<p class="x_xmsonormal"> </p>
<p class="x_xmsonormal">Regards,</p>
<p class="x_xmsonormal">George</p>
<p class="x_xmsonormal"> </p>
</div>
</div>
</div>
</div>
</body>
</html>