[Darshan-users] dxt_analyzer.py: 'invalid continuation byte' error

[Omlin Samuel]

Hi Phil,


thanks a lot. You can find the file attached.


Cheers,


Sam

________________________________
From: Carns, Philip H. <carns at mcs.anl.gov>
Sent: Friday, October 9, 2020 10:37:41 PM
To: Omlin Samuel; darshan-users at lists.mcs.anl.gov
Subject: Re: [Darshan-users] dxt_analyzer.py: 'invalid continuation byte' error

Hi Sam,

I'm not sure off hand what would cause that.  Can you share the log file by any chance (you can send it to me directly if you would prefer not to post it on the mailing list)?  I can try to reproduce on some other systems and see if that narrows down the problem.

thanks,
-Phil
________________________________
From: Darshan-users <darshan-users-bounces at lists.mcs.anl.gov> on behalf of Omlin Samuel <omlin at cscs.ch>
Sent: Friday, October 9, 2020 10:18 AM
To: darshan-users at lists.mcs.anl.gov <darshan-users at lists.mcs.anl.gov>
Subject: [Darshan-users] dxt_analyzer.py: 'invalid continuation byte' error

Hi all,

I have tried the following command both on Ubuntu 16.04 (python 3.5) and on SUSE Linux Enterprise Server 15 SP1 (python 3.6) and got the same error:
```
$ python3 /usr/local/bin/dxt_analyzer.py -i omlins_a.out_id1174947_10-9-40448-1694713884344482404_1602235659.darshan
Traceback (most recent call last):
  File "/usr/local/bin/dxt_analyzer.py", line 264, in <module>
    for line in infile:
  File "/usr/lib/python3.5/codecs.py", line 321, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe6 in position 24: invalid continuation byte
```

With python 2.7.12 (on Ubuntu), I did not get the error, but the generated plot was empty.

Note that the input file does contain values generated by DXT:
```
$ darshan-dxt-parser omlins_a.out_id1174947_10-9-40448-1694713884344482404_1602235659.darshan | tail -3
 X_POSIX       7   read      197    211527180650      1073741824    804.8381    806.1340  [  0]
 X_POSIX       7   read      198    212600922683      1073741824    806.4404    807.7277  [  0]
 X_POSIX       7   read      199    213674664716      1073741824    808.0719    809.3472  [  0]
```

Can you fix this / help me to get this working?

Thanks!!

Sam




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/darshan-users/attachments/20201012/e662462b/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: omlins_a.out_id1174947_10-9-40448-1694713884344482404_1602235659.darshan
Type: application/octet-stream
Size: 59550 bytes
Desc: omlins_a.out_id1174947_10-9-40448-1694713884344482404_1602235659.darshan
URL: <http://lists.mcs.anl.gov/pipermail/darshan-users/attachments/20201012/e662462b/attachment-0001.obj>