[petsc-dev] [Radev, Martin] Re: Adding a new encoding for FP data

[Jed Brown]

Zstd is a remarkably good compressor.  I've experimented with it for
compressing column indices for sparse matrices on structured grids and
(after a simple transform: subtracting the row number) gotten
decompression speed in the neighborhood of 10 GB/s (i.e., faster per
core than DRAM).  I've been meaning to follow up.  The transformation
described below (splitting the bytes) is yielding decompression speed
around 1GB/s (in this link below), which isn't competitive for things
like MatMult, but could be useful for things like trajectory
checkpointing.

https://drive.google.com/file/d/1wfLQyO2G5nofYFkS7pVbUW0-oJkQqBvv/view

-------------- next part --------------
An embedded message was scrubbed...
From: "Radev\, Martin" <martin.radev at tum.de>
Subject: Re: Adding a new encoding for FP data
Date: Thu, 11 Jul 2019 09:55:03 +0000
Size: 9377
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20190711/6b18800c/attachment.mht>