[MOAB-dev] data compression for moab native file format

Jason Kraftcheck kraftche at cae.wisc.edu
Tue Oct 6 12:42:30 CDT 2009


Lukasz Kaczmarczyk wrote:
> Hello,
> 
> Do You consider to implementation data compression ( f.e. SZIP ), it
> could save a lot if time for writing and reading. I have not try how
> data compression work HDF5 by myself, however my friend have very good
> experience with that.
> 

It would be trivial to add support for szip compression, but we do not do so
because a) the only time the file I/O speed is a significant factor is in
parallel, and the HDF5 library doesn't support writing compressed files in
parallel and b) the szip code is non-free.  Why are you interested in using
SZIP compression?  Do you have a problem where the I/O time is a significant
issue?

- jason


More information about the moab-dev mailing list