[MOAB-dev] data compression for moab native file format
Jason Kraftcheck
kraftche at cae.wisc.edu
Tue Oct 6 12:42:30 CDT 2009
Lukasz Kaczmarczyk wrote:
> Hello,
>
> Do You consider to implementation data compression ( f.e. SZIP ), it
> could save a lot if time for writing and reading. I have not try how
> data compression work HDF5 by myself, however my friend have very good
> experience with that.
>
It would be trivial to add support for szip compression, but we do not do so
because a) the only time the file I/O speed is a significant factor is in
parallel, and the HDF5 library doesn't support writing compressed files in
parallel and b) the szip code is non-free. Why are you interested in using
SZIP compression? Do you have a problem where the I/O time is a significant
issue?
- jason
More information about the moab-dev
mailing list