chunking in pnetcdf

[Jim Edwards]

We on the parallel-io project http://code.google.com/p/parallelio/
are currently adding a parallel data compression mechanism
called vdc that works with pnetcdf.    We expect the first version of this
to be available in the next month or so.

Jim

On Thu, May 17, 2012 at 9:02 AM, Rob Latham <robl at mcs.anl.gov> wrote:

> On Thu, May 17, 2012 at 10:40:32AM -0400, Kristopher Bedka wrote:
> > In Netcdf 4.1, I've used functions nf_def_var_chunking and
> > nf_def_var_deflate to internally compress the files I'm creating.
> > I'm not finding these functions within pnetcdf.  Does anyone have a
> > suggestion on how to mimic this Netcdf 4.1 capability in pnetcdf?
>
> As Jim says, there's no netcdf chunking.
>
> Several research groups have been looking at compression in pnetcdf,
> with promising results, but we're a bit away from making those
> research efforts production-ready.
>
> ==rob
>
> --
> Rob Latham
> Mathematics and Computer Science Division
> Argonne National Lab, IL USA
>



-- 

Jim Edwards
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/parallel-netcdf/attachments/20120517/3f094ee3/attachment.htm>