We on the parallel-io project <a href="http://code.google.com/p/parallelio/">http://code.google.com/p/parallelio/</a><br>are currently adding a parallel data compression mechanism <br>called vdc that works with pnetcdf. We expect the first version of this to be available in the next month or so. <br>
<br>Jim<br><br><div class="gmail_quote">On Thu, May 17, 2012 at 9:02 AM, Rob Latham <span dir="ltr"><<a href="mailto:robl@mcs.anl.gov" target="_blank">robl@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="im">On Thu, May 17, 2012 at 10:40:32AM -0400, Kristopher Bedka wrote:<br>
> In Netcdf 4.1, I've used functions nf_def_var_chunking and<br>
> nf_def_var_deflate to internally compress the files I'm creating.<br>
> I'm not finding these functions within pnetcdf. Does anyone have a<br>
> suggestion on how to mimic this Netcdf 4.1 capability in pnetcdf?<br>
<br>
</div>As Jim says, there's no netcdf chunking.<br>
<br>
Several research groups have been looking at compression in pnetcdf,<br>
with promising results, but we're a bit away from making those<br>
research efforts production-ready.<br>
<span class="HOEnZb"><font color="#888888"><br>
==rob<br>
<br>
--<br>
Rob Latham<br>
Mathematics and Computer Science Division<br>
Argonne National Lab, IL USA<br>
</font></span></blockquote></div><br><br clear="all"><br>-- <br><pre>Jim Edwards<br><br><br></pre><br>