Writing large files from pnetcdf on IBM
Katie Antypas
kantypas at flash.uchicago.edu
Fri Mar 16 13:19:15 CDT 2007
Hi Rob,
I actually was still using CDF-1 format and not passing
NC_64BIT_OFFSET. I thought this would work since there is very little
header information written from define mode for this benchmark.
Regardless, passing NC_64BIT_OFFSET to ncmpi_create allows me to create
files > 2GB. All looks good.
Thanks,
Katie
Robert Latham wrote:
> On Thu, Mar 15, 2007 at 05:57:34PM -0500, Robert Latham wrote:
>
>> On Thu, Mar 15, 2007 at 02:45:31PM -0800, Katie Antypas wrote:
>>
>>> I am trying to write large files >2GB on Bassi (IBM Power5) at NERSC. I
>>> have installed the 1.0.2pre2 version and there is no problem writing
>>> files <2GB, but I can't write any file larger than 2GB. Using the
>>> ncmpidump tool shows 'not a netcdf file'.
>>>
>>> OBJECT_MODE is set to 64 and large file support is enabled.
>>>
>>> I followed this discussion last fall and Rob sent out a patch that fixed
>>> this for John. Did the patch make it into the 1.0.2pre2 release?
>>>
>> This does sound much like John Michalakes's bug. All the fixes I know
>> about are in the pre2 release.
>>
>> Can you send me your src/lib/ncconfig.h file?
>>
>
> Ok, the nccconfig.h file looks just fine: all the sizes are what I'd
> expect to see.
>
> If you are already using the NC_64BIT_OFFSET flag to
> ncmpi_create/nfmpi_create, then the next step would be to see if I can
> reproduce this problem. Are you using a code that I can build/run
> on, say Argonne's BGL ?
>
> ==rob
>
>
More information about the parallel-netcdf
mailing list