Writing large files from pnetcdf on IBM

Katie Antypas kantypas at flash.uchicago.edu
Fri Mar 16 13:19:15 CDT 2007


Hi Rob,

I actually was still using CDF-1 format and not passing 
NC_64BIT_OFFSET.  I thought this would work since there is very little 
header information written from define mode for this benchmark.  
Regardless, passing NC_64BIT_OFFSET to ncmpi_create allows me to create 
files > 2GB.  All looks good.

Thanks,

Katie


Robert Latham wrote:
> On Thu, Mar 15, 2007 at 05:57:34PM -0500, Robert Latham wrote:
>   
>> On Thu, Mar 15, 2007 at 02:45:31PM -0800, Katie Antypas wrote:
>>     
>>> I am trying to write large files >2GB on Bassi (IBM Power5) at NERSC.  I 
>>> have installed the 1.0.2pre2 version and there is no problem writing 
>>> files <2GB, but I can't write any file larger than 2GB.  Using the 
>>> ncmpidump tool shows 'not a netcdf file'.
>>>
>>> OBJECT_MODE is set to 64 and large file support is enabled.
>>>
>>> I followed this discussion last fall and Rob sent out a patch that fixed 
>>> this for John.  Did the patch make it into the 1.0.2pre2 release?
>>>       
>> This does sound much like John Michalakes's bug.  All the fixes I know
>> about are in the pre2 release.  
>>
>> Can you send me your src/lib/ncconfig.h file?
>>     
>
> Ok, the nccconfig.h file looks just fine: all the sizes are what I'd
> expect to see.  
>
> If you are already using the NC_64BIT_OFFSET flag to
> ncmpi_create/nfmpi_create, then the next step would be to see if I can
> reproduce this problem.   Are you using a code that I can build/run
> on, say Argonne's BGL ?  
>
> ==rob
>
>   




More information about the parallel-netcdf mailing list