Writing large files from pnetcdf on IBM

Katie Antypas kantypas at flash.uchicago.edu
Thu Mar 15 17:45:31 CDT 2007


Hi All,

I am trying to write large files >2GB on Bassi (IBM Power5) at NERSC.  I 
have installed the 1.0.2pre2 version and there is no problem writing 
files <2GB, but I can't write any file larger than 2GB.  Using the 
ncmpidump tool shows 'not a netcdf file'.

OBJECT_MODE is set to 64 and large file support is enabled.

I followed this discussion last fall and Rob sent out a patch that fixed 
this for John.  Did the patch make it into the 1.0.2pre2 release?

Katie


John Michalakes wrote:
> Hi Robert, I just tried it and it works. Thanks very much! -John
>
>   
>> -----Original Message-----
>> From: Robert Latham [mailto:robl at mcs.anl.gov]
>> Sent: Tuesday, November 28, 2006 3:02 PM
>> To: John Michalakes; parallel-netcdf at mcs.anl.gov
>> Subject: Re: Writing large files from pnetcdf on IBM
>>
>>
>> On Tue, Nov 28, 2006 at 01:33:06PM -0600, Robert Latham wrote:
>>     
>>> Ok, this is good information, especially that the NF_64BIT_OFFSET flag
>>> is not creating CDF-2 files.  I will have to dig into this.  I'll send
>>> an update when I know more...
>>>       
>> As it turns out, John and I have both found the problem.  I introduced
>> this bug while merging in some changes with serial netcdf, and it has
>> remained undetected for some time.  There do not appear to be other bugs of
>> this type from that merge. 
>>
>> The attached patch will fix the problem of not creating CDF-2
>> formatted files.  John, please give it a shot and let me know how the
>> creation of your +2GB data sets works out.
>>
>> Again, thanks for John's bug report and speedy followups.
>>
>> ==rob
>>
>> -- 
>> Rob Latham
>> Mathematics and Computer Science Division    A215 0178 EA2D B059 8CDF
>> Argonne National Lab, IL USA                 B29D F333 664A 4280 315B
>>
>>     




More information about the parallel-netcdf mailing list