Writing large files from pnetcdf on IBM
Katie Antypas
kantypas at flash.uchicago.edu
Thu Mar 15 17:45:31 CDT 2007
Hi All,
I am trying to write large files >2GB on Bassi (IBM Power5) at NERSC. I
have installed the 1.0.2pre2 version and there is no problem writing
files <2GB, but I can't write any file larger than 2GB. Using the
ncmpidump tool shows 'not a netcdf file'.
OBJECT_MODE is set to 64 and large file support is enabled.
I followed this discussion last fall and Rob sent out a patch that fixed
this for John. Did the patch make it into the 1.0.2pre2 release?
Katie
John Michalakes wrote:
> Hi Robert, I just tried it and it works. Thanks very much! -John
>
>
>> -----Original Message-----
>> From: Robert Latham [mailto:robl at mcs.anl.gov]
>> Sent: Tuesday, November 28, 2006 3:02 PM
>> To: John Michalakes; parallel-netcdf at mcs.anl.gov
>> Subject: Re: Writing large files from pnetcdf on IBM
>>
>>
>> On Tue, Nov 28, 2006 at 01:33:06PM -0600, Robert Latham wrote:
>>
>>> Ok, this is good information, especially that the NF_64BIT_OFFSET flag
>>> is not creating CDF-2 files. I will have to dig into this. I'll send
>>> an update when I know more...
>>>
>> As it turns out, John and I have both found the problem. I introduced
>> this bug while merging in some changes with serial netcdf, and it has
>> remained undetected for some time. There do not appear to be other bugs of
>> this type from that merge.
>>
>> The attached patch will fix the problem of not creating CDF-2
>> formatted files. John, please give it a shot and let me know how the
>> creation of your +2GB data sets works out.
>>
>> Again, thanks for John's bug report and speedy followups.
>>
>> ==rob
>>
>> --
>> Rob Latham
>> Mathematics and Computer Science Division A215 0178 EA2D B059 8CDF
>> Argonne National Lab, IL USA B29D F333 664A 4280 315B
>>
>>
More information about the parallel-netcdf
mailing list