pnetcdf test/DRY RUN Error in wrf simulation
BasitAli Khan
BasitAli.Khan at kaust.edu.sa
Thu Jun 5 04:00:06 CDT 2014
Hi Wei-Keng and Rob,
Thanks for the prompt responses. Thanks for spotting snippet from the
wrong file. I get the above mentioned warnings only when i activate
pnetcdf that is io_form_* = 11. If i don't use pnetcdf i.e. io_form_*=2
the wrf sim runs perfect without any warning and/or error.
Sorry, not sure about "WRF_FILE_OPENED_NOT_COMMITTED" as i am not quite
familiar with pnetcdf stuff.
A detailed description of the supercomputing lab(shaheen) is also
available at https://www.hpc.kaust.edu.sa/documentation/user_guide/
Following is the system info + how i compiled wrf, netCDF and pnetCDF
- uname --all
Linux fen1 2.6.16.60-0.97.1-ppc64 #1 SMP Tue May 29 19:21:39 UTC 2012
ppc64 ppc64 ppc64 GNU/Linux
basitali at fen1:~$ lsb_release -a
LSB
Version: core-2.0-noarch:core-3.0-noarch:core-2.0-ppc:core-3.0-ppc:desktop-
3.1-noarch:desktop-3.1-ppc32:graphics-2.0-noarch:graphics-2.0-ppc32:graphic
s-3.1-noarch:graphics-3.1-ppc32
Distributor ID: SUSE LINUX
Description: SUSE Linux Enterprise Server 10 (ppc)
Release: 10
Codename: n/a
- The configure.wrf files is attached that describes the wrf compile setup
- The configure statement for pnetCDF is as follows:
./configure --host powerpc64-bgp-linux --build ppc64-suse-linux
--prefix=/home/basitali/parallel_netCDF
--with-mpi=/bgsys/drivers/ppcfloor/comm/xl MPICC=mpixlc MPICXX=mpixlcxx
MPIF77=mpixlf77 MPIF90=mpixlf90 FFLAGS="-qsuppress=cmpmsg"
FCFLAGS="-qsuppress=cmpmsg"
- The configure statement for netCDF 4.1.2 is as follows:
./configure --prefix=/home/basitali/netCDF_4.1.2 CC="mpixlc -qarch=450d
-qtune=450" CXX="mpixlcxx_r -O3 -qarch=450d -qtune=450" FC="mpixlf90_r -O3
-qarch=450d -qtune=450" F77="mpixlf90_r -O3 -qarch=450d -qtune=450"
CFLAGS="-I/home/basitali/netCDF_4.1.2/include -DIBMR2Fortran
-I/opt/share/zlib/1.2.5/bgp-ibm/include"
LIBS="-L/home/basitali/netCDF_4.1.2/lib
-L/opt/share/zlib/1.2.5/bgp-ibm/lib -lnetcdf -lz -lm" FFLAGS="-g
-I/home/basitali/netCDF_4.1.2/include"
FCFLAGS="-I/home/basitali/netCDF_4.1.2/include -DIBMR2Fortran
-I/opt/share/zlib/1.2.5/bgp-ibm/include"
FLIBS="-L/home/basitali/netCDF_4.1.2/lib -lnetcdff
-L/opt/share/zlib/1.2.5/bgp-ibm/lib -lnetcdf -lz -lm" CXXFLAGS="-qpic
-DIBMR2Fortran -I/home/basitali/netCDF_4.1.2/include
-I/opt/share/zlib/1.2.5/bgp-ibm/include" CPPFLAGS="-qpic -DIBMR2Fortran
-I/home/basitali/netCDF_4.1.2/include
-I/opt/share/zlib/1.2.5/bgp-ibm/include"
--with-zlib=/opt/share/zlib/1.2.5/bgp-ibm --disable-netcdf-4
--enable-pnetcdf --with-pnetcdf=/home/basitali/parallel_netCDF
--disable-dap --disable-shared
uname
- The result of nc-config --all is as follows
--cc -> mpixlc -qarch=450d -qtune=450
--cflags -> -I/home/basitali/netCDF_4.1.2/include
--libs -> -L/home/basitali/netCDF_4.1.2/lib -lnetcdf
--cxx -> mpixlcxx_r -O3 -qarch=450d -qtune=450
--has-c++ -> yes
--fc -> mpixlf90_r -O3 -qarch=450d -qtune=450
--fflags -> -g -I/home/basitali/netCDF_4.1.2/include
-I/home/basitali/netCDF_4.1.2/include
--flibs -> -L/home/basitali/netCDF_4.1.2/lib -lnetcdff -lnetcdf
--has-f77 -> yes
--has-f90 -> yes
--has-dap -> no
--has-nc2 -> yes
--has-nc4 -> no
--has-hdf5 -> no
--has-hdf4 -> no
--has-pnetcdf-> yes
--has-szlib -> no
--prefix -> /home/basitali/netCDF_4.1.2
--includedir-> /home/basitali/netCDF_4.1.2/include
--version -> netCDF 4.1.2
Please have a look. I would greatly appreciate your help and advise in
this regard.
Best regards,
b:)
----
Basit A. Khan, Ph.D.
Postdoctoral Research Fellow
Division of Physical Sciences & Engineering
Office# 3204, Level 3, Building 1,
King Abdullah University of Science & Technology
4700 King Abdullah Blvd, Box 2753, Thuwal 23955 6900,
Kingdom of Saudi Arabia.
Office: +966(0)12 808 0276, Mobile: +966(0)5 0860 3617
E-mail: basitali.khan at kaust.edu.sa
Skype name: basit.a.khan
On 6/4/14 6:54 PM, "Wei-keng Liao" <wkliao at eecs.northwestern.edu> wrote:
>Hi, Basit
>
>The file wrf_io.F90 should be the one in external/io_pnetcdf.
>So the code fragment is like
>
>2399 elseif(DH%FileStatus == WRF_FILE_OPENED_NOT_COMMITTED) then
>2400 do NVar=1,MaxVars
>2401 if(DH%VarNames(NVar) == VarName ) then
>2402 Status = WRF_WARN_2DRYRUNS_1VARIABLE
>2403 write(msg,*) 'Warning 2 DRYRUNS 1 VARIABLE
>(',TRIM(VarName),') in ',__FILE__,', line', __LINE__
>2404 call wrf_debug ( WARN , TRIM(msg))
>2405 return
>2406 elseif(DH%VarNames(NVar) == NO_NAME) then
>
>It looks to me is the file is yet to be closed.
>
>Could you let us know how you build WRF (commands) and the test case (and
>parameters)
>that you run? I may give it a try to see if I can repeat your experiment
>and observe the same errors.
>
>
>Wei-keng
>
>On Jun 4, 2014, at 10:09 AM, BasitAli Khan wrote:
>
>> Hi Rob,
>>
>> Following is the snippet of the subroutine in wrf_io.F90. Actually line
>> 2403 is just a variable declaration.
>>
>>
>> 2380 subroutine
>> ext_ncd_write_field(DataHandle,DateStr,Var,Field,FieldTypeIn, &
>> 2381 Comm, IOComm, DomainDesc, MemoryOrdIn, Stagger, DimNames,
>> &
>> 2382
>> DomainStart,DomainEnd,MemoryStart,MemoryEnd,PatchStart,PatchEnd,Status)
>> 2383 use wrf_data
>> 2384 use ext_ncd_support_routines
>> 2385 implicit none
>> 2386 include 'wrf_status_codes.h'
>> 2387 include 'netcdf.inc'
>> 2388 integer ,intent(in) :: DataHandle
>> 2389 character*(*) ,intent(in) :: DateStr
>> 2390 character*(*) ,intent(in) :: Var
>> 2391 integer ,intent(inout) :: Field(*)
>> 2392 integer ,intent(in) :: FieldTypeIn
>> 2393 integer ,intent(inout) :: Comm
>> 2394 integer ,intent(inout) :: IOComm
>> 2395 integer ,intent(in) :: DomainDesc
>> 2396 character*(*) ,intent(in) :: MemoryOrdIn
>> 2397 character*(*) ,intent(in) :: Stagger ! Dummy
>>for
>> now
>> 2398 character*(*) ,dimension(*) ,intent(in) :: DimNames
>> 2399 integer ,dimension(*) ,intent(in) :: DomainStart,
>> DomainEnd
>> 2400 integer ,dimension(*) ,intent(in) :: MemoryStart,
>> MemoryEnd
>> 2401 integer ,dimension(*) ,intent(in) :: PatchStart,
>> PatchEnd
>> 2402 integer ,intent(out) :: Status
>> 2403 integer :: FieldType
>> 2404 character (3) :: MemoryOrder
>> 2405 type(wrf_data_handle) ,pointer :: DH
>> 2406 integer :: NCID
>> 2407 integer :: NDim
>> 2408 character (VarNameLen) :: VarName
>> 2409 character (3) :: MemO
>> 2410 character (3) :: UCMemO
>> 2411 integer :: VarID
>> 2412 integer ,dimension(NVarDims) :: Length
>> 2413 integer ,dimension(NVarDims) :: VDimIDs
>> 2414 character(80),dimension(NVarDims) :: RODimNames
>> 2415 integer ,dimension(NVarDims) :: StoredStart
>> 2416 integer ,dimension(:,:,:,:),allocatable :: XField
>> 2417 integer :: stat
>> 2418 integer :: NVar
>> 2419 integer :: i,j
>> 2420 integer :: i1,i2,j1,j2,k1,k2
>> 2421 integer :: x1,x2,y1,y2,z1,z2
>> 2422 integer :: l1,l2,m1,m2,n1,n2
>> 2423 integer :: XType
>> 2424 integer :: di
>> 2425 character (80) :: NullName
>> 2426 logical :: NotFound
>> 2427
>>
>>
>>
>>
>>
>>
>>
>> Cheers,
>> b:)
>> ----
>> Basit A. Khan, Ph.D.
>>
>> Postdoctoral Research Fellow
>>
>> Division of Physical Sciences & Engineering
>>
>> Office# 3204, Level 3, Building 1,
>>
>> King Abdullah University of Science & Technology
>>
>> 4700 King Abdullah Blvd, Box 2753, Thuwal 23955 6900,
>>
>> Kingdom of Saudi Arabia.
>>
>>
>>
>> Office: +966(0)12 808 0276, Mobile: +966(0)5 0860 3617
>>
>> E-mail: basitali.khan at kaust.edu.sa
>>
>>
>>
>>
>> Skype name: basit.a.khan
>>
>>
>>
>>
>> On 6/4/14 4:58 PM, "Rob Latham" <robl at mcs.anl.gov> wrote:
>>
>>>
>>>
>>> On 06/04/2014 01:55 AM, BasitAli Khan wrote:
>>>> Hi there,
>>>> I sent you the following email a a weak ago regarding pnetcdf make
>>>> check errors, but did not get response. I used this pnetcdf to
>>>>compile
>>>> netCDF library 4.1.2. The pnetcdf was successfully linked and netCDF
>>>>was
>>>> successfully compiled. I ran a WRF simulation which also was completed
>>>> successfully, however, the log file rsl.out.0000 (attached ) has
>>>>several
>>>> (DRY RUN) errors that are originating from pnetCDF. I am wondering
>>>>what
>>>> these errors are and would they be affecting my simulation in anyway?
>>>>
>>>> Thanks in advance and please do REPLY this email.
>>>
>>> Hello! sorry for the oversight. Here is my (list-only) reply from last
>>> week:
>>>
>>> http://lists.mcs.anl.gov/pipermail/parallel-netcdf/2014-May/001574.html
>>>
>>> Thanks for subscribing to the mailing list.
>>>
>>> There are folks using pnetcdf and WRF on Blue Gene. I don't know the
>>> details, but it apparently is possible. I think we can get you
>>> straightened out.
>>>
>>> When you see errors like this:
>>>
>>> /bin/sh: line 1: 6418 Illegal instruction ./nc_test -c -d .
>>>
>>> it means you are running back-end code on the login nodes. Blue Gene
>>>is
>>> a cross-compile environment: compute node codes cannot run on the login
>>> nodes. (well, technically they can... until they make a system call)
>>>
>>> what does line 2403 of wrf_io.f90 look like?
>>>
>>> ==rob
>>>
>>>
>>> Hi Rob,
>>
>>
>>>>
>>>> Best regards,
>>>> b:)
>>>> ----
>>>>
>>>> Basit A. Khan, Ph.D.
>>>>
>>>> Postdoctoral Research Fellow
>>>>
>>>> Division of Physical Sciences & Engineering
>>>>
>>>> Office# 3204, Level 3, Building 1,
>>>>
>>>> King Abdullah University of Science & Technology
>>>>
>>>> 4700 King Abdullah Blvd, Box 2753, Thuwal 23955 6900,
>>>>
>>>> Kingdom of Saudi Arabia.
>>>>
>>>> Office: +966(0)12 808 0276, Mobile: +966(0)5 0860 3617
>>>>
>>>> E-mail: basitali.khan at kaust.edu.sa <mailto:basitali.khan at kaust.edu.sa>
>>>>
>>>> Skype name: basit.a.khan
>>>>
>>>> From: KAUST <basitali.khan at kaust.edu.sa
>>>> <mailto:basitali.khan at kaust.edu.sa>>
>>>> Date: Wednesday, May 28, 2014 3:05 PM
>>>> To: "parallel-netcdf at mcs.anl.gov <mailto:parallel-netcdf at mcs.anl.gov>"
>>>> <parallel-netcdf at mcs.anl.gov <mailto:parallel-netcdf at mcs.anl.gov>>
>>>> Subject: pnetcdf test
>>>>
>>>> Hi there,
>>>> I am new to pnetcdf. I want to compile it for faster IO of WRF model
>>>>on
>>>> our bluegeneP with Linux RedHat 10 on it. I apparently successfully
>>>> installed the latest version of pnetcdf 1.4.1, however when i run
>>>>'make
>>>> testing', i got few errors (log file attached). I would greatly
>>>> appreciate if you could have a look and advise where i am going wrong.
>>>>
>>>> The compilation of parallel netcdf created 4 directories. The contents
>>>> of these dir are as follows:
>>>>
>>>> /lib/libpnetcdf.a
>>>> /include/pnetcdf.h pnetcdf.inc pnetcdf.mod
>>>> /bin/ncmpidiff ncmpidump ncmpigen ncmpivalid
>>>> /man/man1/ncmpidiff.1 ncmpidump.1 ncmpigen.1 ncmpivalid.1
>>>> /man/man3/pnetcdf.3 pnetcdf_f77.3 pnetcdf_f90.3
>>>>
>>>>
>>>> Another question is that, do i have to do anything special to use it
>>>> with WRF?
>>>>
>>>> Thanks in advance and best regards,
>>>>
>>>>
>>>> b:)
>>>> ----
>>>>
>>>> Basit A. Khan, Ph.D.
>>>>
>>>> Postdoctoral Research Fellow
>>>>
>>>> Division of Physical Sciences & Engineering
>>>>
>>>> Office# 3204, Level 3, Building 1,
>>>>
>>>> King Abdullah University of Science & Technology
>>>>
>>>> 4700 King Abdullah Blvd, Box 2753, Thuwal 23955 6900,
>>>>
>>>> Kingdom of Saudi Arabia.
>>>>
>>>> Office: +966(0)12 808 0276, Mobile: +966(0)5 0860 3617
>>>>
>>>> E-mail: basitali.khan at kaust.edu.sa <mailto:basitali.khan at kaust.edu.sa>
>>>>
>>>> Skype name: basit.a.khan
>>>>
>>>>
>>>>-----------------------------------------------------------------------
>>>>-
>>>>
>>>> This message and its contents including attachments are intended
>>>>solely
>>>> for the original recipient. If you are not the intended recipient or
>>>> have received this message in error, please notify me immediately and
>>>> delete this message from your computer system. Any unauthorized use or
>>>> distribution is prohibited. Please consider the environment before
>>>> printing this email.
>>>
>>> --
>>> Rob Latham
>>> Mathematics and Computer Science Division
>>> Argonne National Lab, IL USA
>>
>>
>> ________________________________
>>
>> This message and its contents including attachments are intended solely
>>for the original recipient. If you are not the intended recipient or
>>have received this message in error, please notify me immediately and
>>delete this message from your computer system. Any unauthorized use or
>>distribution is prohibited. Please consider the environment before
>>printing this email.
>
________________________________
This message and its contents including attachments are intended solely for the original recipient. If you are not the intended recipient or have received this message in error, please notify me immediately and delete this message from your computer system. Any unauthorized use or distribution is prohibited. Please consider the environment before printing this email.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: configure.wrf
Type: application/octet-stream
Size: 20813 bytes
Desc: configure.wrf
URL: <http://lists.mcs.anl.gov/pipermail/parallel-netcdf/attachments/20140605/5416bf9e/attachment-0001.obj>
More information about the parallel-netcdf
mailing list