regression harness in pre-release of PnetCDF 1.9.0

Carl Ponder cponder at nvidia.com
Tue Nov 21 01:38:34 CST 2017


*On 11/01/2017 07:04 PM, Wei-keng Liao wrote:*
>
>     We are pleased to announce the preview release of PnetCDF 1.9.0,
>     parallel-netcdf-1.9.0.pre1, is now available for download. We are
>     sincerely soliciting feedbacks from the PnetCDF community for this
>     test release. The tar balls can be downloaded from:
>     http://cucis.ece.northwestern.edu/projects/PnetCDF/download.html
>     Below is a brief list of noticeable changes. 1. PnetCDF has
>     migrated to use automake and libtool. 2. Support shared libraries.
>     (ABI version starts from 1:0:0). 3. NC_MAX_VAR_DIMS, NC_MAX_DIMS,
>     NC_MAX_ATTRS, NC_MAX_VARS have been lift to NC_MAX_INT for all
>     classic formats 4. Improved support for fill mode 5. Support ARM
>     architecture 6. Update UTF8 encoding to use utf8proc v2.1.0 from
>     the Julia Language project 7. Build recipe for Unbuntu 8. Address
>     issues/bugs caused by MPI libraries (OpenMPI an MVAPICH) Please
>     note this is the first release of PnetCDF that officially supports
>     shared libraries. Problems may occur during the building and
>     linking stages. As always, please report problems encountered to
>     this mailing list. Detailed changes made since 1.8.1 are listed in
>     http://trac.mcs.anl.gov/projects/parallel-netcdf/browser/tags/v1-9-0-pre1/sneak_peek
>
A question on the regression-tests: in this pre-release version, I see 
10 regression-tests being reported

    # TOTAL: 1
    # TOTAL: 1
    # TOTAL: 1
    # TOTAL: 1
    # TOTAL: 1
    # TOTAL: 1
    # TOTAL: 0
    # TOTAL: 1
    # TOTAL: 1
    # TOTAL: 1
    # TOTAL: 1

whereas in 1.8.1, there were 86 tests reported:

    *** TESTING C   nc_test for format CDF-1
    *** TESTING C   nc_test for format CDF-2
    *** TESTING C   nc_test for format CDF-5
    *** TESTING C   t_nc for emulating netCDF t_nc                    
    ------ pass
    *** TESTING C   tst_misc for emulating netCDF t_misc              
    ------ pass
    *** TESTING C   tst_norm for emulating netCDF tst_norm            
    ------ pass
    *** TESTING C   tst_small for emulating netCDF tst_small          
    ------ pass
    *** TESTING C   tst_names for emulating netCDF tst_names          
    ------ pass
    *** TESTING C   tst_atts3 for emulating netCDF tst_atts3          
    ------ pass
    *** TESTING C   tst_atts for emulating netCDF tst_atts            
    ------ pass
    *** TESTING C   tst_nofill for fill/nofill modes                  
    ------ pass
    *** TESTING C   pres_temp_4D_wr for writing file                  
    ------ pass
    *** TESTING C   pres_temp_4D_rd for reading file                  
    ------ pass
    *** TESTING C   mcoll_perf for mput/iput APIs                     
    ------ pass
    *** TESTING C   test_bput for bput API                            
    ------ pass
    *** TESTING C   interleaved for writing interleaved fileviews     
    ------ pass
    *** TESTING C   i_varn_int64 for iput/iget varn                   
    ------ pass
    *** TESTING C   flexible_bput for flexible bput_varm              
    ------ pass
    *** TESTING C   wait_after_indep for ncmpi_end_indep_data         
    ------ pass
    *** TESTING C   req_all for NC_REQ_ALL                            
    ------ pass
    *** TESTING C   i_varn_indef for iput/iget varn in define mode    
    ------ pass
    *** TESTING C   bput_varn for bput_varn                           
    ------ pass
    *** TESTING C   column_wise for iput/iget interleaved access      
    ------ pass
    *** TESTING F77 ./mcoll_testf77 for iput API                      
    ------ pass
    *** TESTING F77 ./test_bputf77 for bput_varm_real API             
    ------ pass
    *** TESTING F90 ./mcoll_testf for nf90mpi_iput_var API            
    ------ pass
    *** TESTING F90 ./test_bputf for bput_var                         
    ------ pass
    *** TESTING C   test_inq_format for inquiring CDF file formats    
    ------ pass
    *** TESTING C   cdf_type for CDF-5 type in CDF-1 and 2            
    ------ pass
    *** TESTING C   dim_cdf12 for defining dim in CDF-1/2 format      
    ------ pass
    *** TESTING C   ncmpi_vars_null_stride for NULL stride            
    ------ pass
    *** TESTING C   vectors for put_vara/get_vara                     
    ------ pass
    *** TESTING C   collective_error for collective abort             
    ------ pass
    *** TESTING C   test_varm for get/put varm                        
    ------ pass
    *** TESTING C   alignment_test for alignment                      
    ------ pass
    *** TESTING C   flexible for flexible put and get                 
    ------ pass
    *** TESTING C   flexible2 for flexible APIs                       
    ------ pass
    *** TESTING C   flexible_varm for flexible varm APIs              
    ------ pass
    *** TESTING C   nonblocking for using ncmpi_iput_vara_int()       
    ------ pass
    *** TESTING C   noclobber for NC_NOCLOBBER and NC_EEXIST          
    ------ pass
    *** TESTING C   record for write records in reversed order        
    ------ pass
    *** TESTING C   inq_num_vars for no. record/fixed variables       
    ------ pass
    *** TESTING C   varn_int for ncmpi_put_varn_int_all()             
    ------ pass
    *** TESTING C   modes for file create/open modes
    *** TESTING C   one_record for only one record variable           
    ------ pass
    *** TESTING C   inq_recsize for inquiring record size             
    ------ pass
    *** TESTING C   test_vard for flexible put and get                
    ------ pass
    *** TESTING C   varn_contig for put_varn with contig fileview     
    ------ pass
    *** TESTING C   ivarn for ncmpi_iput_varn_<type>()                
    ------ pass
    *** TESTING C   check_striping for strining info                  
    ------ pass
    *** TESTING C   add_var for checking offsets of new variables     
    ------ pass
    *** TESTING C   buftype_free for free buftype in flexible API     
    ------ pass
    *** TESTING C   last_large_var for last large var in CDF-1/2      
    ------ pass
    *** TESTING C   check_type for checking for type conflict         
    ------ pass
    *** TESTING C   test_erange for checking for NC_ERANGE            
    ------ pass
    *** TESTING C   scalar for get/put scalar variables               
    ------ pass
    *** TESTING C   redef1 for entering re-define mode                
    ------ pass
    *** TESTING F77 ./varn_intf for varn API                          
    ------ pass
    *** TESTING F77 ./attrf for attribute overflow                    
    ------ pass
    *** TESTING F77 ./buftype_freef for flexible API                  
    ------ pass
    *** TESTING F77 ./put_parameter for using immutable write buf     
    ------ pass
    *** TESTING F77 ./test_vardf for vard API                         
    ------ pass
    *** TESTING F90 ./inq_num_varsf for no. record/fixed variables    
    ------ pass
    *** TESTING F90 ./inq_recsizef for inquiring record size          
    ------ pass
    *** TESTING F90 ./test_vardf90 for vard API                       
    ------ pass
    *** TESTING F90 ./varn_real for varn API                          
    ------ pass
    *** TESTING C   erange_fill for checking for type conflict        
    ------ pass
    *** TESTING C   redef1 for entering re-define mode                
    ------ pass
    *** TESTING C++ nctst for APIs with different netCDF formats      
    ------ pass
    *** TESTING C++ test_classic for creation of classic format file  
    ------ pass
    *** TESTING F77 ./nf_test for CDF-1                               
    ------ pass
    *** TESTING F77 ./nf_test for CDF-2                               
    ------ pass
    *** TESTING F77 ./nf_test for CDF-5                               
    ------ pass
    *** TESTING F90 ./nf90_test for CDF-1                             
    ------ pass
    *** TESTING F90 ./nf90_test for CDF-2                             
    ------ pass
    *** TESTING F90 ./nf90_test for CDF-5                             
    ------ pass
    *** TESTING F90 ./test_intent for INTENT modifier                 
    ------ pass
    *** TESTING F90 ./tst_f90                                         
    ------ pass
    *** TESTING F90 ./f90tst_vars for def_var API                     
    ------ pass
    *** TESTING F90 ./tst_types2 for 64-bit integer types             
    ------ pass
    *** TESTING F90 ./tst_f90_cdf5                                    
    ------ pass
    *** TESTING F90 ./f90tst_vars2 for def_var API                    
    ------ pass
    *** TESTING F90 ./f90tst_vars3 for def_var API                    
    ------ pass
    *** TESTING F90 ./f90tst_vars4 for def_var API                    
    ------ pass
    *** TESTING F90 ./tst_flarge for large files                      
    ------ pass
    *** TESTING F90 ./tst_io                                          
    ------ pass

In the 1.9.0 list, are you aggregating the the results of more than one 
test in the 1-total's?
For example, it looks like you're compiling several tests here but 
running a single driver, and reporting it as a single test:

    Making check in cdf_format
    make[2]: Entering directory
    `/cm/extra/apps/PNetCDF/1.9.0.pre1/PGI-17.10_OpenMPI-1.10.7_CUDA-9.0.176_Power/distro/test/cdf_format'
    make  test_inq_format cdf_type dim_cdf12 tst_open_cdf5 tst_corrupt
    make[3]: Entering directory
    `/cm/extra/apps/PNetCDF/1.9.0.pre1/PGI-17.10_OpenMPI-1.10.7_CUDA-9.0.176_Power/distro/test/cdf_format'
       CC       test_inq_format.o
       CCLD     test_inq_format
       CC       cdf_type.o
       CCLD     cdf_type
       CC       dim_cdf12.o
       CCLD     dim_cdf12
       CC       tst_open_cdf5.o
       CCLD     tst_open_cdf5
       CC       tst_corrupt.o
       CCLD     tst_corrupt
    make[3]: Leaving directory
    `/cm/extra/apps/PNetCDF/1.9.0.pre1/PGI-17.10_OpenMPI-1.10.7_CUDA-9.0.176_Power/distro/test/cdf_format'
    make  check-TESTS
    make[3]: Entering directory
    `/cm/extra/apps/PNetCDF/1.9.0.pre1/PGI-17.10_OpenMPI-1.10.7_CUDA-9.0.176_Power/distro/test/cdf_format'
    make[4]: Entering directory
    `/cm/extra/apps/PNetCDF/1.9.0.pre1/PGI-17.10_OpenMPI-1.10.7_CUDA-9.0.176_Power/distro/test/cdf_format'
    PASS: seq_runs.sh
    ============================================================================
    Testsuite summary for parallel-netcdf 1.9.0.pre1
    ============================================================================
    # TOTAL: 1
    # PASS:  1
    # SKIP:  0
    # XFAIL: 0
    # FAIL:  0
    # XPASS: 0
    # ERROR: 0
    ============================================================================

This would make it difficult to identify any single failures.


-----------------------------------------------------------------------------------
This email message is for the sole use of the intended recipient(s) and may contain
confidential information.  Any unauthorized review, use, disclosure or distribution
is prohibited.  If you are not the intended recipient, please contact the sender by
reply email and destroy all copies of the original message.
-----------------------------------------------------------------------------------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/parallel-netcdf/attachments/20171121/cb86d55d/attachment.html>


More information about the parallel-netcdf mailing list