make test

[Yixun Liu]

I run it on my computer.

md[/home/scratch/yixun/petsc-3.0.0-p3/src/ksp/ksp/examples/tutorials>make
ex2

mpicc -o ex2.o -c -Wall -Wwrite-strings -Wno-strict-aliasing -g3
-I/home/scratch/yixun/petsc-3.0.0-p3/src/dm/mesh/sieve
-I/home/scratch/yixun/petsc-3.0.0-p3/linux-gnu-c-debug/include
-I/home/scratch/yixun/petsc-3.0.0-p3/include
-I/usr/lib64/mpi/gcc/openmpi/include -I/usr/lib64/mpi/gcc/openmpi/lib64
-D__SDIR__="src/ksp/ksp/examples/tutorials/" ex2.c
mpicc -Wall -Wwrite-strings -Wno-strict-aliasing -g3 -o ex2 ex2.o
-Wl,-rpath,/home/scratch/yixun/petsc-3.0.0-p3/linux-gnu-c-debug/lib
-L/home/scratch/yixun/petsc-3.0.0-p3/linux-gnu-c-debug/lib -lpetscksp
-lpetscdm -lpetscmat -lpetscvec -lpetsc -lX11 -llapack -lblas
-L/usr/lib64/mpi/gcc/openmpi/lib64
-L/usr/lib64/gcc/x86_64-suse-linux/4.3 -L/usr/lib64 -L/lib64
-L/usr/x86_64-suse-linux/lib -ldl -lmpi -lopen-rte -lopen-pal -lnsl
-lutil -lgcc_s -lpthread -lmpi_f90 -lmpi_f77 -lgfortranbegin -lgfortran
-lm -lm -L/usr/lib64/gcc/x86_64-suse-linux -L/usr/x86_64-suse-linux/bin
-L/lib -lm -lm -ldl -lmpi -lopen-rte -lopen-pal -lnsl -lutil -lgcc_s
-lpthread -ldl
/bin/rm -f ex2.o



md[/home/scratch/yixun/petsc-3.0.0-p3/src/ksp/ksp/examples/tutorials>mpiexec
-n 2 ./ex2

DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
dat_registry_add_provider
DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
dat_registry_add_provider
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-cma"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-cma-1"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
dat_registry_add_provider
DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
dat_registry_add_provider
DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
dat_registry_add_provider
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-mthca0-1"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-mthca0-2"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-mlx4_0-1"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
dat_registry_add_provider
DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
dat_registry_add_provider
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-mlx4_0-2"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-iwarp"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
[0,1,0]: uDAPL on host md was unable to find any NICs.
Another transport will be used instead, although this may result in
lower performance.
--------------------------------------------------------------------------
DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
dat_registry_add_provider
DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
dat_registry_add_provider
DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
dat_registry_add_provider
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-cma"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-cma-1"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-mthca0-1"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
dat_registry_add_provider
DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
dat_registry_add_provider
DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
dat_registry_add_provider
DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
dat_registry_add_provider
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-mthca0-2"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-mlx4_0-1"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-mlx4_0-2"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------

WARNING: Failed to open "OpenIB-iwarp"
[DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
This may be a real error or it may be an invalid entry in the uDAPL
Registry which is contained in the dat.conf file. Contact your local
System Administrator to confirm the availability of the interfaces in
the dat.conf file.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
[0,1,1]: uDAPL on host md was unable to find any NICs.
Another transport will be used instead, although this may result in
lower performance.
--------------------------------------------------------------------------
Norm of error 0.000411674 iterations 7




















Satish Balay wrote:
> Looks like some issue with your MPI. You might want to talk with your
> sysadmin about it.
>
> Also send us some compile logs - so we know whats hapenning. For eg:
>
> cd src/ksp/ksp/examples/tutorials/
> make ex2
> mpiexec -n 2 ./ex2 [or however you are supporsed to run MPI binaries on this cluster]
>
> BTW: If you are currently doing development - don't bother with a
> cluster MPI - and just use --download-mpich=1
>
>
> Satish
>
> On Sun, 5 Jul 2009, Yixun Liu wrote:
>
>   
>> Hi,
>> After making test, I received a lot of warnings and lib load failures.
>>
>> Running test examples to verify correct installation
>> Possible error running C/C++ src/snes/examples/tutorials/ex19 with 1 MPI
>> process
>> See http://www.mcs.anl.gov/petsc/petsc-as/documentation/troubleshooting.html
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-cma"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-cma-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mthca0-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mthca0-2"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mlx4_0-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mlx4_0-2"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-iwarp"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> --------------------------------------------------------------------------
>> [0,1,0]: uDAPL on host md was unable to find any NICs.
>> Another transport will be used instead, although this may result in
>> lower performance.
>> --------------------------------------------------------------------------
>> lid velocity = 0.0016, prandtl # = 1, grashof # = 1
>> Number of Newton iterations = 2
>> lid velocity = 0.0016, prandtl # = 1, grashof # = 1
>> Number of Newton iterations = 2
>> Possible error running C/C++ src/snes/examples/tutorials/ex19 with 2 MPI
>> processes
>> See http://www.mcs.anl.gov/petsc/petsc-as/documentation/troubleshooting.html
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-cma"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-cma-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mthca0-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mthca0-2"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mlx4_0-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mlx4_0-2"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-iwarp"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> --------------------------------------------------------------------------
>> [0,1,1]: uDAPL on host md was unable to find any NICs.
>> Another transport will be used instead, although this may result in
>> lower performance.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-cma"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-cma-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mthca0-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mthca0-2"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mlx4_0-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mlx4_0-2"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-iwarp"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> --------------------------------------------------------------------------
>> [0,1,0]: uDAPL on host md was unable to find any NICs.
>> Another transport will be used instead, although this may result in
>> lower performance.
>> --------------------------------------------------------------------------
>> lid velocity = 0.0016, prandtl # = 1, grashof # = 1
>> Number of Newton iterations = 2
>> lid velocity = 0.0016, prandtl # = 1, grashof # = 1
>> Number of Newton iterations = 2
>> Possible error running Graphics examples
>> src/snes/examples/tutorials/ex19 1 MPI process
>> See http://www.mcs.anl.gov/petsc/petsc-as/documentation/troubleshooting.html
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-cma"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-cma-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mthca0-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mthca0-2"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mlx4_0-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mlx4_0-2"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-iwarp"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> --------------------------------------------------------------------------
>> [0,1,0]: uDAPL on host md was unable to find any NICs.
>> Another transport will be used instead, although this may result in
>> lower performance.
>> --------------------------------------------------------------------------
>> lid velocity = 0.0016, prandtl # = 1, grashof # = 1
>> Number of Newton iterations = 2
>> lid velocity = 0.0016, prandtl # = 1, grashof # = 1
>> Number of Newton iterations = 2
>> Error running Fortran example src/snes/examples/tutorials/ex5f with 1
>> MPI process
>> See http://www.mcs.anl.gov/petsc/petsc-as/documentation/troubleshooting.html
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-cma"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-cma-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mthca0-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mthca0-2"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mlx4_0-1"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplscm.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-mlx4_0-2"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol:
>> dat_registry_add_provider
>> --------------------------------------------------------------------------
>>
>> WARNING: Failed to open "OpenIB-iwarp"
>> [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED].
>> This may be a real error or it may be an invalid entry in the uDAPL
>> Registry which is contained in the dat.conf file. Contact your local
>> System Administrator to confirm the availability of the interfaces in
>> the dat.conf file.
>> --------------------------------------------------------------------------
>> --------------------------------------------------------------------------
>> [0,1,0]: uDAPL on host md was unable to find any NICs.
>> Another transport will be used instead, although this may result in
>> lower performance.
>> --------------------------------------------------------------------------
>> Number of Newton iterations =     4
>> Completed test examples
>>
>>
>> Thanks.
>>
>> Yixun
>>
>>     
>
>