[petsc-dev] threadcomm_type problem with Openmp

[Pierpaolo Minelli]

Hi,

i am using last petsc-dev with Openmp (configure.log in attachment)
Using previous versions i was able to obtain parallelization appending arguments like these:

-threadcomm_type openmp -threadcomm_nthreads <n>

Now, using these arguments i receive an error (reported fully in attached file outerr.txt):


[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[0]PETSC ERROR: Unknown type. Check for miss-spelling or missing package: http://www.mcs.anl.gov/petsc/documentation/installation.html#external
[0]PETSC ERROR: Unable to find requested PetscThreadComm type openmp
[0]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[0]PETSC ERROR: Petsc Development GIT revision: v3.5.3-2151-g30fc1d0  GIT Date: 2015-03-03 23:20:18 -0600
[0]PETSC ERROR: NIS2D on a petsc_dev named tesla02.ba.infn.it by ippolito Thu Mar  5 17:35:15 2015
[0]PETSC ERROR: Configure options --PETSC_ARCH=petsc_dev --PETSC_DIR=/opt/exp_soft/ippolito/petsc --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --with-debugging=0 --CFLAGS=-fopenmp --CXXFLAGS=-fopenmp --FFLAGS=-fopenmp COPTFLAGS="-O3 -march=native -mtune=native" CXXOPTFLAGS="-O3 -march=native -mtune=native" FOPTFLAGS="-O3 -march=native -mtune=native" --with-large-file-io=1 --with-openmp --with-pthreadclasses --with-threadcomm --download-cmake=yes --download-metis --download-parmetis --download-superlu_dist --download-mpich --download-fblaslapack -download-hypre -download-ml
[0]PETSC ERROR: #1 PetscThreadCommSetType() line 506 in /opt/exp_soft/ippolito/petsc/src/sys/threadcomm/interface/threadcomm.c


I tried also on another server where i use intel compilers but i obtain the same error.

I have also tried to run examples in $PETSC_DIR/src/sys/threadcomm/examples/tutorials and everything went fine using pthread as comm. I am a fortran programmer but i modified ex1.c (attached here as ex1_mod.c) in this directory to check function PetscThreadCommView() and also in this case if i use pthread i obtain a correct result:

[ippolito at tesla02 tutorials]$ ex1 -threadcomm_type pthread -threadcomm_nthreads 8
Thread Communicator
  Number of threads = 8
  Type = pthread

while if i use openmp i obtain the same error:

[ippolito at tesla02 tutorials]$ ex1 -threadcomm_type openmp -threadcomm_nthreads 8
[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[0]PETSC ERROR: Unknown type. Check for miss-spelling or missing package: http://www.mcs.anl.gov/petsc/documentation/installation.html#external
[0]PETSC ERROR: Unable to find requested PetscThreadComm type openmp
[0]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[0]PETSC ERROR: Petsc Development GIT revision: v3.5.3-2151-g30fc1d0  GIT Date: 2015-03-03 23:20:18 -0600
[0]PETSC ERROR: ex1 on a petsc_dev named tesla02.ba.infn.it by ippolito Fri Mar  6 10:19:35 2015
[0]PETSC ERROR: Configure options --PETSC_ARCH=petsc_dev --PETSC_DIR=/opt/exp_soft/ippolito/petsc --with-cc=gcc --with-cxx=g++ --with-fc=gfortran --with-debugging=0 --CFLAGS=-fopenmp --CXXFLAGS=-fopenmp --FFLAGS=-fopenmp COPTFLAGS="-O3 -march=native -mtune=native" CXXOPTFLAGS="-O3 -march=native -mtune=native" FOPTFLAGS="-O3 -march=native -mtune=native" --with-large-file-io=1 --with-openmp --with-pthreadclasses --with-threadcomm --download-cmake=yes --download-metis --download-parmetis --download-superlu_dist --download-mpich --download-fblaslapack -download-hypre -download-ml
[0]PETSC ERROR: #1 PetscThreadCommSetType() line 506 in /opt/exp_soft/ippolito/petsc/src/sys/threadcomm/interface/threadcomm.c
[0]PETSC ERROR: #2 PetscThreadCommWorldInitialize() line 1242 in /opt/exp_soft/ippolito/petsc/src/sys/threadcomm/interface/threadcomm.c
[0]PETSC ERROR: #3 PetscGetThreadCommWorld() line 82 in /opt/exp_soft/ippolito/petsc/src/sys/threadcomm/interface/threadcomm.c
[0]PETSC ERROR: #4 PetscCommGetThreadComm() line 117 in /opt/exp_soft/ippolito/petsc/src/sys/threadcomm/interface/threadcomm.c
[0]PETSC ERROR: #5 PetscThreadCommView() line 287 in /opt/exp_soft/ippolito/petsc/src/sys/threadcomm/interface/threadcomm.c
[0]PETSC ERROR: #6 main() line 23 in /opt/exp_soft/ippolito/petsc/src/sys/threadcomm/examples/tutorials/ex1.c
[0]PETSC ERROR: PETSc Option Table entries:
[0]PETSC ERROR: -threadcomm_nthreads 8
[0]PETSC ERROR: -threadcomm_type openmp
[0]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov—————

Is there someone that can help me to solve this problem?

Thanks in advance

Pierpaolo

-------------- next part --------------
A non-text attachment was scrubbed...
Name: configure.log
Type: application/octet-stream
Size: 5365010 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20150306/0f30486f/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ex1_mod.c
Type: application/octet-stream
Size: 632 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20150306/0f30486f/attachment-0001.obj>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: outerr.txt
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20150306/0f30486f/attachment.txt>
-------------- next part --------------