Petsc with hypre

Fri Aug 1 11:18:31 CDT 2008

I am able to install hypre, but fail to install petsc with including hypre. 

1. I have been trying to get PETSc to download and install its own version of
HYPRE -- and failed with the error

*****************************************************************************
****
         UNABLE to CONFIGURE with GIVEN OPTIONS    (see configure.log for
details):
-----------------------------------------------------------------------------
----------
Error running configure on HYPRE: Could not execute 'cd
/work/hvnguyen/work_project/petsc-2.3.3-p3/externalpackages/hypre-2.0.0/src;m
ake distclean;./configure
--prefix=/work/hvnguyen/work_project/petsc-2.3.3-p3/externalpackages/hypre-2.
0.0/CrayXT3-O CC="cc  -fPIC -fastsse -O3 -Munroll=c:4 -tp k8-64 " CXX="CC  -O
-fPIC " F77="ftn  -fPIC -fastsse -O3 -Munroll=c:4 -tp k8-64  "
--with-MPI-include="/opt/xt-mpt/default/mpich2-64/P2/include"
--with-MPI-lib-dirs="" --with-MPI-libs="" --with-blas-libs=
--with-blas-lib-dir= --with-lapack-libs= --with-lapack-lib-dir=
--with-blas=yes --with-lapack=yes --without-babel --without-mli --without-fei
--without-superlu':
Dist-cleaning utilities ...
make[1]: Entering directory
`/work/hvnguyen/work_project/petsc-2.3.3-p3/externalpackages/hypre-2.0.0/src/
utilities'
rm -f *.o libHYPRE* f2c.h *blas.h *lapack.h

2. I tried to install hypre and it works (I tested their example codes). The,
I try to install petsc with config option below, but -no success, see error

 hvnguyen:sapphire01% config/configure.py --with-batch=1 --with-mpi-shared=0
--with-memcmp-ok --sizeof_char=1 --sizeof_void_p=8 --sizeof_short=2
--sizeof_int=4 --sizeof_long=8 --sizeof_long_long=8 --sizeof_float=4
--sizeof_double=8 --bits_per_byte=8 --sizeof_MPI_Comm=4 --sizeof_MPI_Fint=4
--with-fc=ftn --with-cc=cc --with-cxx=CC -PETSC_ARCH=CrayXT3-O
--with-debugging=0 --with-error-checking=0 COPTFLAGS="-fastsse -O3
-Munroll=c:4 -tp k8-64" FOPTFLAGS="-fastsse -O3 -Munroll=c:4 -tp k8-64"
--with-x=0 --with-mpi-dir=/opt/xt-mpt/default/mpich2-64/P2 --with-shared=0
--with-hypre-include=/work/hvnguyen/work_project/hypre-2.0.0/small/fastsse/in
clude
--with-hypre-lib=[/work/hvnguyen/work_project/hypre-2.0.0/small/fastsse/lib/l
ibHYPRE.a,-lHYPRE_DistributedMatrix,-lHYPRE_DistributedMatrixPilutSolver,-lHY
PRE_Euclid,-lHYPRE_FEI,-lHYPRE_IJ_mv,-lHYPRE_LSI,-lHYPRE_MatrixMatrix,-lHYPRE
_ParaSails,-lHYPRE_ParaSails,-lHYPRE_mli,-lHYPRE_multivector,-lHYPRE_parcsr_b
lock_mv,-lHYPRE_parcsr_ls,-lHYPRE_parcsr_mv,-lHYPRE_seq_mv,-lHYPRE_sstruct_ls
,-lHYPRE_sstruct_mv,-lHYPRE_sstruct_mv,-lHYPRE_utilities

-- error:
TESTING: check from
config.libraries(/work/hvnguyen/work_project/petsc-2.3.3-p3/python/BuildSyste
m/config/libraries.py:108)
*****************************************************************************
****
         UNABLE to CONFIGURE with GIVEN OPTIONS    (see configure.log for
details):
-----------------------------------------------------------------------------
----------
--with-hypre-lib=['[/work/hvnguyen/work_project/hypre-2.0.0/small/fastsse/lib
/libHYPRE.a,-lHYPRE_DistributedMatrix,-lHYPRE_DistributedMatrixPilutSolver,-l
HYPRE_Euclid,-lHYPRE_FEI,-lHYPRE_IJ_mv,-lHYPRE_LSI,-lHYPRE_MatrixMatrix,-lHYP
RE_ParaSails,-lHYPRE_ParaSails,-lHYPRE_mli,-lHYPRE_multivector,-lHYPRE_parcsr
_block_mv,-lHYPRE_parcsr_ls,-lHYPRE_parcsr_mv,-lHYPRE_seq_mv,-lHYPRE_sstruct_
ls,-lHYPRE_sstruct_mv,-lHYPRE_sstruct_mv,-lHYPRE_utilities'] and
--with-hypre-include=/work/hvnguyen/work_project/hypre-2.0.0/small/fastsse/in
clude did not work
*****************************************************************************
****

Thanks for your help.

-Hung

-----Original Message-----
From: owner-petsc-users at mcs.anl.gov [mailto:owner-petsc-users at mcs.anl.gov] On
Behalf Of Barry Smith
Sent: Wednesday, July 30, 2008 10:28 AM
To: petsc-users at mcs.anl.gov
Cc: Keita Teranishi
Subject: Re: Petsc with hypre

    If PETSc is built from source then it, by default, does not include hypre
and other external packages. You should install PETSc yourself and include
the additional config/configure.py option --download-hypre

    Barry

On Jul 30, 2008, at 9:18 AM, Nguyen, Hung V ERDC-ITL-MS wrote:

>
> Hello Keita,
>
>> Did this error happen with Cray's PETSc?
>
> I am running my code in Cray XT3 (at ERDC). Please find the current 
> and available modules in the system below.
>
> I think I amn't using Cray's PETSC since I am using the one from the 
> location /usr/local/usp/PETtools/CE/MATH/petsc-2.3.3-p3.
>
> How do I use Cray's PETSC? Which module I need to load?
>
> Thanks,
>
> -Hung
>
> --- current module:
> hvnguyen:sapphire12% module list
> Currently Loaded Modulefiles:
>  1) modules/3.1.6         5) xt-libsci/1.5.52      9) xt-pbs/5.3.5
> 13) xt-catamount/1.5.52  17) Base-opts/1.5.52
>  2) MySQL/4.0.27          6) xt-mpt/1.5.52        10) xt-service/ 
> 1.5.52
> 14) xt-boot/1.5.52
>  3) acml/3.6              7) xt-pe/1.5.52         11) xt-libc/1.5.52
> 15) xt-crms/1.5.52
>  4) pgi/7.0.6             8) PrgEnv-pgi/1.5.52    12) xt-os/1.5.52
> 16) xt-lustre-ss/1.5.52
> hvnguyen:sapphire12% module avai
>
> ---------------------------------------------------------------
> /opt/modulefiles
> ---------------------------------------------------------------Base-
> opts/1.4.
> 10             craypat/3.2.3                xt-catamount/1.4.43
> xt-mpt/1.4.10
> Base-opts/1.4.38             dwarf/6.10.0                 xt- 
> catamount/1.5.16
> xt-mpt/1.4.38
> Base-opts/1.4.43             elf/0.8.6(default)           xt- 
> catamount/1.5.27
> xt-mpt/1.4.43
> Base-opts/1.5.16             fftw/2.1.5(default)          xt- 
> catamount/1.5.39
> xt-mpt/1.5.16
> Base-opts/1.5.27             fftw/3.1.1
> xt-catamount/1.5.39.nic10    xt-mpt/1.5.27
> Base-opts/1.5.39             gcc/3.2.3                    xt- 
> catamount/1.5.52
> xt-mpt/1.5.39
> Base-opts/1.5.52(default)    gcc/4.1.1(default)
> xt-craypat/4.0(default)      xt-mpt/1.5.52
> MySQL/4.0.27                 glib/2.4.2                   xt-crms/ 
> 1.4.10
> xt-mpt-gnu/1.4.10
> PrgEnv/1.4.10                gmalloc                      xt-crms/ 
> 1.4.38
> xt-mpt-gnu/1.4.38
> PrgEnv/1.4.38                gnet/2.0.5                   xt-crms/ 
> 1.4.43
> xt-mpt-gnu/1.4.43
> PrgEnv/1.4.43                iobuf/1.0.2                  xt-crms/ 
> 1.5.16
> xt-mpt-gnu/1.5.16
> PrgEnv-gnu/1.4.10            iobuf/1.0.5(default)         xt-crms/ 
> 1.5.27
> xt-mpt-gnu/1.5.27
> PrgEnv-gnu/1.4.38            iobuf/1.0.6                  xt-crms/ 
> 1.5.39
> xt-mpt-gnu/1.5.39
> PrgEnv-gnu/1.4.43            libscifft-pgi/1.0.0(default) xt-crms/ 
> 1.5.52
> xt-mpt-gnu/1.5.52
> PrgEnv-gnu/1.5.16            modules/3.1.6                xt-libc/ 
> 1.4.10
> xt-mpt-pathscale/1.5.39
> PrgEnv-gnu/1.5.27            papi/3.2.1(default)          xt-libc/ 
> 1.4.38
> xt-mpt-pathscale/1.5.52
> PrgEnv-gnu/1.5.39            papi/3.5.0C.1                xt-libc/ 
> 1.4.43
> xt-os/1.4.10
> PrgEnv-gnu/1.5.52(default)   pathscale/2.5                xt-libc/ 
> 1.5.16
> xt-os/1.4.38
> PrgEnv-pathscale/1.5.39      pathscale/3.0(default)       xt-libc/ 
> 1.5.27
> xt-os/1.4.43
> PrgEnv-pathscale/1.5.52      pgi/6.2.5                    xt-libc/ 
> 1.5.39
> xt-os/1.5.16
> PrgEnv-pgi/1.4.10            pgi/7.0.2                    xt-libc/ 
> 1.5.52
> xt-os/1.5.27
> PrgEnv-pgi/1.4.38            pgi/7.0.3                    xt-libsci/ 
> 1.4.10
> xt-os/1.5.39
> PrgEnv-pgi/1.4.43            pgi/7.0.4                    xt-libsci/ 
> 1.4.38
> xt-os/1.5.52
> PrgEnv-pgi/1.5.16            pgi/7.0.5                    xt-libsci/ 
> 1.4.43
> xt-papi/3.5.99a(default)
> PrgEnv-pgi/1.5.27            pgi/7.0.6(default)           xt-libsci/ 
> 1.5.16
> xt-pbs/5.3.5
> PrgEnv-pgi/1.5.39            pgi/7.0.7                    xt-libsci/ 
> 1.5.27
> xt-pe/1.4.38
> PrgEnv-pgi/1.5.52(default)   pgi/7.1.2                    xt-libsci/ 
> 1.5.39
> xt-pe/1.4.43
> acml/3.0                     pgi/7.1.4
> xt-libsci/1.5.52(default)    xt-pe/1.5.16
> acml/3.6(default)            pgi32/6.1.1                  xt-libsci/ 
> 10.2.0
> xt-pe/1.5.27
> acml/4.0.1a                  pkg-config/0.15.0            xt-lsfhpc/ 
> 6.1
> xt-pe/1.5.39
> acml-gnu/3.0                 xt-boot/1.4.10               xt-lustre- 
> ss/1.4.10
> xt-pe/1.5.52
> acml-large_arrays/3.0        xt-boot/1.4.38               xt-lustre- 
> ss/1.4.38
> xt-service/1.4.10
> acml-mp/3.0                  xt-boot/1.4.43               xt-lustre- 
> ss/1.4.43
> xt-service/1.4.38
> apprentice2/3.0.1(default)   xt-boot/1.5.16               xt-lustre- 
> ss/1.5.16
> xt-service/1.4.43
> apprentice2/3.2.3            xt-boot/1.5.27               xt-lustre- 
> ss/1.5.27
> xt-service/1.5.16
> apprentice2/4.0              xt-boot/1.5.39               xt-lustre- 
> ss/1.5.39
> xt-service/1.5.27
> craypat/3.0.1                xt-boot/1.5.52
> xt-lustre-ss/1.5.39.bogl1    xt-service/1.5.39
> craypat/3.1.1                xt-catamount/1.4.10
> xt-lustre-ss/1.5.39.nic10    xt-service/1.5.52
> craypat/3.1.2(default)       xt-catamount/1.4.38          xt-lustre- 
> ss/1.5.52
>
>
>
> -----Original Message-----
> From: Keita Teranishi [mailto:keita at cray.com]
> Sent: Wednesday, July 30, 2008 9:09 AM
> To: petsc-users at mcs.anl.gov
> Cc: Nguyen, Hung V ERDC-ITL-MS
> Subject: RE: Petsc with hypre
>
> Hi Hung,
>
> Did this error happen with Cray's PETSc?  Our PETSc supports both 
> hypre and ParMetis.
> Please let me know more details with your error (such as module 
> environment).
>
>
> Thanks,
>
> ================================
> Keita Teranishi
> Math Software Group
> Cray, Inc.
> keita at cray.com
> ================================
>
>
> -----Original Message-----
> From: owner-petsc-users at mcs.anl.gov 
> [mailto:owner-petsc-users at mcs.anl.gov
> ] On
> Behalf Of Nguyen, Hung V ERDC-ITL-MS
> Sent: Wednesday, July 30, 2008 8:57 AM
> To: petsc-users at mcs.anl.gov
> Subject: Petsc with hypre
>
>
> Dear,
>
> I tried to run PETSC with hypre on CrayXT3 system and got the error 
> message below. I didn't install PETSC so I don't know whether it was 
> installed with hypre option or not. So if I need to install PETSC with 
> using hypre option, then please send me the instruction for 
> installation (and also using parMeTiS).
>
> I appreciate your help,
>
> Regards,
>
> -hung
>
> hvnguyen:sapphire09% yod -np 16 ./fw -ksp_type richardson -pc_type 
> hypre -pc_hypre_type boomeramg -pc_hypre_boomeramg_max_iter 4 
> -pc_hypre_boomeramg_tol 1.0e-15
>
>
> [10]PETSC ERROR: [9]PETSC ERROR: [13]PETSC ERROR: [11]PETSC ERROR:  
> [3]PETSC
> ERROR: [2]PETSC ERROR: [8]PETSC ERROR: [7]PETSC ERROR: [14]PETSC  
> ERROR:
> [0]PETSC ERROR: [5]PETSC ERROR: [12]PETSC ERROR: [15]PETSC ERROR:  
> [6]PETSC
> ERROR: [1]PETSC ERROR: [4]PETSC ERROR: --------------------- Error  
> Message
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> --------------------- Error Message  
> ------------------------------------
> [10]PETSC ERROR: [9]PETSC ERROR: [13]PETSC ERROR: [11]PETSC ERROR:  
> [3]PETSC
> ERROR: [2]PETSC ERROR: [8]PETSC ERROR: [7]PETSC ERROR: [14]PETSC  
> ERROR:
> [0]PETSC ERROR: [5]PETSC ERROR: [12]PETSC ERROR: [15]PETSC ERROR:  
> [6]PETSC
> ERROR: [1]PETSC ERROR: [4]PETSC ERROR: Unknown type. Check for miss- 
> spelling
> or missing external package needed for type!
> Unknown type. Check for miss-spelling or missing external package  
> needed for
> type!
> Unknown type. Check for miss-spelling or missing external package  
> needed for
> type!
>
> Unknown type. Check for miss-spelling or missing external package  
> needed for
> type!
> [10]PETSC ERROR: [9]PETSC ERROR: [13]PETSC ERROR: [11]PETSC ERROR:  
> [3]PETSC
> ERROR: [2]PETSC ERROR: [8]PETSC ERROR: [7]PETSC ERROR: [14]PETSC  
> ERROR:
> [0]PETSC ERROR: [5]PETSC ERROR: [12]PETSC ERROR: [15]PETSC ERROR:  
> [6]PETSC
> ERROR: [1]PETSC ERROR: [4]PETSC ERROR: Unable to find requested PC  
> type
> hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> Unable to find requested PC type hypre!
> [10]PETSC ERROR: [9]PETSC ERROR: [13]PETSC ERROR: [11]PETSC ERROR:  
> [3]PETSC
> ERROR: [2]PETSC ERROR: [8]PETSC ERROR: [7]PETSC ERROR: [14]PETSC  
> ERROR:
> [0]PETSC ERROR: [5]PETSC ERROR: [12]PETSC ERROR: [15]PETSC ERROR:  
> [6]PETSC
> ERROR: [1]PETSC ERROR: [4]PETSC ERROR:
> ------------------------------------------------------------------------
>