[petsc-users] PETSc/TAU configuration

[Satish Balay]

On Mon, 22 Sep 2014, Matthew Hills wrote:

> 
> 
> 
> Hi PETSc Team,
> 
> I'm still experiencing difficulties  with configuring PETSc with TAU. I'm currently:
> 
> building OpenMPI
> 1. ./configure --prefix=${SESKADIR}/packages/openmpi 
> 2. make all install
> 
> set library path
> 1. export LD_LIBRARY_PATH=${SESKADIR}/lib:${SESKADIR}/packages/openmpi /lib:${SESKADIR}/packages/pdt/x86_64/lib:/${SESKADIR}/packages/tau/x86_64/lib:${SESKADIR}/packages/petsc/${PETSC_ARCH}/lib:$LD_LIBRARY_PATH
> 2. export PATH=${SESKADIR}/bin:${SESKADIR}/packages/petsc/${PETSC_ARCH}/bin:$PATH
> 
> 
> 
> build PDT (pdtoolkit-3.20)
> 1. ./configure -GNU
> 2. export PATH=${SESKADIR}/packages/pdt/x86_64/bin:${SESKADIR}/packages/pdt/x86_64//bin:$PATH
> 5. make
> 6. make install
> 
> build TAU (tau-2.23.1) using OpenMPI
> 1. ./configure -prefix=`pwd` -cc=mpicc -c++=mpicxx -fortran=mpif90 -pdt=${SESKADIR}/packages/pdt -mpiinc=${SESKADIR}/packages/openmpi/include -mpilib=${SESKADIR}/packages/openmpi/lib -bfd=download
> 2. export PATH=${SESKADIR}/packages/tau/x86_64/bin:$PATH
> 3. make install
> 
> build fblaslapacklinpack-3.1.1
> 1. make

Should have said '--download-fblaslapack' would be fine here [as it
uses mpif90 - not tau_cc.sh]. Building seperately is also fine.

> 
> build PETSc using TAU_CC/MPI
> 1. export TAU_MAKEFILE=${SESKADIR}/packages/tau/x86_64/lib/Makefile.tau-mpi-pdt
> 2. ./configure --prefix='pwd' --with-mpi=1 --with-cc=tau_cc.sh  --with-cxx=mpicxx --with-fc=mpif90  --with-blas-lapack-dir=${SESKADIR}/packages/fblaslapack

--prefix='pwd' doesn't make sense. Please remove it.

> 
> Error: Tried looking for file: /tmp/petsc-U9YCMv/config.setCompilers/conftest
> Error: Failed to link with TAU options
> Error: Command(Executable) is -- gcc

configure.log looks complete [and indicates a successful run]. Did the
messages above come during configure step on the terminal?

Can you try the following and see if PETSc builds successfully? [but
recommend rerunning configure first - without --prefix option]

make PETSC_DIR=/home/hills/seska/packages/petsc PETSC_ARCH=linux-gnu-cxx-opt all

Satish

> 
> 
> Attached you'll find my configure log. Any assistance would be greatly appreciated.
> 
> Warm regards,
> Matthew
> 
> 
> 
> > Date: Tue, 16 Sep 2014 08:21:41 -0500
> > From: balay at mcs.anl.gov
> > To: hillsmattc at outlook.com
> > CC: petsc-users at mcs.anl.gov
> > Subject: Re: [petsc-users] PETSc/TAU configuration
> > 
> > I haven't tried using TAU in a while - but here are some obvious things to try.
> > 
> > 1. --download-mpich [or openmpi] with TAU does not make sense.
> > 
> > You would have to build MPICH/OpenMPI first.
> > 
> > Then build TAU to use this MPI.
> > 
> > And then build PETSc to use this TAU_CC/MPI
> > 
> > 2. I would use only tau_cc.sh - and not bother with c++/fortran
> > 
> > i.e [with TAU build with a given mpicc] - configure PETSc with:
> > ./configure --with-cc=tau_cc.sh --with-cxx=mpicxx --with-fc=mpif90
> > 
> > 3. Do not use any --download-package when using tau_cc.sh. First check
> > if you are able to use TAU with PETSc - without externalpackages [you
> > would need blas,mpi. Use system blas/lapack for blas/lapack - and
> > build MPI as mentioned above for use with TAU and later PETSc]
> > 
> > And if you really need these externalpackage [assuming the above basic
> > build with TAU works] - I would recommend the following 2 step build process:
> > 
> > <build packages without TAU>
> > 4.1. ./configure --with-cc=mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-PACKAGE PETSC_ARCH=arch-packages
> > 
> > 4.2. Now strip out the petsc relavent stuff from this location
> > rm -f arch-packages/include/petsc*.h
> > 
> > 4.3. Now build PETSc with TAU - using these prebuilt-packages
> > 
> > ./configure --with-cc=tau_cc.sh --with-cxx=mpicxx --with-fc=mpif90 PETSC_ARCH=arch-tau --with-PACKAGE-dir=`pwd`/arch-packages
> > 
> > BTW: the current release is petsc-3.5 - we recommend upgrading to
> > using it [as we usually support the latest release wrt debugging/bug
> > fixes]
> > 
> > Satish
> > 
> > 
> > 
> > On Tue, 16 Sep 2014, Matthew Hills wrote:
> > > 
> > > Hi PETSc Team,]
> > > 
> > > I am experiencing difficulties with configuring PETSc with TAU. I have replaced the standard compilers with the tau_cc.sh, tau_cxx.sh, and tau_f90.sh scripts but this produces multiple errors. I have also attempted to use OpenMPI and MPICH, but both produce their own unique errors.
> > > 
> > > After successfully compiling PDT, TAU was compiled with:
> > > 
> > > ./configure
> > > -prefix=`pwd`
> > > -cc=gcc
> > > -c++=g++ -fortran=gfortran
> > > -pdt=${SESKADIR}/packages/pdt
> > > -mpiinc=${PETSC_DIR}/${PETSC_ARCH}/include
> > > -mpilib=${PETSC_DIR}/${PETSC_ARCH}/lib -bfd=download
> > > 
> > > Attached you'll find the PETSc configuration logs. If any more information is needed please let me know.
> > > 
> > > Warm regards,
> > > 
> > > Matthew Hills
> > > University of Cape Town
> > 
> 
>