[petsc-users] Compiling PETSc in for Grace-Hopper nodes

[Satish Balay]

Can you send configure.log for this failure?

Satish

On Fri, 8 Nov 2024, Vanella, Marcos (Fed) via petsc-users wrote:

> Hi all, does anyone have experience compiling PETSc with gnu openmpi and cross compiling with cuda nvcc on these systems?
> we have access to Vista, a machine in TACC and was trying to build PETSc with these libraries. I would need gnu openmpi to compile my code (fortran std 2018), and would like to keep the same cpu compiler/openmpi for PETSc.I have the following modules loaded:
> 
> Currently Loaded Modules:
>   1) ucc/1.3.0   2) ucx/1.17.0   3) cmake/3.29.5   4) xalt/3.1   5) TACC   6) gcc/14.2.0   7) cuda/12.5 (g)   8) openmpi/5.0.5
> 
>   Where:
>    g:  built for GPU
> 
> Here mpicc points to the gcc compiler, etc. When configuring PETSc in the following form I get nvcc not working:
> 
> $ ./configure COPTFLAGS="-O2 -g" CXXOPTFLAGS="-O2 -g" FOPTFLAGS="-O2 -g" FCOPTFLAGS="-O2 -g" CUDAOPTFLAGS="-O2 -g" --with-debugging=1 --with-cc=mpicc --with-cxx=mpicxx --with-fc=mpifort --with-cuda --with-cudac=nvcc --with-cuda-arch=90 --download-fblaslapack=1 --with-make-np=8
> 
> =============================================================================================
>                          Configuring PETSc to compile on your system
> =============================================================================================
> TESTING: checkCUDACompiler from config.setCompilers(config/BuildSystem/config/setCompilers.py:1541)
> *********************************************************************************************
>            UNABLE to CONFIGURE with GIVEN OPTIONS (see configure.log for details):
> ---------------------------------------------------------------------------------------------
>   CUDA compiler you provided with -with-cudac=nvcc cannot be found or does not work.
>   Cannot compile CUDA with nvcc.
> *********************************************************************************************
> 
> I have nvcc in my path:
> 
> $ nvcc --version
> nvcc: NVIDIA (R) Cuda compiler driver
> Copyright (c) 2005-2024 NVIDIA Corporation
> Built on Thu_Jun__6_02:26:10_PDT_2024
> Cuda compilation tools, release 12.5, V12.5.82
> Build cuda_12.5.r12.5/compiler.34385749_0
> 
> I remember being able to do this cross compilation in polaris. Any help is most appreciated,
> Marcos
>