<div dir="ltr"><div>The compiler:</div><div><br></div><div>FCC (FCC) 4.5.0 20210304<br><b><u>simulating</u> gcc version 6.1<br></b>Copyright FUJITSU LIMITED 2019-2021<br></div><div dir="ltr"><br></div><div>and</div><div dir="ltr"> -Kopenmp specifies to enable the Specification of OpenMP Application<br> Program Interface. The -Knoopenmp option invalidates the -Kopenmp<br> option. -Knoopenmp is set by default.<br><br> When the -Kopenmp option is specified, -mt is assumed.<br><br> <b>The -Kopenmp option is needed if an object program compiled with it<br> exists in the command line as an input file.</b><br><br></div><div>I am going to try w/o Kopenmp.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Apr 14, 2021 at 8:15 PM Satish Balay <<a href="mailto:balay@mcs.anl.gov">balay@mcs.anl.gov</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">I don't understand kokkos build errors.<br>
<br>
For one - kokkos-kernels are taking long to build. And on the back end - I'm getting into time limit [and terminated]<br></blockquote><div><br></div><div>Kokkos take a very long time in configure on Summit.</div><div><br></div><div>Thanks,</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<br>
Trying a build on the front-end - its running - for a long time..<br>
<br>
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 4016901 a04201 20 0 11.0g 10.7g 13876 R 99.3 11.6 66:22.35 ccpcompx <br>
The above compile process has been running for more than an hour. Ok - its finally done.<br>
<br>
When I enable openmp - kokkos cmake completes - but I get errors at build time [BTW: I don't understand difference between -fopenmp and -Kopenmp]<br>
<br>
login6$ ../petsc.save/arch-linux2-c-opt/lib/petsc/conf/reconfigure-arch-linux2-c-opt.py --with-p4est-dir=$HOME/p4est-install --with-zlib-dir=$HOME/p4est-install -download-kokkos --download-kokkos-kernelsx --download-kokkos-commit=origin/develop --download-kokkos-kernels-commit=origin/develop --download-cmake=<a href="https://github.com/Kitware/CMake/releases/download/v3.20.1/cmake-3.20.1.tar.gz" rel="noreferrer" target="_blank">https://github.com/Kitware/CMake/releases/download/v3.20.1/cmake-3.20.1.tar.gz</a> '--download-kokkos-cmake-arguments=-DBUILD_TESTING=OFF -DKokkos_ENABLE_LIBDL=OFF -DKokkos_ENABLE_AGGRESSIVE_VECTORIZATION=ON -DKokkos_ENABLE_OPENMP=ON' --ignoreLinkOutput=1 --with-openmp=1<br>
<br>
<br>
/a04201/petsc.x/arch-linux2-c-opt/externalpackages/git.kokkos/petsc-build/core/src -I/vol0004/ra010009/a04201/petsc.x/arch-linux2-c-opt/externalpackages/git.kokkos/core/src -I/vol0004/ra010009/a04201/petsc.x/arch-linux2-c-opt/externalpackages/git.kokkos/petsc-build -O -fopenmp -fPIC -fopenmp -O -fopenmp -fPIC -fopenmp -fopenmp -std=c++14 -o CMakeFiles/kokkoscore.dir/OpenMP/Kokkos_OpenMP_Task.cpp.o -c /vol0004/ra010009/a04201/petsc.x/arch-linux2-c-opt/externalpackages/git.kokkos/core/src/OpenMP/Kokkos_OpenMP_Task.cpp<br>
gmake[2]: Leaving directory '/vol0004/ra010009/a04201/petsc.x/arch-linux2-c-opt/externalpackages/git.kokkos/petsc-build'<br>
gmake[1]: Leaving directory '/vol0004/ra010009/a04201/petsc.x/arch-linux2-c-opt/externalpackages/git.kokkos/petsc-build'/home/ra010009/a04201/asmqkagl0.s: Assembler messages:<br>
/home/ra010009/a04201/asmqkagl0.s:20333: Error: symbol `.LEHB41' is already defined<br>
/home/ra010009/a04201/asmqkagl0.s:21334: Error: symbol `.LEHB41' is already defined<br>
gmake[2]: *** [core/src/CMakeFiles/kokkoscore.dir/build.make:312: core/src/CMakeFiles/kokkoscore.dir/OpenMP/Kokkos_OpenMP_Exec.cpp.o] Error 1<br>
<br>
Note: I have a successful configure run with p4est+kokkos+kokkos-kernels, without-openmp<br>
[for this - I had to build p4est on the back-end, then switch over to front-end - and build the reset of the packages]<br>
<br>
Now I'm stuck at compiling petsc sources - src/vec/is/sf/impls/basic/kokkos/sfkok.kokkos.cxx<br>
<br>
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 56491 a04201 20 0 4944176 4.5g 11216 R 98.4 4.9 12:45.52 ccpcompx <br>
<br>
Satish<br>
<br>
On Wed, 14 Apr 2021, Mark Adams wrote:<br>
<br>
> PETSc seems to be skipping the compiler that it should use:<br>
> <br>
> -- Check for working CXX compiler:<br>
> /opt/FJSVxtclanga/tcsds-1.2.31/bin/mpiFCC - skipped<br>
> <br>
> I see -fopenmp was added. This might be wrong. I use -Kopenmp.<br>
> <br>
> --help says:<br>
> <br>
> -fopenmp<br>
> <br>
> The -fopenmp option specifies to enable Specification of OpenMP<br>
> Appli-<br>
> cation Program Interface.<br>
> <br>
> When the -fopenmp option is specified, -mt is set.<br>
> <br>
> The -fopenmp option is needed if an object program compiled with the<br>
> -fopenmp option exists in the command line as input files.<br>
> <br>
> Any ideas?<br>
> <br>
> <br>
> On Wed, Apr 14, 2021 at 5:17 PM Satish Balay <<a href="mailto:balay@mcs.anl.gov" target="_blank">balay@mcs.anl.gov</a>> wrote:<br>
> <br>
> > The following is working for me on the compute node [its completed kokkos<br>
> > (core) build - and is now building kokkos-kernels<br>
> ><br>
> > ~/petsc.save/arch-arm/lib/petsc/conf/reconfigure-arch-arm.py<br>
> > --download-p4est --download-zlib --download-kokkos<br>
> > --download-kokkos-kernels --download-kokkos-commit=origin/develop<br>
> > --download-cmake=<br>
> > <a href="https://github.com/Kitware/CMake/releases/download/v3.20.1/cmake-3.20.1.tar.gz" rel="noreferrer" target="_blank">https://github.com/Kitware/CMake/releases/download/v3.20.1/cmake-3.20.1.tar.gz</a><br>
> ><br>
> > -DKokkos_ENABLE_OPENMP=ON give me some issue - so I didn't try any of the<br>
> > additional options..<br>
> ><br>
> > Satish<br>
> ><br>
> > On Wed, 14 Apr 2021, Mark Adams wrote:<br>
> ><br>
> > > Satish, I get this error.<br>
> > ><br>
> > > I wonder if this syntax is wrong:<br>
> > ><br>
> > > '--download-kokkos-cmake-arguments=-DCMAKE_BUILD_TYPE=Release<br>
> > > -DBUILD_TESTING=OFF -DKokkos_ENABLE_LIBDL=OFF -DKokkos_ENABLE_OPENMP=ON<br>
> > > -DKokkos_ENABLE_SERIAL=ON -DKokkos_ENABLE_AGGRESSIVE_VECTORIZATION=ON',<br>
> > ><br>
> > ><br>
> > ><br>
> > =============================================================================================<br>
> > > Configuring KOKKOS with cmake; this may<br>
> > take<br>
> > > several minutes<br>
> > ><br>
> > ><br>
> > =============================================================================================<br>
> > ><br>
> > > Executing: /usr/bin/cmake ..<br>
> > > -DCMAKE_INSTALL_PREFIX=/home/ra010009/a04199/petsc/arch-arm<br>
> > ><br>
> > -DCMAKE_INSTALL_NAME_DIR:STRING="/home/ra010009/a04199/petsc/arch-arm/lib"<br>
> > > -DCMAKE_INSTALL_LIBDIR:STRING="lib" -DCMAKE_VERBOSE_MAKEFILE=1<br>
> > > -DCMAKE_BUILD_TYPE=Release -DCMAKE_C_COMPILER="mpifcc"<br>
> > > -DMPI_C_COMPILER="mpifcc" -DCMAKE_AR=/usr/bin/ar<br>
> > > -DCMAKE_RANLIB=/usr/bin/ranlib -DCMAKE_C_FLAGS:STRING="-fPIC<br>
> > -Kfast,openmp<br>
> > > -fopenmp" -DCMAKE_C_FLAGS_DEBUG:STRING="-fPIC -Kfast,openmp -fopenmp"<br>
> > > -DCMAKE_C_FLAGS_RELEASE:STRING="-fPIC -Kfast,openmp -fopenmp"<br>
> > > -DCMAKE_CXX_COMPILER="mpiFCC" -DMPI_CXX_COMPILER="mpiFCC"<br>
> > > -DCMAKE_CXX_FLAGS:STRING="-Kfast,openmp -fopenmp -fPIC -fopenmp"<br>
> > > -DCMAKE_CXX_FLAGS_DEBUG:STRING="-Kfast,openmp -fopenmp -fPIC -fopenmp"<br>
> > > -DCMAKE_CXX_FLAGS_RELEASE:STRING="-Kfast,openmp -fopenmp -fPIC -fopenmp"<br>
> > > -DCMAKE_Fortran_COMPILER="mpifrt" -DMPI_Fortran_COMPILER="mpifrt"<br>
> > > -DCMAKE_Fortran_FLAGS:STRING="-fPIC -O -fopenmp"<br>
> > > -DCMAKE_Fortran_FLAGS_DEBUG:STRING="-fPIC -O -fopenmp"<br>
> > > -DCMAKE_Fortran_FLAGS_RELEASE:STRING="-fPIC -O -fopenmp"<br>
> > > -DCMAKE_EXE_LINKER_FLAGS:STRING=" -fopenmp" -DBUILD_SHARED_LIBS:BOOL=ON<br>
> > > -DUSE_XSDK_DEFAULTS=YES -DXSDK_ENABLE_DEBUG=NO<br>
> > > -DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=ON<br>
> > > -DCMAKE_BUILD_WITH_INSTALL_RPATH:BOOL=ON -DKokkos_ENABLE_MPI=ON<br>
> > > -DKokkos_ENABLE_SERIAL=ON -DKokkos_ENABLE_OPENMP=ON<br>
> > > -DCMAKE_CXX_STANDARD="14" -DCMAKE_BUILD_TYPE=Release -DBUILD_TESTING=OFF<br>
> > > -DKokkos_ENABLE_LIBDL=OFF -DKokkos_ENABLE_OPENMP=ON<br>
> > > -DKokkos_ENABLE_SERIAL=ON -DKokkos_ENABLE_AGGRESSIVE_VECTORIZATION=ON<br>
> > > stdout:<br>
> > > -- Setting default Kokkos CXX standard to 14<br>
> > > -- The CXX compiler identification is Fujitsu<br>
> > > -- Check for working CXX compiler:<br>
> > /opt/FJSVxtclanga/tcsds-1.2.31/bin/mpiFCC<br>
> > > -- Check for working CXX compiler:<br>
> > > /opt/FJSVxtclanga/tcsds-1.2.31/bin/mpiFCC -- works<br>
> > > -- Detecting CXX compiler ABI info<br>
> > > -- Detecting CXX compiler ABI info - done<br>
> > > -- The project name is: Kokkos<br>
> > > -- Configuring incomplete, errors occurred!<br>
> > > See also<br>
> > ><br>
> > "/vol0004/ra010009/a04199/petsc/arch-arm/externalpackages/git.kokkos/petsc-build/CMakeFiles/CMakeOutput.log".<br>
> > > Error configuring KOKKOS with cmake Could not execute<br>
> > > "['/usr/bin/cmake ..<br>
> > > -DCMAKE_INSTALL_PREFIX=/home/ra010009/a04199/petsc/arch-arm<br>
> > ><br>
> > -DCMAKE_INSTALL_NAME_DIR:STRING="/home/ra010009/a04199/petsc/arch-arm/lib"<br>
> > > -DCMAKE_INSTALL_LIBDIR:STRING="lib" -DCMAKE_VERBOSE_MAKEFILE=1<br>
> > > -DCMAKE_BUILD_TYPE=Release -DCMAKE_C_COMPILER="mpifcc"<br>
> > > -DMPI_C_COMPILER="mpifcc" -DCMAKE_AR=/usr/bin/ar<br>
> > > -DCMAKE_RANLIB=/usr/bin/ranlib -DCMAKE_C_FLAGS:STRING="-fPIC<br>
> > -Kfast,openmp<br>
> > > -fopenmp" -DCMAKE_C_FLAGS_DEBUG:STRING="-fPIC -Kfast,openmp -fopenmp"<br>
> > > -DCMAKE_C_FLAGS_RELEASE:STRING="-fPIC -Kfast,openmp -fopenmp"<br>
> > > -DCMAKE_CXX_COMPILER="mpiFCC" -DMPI_CXX_COMPILER="mpiFCC"<br>
> > > -DCMAKE_CXX_FLAGS:STRING="-Kfast,openmp -fopenmp -fPIC -fopenmp"<br>
> > > -DCMAKE_CXX_FLAGS_DEBUG:STRING="-Kfast,openmp -fopenmp -fPIC -fopenmp"<br>
> > > -DCMAKE_CXX_FLAGS_RELEASE:STRING="-Kfast,openmp -fopenmp -fPIC -fopenmp"<br>
> > > -DCMAKE_Fortran_COMPILER="mpifrt" -DMPI_Fortran_COMPILER="mpifrt"<br>
> > > -DCMAKE_Fortran_FLAGS:STRING="-fPIC -O -fopenmp"<br>
> > > -DCMAKE_Fortran_FLAGS_DEBUG:STRING="-fPIC -O -fopenmp"<br>
> > > -DCMAKE_Fortran_FLAGS_RELEASE:STRING="-fPIC -O -fopenmp"<br>
> > > -DCMAKE_EXE_LINKER_FLAGS:STRING=" -fopenmp" -DBUILD_SHARED_LIBS:BOOL=ON<br>
> > > -DUSE_XSDK_DEFAULTS=YES -DXSDK_ENABLE_DEBUG=NO<br>
> > > -DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=ON<br>
> > > -DCMAKE_BUILD_WITH_INSTALL_RPATH:BOOL=ON -DKokkos_ENABLE_MPI=ON<br>
> > > -DKokkos_ENABLE_SERIAL=ON -DKokkos_ENABLE_OPENMP=ON<br>
> > > -DCMAKE_CXX_STANDARD="14" -DCMAKE_BUILD_TYPE=Release -DBUILD_TESTING=OFF<br>
> > > -DKokkos_ENABLE_LIBDL=OFF -DKokkos_ENABLE_OPENMP=ON<br>
> > > -DKokkos_ENABLE_SERIAL=ON -DKokkos_ENABLE_AGGRESSIVE_VECTORIZATION=ON']":<br>
> > > -- Setting default Kokkos CXX standard to 14<br>
> > > -- The CXX compiler identification is Fujitsu<br>
> > > -- Check for working CXX compiler:<br>
> > /opt/FJSVxtclanga/tcsds-1.2.31/bin/mpiFCC<br>
> > > -- Check for working CXX compiler:<br>
> > > /opt/FJSVxtclanga/tcsds-1.2.31/bin/mpiFCC -- works<br>
> > > -- Detecting CXX compiler ABI info<br>
> > > -- Detecting CXX compiler ABI info - done<br>
> > > -- The project name is: Kokkos<br>
> > > -- Configuring incomplete, errors occurred!<br>
> > > See also<br>
> > ><br>
> > "/vol0004/ra010009/a04199/petsc/arch-arm/externalpackages/git.kokkos/petsc-build/CMakeFiles/CMakeOutput.log".CMake<br>
> > > Error at cmake/kokkos_compiler_id.cmake:129 (STRING):<br>
> > ><br>
> > > * STRING sub-command REPLACE requires at least four arguments.*Call<br>
> > Stack<br>
> > > (most recent call first):<br>
> > > cmake/kokkos_tribits.cmake:174 (INCLUDE)<br>
> > > CMakeLists.txt:166 (KOKKOS_SETUP_BUILD_ENVIRONMENT)<br>
> > ><br>
> > > On Wed, Apr 14, 2021 at 3:34 PM Satish Balay <<a href="mailto:balay@mcs.anl.gov" target="_blank">balay@mcs.anl.gov</a>> wrote:<br>
> > ><br>
> > > > Additional kokkos cmake arguments can be passed in via<br>
> > > > --download-kokkos-cmake-arguments=string option.<br>
> > > ><br>
> > > > Satish<br>
> > > ><br>
> > > > On Wed, 14 Apr 2021, Mark Adams wrote:<br>
> > > ><br>
> > > > > Satish,<br>
> > > > ><br>
> > > > > For the fujitsu compiler OMP is -Kopenmp.<br>
> > > > ><br>
> > > > > Sarat (cc'ed) tells me that he built Kokkos with:<br>
> > > > ><br>
> > > > > cmake -DCMAKE_BUILD_TYPE=Release \<br>
> > > > > -DCMAKE_INSTALL_PREFIX=${KOKKOS_SRC_DIR}/install \<br>
> > > > > -DBUILD_TESTING=OFF \<br>
> > > > > -DKokkos_ENABLE_LIBDL=OFF \<br>
> > > > > -DKokkos_ENABLE_OPENMP=ON \<br>
> > > > > -DKokkos_ENABLE_SERIAL=ON \<br>
> > > > > -DKokkos_ENABLE_AGGRESSIVE_VECTORIZATION=ON \<br>
> > > > > ..<br>
> > > > ><br>
> > > > > How might I make this happen in PETSc?<br>
> > > > ><br>
> > > > > Thanks,<br>
> > > > > Mark<br>
> > > > ><br>
> > > > ><br>
> > > > > On Wed, Apr 14, 2021 at 2:44 PM Satish Balay <<a href="mailto:balay@mcs.anl.gov" target="_blank">balay@mcs.anl.gov</a>><br>
> > wrote:<br>
> > > > ><br>
> > > > > > On Wed, 14 Apr 2021, Mark Adams wrote:<br>
> > > > > ><br>
> > > > > > > I have this building now.<br>
> > > > > > > Do you know anything about OpenMP?<br>
> > > > > > > I can add --with-openmp<br>
> > > > > > > That should get Kokkos to be made with OpenMP.<br>
> > > > > > > Should PETSc deal with the compilers correctly?<br>
> > > > > ><br>
> > > > > > Well it tries the following compiler options for openmp.<br>
> > > > > ><br>
> > > > > > oflags = ["-fopenmp", # Gnu<br>
> > > > > > "-qsmp=omp",# IBM XL C/C++<br>
> > > > > > "-h omp", # Cray. Must come after XL because XL<br>
> > > > interprets<br>
> > > > > > this option as meaning "-soname omp"<br>
> > > > > > "-mp", # Portland Group<br>
> > > > > > "-Qopenmp", # Intel windows<br>
> > > > > > "-openmp", # Intel<br>
> > > > > > "-xopenmp", # Sun<br>
> > > > > > "+Oopenmp", # HP<br>
> > > > > > "/openmp" # Microsoft Visual Studio<br>
> > > > > > ]<br>
> > > > > ><br>
> > > > > > I don't know what the flag for fugaku compiler is.<br>
> > > > > ><br>
> > > > > > Satish<br>
> > > > > ><br>
> > > > > ><br>
> > > > > > > Thanks,<br>
> > > > > > > Mark<br>
> > > > > > ><br>
> > > > > > > On Wed, Apr 14, 2021 at 1:45 PM Mark Adams <<a href="mailto:mfadams@lbl.gov" target="_blank">mfadams@lbl.gov</a>><br>
> > wrote:<br>
> > > > > > ><br>
> > > > > > > > Thanks,<br>
> > > > > > > > If you feel inspired you could try Kokkos :||<br>
> > > > > > > > I am in a parking lot waiting for my daughter but can try this<br>
> > > > when I<br>
> > > > > > get<br>
> > > > > > > > home,<br>
> > > > > > > > Thanks again,<br>
> > > > > > > > Mark<br>
> > > > > > > ><br>
> > > > > > > > On Wed, Apr 14, 2021 at 1:33 PM Satish Balay <<br>
> > <a href="mailto:balay@mcs.anl.gov" target="_blank">balay@mcs.anl.gov</a>><br>
> > > > > > wrote:<br>
> > > > > > > ><br>
> > > > > > > >> I think I allocated a single node - and did the build on it.<br>
> > > > > > > >><br>
> > > > > > > >> Now I'm getting an error - don't know what changed..<br>
> > > > > > > >><br>
> > > > > > > >> login6$ pjsub --interact -L "node=1" -L<br>
> > "rscunit=rscunit_ft01" -L<br>
> > > > > > > >> "rscgrp=eap-int" -L "elapse=1:00:00" --sparam "wait-time=600"<br>
> > > > > > > >> [ERR.] PJM 0059 pjsub rscgrp=eap-int is disabled.<br>
> > > > > > > >><br>
> > > > > > > >> Ok - the following worked..<br>
> > > > > > > >><br>
> > > > > > > >> login6$ pjsub --interact -L "node=1" -L<br>
> > "rscunit=rscunit_ft01" -L<br>
> > > > > > > >> "elapse=1:00:00" --sparam "wait-time=600"<br>
> > > > > > > >> [INFO] PJM 0000 pjsub Job 6301572 submitted.<br>
> > > > > > > >> [INFO] PJM 0081 .connected.<br>
> > > > > > > >> [INFO] PJM 0082 pjsub Interactive job 6301572 started.<br>
> > > > > > > >> [a04201@j31-3110s petsc]$<br>
> > > > > > > >><br>
> > > > > > > >> Ok - trying this build now.<br>
> > > > > > > >><br>
> > > > > > > >> [a04201@j31-3110s petsc]$ cat<br>
> > > > > > > >> ~/petsc.save/arch-arm/lib/petsc/conf/reconfigure-arch-arm.py<br>
> > > > > > > >> #!/usr/bin/python3<br>
> > > > > > > >> if __name__ == '__main__':<br>
> > > > > > > >> import sys<br>
> > > > > > > >> import os<br>
> > > > > > > >> sys.path.insert(0, os.path.abspath('config'))<br>
> > > > > > > >> import configure<br>
> > > > > > > >> configure_options = [<br>
> > > > > > > >> '--with-blaslapack-lib=-lfjlapack',<br>
> > > > > > > >> '--with-debugging=0',<br>
> > > > > > > >> 'CC=mpifcc',<br>
> > > > > > > >> 'CXX=mpiFCC',<br>
> > > > > > > >> 'FC=mpifrt',<br>
> > > > > > > >> 'PETSC_ARCH=arch-arm',<br>
> > > > > > > >> ]<br>
> > > > > > > >> configure.petsc_configure(configure_options)<br>
> > > > > > > >> [a04201@j31-3110s petsc]$<br>
> > > > > > > >> ~/petsc.save/arch-arm/lib/petsc/conf/reconfigure-arch-arm.py<br>
> > > > > > > >> --download-p4est --download-zlib<br>
> > > > > > > >> <snip><br>
> > > > > > > >> p4est:<br>
> > > > > > > >> Includes: -I/vol0004/ra010009/a04201/petsc/arch-arm/include<br>
> > > > > > > >> Library:<br>
> > -Wl,-rpath,/vol0004/ra010009/a04201/petsc/arch-arm/lib<br>
> > > > > > > >> -L/vol0004/ra010009/a04201/petsc/arch-arm/lib -lp4est -lsc<br>
> > > > > > > >><br>
> > > > > > > >> Ok - this worked for me.<br>
> > > > > > > >><br>
> > > > > > > >> Satish<br>
> > > > > > > >><br>
> > > > > > > >> On Wed, 14 Apr 2021, Mark Adams wrote:<br>
> > > > > > > >><br>
> > > > > > > >> > Do you recall what nodes you use to build on a "compute"<br>
> > node,<br>
> > > > to<br>
> > > > > > avoid<br>
> > > > > > > >> > cross compilation?<br>
> > > > > > > >> ><br>
> > > > > > > >> > On Wed, Apr 14, 2021 at 12:08 PM Satish Balay <<br>
> > > > <a href="mailto:balay@mcs.anl.gov" target="_blank">balay@mcs.anl.gov</a>><br>
> > > > > > > >> wrote:<br>
> > > > > > > >> ><br>
> > > > > > > >> > > looks like p4est cannot be cross-compiled.<br>
> > > > > > > >> > ><br>
> > > > > > > >> > > Satish<br>
> > > > > > > >> > ><br>
> > > > > > > >> > > On Wed, 14 Apr 2021, Mark Adams wrote:<br>
> > > > > > > >> > ><br>
> > > > > > > >> > > > I get this error with p4est on Fugaku.<br>
> > > > > > > >> > > > It is a Fortran error. Odd.<br>
> > > > > > > >> > > > Mark<br>
> > > > > > > >> > > ><br>
> > > > > > > >> > ><br>
> > > > > > > >> > ><br>
> > > > > > > >> ><br>
> > > > > > > >><br>
> > > > > > > >><br>
> > > > > > ><br>
> > > > > ><br>
> > > > > ><br>
> > > > ><br>
> > > ><br>
> > > ><br>
> > ><br>
> ><br>
> ><br>
> <br>
<br>
</blockquote></div></div>