<div dir="ltr"><div>Add <span style="color:rgb(0,0,0);font-family:Menlo,Monaco,"Courier New",monospace;font-size:14px;white-space:pre">--show </span>to the failing nvcc_wrapper command and see how nvcc_wrapper parses the options</div><div><span style="color:rgb(0,0,0);font-family:Menlo,Monaco,"Courier New",monospace;font-size:14px;white-space:pre"><br></span></div><div>PATH=/global/common/sw/cray/sles15/x86_64/zlib/1.2.11/gcc/8.2.0/pep2pal/bin:/global/common/sw/cray/cnl7/haswell/cmake/3.18.2/bin:/opt/cray/rca/2.2.20-7.0.1.1_4.62__g8e3fb5b.ari/bin:/opt/cray/alps/6.6.58-7.0.1.1_6.20__g437d88db.ari/sbin:/opt/cray/alps/default/bin:/opt/cray/job/2.2.4-7.0.1.1_3.48__g36b56f4.ari/bin:/opt/cray/pe/craype/2.6.2/bin:/usr/common/software/sles15_cgpu/openmpi/4.0.3/gcc/bin:/usr/common/software/sles15_cgpu/hpcsdk/20.11/Linux_x86_64/20.11/compilers/bin:/usr/common/software/sles15_cgpu/hpcsdk/20.11/Linux_x86_64/20.11/cuda/bin:/usr/common/software/sles15_cgpu/cuda/11.1.1/bin:/usr/common/software/sles15_cgpu/gcc/8.3.0/bin:/opt/esslurm/bin:/opt/cray/pe/modules/<a href="http://3.2.11.4/bin:/usr/common/software/bin:/usr/common/nsg/bin:/opt/ovis/bin:/opt/ovis/sbin:/usr/local/bin:/usr/bin:/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin:/opt/cray/pe/bin:dirname" target="_blank">3.2.11.4/bin:/usr/common/software/bin:/usr/common/nsg/bin:/opt/ovis/bin:/opt/ovis/sbin:/usr/local/bin:/usr/bin:/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin:/opt/cray/pe/bin:`dirname</a> /usr/common/software/sles15_cgpu/cuda/11.1.1/bin/nvcc` NVCC_WRAPPER_DEFAULT_COMPILER=/usr/common/software/sles15_cgpu/openmpi/4.0.3/gcc/bin/mpicxx /global/homes/m/madams/petsc/arch-cori-gpu-opt-kokkos-gcc/bin/nvcc_wrapper --expt-extended-lambda -c -arch=sm_70 -Xcompiler -rdynamic -DLANDAU_DIM=2 -DLANDAU_MAX_SPECIES=10 -DPETSC_HAVE_CUDA_ATOMIC -DLANDAU_MAX_Q=4 -Xcompiler -fPIC -O3 -gencode arch=compute_80,code=sm_80 -I/usr/common/software/sles15_cgpu/openmpi/4.0.3/gcc/include -Wno-deprecated-gpu-targets -I/global/homes/m/madams/petsc/include -I/global/homes/m/madams/petsc/arch-cori-gpu-opt-kokkos-gcc/include -I/usr/common/software/sles15_cgpu/openmpi/4.0.3/gcc/include -I/usr/common/software/sles15_cgpu/cuda/11.1.1/include /global/u2/m/madams/petsc/src/sys/objects/kokkos/kinit.kokkos.cxx -o arch-cori-gpu-opt-kokkos-gcc/obj/sys/objects/kokkos/kinit.o --show<span style="color:rgb(0,0,0);font-family:Menlo,Monaco,"Courier New",monospace;font-size:14px;white-space:pre"><br></span></div><div><br></div><div><div style="color:rgb(0,0,0);font-family:Menlo,Monaco,"Courier New",monospace;font-size:14px;line-height:21px;white-space:pre"><div><span style="color:rgb(34,34,34);font-family:Arial,Helvetica,sans-serif;font-size:small">--Junchao Zhang</span><br></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sat, May 15, 2021 at 7:14 PM Mark Adams <<a href="mailto:mfadams@lbl.gov">mfadams@lbl.gov</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Thanks,<div>Now I get an error in make all. THis was working a few weeks ago.</div><div>Make.log was empty but here is the output.</div><div> ....</div><div> CC arch-cori-gpu-opt-kokkos-gcc/obj/sys/error/ftn-custom/zerrf.o<br> CC arch-cori-gpu-opt-kokkos-gcc/obj/sys/f90-src/f90_cwrap.o<br> CC arch-cori-gpu-opt-kokkos-gcc/obj/vec/is/utils/hdf5io.o<br>PATH=/global/common/sw/cray/sles15/x86_64/zlib/1.2.11/gcc/8.2.0/pep2pal/bin:/global/common/sw/cray/cnl7/haswell/cmake/3.18.2/bin:/opt/cray/rca/2.2.20-7.0.1.1_4.62__g8e3fb5b.ari/bin:/opt/cray/alps/6.6.58-7.0.1.1_6.20__g437d88db.ari/sbin:/opt/cray/alps/default/bin:/opt/cray/job/2.2.4-7.0.1.1_3.48__g36b56f4.ari/bin:/opt/cray/pe/craype/2.6.2/bin:/usr/common/software/sles15_cgpu/openmpi/4.0.3/gcc/bin:/usr/common/software/sles15_cgpu/hpcsdk/20.11/Linux_x86_64/20.11/compilers/bin:/usr/common/software/sles15_cgpu/hpcsdk/20.11/Linux_x86_64/20.11/cuda/bin:/usr/common/software/sles15_cgpu/cuda/11.1.1/bin:/usr/common/software/sles15_cgpu/gcc/8.3.0/bin:/opt/esslurm/bin:/opt/cray/pe/modules/<a href="http://3.2.11.4/bin:/usr/common/software/bin:/usr/common/nsg/bin:/opt/ovis/bin:/opt/ovis/sbin:/usr/local/bin:/usr/bin:/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin:/opt/cray/pe/bin:dirname" target="_blank">3.2.11.4/bin:/usr/common/software/bin:/usr/common/nsg/bin:/opt/ovis/bin:/opt/ovis/sbin:/usr/local/bin:/usr/bin:/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin:/opt/cray/pe/bin:`dirname</a> /usr/common/software/sles15_cgpu/cuda/11.1.1/bin/nvcc` NVCC_WRAPPER_DEFAULT_COMPILER=/usr/common/software/sles15_cgpu/openmpi/4.0.3/gcc/bin/mpicxx /global/homes/m/madams/petsc/arch-cori-gpu-opt-kokkos-gcc/bin/nvcc_wrapper --expt-extended-lambda -c -arch=sm_70 -Xcompiler -rdynamic -DLANDAU_DIM=2 -DLANDAU_MAX_SPECIES=10 -DPETSC_HAVE_CUDA_ATOMIC -DLANDAU_MAX_Q=4 -Xcompiler -fPIC -O3 -gencode arch=compute_80,code=sm_80 -I/usr/common/software/sles15_cgpu/openmpi/4.0.3/gcc/include -Wno-deprecated-gpu-targets -I/global/homes/m/madams/petsc/include -I/global/homes/m/madams/petsc/arch-cori-gpu-opt-kokkos-gcc/include -I/usr/common/software/sles15_cgpu/openmpi/4.0.3/gcc/include -I/usr/common/software/sles15_cgpu/cuda/11.1.1/include /global/u2/m/madams/petsc/src/sys/objects/kokkos/kinit.kokkos.cxx -o arch-cori-gpu-opt-kokkos-gcc/obj/sys/objects/kokkos/kinit.o<br>g++: error: arch=compute_80: No such file or directory<br>g++: error: code=sm_80: No such file or directory<br>gmake[3]: *** [gmakefile:188: arch-cori-gpu-opt-kokkos-gcc/obj/sys/objects/kokkos/kinit.o] Error 1<br>gmake[3]: *** Waiting for unfinished jobs....<br> CC arch-cori-gpu-opt-kokkos-gcc/obj/vec/is/utils/isio.o<br> CC arch-cori-gpu-opt-kokkos-gcc/obj/vec/is/utils/ftn-auto/pmapf.o<br> CC arch-cori-gpu-opt-kokkos-gcc/obj/vec/is/utils/pmap.o<br> CC arch-cori-gpu-opt-kokkos-gcc/obj/vec/is/utils/psort.o<br> CC arch-cori-gpu-opt-kokkos-gcc/obj/vec/is/utils/isltog.o<br> FC arch-cori-gpu-opt-kokkos-gcc/obj/vec/f90-mod/petscvecmod.o<br> CUDAC arch-cori-gpu-opt-kokkos-gcc/obj/sys/memory/cuda/mcudahost.o<br> CUDAC.dep arch-cori-gpu-opt-kokkos-gcc/obj/sys/memory/cuda/mcudahost.o<br>gmake[2]: *** [/global/homes/m/madams/petsc/lib/petsc/conf/rules:50: libs] Error 2<br>**************************ERROR*************************************<br> Error during compile, check arch-cori-gpu-opt-kokkos-gcc/lib/petsc/conf/make.log<br> Send it and arch-cori-gpu-opt-kokkos-gcc/lib/petsc/conf/configure.log to <a href="mailto:petsc-maint@mcs.anl.gov" target="_blank">petsc-maint@mcs.anl.gov</a><br>********************************************************************<br>gmake[1]: *** [makefile:40: all] Error 1<br>make: *** [GNUmakefile:9: all] Error 2<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sat, May 15, 2021 at 5:30 PM Barry Smith <<a href="mailto:bsmith@petsc.dev" target="_blank">bsmith@petsc.dev</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div><br></div> Bitbucket is off-line. Do you need fortran stubs at this moment? If not use --with-fortran-interface=0 <div><br><div><br><blockquote type="cite"><div>On May 15, 2021, at 2:51 PM, Mark Adams <<a href="mailto:mfadams@lbl.gov" target="_blank">mfadams@lbl.gov</a>> wrote:</div><br><div><div dir="ltr"><div>I can build a non-kokkos PETSc here (Cori/GPU) but I get this error with Kokkos.</div><div>Any suggestions?</div><div>Thanks,</div><div>Mark</div><div><br></div>============================================================================================= ============================================================================================= Trying to download git://<a href="https://bitbucket.org/petsc/pkg-sowing.git" target="_blank">https://bitbucket.org/petsc/pkg-sowing.git</a> for SOWING ============================================================================================= ============================================================================================= Trying to download git://<a href="https://bitbucket.org/petsc/pkg-sowing.git" target="_blank">https://bitbucket.org/petsc/pkg-sowing.git</a> for SOWING ============================================================================================= ============================================================================================= Trying to download <a href="https://bitbucket.org/petsc/pkg-sowing/get/v1.1.26-p1.tar.gz" target="_blank">https://bitbucket.org/petsc/pkg-sowing/get/v1.1.26-p1.tar.gz</a> for SOWING ============================================================================================= *******************************************************************************<br> UNABLE to CONFIGURE with GIVEN OPTIONS (see configure.log for details):<br>-------------------------------------------------------------------------------<br>Error during download/extract/detection of SOWING:<br>Unable to clone sowing<br>Could not execute "['git clone <a href="https://bitbucket.org/petsc/pkg-sowing.git" target="_blank">https://bitbucket.org/petsc/pkg-sowing.git</a> /global/u2/m/madams/petsc/arch-cori-gpu-opt-kokkos-gcc/externalpackages/git.sowing']":<br>Cloning into '/global/u2/m/madams/petsc/arch-cori-gpu-opt-kokkos-gcc/externalpackages/git.sowing'...<br>fatal: unable to access '<a href="https://bitbucket.org/petsc/pkg-sowing.git/" target="_blank">https://bitbucket.org/petsc/pkg-sowing.git/</a>': The requested URL returned error: 503<br>Unable to download package SOWING from: git://<a href="https://bitbucket.org/petsc/pkg-sowing.git" target="_blank">https://bitbucket.org/petsc/pkg-sowing.git</a><br>* If URL specified manually - perhaps there is a typo?<br>* If your network is disconnected - please reconnect and rerun ./configure<br>* Or perhaps you have a firewall blocking the download<br>* You can run with --with-packages-download-dir=/adirectory and ./configure will instruct you what packages to download manually<br>* or you can download the above URL manually, to /yourselectedlocation<br> and use the configure option:<br> --download-sowing=/yourselectedlocation<br> Unable to clone sowing<br>Could not execute "['git clone <a href="https://bitbucket.org/petsc/pkg-sowing.git" target="_blank">https://bitbucket.org/petsc/pkg-sowing.git</a> /global/u2/m/madams/petsc/arch-cori-gpu-opt-kokkos-gcc/externalpackages/git.sowing']":<br>Cloning into '/global/u2/m/madams/petsc/arch-cori-gpu-opt-kokkos-gcc/externalpackages/git.sowing'...<br>fatal: unable to access '<a href="https://bitbucket.org/petsc/pkg-sowing.git/" target="_blank">https://bitbucket.org/petsc/pkg-sowing.git/</a>': The requested URL returned error: 503<br>Unable to download package SOWING from: git://<a href="https://bitbucket.org/petsc/pkg-sowing.git" target="_blank">https://bitbucket.org/petsc/pkg-sowing.git</a><br>* If URL specified manually - perhaps there is a typo?<br>* If your network is disconnected - please reconnect and rerun ./configure<br>* Or perhaps you have a firewall blocking the download<br>* You can run with --with-packages-download-dir=/adirectory and ./configure will instruct you what packages to download manually<br>* or you can download the above URL manually, to /yourselectedlocation<br> and use the configure option:<br> --download-sowing=/yourselectedlocation<br> file could not be opened successfully<br>Downloaded package SOWING from: <a href="https://bitbucket.org/petsc/pkg-sowing/get/v1.1.26-p1.tar.gz" target="_blank">https://bitbucket.org/petsc/pkg-sowing/get/v1.1.26-p1.tar.gz</a> is not a tarball.<br>[or installed python cannot process compressed files]<br>* If you are behind a firewall - please fix your proxy and rerun ./configure<br> For example at LANL you may need to set the environmental variable http_proxy (or HTTP_PROXY?) to <a href="http://proxyout.lanl.gov/" target="_blank">http://proxyout.lanl.gov</a><br>* You can run with --with-packages-download-dir=/adirectory and ./configure will instruct you what packages to download manually<br>* or you can download the above URL manually, to /yourselectedlocation/v1.1.26-p1.tar.gz<br> and use the configure option:<br> --download-sowing=/yourselectedlocation/v1.1.26-p1.tar.gz<br>*******************************************************************************<br></div>
<span id="gmail-m_1572418973608050119gmail-m_4467875874349699104cid:f_koq5z5j90"><configure.log></span></div></blockquote></div><br></div></div></blockquote></div>
</blockquote></div>