<div dir="ltr"><div>Thanks Junchao and Satish, <br></div><div>However, using 'make V=1 CUDAFLAGS="-g -O0" all' produces the same error. <br></div><div><br></div><div>I will forward these discussions to our system admin, hoping they can get some hints on this internal compiler error. <br></div><div><br></div><div>Thanks,</div><div>Qiyue Lu<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Sep 24, 2024 at 11:09 PM Satish Balay <<a href="mailto:balay.anl@fastmail.org">balay.anl@fastmail.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Can you try the following and see if it makes a difference<br>
<br>
make V=1 CUDAFLAGS="-g -O0" all<br>
<br>
Satish<br>
<br>
On Tue, 24 Sep 2024, Junchao Zhang wrote:<br>
<br>
> Hi, Qiyue,<br>
> I don't have the exact compilers as yours (cuda-12.3 + gcc-13.2.1). I<br>
> tried petsc-3.21.5 with cuda-12.6 + gcc-13.3.0 and it compiled fine.<br>
> Since it was an internal compiler error, it seems the only option is to<br>
> change compilers.<br>
> <br>
> Thanks.<br>
> --Junchao Zhang<br>
> <br>
> <br>
> On Fri, Sep 20, 2024 at 2:22 PM Qiyue Lu <<a href="mailto:qiyuelu1@gmail.com" target="_blank">qiyuelu1@gmail.com</a>> wrote:<br>
> <br>
> > Sure, here it is. Thanks.<br>
> ><br>
> > On Fri, Sep 20, 2024 at 2:07 PM Junchao Zhang <<a href="mailto:junchao.zhang@gmail.com" target="_blank">junchao.zhang@gmail.com</a>><br>
> > wrote:<br>
> ><br>
> >> Could you send the configure.log file?<br>
> >> --Junchao Zhang<br>
> >><br>
> >><br>
> >> On Fri, Sep 20, 2024 at 1:33 PM Qiyue Lu <<a href="mailto:qiyuelu1@gmail.com" target="_blank">qiyuelu1@gmail.com</a>> wrote:<br>
> >><br>
> >>> Thanks for your response.<br>
> >>> Here is my module loaded:<br>
> >>><br>
> >>><br>
> >>><br>
> >>> *Currently Loaded Modules: 1) craype-arm-grace 4)<br>
> >>> perftools-base/24.03.0 7) craype/2.7.31 10)<br>
> >>> cray-libsci/24.03.0 13) default 2) libfabric/<a href="https://urldefense.us/v3/__http://1.15.2.0__;!!G_uCfscf7eWS!bdbauHuz_abJWQXNOiSQp9GM_YInlO8pK2hcvOs0f0n4IF9--aHRTSGSoqp2qPO3O8OjO7LqvM7eUSYlkBpGzw$" rel="noreferrer" target="_blank">1.15.2.0</a><br>
> >>> <<a href="https://urldefense.us/v3/__http://1.15.2.0__;!!G_uCfscf7eWS!ZHTIMyeRVq_2VWhDO4gvbHRyVBXfTyJ7D25fWIZqvdeq5izIpEwmCtqUmYOjItUtNDX2wgMxilvBpjEZv0WMfOTeAAxd$" rel="noreferrer" target="_blank">https://urldefense.us/v3/__http://1.15.2.0__;!!G_uCfscf7eWS!ZHTIMyeRVq_2VWhDO4gvbHRyVBXfTyJ7D25fWIZqvdeq5izIpEwmCtqUmYOjItUtNDX2wgMxilvBpjEZv0WMfOTeAAxd$</a> > 5) xpmem/2.8.4-1.0_7.1__ga37cbd9.shasta 8)<br>
> >>> cray-dsmml/0.3.0 11) PrgEnv-gnu/8.5.0 3) craype-network-ofi 6)<br>
> >>> gcc-native/13.2 9) cray-mpich/8.1.29 12)<br>
> >>> cudatoolkit/23.11_12.3*<br>
> >>> And here is the configuration option now:<br>
> >>><br>
> >>> *--with-cc=cc --with-cxx=CC --with-fc=ftn --download-f2cblaslapack=1<br>
> >>> --with-cuda=1 *<br>
> >>><br>
> >>> That error is still there.<br>
> >>><br>
> >>> Best,<br>
> >>> Qiyue Lu<br>
> >>><br>
> >>> On Fri, Sep 20, 2024 at 11:58 AM Junchao Zhang <<a href="mailto:junchao.zhang@gmail.com" target="_blank">junchao.zhang@gmail.com</a>><br>
> >>> wrote:<br>
> >>><br>
> >>>> /u/qiyuelu1/petsc/src/vec/vec/impls/seq/cupm/cuda/../vecseqcupm_impl.hpp:1313:150:<br>
> >>>> *internal compiler error*: in maybe_undo_parenthesized_ref, at<br>
> >>>> cp/semantics.c:1740<br>
> >>>><br>
> >>>> Did you use nvidia compilers, e.g. nvc, nvc++? If yes, you may want to<br>
> >>>> change to other compilers by loading other cray PrgEnvs<br>
> >>>><br>
> >>>> --Junchao Zhang<br>
> >>>><br>
> >>>><br>
> >>>> On Fri, Sep 20, 2024 at 11:42 AM Qiyue Lu <<a href="mailto:qiyuelu1@gmail.com" target="_blank">qiyuelu1@gmail.com</a>> wrote:<br>
> >>>><br>
> >>>>> Hello,<br>
> >>>>> I am trying to build the PETSc version 3.21.5 (the latest, cloned from<br>
> >>>>> git) version on a Grace Hopper node with this configuration options:<br>
> >>>>> *--with-cc=cc --with-cxx=CC --with-fc=ftn --download-f2cblaslapack=1<br>
> >>>>> --with-cudac=nvcc --with-cuda=1 --with-threadsafety=1*<br>
> >>>>> with module cudatoolkit/23.11_12.3.<br>
> >>>>><br>
> >>>>> And I got this error:<br>
> >>>>> ===============<br>
> >>>>> /u/qiyuelu1/petsc/src/vec/vec/impls/seq/cupm/cuda/../vecseqcupm_impl.hpp:<br>
> >>>>> In instantiation of ‘Petsc::vec::cupm::impl::VecSeq_CUPM<<anonymous><br>
> >>>>> >::SetAsync(Vec, PetscScalar, PetscDeviceContext)::<lambda()> [with<br>
> >>>>> Petsc::device::cupm::DeviceType T = (Petsc::device::cupm::DeviceType)0]’:<br>
> >>>>> /u/qiyuelu1/petsc/src/vec/vec/impls/seq/cupm/cuda/../vecseqcupm_impl.hpp:1313:157:<br>
> >>>>> required from ‘struct Petsc::vec::cupm::impl::VecSeq_CUPM<<anonymous><br>
> >>>>> >::SetAsync(Vec, PetscScalar, PetscDeviceContext) [with<br>
> >>>>> Petsc::device::cupm::DeviceType T = (Petsc::device::cupm::DeviceType)0;<br>
> >>>>> PetscErrorCode = int; Vec = _p_Vec*; PetscScalar = double;<br>
> >>>>> PetscDeviceContext = _p_PetscDeviceContext*]::<lambda()>’<br>
> >>>>> /u/qiyuelu1/petsc/src/vec/vec/impls/seq/cupm/cuda/../vecseqcupm_impl.hpp:1313:167:<br>
> >>>>> required from ‘static PetscErrorCode<br>
> >>>>> Petsc::vec::cupm::impl::VecSeq_CUPM<<anonymous> >::SetAsync(Vec,<br>
> >>>>> PetscScalar, PetscDeviceContext) [with Petsc::device::cupm::DeviceType T =<br>
> >>>>> (Petsc::device::cupm::DeviceType)0; PetscErrorCode = int; Vec = _p_Vec*;<br>
> >>>>> PetscScalar = double; PetscDeviceContext = _p_PetscDeviceContext*]’<br>
> >>>>> /u/qiyuelu1/petsc/src/vec/vec/impls/seq/cupm/cuda/vecseqcupm.cu:7:40:<br>
> >>>>> required from here<br>
> >>>>> /u/qiyuelu1/petsc/src/vec/vec/impls/seq/cupm/cuda/../vecseqcupm_impl.hpp:1313:150:<br>
> >>>>> internal compiler error: in maybe_undo_parenthesized_ref, at<br>
> >>>>> cp/semantics.c:1740<br>
> >>>>> PetscCallThrust(THRUST_CALL(thrust::fill, stream, dptr, dptr +<br>
> >>>>> n, alpha));<br>
> >>>>><br>
> >>>>> ===============<br>
> >>>>><br>
> >>>>> Could you please show some hints on this issue?<br>
> >>>>><br>
> >>>>> Thanks,<br>
> >>>>> Qiyue Lu<br>
> >>>>><br>
> >>>><br>
> <br>
</blockquote></div>