[petsc-users] Kokkos with OpenMP

[Mark Adams]

That would be great and early Feb would be perfect. Not having LU in Kokkos
is not perfect  but having a GPU ILU would be much much better than the
current CPU LU.

I am now suspecting that I am not running the job correctly for OMP at
NERSc. I am going to read the docs more carefully.

On Tue, Jan 19, 2021 at 10:27 AM Junchao Zhang <junchao.zhang at gmail.com>
wrote:

> Mark,
>   I hope I can take up the Kokkos work in early February once we have the
> ecp-tpds paper done.
> --Junchao Zhang
>
>
> On Mon, Jan 18, 2021 at 8:16 AM Mark Adams <mfadams at lbl.gov> wrote:
>
>> OK, this running and using OMP Fieldsplit/additive.
>>
>> Kokkos does not have any solvers hooked up yet, but I have added an LU
>> interface that just uses AIJ's LU.
>>
>> Junchao, I asked Kokkos about adding LU and they said that it is on the
>> todo list. Until they do that I can't use it for the paper, but if you want
>> to work on integrating solvers into aijkokkos I can do that and test with
>> GMRES/Jacobi.
>>
>> Thanks,
>> Mark
>>
>> On Mon, Jan 18, 2021 at 1:00 AM Barry Smith <bsmith at petsc.dev> wrote:
>>
>>>
>>>   Mark,
>>>
>>>   Looks like you tried to do two things at once, you removed the fopenmp
>>> and put back the --with-cuda.
>>>
>>>
>>>
>>>   Like I said if you want PETSc to build OpenMP and CUDA you need to
>>> remove this line (and some others) from kokkos.py
>>>
>>>
>>>
>>>      if self.openmp.found + pthreadfound + self.cuda.found > 1:
>>>       raise RuntimeError("Kokkos only supports a single parallel system
>>> during its configuration")
>>>
>>>
>>>
>>> On Jan 17, 2021, at 9:39 PM, Mark Adams <mfadams at lbl.gov> wrote:
>>>
>>>
>>>>
>>>> Here is the problem. You set  --CXXOPTFLAGS="-g -O0 -fPIC  -fopenmp" to
>>>> indicate how to compile for OpenMP but when ./configure checks the
>>>> installed KokkosKernel include files it uses CXXPPFLAGS. (Since you
>>>> provided the flag CXXOPTFLAGS  ./configure never determines the flag to put
>>>> into CXXPPFLAGS.
>>>>
>>>> It is more desirable if you do not provide -fPIC  -fopenmp.
>>>> ./configure will figure them out for you.
>>>>
>>>
>>> :(
>>> <configure.log>
>>>
>>>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20210119/e369fd56/attachment.html>