[petsc-dev] building on KNL

[Mark Adams]

On Sat, Mar 11, 2017 at 1:43 PM, Barry Smith <bsmith at mcs.anl.gov> wrote:
>
>    What happens if you just add the module udreg?

It did not help. There is a udreg in PKG_CONFIG_PATH

>
>    I would never rely on "default" modules, make sure you set the modules you need and make sure they get set for both the front end and the compute nodes.
>
>   Barry
>
>> On Mar 11, 2017, at 11:55 AM, Mark Adams <mfadams at lbl.gov> wrote:
>>
>> Well, I get the same error now with testing. I will ask NERSC.
>> PKG_CONFIG_PATH does have a path to libudreg.so.0.2.3, but that does
>> not seem to be enough.
>>
>> 09:52 nid02358  ~/petsc_install/petsc$ make
>> PETSC_DIR=/global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel
>> PETSC_ARCH="" test
>> Running test examples to verify correct installation
>> Using PETSC_DIR=/global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel
>> and PETSC_ARCH=
>> /global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel/lib/petsc/conf/rules:448:
>> recipe for target 'ex19.PETSc' failed
>> gmake[2]: [ex19.PETSc] Error 2 (ignored)
>> *******************Error detected during compile or
>> link!*******************
>> See http://www.mcs.anl.gov/petsc/documentation/faq.html
>> /global/homes/m/madams/petsc_install/petsc/src/snes/examples/tutorials
>> ex19
>> *********************************************************************************
>> cc -o ex19.o -c -g -O3 -fp-model fast -xMIC-AVX512 -qopt-report=5
>> -hcpu=mic-knl -qopenmp-simd
>> -I/global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel/include
>> -I/global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel/include
>> -I/global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel/include
>>   `pwd`/ex19.c
>> Error invoking pkg-config!
>> Package cray-udreg was not found in the pkg-config search path.
>> Perhaps you should add the directory containing `cray-udreg.pc'
>> to the PKG_CONFIG_PATH environment variable
>> Package 'cray-udreg', required by 'mpich', not found
>> /global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel/lib/petsc/conf/rules:399:
>> recipe for target 'ex19.o' failed
>> gmake[3]: *** [ex19.o] Error 1
>>
>> On Sat, Mar 11, 2017 at 12:17 PM, Mark Adams <mfadams at lbl.gov> wrote:
>>> I tried running in batch=1 and that seems to have fixed it. Default
>>> modules in the KNL compute nodes are different, that may have caused
>>> the problem.
>>> Thanks,
>>>
>>> On Sat, Mar 11, 2017 at 11:22 AM, Matthew Knepley <knepley at gmail.com> wrote:
>>>> Looks like a module problem
>>>>
>>>> Executing: cc -c -o /tmp/petsc-7rDzhd/config.setCompilers/conftest.o
>>>> -I/tmp/petsc-7rDzhd/config.setCompilers
>>>> /tmp/petsc-7rDzhd/config.setCompilers/conftest.c
>>>> Possible ERROR while running compiler: exit code 256
>>>> stderr:
>>>> Error invoking pkg-config!
>>>> Package cray-udreg was not found in the pkg-config search path.
>>>> Perhaps you should add the directory containing `cray-udreg.pc'
>>>> to the PKG_CONFIG_PATH environment variable
>>>> Package 'cray-udreg', required by 'mpich', not found
>>>> Source:
>>>> #include "confdefs.h"
>>>> #include "conffix.h"
>>>>
>>>> int main() {
>>>> ;
>>>>  return 0;
>>>> }
>>>>              Popping language C
>>>>          Error testing C compiler: Cannot compile C with cc.
>>>>            Deleting "CC"
>>>>
>>>>   Matt
>>>>
>>>> On Sat, Mar 11, 2017 at 8:43 AM, Mark Adams <mfadams at lbl.gov> wrote:
>>>>>
>>>>> I have been using Cori/KNL with Intel MPI and want to move to cray-mpi
>>>>> and am having an error with cc.
>>>>>
>>>>> 06:42 1 cori06 maint= ~/petsc_install/petsc$ cc --version
>>>>> icc (ICC) 17.0.1 20161005
>>>>> Copyright (C) 1985-2016 Intel Corporation.  All rights reserved.
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> What most experimenters take for granted before they begin their experiments
>>>> is infinitely more interesting than any results to which their experiments
>>>> lead.
>>>> -- Norbert Wiener
>