[petsc-dev] building on KNL

[Barry Smith]

   What happens if you just add the module cray-udreg?

   I would never rely on "default" modules, make sure you set the modules you need and make sure they get set for both the front end and the compute nodes.

  Barry

> On Mar 11, 2017, at 11:55 AM, Mark Adams <mfadams at lbl.gov> wrote:
> 
> Well, I get the same error now with testing. I will ask NERSC.
> PKG_CONFIG_PATH does have a path to libudreg.so.0.2.3, but that does
> not seem to be enough.
> 
> 09:52 nid02358  ~/petsc_install/petsc$ make
> PETSC_DIR=/global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel
> PETSC_ARCH="" test
> Running test examples to verify correct installation
> Using PETSC_DIR=/global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel
> and PETSC_ARCH=
> /global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel/lib/petsc/conf/rules:448:
> recipe for target 'ex19.PETSc' failed
> gmake[2]: [ex19.PETSc] Error 2 (ignored)
> *******************Error detected during compile or
> link!*******************
> See http://www.mcs.anl.gov/petsc/documentation/faq.html
> /global/homes/m/madams/petsc_install/petsc/src/snes/examples/tutorials
> ex19
> *********************************************************************************
> cc -o ex19.o -c -g -O3 -fp-model fast -xMIC-AVX512 -qopt-report=5
> -hcpu=mic-knl -qopenmp-simd
> -I/global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel/include
> -I/global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel/include
> -I/global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel/include
>   `pwd`/ex19.c
> Error invoking pkg-config!
> Package cray-udreg was not found in the pkg-config search path.
> Perhaps you should add the directory containing `cray-udreg.pc'
> to the PKG_CONFIG_PATH environment variable
> Package 'cray-udreg', required by 'mpich', not found
> /global/homes/m/madams/petsc_install/petsc-cori-knl-opt64-intel/lib/petsc/conf/rules:399:
> recipe for target 'ex19.o' failed
> gmake[3]: *** [ex19.o] Error 1
> 
> On Sat, Mar 11, 2017 at 12:17 PM, Mark Adams <mfadams at lbl.gov> wrote:
>> I tried running in batch=1 and that seems to have fixed it. Default
>> modules in the KNL compute nodes are different, that may have caused
>> the problem.
>> Thanks,
>> 
>> On Sat, Mar 11, 2017 at 11:22 AM, Matthew Knepley <knepley at gmail.com> wrote:
>>> Looks like a module problem
>>> 
>>> Executing: cc -c -o /tmp/petsc-7rDzhd/config.setCompilers/conftest.o
>>> -I/tmp/petsc-7rDzhd/config.setCompilers
>>> /tmp/petsc-7rDzhd/config.setCompilers/conftest.c
>>> Possible ERROR while running compiler: exit code 256
>>> stderr:
>>> Error invoking pkg-config!
>>> Package cray-udreg was not found in the pkg-config search path.
>>> Perhaps you should add the directory containing `cray-udreg.pc'
>>> to the PKG_CONFIG_PATH environment variable
>>> Package 'cray-udreg', required by 'mpich', not found
>>> Source:
>>> #include "confdefs.h"
>>> #include "conffix.h"
>>> 
>>> int main() {
>>> ;
>>>  return 0;
>>> }
>>>              Popping language C
>>>          Error testing C compiler: Cannot compile C with cc.
>>>            Deleting "CC"
>>> 
>>>   Matt
>>> 
>>> On Sat, Mar 11, 2017 at 8:43 AM, Mark Adams <mfadams at lbl.gov> wrote:
>>>> 
>>>> I have been using Cori/KNL with Intel MPI and want to move to cray-mpi
>>>> and am having an error with cc.
>>>> 
>>>> 06:42 1 cori06 maint= ~/petsc_install/petsc$ cc --version
>>>> icc (ICC) 17.0.1 20161005
>>>> Copyright (C) 1985-2016 Intel Corporation.  All rights reserved.
>>> 
>>> 
>>> 
>>> 
>>> --
>>> What most experimenters take for granted before they begin their experiments
>>> is infinitely more interesting than any results to which their experiments
>>> lead.
>>> -- Norbert Wiener