[petsc-dev] Fwd: no petsc on Edison

Mark Adams mfadams at lbl.gov
Tue Jan 10 14:47:42 CST 2017


We have a code that is failing on large scale runs on Edison at NERSC. We
ran with a debug version and we got this error message that I assume is
from a check that is done in debug. Is this a false positive? This is a 64
bit integer build.
Thanks,
Mark

[5]PETSC ERROR: --------------------- Error Message
--------------------------------------------------------------
[5]PETSC ERROR: Argument out of range
[5]PETSC ERROR: A really huge hash is being requested.. cannot process:
4294967296
[5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for
trouble shooting.
[5]PETSC ERROR: Petsc Development GIT revision: v3.7.4-2584-g7175242 GIT
Date: 2016-12-21 13:19:16 -0600
[5]PETSC ERROR: /tmp/targetExec on a arch-xc30-dbg64-intel named nid00008
by u6338 Sat Jan  7 16:39:16 2017
[5]PETSC ERROR: Configure options --COPTFLAGS="-O0 -g -no-ipo"
--CXXOPTFLAGS="-O0 -g -no-ipo" --FOPTFLAGS="-O0 -g -ipo"
--download-parmetis --download-metis --download-hypre --with-ssl=0
--with-cc=cc --with-clib-autodetect=0 --with-cxx=CC
--with-cxxlib-autodetect=0 --with-debugging=1 --with-fc=ftn
--with-fortranlib-autodetect=0 --with-shared-libraries=0 --with-x=0
--with-mpiexec=srun LIBS=-lstdc++ --with-64-bit-indices
--prefix=/global/homes/m/madams/petsc_install/petscv3.7-x[16527]PETSC
ERROR: ----

using:
PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc30-dbg64-intel/

maybe go back to opt version?


On 12/22/2016 03:22 PM, Mark Adams wrote:

> You configure with the size of an integer explicitly, ie,
> --with-64-bit-integers. I can't imagine there is anything bigger, but it
> would not be hard to do.
>
> On Thu, Dec 22, 2016 at 6:06 PM, David Trebotich <treb at hpcrdm.lbl.gov>
> wrote:
>
> i just committed changes to SPMD that Brian needed for signed long long.
>> Evidently petsc is now handling bigger matrices?
>>
>>
>> On 12/22/2016 2:57 PM, Mark Adams wrote:
>>
>> There are a few hits on stack exchange, google:
>>
>> "error: expression must have class type"
>>
>> I think intputT is a templated type and it is templated with a PetscInt.
>> You are calling the linearSize() method on a primitive type. That is my
>> best guess.
>>
>> On Thu, Dec 22, 2016 at 3:33 PM, David Trebotich <treb at hpcrd.lbl.gov>
>> wrote:
>>
>> building with dbg looks same:
>>>
>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression must
>>> have class type
>>>     return inputT.linearSize();
>>>            ^
>>>           detected during:
>>>             instantiation of "int linearSize(const T &) [with
>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of
>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>             instantiation of "int MiniIVFAB<T>::size(const Box &, const
>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at line 155
>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>             instantiation of "int BaseEBCellFAB<T>::size(const Box &,
>>> const Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at
>>> line
>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
>>>             instantiation of "int LDOperator<T>::size(const T &, const
>>> Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
>>> cInt64={long
>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>             implicit generation of "LDOperator<T>::LDOperator() [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>             instantiation of class "LDOperator<T> [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
>>> BoxLayoutData<T> &, const Interval &, const Copier &, const LDOperator<T>
>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
>>> BoxLayoutData<T> &, const Interval &) const [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>             instantiation of "LevelData<T>::LevelData() [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
>>> "../srcLib/EBPetscSolver.cpp"
>>>
>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression must
>>> have class type
>>>     inputT.linearOut(a_outBuf);
>>>     ^
>>>           detected during:
>>>             instantiation of "void linearOut(void *, const T &) [with
>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of
>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>             instantiation of "void MiniIVFAB<T>::linearOut(void *, const
>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
>>> long}}]"
>>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>             instantiation of "void BaseEBCellFAB<T>::linearOut(void *,
>>> const Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo
>>> ols/BoxLayoutData.H"
>>>             instantiation of "void LDOperator<T>::linearOut(const T &,
>>> void *, const Box &, const Interval &) const [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>             implicit generation of "LDOperator<T>::LDOperator() [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>             instantiation of class "LDOperator<T> [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
>>> BoxLayoutData<T> &, const Interval &, const Copier &, const LDOperator<T>
>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
>>> BoxLayoutData<T> &, const Interval &) const [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>             instantiation of "LevelData<T>::LevelData() [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
>>> "../srcLib/EBPetscSolver.cpp"
>>>
>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression must
>>> have class type
>>>     a_outputT.linearIn(inBuf);
>>>     ^
>>>           detected during:
>>>             instantiation of "void linearIn(T &, const void *) [with
>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of
>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>             instantiation of "void MiniIVFAB<T>::linearIn(void *, const
>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long long}}]" at
>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>             instantiation of "void BaseEBCellFAB<T>::linearIn(void *,
>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long
>>> long}}]"
>>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
>>>             instantiation of "void LDOperator<T>::linearIn(T &, void *,
>>> const Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
>>> cInt64={long
>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>             implicit generation of "LDOperator<T>::LDOperator() [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>             instantiation of class "LDOperator<T> [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
>>> BoxLayoutData<T> &, const Interval &, const Copier &, const LDOperator<T>
>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
>>> BoxLayoutData<T> &, const Interval &) const [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>             instantiation of "LevelData<T>::LevelData() [with
>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
>>> "../srcLib/EBPetscSolver.cpp"
>>>
>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2)
>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.DEBUG.MPI.PETSC/EBPetscSolver.o]
>>> Error 2
>>>
>>>
>>> On 12/22/2016 09:42 AM, Mark Adams wrote:
>>>
>>> I have build a debug version (opt64 --> dbg64). You might try that.
>>>>
>>>> On Wed, Dec 21, 2016 at 9:46 PM, Mark Adams <mfadams at lbl.gov> wrote:
>>>>
>>>>
>>>>
>>>>> On Wed, Dec 21, 2016 at 2:25 PM, David Trebotich <treb at hpcrd.lbl.gov>
>>>>> wrote:
>>>>>
>>>>> This wasn't happening until after you rebuilt petsc.  So I am wondering
>>>>>
>>>>>> if you upgraded or changed something??
>>>>>>
>>>>>>
>>>>>
>>>>> Humm, let me rebuild. This is on Edison I assume.
>>>>>
>>>>> Try PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc3
>>>>> 0-opt64-intel
>>>>> (again)
>>>>>
>>>>> This is a new build. I would also do a deep clean on your end, of
>>>>> course.
>>>>>
>>>>> I see a DCH_USE_COMPLEX ...
>>>>>
>>>>> Also, I would try a debug build just to get some data. This is some
>>>>> strange problem of something is out of synch.
>>>>>
>>>>>
>>>>>
>>>>> On 12/19/2016 05:05 PM, Mark Adams wrote:
>>>>>>
>>>>>> On Mon, Dec 19, 2016 at 6:35 PM, David Trebotich <treb at hpcrd.lbl.gov>
>>>>>>
>>>>>>> wrote:
>>>>>>>
>>>>>>> I am sorry, you mean I need to add that to environment variables?
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>> The PETSC_ARCH is hardwired for the size of integers so you would use
>>>>>>> PETSC_ARCH=arch-xc30-opt-intel to get 32 bit ints (I don't know of
>>>>>>> this
>>>>>>> installation ever being used). But now that I think about it you
>>>>>>> always
>>>>>>> use
>>>>>>> 64 bit ints and you need to.
>>>>>>>
>>>>>>> So what is going on here ... it looks like an object has been
>>>>>>> templated
>>>>>>> on
>>>>>>> a PetscInt and is getting mixed up. I don't think you ever use 32 bit
>>>>>>> ints
>>>>>>> in PETSc so it looks like you regressed here... I don't have a lot of
>>>>>>> experience with templates. I'd ask Brian or Dan.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On 12/19/2016 03:34 PM, Mark Adams wrote:
>>>>>>>>
>>>>>>>> There is a: arch-xc30-opt-intel
>>>>>>>>
>>>>>>>>
>>>>>>>>> On Mon, Dec 19, 2016 at 6:25 PM, David Trebotich <
>>>>>>>>> treb at hpcrd.lbl.gov>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>> Hey Mark-
>>>>>>>>>
>>>>>>>>> We have had this issue recently and am wondering if you know what
>>>>>>>>>
>>>>>>>>>> the
>>>>>>>>>> problem is.  Maybe an int vs. PetscInt vs. PetscInt64 kind of
>>>>>>>>>> thing?
>>>>>>>>>>
>>>>>>>>>> CC  -O2 -fast -no-ipo -std=c++11 -O3 -m64
>>>>>>>>>> -qopt-multi-version-aggressive
>>>>>>>>>> -restrict -m64 -std=c++11 -Wno-unknown-pragmas -diag-disable 3180
>>>>>>>>>> -DCH_SPACEDIM=3 -DCH_Linux   -DNDEBUG  -DCH_MPI
>>>>>>>>>> -DMPICH_SKIP_MPICXX
>>>>>>>>>> -ULAM_WANT_MPI2CPP -DMPI_NO_CPPBIND     -DCH_USE_COMPLEX
>>>>>>>>>>  -DCH_USE_EB
>>>>>>>>>> -DCH_USE_MEMORY_TRACKING  -DCH_USE_64 -DCH_USE_DOUBLE
>>>>>>>>>> -DCH_USE_HDF5
>>>>>>>>>> -I/opt/cray/hdf5-parallel/1.8.16/INTEL/15.0/include    -I.
>>>>>>>>>> -I../srcBCG
>>>>>>>>>> -I../srcLib -I../srcAdvectDiffuseCrunch_BCG
>>>>>>>>>> -I../srcCrunchFlow_BCG
>>>>>>>>>> -I../srcCrunchFlow_BCG/modules    -DCH_USE_PETSC
>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
>>>>>>>>>> intel/include
>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
>>>>>>>>>> intel/include
>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
>>>>>>>>>> intel/include
>>>>>>>>>> -DCH_FORT_UNDERSCORE -I../../../Chombo/lib/src/EBAMRTimeDependent
>>>>>>>>>> -I../../../Chombo/lib/src/EBAMRElliptic
>>>>>>>>>> -I../../../Chombo/lib/src/EBAM
>>>>>>>>>> RTools
>>>>>>>>>> -I../../../Chombo/lib/src/Workshop -I../../../Chombo/lib/src/EBTo
>>>>>>>>>> ols
>>>>>>>>>> -I../../../Chombo/lib/src/AMRTimeDependent
>>>>>>>>>> -I../../../Chombo/lib/src/AMRElliptic
>>>>>>>>>> -I../../../Chombo/lib/src/AMRTools -I../../../Chombo/lib/src/BoxT
>>>>>>>>>> ools
>>>>>>>>>> -I../../../Chombo/lib/src/BaseTools  -DCH_LANG_CC -c
>>>>>>>>>> ../srcLib/EBPetscSolver.cpp -o o/3d.Linux.64.CC.ftn.OPTHIGH.M
>>>>>>>>>> PI.PETSC/EBPetscSolver.o
>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression
>>>>>>>>>> must
>>>>>>>>>> have class type
>>>>>>>>>>     return inputT.linearSize();
>>>>>>>>>>            ^
>>>>>>>>>>           detected during:
>>>>>>>>>>             instantiation of "int linearSize(const T &) [with
>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of
>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>>>>>>>>             instantiation of "int MiniIVFAB<T>::size(const Box &,
>>>>>>>>>> const
>>>>>>>>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at
>>>>>>>>>> line
>>>>>>>>>> 155
>>>>>>>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>>>>>>>>             instantiation of "int BaseEBCellFAB<T>::size(const Box
>>>>>>>>>> &,
>>>>>>>>>> const Interval &) const [with T=PetscInt={PetscInt64={long
>>>>>>>>>> long}}]" at
>>>>>>>>>> line
>>>>>>>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
>>>>>>>>>>             instantiation of "int LDOperator<T>::size(const T &,
>>>>>>>>>> const
>>>>>>>>>> Box
>>>>>>>>>> &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
>>>>>>>>>> cInt64={long
>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
>>>>>>>>>> ols/LevelData.H"
>>>>>>>>>>             implicit generation of "LDOperator<T>::LDOperator()
>>>>>>>>>> [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>> of
>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>             instantiation of class "LDOperator<T> [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>> of
>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>> Interval &,
>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
>>>>>>>>>> LDOperator<T>
>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
>>>>>>>>>> long}}>]"
>>>>>>>>>> at
>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>> Interval &,
>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
>>>>>>>>>> of
>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>             instantiation of "LevelData<T>::LevelData() [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
>>>>>>>>>> of
>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
>>>>>>>>>>
>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression
>>>>>>>>>> must
>>>>>>>>>> have class type
>>>>>>>>>>     inputT.linearOut(a_outBuf);
>>>>>>>>>>     ^
>>>>>>>>>>           detected during:
>>>>>>>>>>             instantiation of "void linearOut(void *, const T &)
>>>>>>>>>> [with
>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of
>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>>>>>>>>             instantiation of "void MiniIVFAB<T>::linearOut(void *,
>>>>>>>>>> const
>>>>>>>>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
>>>>>>>>>> long}}]"
>>>>>>>>>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>>>>>>>>             instantiation of "void BaseEBCellFAB<T>::linearOut(vo
>>>>>>>>>> id
>>>>>>>>>> *,
>>>>>>>>>> const Box &, const Interval &) const [with
>>>>>>>>>> T=PetscInt={PetscInt64={long
>>>>>>>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo
>>>>>>>>>> ols/BoxLayoutData.H"
>>>>>>>>>>             instantiation of "void LDOperator<T>::linearOut(const
>>>>>>>>>> T &,
>>>>>>>>>> void *, const Box &, const Interval &) const [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>> of
>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>             implicit generation of "LDOperator<T>::LDOperator()
>>>>>>>>>> [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>> of
>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>             instantiation of class "LDOperator<T> [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>> of
>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>> Interval &,
>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
>>>>>>>>>> LDOperator<T>
>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
>>>>>>>>>> long}}>]"
>>>>>>>>>> at
>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>> Interval &,
>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
>>>>>>>>>> of
>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>             instantiation of "LevelData<T>::LevelData() [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
>>>>>>>>>> of
>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
>>>>>>>>>>
>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression
>>>>>>>>>> must
>>>>>>>>>> have class type
>>>>>>>>>>     a_outputT.linearIn(inBuf);
>>>>>>>>>>     ^
>>>>>>>>>>           detected during:
>>>>>>>>>>             instantiation of "void linearIn(T &, const void *)
>>>>>>>>>> [with
>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of
>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>>>>>>>>             instantiation of "void MiniIVFAB<T>::linearIn(void *,
>>>>>>>>>> const
>>>>>>>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long
>>>>>>>>>> long}}]"
>>>>>>>>>> at
>>>>>>>>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>>>>>>>>             instantiation of "void BaseEBCellFAB<T>::linearIn(voi
>>>>>>>>>> d
>>>>>>>>>> *,
>>>>>>>>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long
>>>>>>>>>> long}}]"
>>>>>>>>>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
>>>>>>>>>>             instantiation of "void LDOperator<T>::linearIn(T &,
>>>>>>>>>> void
>>>>>>>>>> *,
>>>>>>>>>> const Box &, const Interval &) const [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={Pets
>>>>>>>>>> cInt64={long
>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
>>>>>>>>>> ols/LevelData.H"
>>>>>>>>>>             implicit generation of "LDOperator<T>::LDOperator()
>>>>>>>>>> [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>> of
>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>             instantiation of class "LDOperator<T> [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>> of
>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>> Interval &,
>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
>>>>>>>>>> LDOperator<T>
>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
>>>>>>>>>> long}}>]"
>>>>>>>>>> at
>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>> Interval &,
>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
>>>>>>>>>> of
>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>             instantiation of "LevelData<T>::LevelData() [with
>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
>>>>>>>>>> of
>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
>>>>>>>>>>
>>>>>>>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2)
>>>>>>>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.OPTHIGH.
>>>>>>>>>> MPI.PETSC/EBPetscSolver.o]
>>>>>>>>>> Error 2
>>>>>>>>>> make: *** [all-example] Error 2
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On 12/19/2016 03:09 PM, Mark Adams wrote:
>>>>>>>>>>
>>>>>>>>>> Sorry cleaning up. insert "petsc_install" in the path: "...madams/
>>>>>>>>>>
>>>>>>>>>> petsc_install/petscv3.6..."
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Dec 19, 2016 at 5:43 PM, David Trebotich <
>>>>>>>>>>> treb at hpcrd.lbl.gov
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Hey Mark-
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> I seem to have lost contact with petsc over the weekend:
>>>>>>>>>>>
>>>>>>>>>>>> /global/homes/m/madams/petscv3.6-xc30-opt64-intel//lib/
>>>>>>>>>>>> petsc/conf/variables:
>>>>>>>>>>>> No such file or directory
>>>>>>>>>>>> Last chance .ex rule for target /global/homes/m/madams/petscv3
>>>>>>>>>>>> .6-xc30-opt64-intel//lib/petsc/conf/variables
>>>>>>>>>>>>
>>>>>>>>>>>> setenv | grep petsc:
>>>>>>>>>>>> PE_PETSC_DEFAULT_VOLATILE_PKGCONFIG_PATH=/opt/cray/petsc/3.
>>>>>>>>>>>> 7.2.0/real/@PRGENV@/@PE_PETSC_DEFAULT_GENCOMPS@/@PE_PETSC_
>>>>>>>>>>>> DEFAULT_TARGET@/lib/pkgconfig
>>>>>>>>>>>> PETSC_DIR=/global/homes/m/madams/petscv3.6-xc30-opt64-intel/
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Currently Loaded Modulefiles:
>>>>>>>>>>>>   1) modules/3.2.10.4                       8) intel/15.0.1.133
>>>>>>>>>>>>     15) xpmem/0.1-2.0502.57015.1.15.ari       22)
>>>>>>>>>>>> cray-mpich/7.4.1
>>>>>>>>>>>>   2) nsg/1.2.0                              9)
>>>>>>>>>>>> cray-libsci/16.07.1
>>>>>>>>>>>>       16) dvs/2.5_0.9.0-1.0502.1958.2.55.ari    23)
>>>>>>>>>>>> slurm/edison
>>>>>>>>>>>>   3) eswrap/1.3.3-1.020200.1278.0          10)
>>>>>>>>>>>> udreg/2.3.2-1.0502.9889.2.20.ari      17)
>>>>>>>>>>>> alps/5.2.3-2.0502.9295.14.14.a
>>>>>>>>>>>> ri
>>>>>>>>>>>>     24) altd/2.0
>>>>>>>>>>>>   4) switch/1.0-1.0502.57058.1.58.ari      11)
>>>>>>>>>>>> ugni/6.0-1.0502.10245.9.9.ari         18) rca/
>>>>>>>>>>>> 1.0.0-2.0502.57212.2.56.ar
>>>>>>>>>>>> i
>>>>>>>>>>>>      25) darshan/2.3.1
>>>>>>>>>>>>   5) craype-ivybridge                      12) pmi/
>>>>>>>>>>>> 5.0.10-1.0000.11050.0.0.ari       19) atp/2.0.2        26)
>>>>>>>>>>>> emacs/24.2
>>>>>>>>>>>>   6) craype-network-aries                  13)
>>>>>>>>>>>> dmapp/7.0.1-1.0502.10246.8.47.ari     20) PrgEnv-intel/5.2.56
>>>>>>>>>>>> 27)
>>>>>>>>>>>> cray-hdf5-parallel/1.8.16
>>>>>>>>>>>>   7) craype/2.4.2                          14)
>>>>>>>>>>>> gni-headers/4.0-1.0502.10317.9.2.ari  21) cray-shmem/7.4.1
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>
>>>>>>>>>>>> treb
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> David Trebotich
>>>>>>>>>>>> Applied Numerical Algorithms Group
>>>>>>>>>>>> Lawrence Berkeley National Laboratory
>>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
>>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>> David Trebotich
>>>>>>>>>>>
>>>>>>>>>> Applied Numerical Algorithms Group
>>>>>>>>>> Lawrence Berkeley National Laboratory
>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> David Trebotich
>>>>>>>> Applied Numerical Algorithms Group
>>>>>>>> Lawrence Berkeley National Laboratory
>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>
>>>>>> David Trebotich
>>>>>> Applied Numerical Algorithms Group
>>>>>> Lawrence Berkeley National Laboratory
>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>> --
>>> David Trebotich
>>> Applied Numerical Algorithms Group
>>> Lawrence Berkeley National Laboratory
>>> (510) 486-5984 office
>>> (510) 384-6868 mobile
>>>
>>>
>>>
>> --
>> David Trebotich
>> Applied Numerical Algorithms Group
>> Computational Research Division
>> Lawrence Berkeley National Laboratory(510) 486-5984 office(510) 384-6868
>> mobile
>>
>>
>>
>
-- 
David Trebotich
Applied Numerical Algorithms Group
Lawrence Berkeley National Laboratory
(510) 486-5984 office
(510) 384-6868 mobile
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20170110/bd9839f5/attachment.html>


More information about the petsc-dev mailing list