[petsc-dev] Fwd: no petsc on Edison
Matthew Knepley
knepley at gmail.com
Tue Jan 10 14:54:32 CST 2017
On Tue, Jan 10, 2017 at 2:47 PM, Mark Adams <mfadams at lbl.gov> wrote:
> We have a code that is failing on large scale runs on Edison at NERSC. We
> ran with a debug version and we got this error message that I assume is
> from a check that is done in debug. Is this a false positive? This is a 64
> bit integer build.
>
Satish just fixed an error with hash table sizes. You can try on the latest
master.
Thanks,
Matt
> Thanks,
> Mark
>
> [5]PETSC ERROR: --------------------- Error Message
> --------------------------------------------------------------
> [5]PETSC ERROR: Argument out of range
> [5]PETSC ERROR: A really huge hash is being requested.. cannot process:
> 4294967296
> [5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html
> for trouble shooting.
> [5]PETSC ERROR: Petsc Development GIT revision: v3.7.4-2584-g7175242 GIT
> Date: 2016-12-21 13:19:16 -0600
> [5]PETSC ERROR: /tmp/targetExec on a arch-xc30-dbg64-intel named nid00008
> by u6338 Sat Jan 7 16:39:16 2017
> [5]PETSC ERROR: Configure options --COPTFLAGS="-O0 -g -no-ipo"
> --CXXOPTFLAGS="-O0 -g -no-ipo" --FOPTFLAGS="-O0 -g -ipo"
> --download-parmetis --download-metis --download-hypre --with-ssl=0
> --with-cc=cc --with-clib-autodetect=0 --with-cxx=CC
> --with-cxxlib-autodetect=0 --with-debugging=1 --with-fc=ftn
> --with-fortranlib-autodetect=0 --with-shared-libraries=0 --with-x=0
> --with-mpiexec=srun LIBS=-lstdc++ --with-64-bit-indices
> --prefix=/global/homes/m/madams/petsc_install/petscv3.7-x[16527]PETSC
> ERROR: ----
>
> using:
> PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc30-dbg64-intel/
>
> maybe go back to opt version?
>
>
> On 12/22/2016 03:22 PM, Mark Adams wrote:
>
>> You configure with the size of an integer explicitly, ie,
>> --with-64-bit-integers. I can't imagine there is anything bigger, but it
>> would not be hard to do.
>>
>> On Thu, Dec 22, 2016 at 6:06 PM, David Trebotich <treb at hpcrdm.lbl.gov>
>> wrote:
>>
>> i just committed changes to SPMD that Brian needed for signed long long.
>>> Evidently petsc is now handling bigger matrices?
>>>
>>>
>>> On 12/22/2016 2:57 PM, Mark Adams wrote:
>>>
>>> There are a few hits on stack exchange, google:
>>>
>>> "error: expression must have class type"
>>>
>>> I think intputT is a templated type and it is templated with a PetscInt.
>>> You are calling the linearSize() method on a primitive type. That is my
>>> best guess.
>>>
>>> On Thu, Dec 22, 2016 at 3:33 PM, David Trebotich <treb at hpcrd.lbl.gov>
>>> wrote:
>>>
>>> building with dbg looks same:
>>>>
>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression must
>>>> have class type
>>>> return inputT.linearSize();
>>>> ^
>>>> detected during:
>>>> instantiation of "int linearSize(const T &) [with
>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of
>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>> instantiation of "int MiniIVFAB<T>::size(const Box &, const
>>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at line
>>>> 155
>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>> instantiation of "int BaseEBCellFAB<T>::size(const Box &,
>>>> const Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at
>>>> line
>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
>>>> instantiation of "int LDOperator<T>::size(const T &, const
>>>> Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
>>>> cInt64={long
>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>> implicit generation of "LDOperator<T>::LDOperator() [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>> instantiation of class "LDOperator<T> [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>> instantiation of "void LevelData<T>::copyTo(const Interval
>>>> &,
>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
>>>> LDOperator<T>
>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>> instantiation of "void LevelData<T>::copyTo(const Interval
>>>> &,
>>>> BoxLayoutData<T> &, const Interval &) const [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>> instantiation of "LevelData<T>::LevelData() [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
>>>> "../srcLib/EBPetscSolver.cpp"
>>>>
>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression must
>>>> have class type
>>>> inputT.linearOut(a_outBuf);
>>>> ^
>>>> detected during:
>>>> instantiation of "void linearOut(void *, const T &) [with
>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of
>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>> instantiation of "void MiniIVFAB<T>::linearOut(void *, const
>>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
>>>> long}}]"
>>>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>> instantiation of "void BaseEBCellFAB<T>::linearOut(void *,
>>>> const Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo
>>>> ols/BoxLayoutData.H"
>>>> instantiation of "void LDOperator<T>::linearOut(const T &,
>>>> void *, const Box &, const Interval &) const [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>> implicit generation of "LDOperator<T>::LDOperator() [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>> instantiation of class "LDOperator<T> [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>> instantiation of "void LevelData<T>::copyTo(const Interval
>>>> &,
>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
>>>> LDOperator<T>
>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>> instantiation of "void LevelData<T>::copyTo(const Interval
>>>> &,
>>>> BoxLayoutData<T> &, const Interval &) const [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>> instantiation of "LevelData<T>::LevelData() [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
>>>> "../srcLib/EBPetscSolver.cpp"
>>>>
>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression must
>>>> have class type
>>>> a_outputT.linearIn(inBuf);
>>>> ^
>>>> detected during:
>>>> instantiation of "void linearIn(T &, const void *) [with
>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of
>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>> instantiation of "void MiniIVFAB<T>::linearIn(void *, const
>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long long}}]" at
>>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>> instantiation of "void BaseEBCellFAB<T>::linearIn(void *,
>>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long
>>>> long}}]"
>>>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
>>>> instantiation of "void LDOperator<T>::linearIn(T &, void *,
>>>> const Box &, const Interval &) const [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long
>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>> implicit generation of "LDOperator<T>::LDOperator() [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>> instantiation of class "LDOperator<T> [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>> instantiation of "void LevelData<T>::copyTo(const Interval
>>>> &,
>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
>>>> LDOperator<T>
>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>> instantiation of "void LevelData<T>::copyTo(const Interval
>>>> &,
>>>> BoxLayoutData<T> &, const Interval &) const [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>> instantiation of "LevelData<T>::LevelData() [with
>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
>>>> "../srcLib/EBPetscSolver.cpp"
>>>>
>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2)
>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.DEBUG.MPI.PETSC/EBPetscSolver.o]
>>>> Error 2
>>>>
>>>>
>>>> On 12/22/2016 09:42 AM, Mark Adams wrote:
>>>>
>>>> I have build a debug version (opt64 --> dbg64). You might try that.
>>>>>
>>>>> On Wed, Dec 21, 2016 at 9:46 PM, Mark Adams <mfadams at lbl.gov> wrote:
>>>>>
>>>>>
>>>>>
>>>>>> On Wed, Dec 21, 2016 at 2:25 PM, David Trebotich <treb at hpcrd.lbl.gov>
>>>>>> wrote:
>>>>>>
>>>>>> This wasn't happening until after you rebuilt petsc. So I am
>>>>>> wondering
>>>>>>
>>>>>>> if you upgraded or changed something??
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> Humm, let me rebuild. This is on Edison I assume.
>>>>>>
>>>>>> Try PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc3
>>>>>> 0-opt64-intel
>>>>>> (again)
>>>>>>
>>>>>> This is a new build. I would also do a deep clean on your end, of
>>>>>> course.
>>>>>>
>>>>>> I see a DCH_USE_COMPLEX ...
>>>>>>
>>>>>> Also, I would try a debug build just to get some data. This is some
>>>>>> strange problem of something is out of synch.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 12/19/2016 05:05 PM, Mark Adams wrote:
>>>>>>>
>>>>>>> On Mon, Dec 19, 2016 at 6:35 PM, David Trebotich <treb at hpcrd.lbl.gov
>>>>>>> >
>>>>>>>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>> I am sorry, you mean I need to add that to environment variables?
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>> The PETSC_ARCH is hardwired for the size of integers so you would
>>>>>>>> use
>>>>>>>> PETSC_ARCH=arch-xc30-opt-intel to get 32 bit ints (I don't know of
>>>>>>>> this
>>>>>>>> installation ever being used). But now that I think about it you
>>>>>>>> always
>>>>>>>> use
>>>>>>>> 64 bit ints and you need to.
>>>>>>>>
>>>>>>>> So what is going on here ... it looks like an object has been
>>>>>>>> templated
>>>>>>>> on
>>>>>>>> a PetscInt and is getting mixed up. I don't think you ever use 32
>>>>>>>> bit
>>>>>>>> ints
>>>>>>>> in PETSc so it looks like you regressed here... I don't have a lot
>>>>>>>> of
>>>>>>>> experience with templates. I'd ask Brian or Dan.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On 12/19/2016 03:34 PM, Mark Adams wrote:
>>>>>>>>>
>>>>>>>>> There is a: arch-xc30-opt-intel
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> On Mon, Dec 19, 2016 at 6:25 PM, David Trebotich <
>>>>>>>>>> treb at hpcrd.lbl.gov>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>> Hey Mark-
>>>>>>>>>>
>>>>>>>>>> We have had this issue recently and am wondering if you know what
>>>>>>>>>>
>>>>>>>>>>> the
>>>>>>>>>>> problem is. Maybe an int vs. PetscInt vs. PetscInt64 kind of
>>>>>>>>>>> thing?
>>>>>>>>>>>
>>>>>>>>>>> CC -O2 -fast -no-ipo -std=c++11 -O3 -m64
>>>>>>>>>>> -qopt-multi-version-aggressive
>>>>>>>>>>> -restrict -m64 -std=c++11 -Wno-unknown-pragmas -diag-disable 3180
>>>>>>>>>>> -DCH_SPACEDIM=3 -DCH_Linux -DNDEBUG -DCH_MPI
>>>>>>>>>>> -DMPICH_SKIP_MPICXX
>>>>>>>>>>> -ULAM_WANT_MPI2CPP -DMPI_NO_CPPBIND -DCH_USE_COMPLEX
>>>>>>>>>>> -DCH_USE_EB
>>>>>>>>>>> -DCH_USE_MEMORY_TRACKING -DCH_USE_64 -DCH_USE_DOUBLE
>>>>>>>>>>> -DCH_USE_HDF5
>>>>>>>>>>> -I/opt/cray/hdf5-parallel/1.8.16/INTEL/15.0/include -I.
>>>>>>>>>>> -I../srcBCG
>>>>>>>>>>> -I../srcLib -I../srcAdvectDiffuseCrunch_BCG
>>>>>>>>>>> -I../srcCrunchFlow_BCG
>>>>>>>>>>> -I../srcCrunchFlow_BCG/modules -DCH_USE_PETSC
>>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
>>>>>>>>>>> intel/include
>>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
>>>>>>>>>>> intel/include
>>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
>>>>>>>>>>> intel/include
>>>>>>>>>>> -DCH_FORT_UNDERSCORE -I../../../Chombo/lib/src/EBAM
>>>>>>>>>>> RTimeDependent
>>>>>>>>>>> -I../../../Chombo/lib/src/EBAMRElliptic
>>>>>>>>>>> -I../../../Chombo/lib/src/EBAM
>>>>>>>>>>> RTools
>>>>>>>>>>> -I../../../Chombo/lib/src/Workshop
>>>>>>>>>>> -I../../../Chombo/lib/src/EBTo
>>>>>>>>>>> ols
>>>>>>>>>>> -I../../../Chombo/lib/src/AMRTimeDependent
>>>>>>>>>>> -I../../../Chombo/lib/src/AMRElliptic
>>>>>>>>>>> -I../../../Chombo/lib/src/AMRTools
>>>>>>>>>>> -I../../../Chombo/lib/src/BoxT
>>>>>>>>>>> ools
>>>>>>>>>>> -I../../../Chombo/lib/src/BaseTools -DCH_LANG_CC -c
>>>>>>>>>>> ../srcLib/EBPetscSolver.cpp -o o/3d.Linux.64.CC.ftn.OPTHIGH.M
>>>>>>>>>>> PI.PETSC/EBPetscSolver.o
>>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression
>>>>>>>>>>> must
>>>>>>>>>>> have class type
>>>>>>>>>>> return inputT.linearSize();
>>>>>>>>>>> ^
>>>>>>>>>>> detected during:
>>>>>>>>>>> instantiation of "int linearSize(const T &) [with
>>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of
>>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>>>>>>>>> instantiation of "int MiniIVFAB<T>::size(const Box &,
>>>>>>>>>>> const
>>>>>>>>>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at
>>>>>>>>>>> line
>>>>>>>>>>> 155
>>>>>>>>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>>>>>>>>> instantiation of "int BaseEBCellFAB<T>::size(const
>>>>>>>>>>> Box
>>>>>>>>>>> &,
>>>>>>>>>>> const Interval &) const [with T=PetscInt={PetscInt64={long
>>>>>>>>>>> long}}]" at
>>>>>>>>>>> line
>>>>>>>>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
>>>>>>>>>>> instantiation of "int LDOperator<T>::size(const T &,
>>>>>>>>>>> const
>>>>>>>>>>> Box
>>>>>>>>>>> &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
>>>>>>>>>>> cInt64={long
>>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
>>>>>>>>>>> ols/LevelData.H"
>>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator()
>>>>>>>>>>> [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>>> of
>>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>> instantiation of class "LDOperator<T> [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>>> of
>>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>>> Interval &,
>>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
>>>>>>>>>>> LDOperator<T>
>>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
>>>>>>>>>>> long}}>]"
>>>>>>>>>>> at
>>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>>> Interval &,
>>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
>>>>>>>>>>> of
>>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
>>>>>>>>>>> of
>>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
>>>>>>>>>>>
>>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression
>>>>>>>>>>> must
>>>>>>>>>>> have class type
>>>>>>>>>>> inputT.linearOut(a_outBuf);
>>>>>>>>>>> ^
>>>>>>>>>>> detected during:
>>>>>>>>>>> instantiation of "void linearOut(void *, const T &)
>>>>>>>>>>> [with
>>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of
>>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearOut(void
>>>>>>>>>>> *,
>>>>>>>>>>> const
>>>>>>>>>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
>>>>>>>>>>> long}}]"
>>>>>>>>>>> at line 169 of "../../../Chombo/lib/src/EBToo
>>>>>>>>>>> ls/BaseEBCellFABI.H"
>>>>>>>>>>> instantiation of "void BaseEBCellFAB<T>::linearOut(vo
>>>>>>>>>>> id
>>>>>>>>>>> *,
>>>>>>>>>>> const Box &, const Interval &) const [with
>>>>>>>>>>> T=PetscInt={PetscInt64={long
>>>>>>>>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo
>>>>>>>>>>> ols/BoxLayoutData.H"
>>>>>>>>>>> instantiation of "void LDOperator<T>::linearOut(const
>>>>>>>>>>> T &,
>>>>>>>>>>> void *, const Box &, const Interval &) const [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>>> of
>>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator()
>>>>>>>>>>> [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>>> of
>>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>> instantiation of class "LDOperator<T> [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>>> of
>>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>>> Interval &,
>>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
>>>>>>>>>>> LDOperator<T>
>>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
>>>>>>>>>>> long}}>]"
>>>>>>>>>>> at
>>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>>> Interval &,
>>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
>>>>>>>>>>> of
>>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
>>>>>>>>>>> of
>>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
>>>>>>>>>>>
>>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression
>>>>>>>>>>> must
>>>>>>>>>>> have class type
>>>>>>>>>>> a_outputT.linearIn(inBuf);
>>>>>>>>>>> ^
>>>>>>>>>>> detected during:
>>>>>>>>>>> instantiation of "void linearIn(T &, const void *)
>>>>>>>>>>> [with
>>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of
>>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
>>>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearIn(void *,
>>>>>>>>>>> const
>>>>>>>>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long
>>>>>>>>>>> long}}]"
>>>>>>>>>>> at
>>>>>>>>>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
>>>>>>>>>>> instantiation of "void BaseEBCellFAB<T>::linearIn(voi
>>>>>>>>>>> d
>>>>>>>>>>> *,
>>>>>>>>>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long
>>>>>>>>>>> long}}]"
>>>>>>>>>>> at line 159 of "../../../Chombo/lib/src/BoxTo
>>>>>>>>>>> ols/BoxLayoutData.H"
>>>>>>>>>>> instantiation of "void LDOperator<T>::linearIn(T &,
>>>>>>>>>>> void
>>>>>>>>>>> *,
>>>>>>>>>>> const Box &, const Interval &) const [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={Pets
>>>>>>>>>>> cInt64={long
>>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
>>>>>>>>>>> ols/LevelData.H"
>>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator()
>>>>>>>>>>> [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>>> of
>>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>> instantiation of class "LDOperator<T> [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
>>>>>>>>>>> of
>>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
>>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>>> Interval &,
>>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
>>>>>>>>>>> LDOperator<T>
>>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
>>>>>>>>>>> long}}>]"
>>>>>>>>>>> at
>>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
>>>>>>>>>>> Interval &,
>>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
>>>>>>>>>>> of
>>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
>>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with
>>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
>>>>>>>>>>> of
>>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
>>>>>>>>>>>
>>>>>>>>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2)
>>>>>>>>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.OPTHIGH.
>>>>>>>>>>> MPI.PETSC/EBPetscSolver.o]
>>>>>>>>>>> Error 2
>>>>>>>>>>> make: *** [all-example] Error 2
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On 12/19/2016 03:09 PM, Mark Adams wrote:
>>>>>>>>>>>
>>>>>>>>>>> Sorry cleaning up. insert "petsc_install" in the path:
>>>>>>>>>>> "...madams/
>>>>>>>>>>>
>>>>>>>>>>> petsc_install/petscv3.6..."
>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On Mon, Dec 19, 2016 at 5:43 PM, David Trebotich <
>>>>>>>>>>>> treb at hpcrd.lbl.gov
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Hey Mark-
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> I seem to have lost contact with petsc over the weekend:
>>>>>>>>>>>>
>>>>>>>>>>>>> /global/homes/m/madams/petscv3.6-xc30-opt64-intel//lib/
>>>>>>>>>>>>> petsc/conf/variables:
>>>>>>>>>>>>> No such file or directory
>>>>>>>>>>>>> Last chance .ex rule for target /global/homes/m/madams/petscv3
>>>>>>>>>>>>> .6-xc30-opt64-intel//lib/petsc/conf/variables
>>>>>>>>>>>>>
>>>>>>>>>>>>> setenv | grep petsc:
>>>>>>>>>>>>> PE_PETSC_DEFAULT_VOLATILE_PKGCONFIG_PATH=/opt/cray/petsc/3.
>>>>>>>>>>>>> 7.2.0/real/@PRGENV@/@PE_PETSC_DEFAULT_GENCOMPS@/@PE_PETSC_
>>>>>>>>>>>>> DEFAULT_TARGET@/lib/pkgconfig
>>>>>>>>>>>>> PETSC_DIR=/global/homes/m/madams/petscv3.6-xc30-opt64-intel/
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Currently Loaded Modulefiles:
>>>>>>>>>>>>> 1) modules/3.2.10.4 8) intel/
>>>>>>>>>>>>> 15.0.1.133
>>>>>>>>>>>>> 15) xpmem/0.1-2.0502.57015.1.15.ari 22)
>>>>>>>>>>>>> cray-mpich/7.4.1
>>>>>>>>>>>>> 2) nsg/1.2.0 9)
>>>>>>>>>>>>> cray-libsci/16.07.1
>>>>>>>>>>>>> 16) dvs/2.5_0.9.0-1.0502.1958.2.55.ari 23)
>>>>>>>>>>>>> slurm/edison
>>>>>>>>>>>>> 3) eswrap/1.3.3-1.020200.1278.0 10)
>>>>>>>>>>>>> udreg/2.3.2-1.0502.9889.2.20.ari 17)
>>>>>>>>>>>>> alps/5.2.3-2.0502.9295.14.14.a
>>>>>>>>>>>>> ri
>>>>>>>>>>>>> 24) altd/2.0
>>>>>>>>>>>>> 4) switch/1.0-1.0502.57058.1.58.ari 11)
>>>>>>>>>>>>> ugni/6.0-1.0502.10245.9.9.ari 18) rca/
>>>>>>>>>>>>> 1.0.0-2.0502.57212.2.56.ar
>>>>>>>>>>>>> i
>>>>>>>>>>>>> 25) darshan/2.3.1
>>>>>>>>>>>>> 5) craype-ivybridge 12) pmi/
>>>>>>>>>>>>> 5.0.10-1.0000.11050.0.0.ari 19) atp/2.0.2 26)
>>>>>>>>>>>>> emacs/24.2
>>>>>>>>>>>>> 6) craype-network-aries 13)
>>>>>>>>>>>>> dmapp/7.0.1-1.0502.10246.8.47.ari 20) PrgEnv-intel/5.2.56
>>>>>>>>>>>>> 27)
>>>>>>>>>>>>> cray-hdf5-parallel/1.8.16
>>>>>>>>>>>>> 7) craype/2.4.2 14)
>>>>>>>>>>>>> gni-headers/4.0-1.0502.10317.9.2.ari 21) cray-shmem/7.4.1
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>
>>>>>>>>>>>>> treb
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> David Trebotich
>>>>>>>>>>>>> Applied Numerical Algorithms Group
>>>>>>>>>>>>> Lawrence Berkeley National Laboratory
>>>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
>>>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>> David Trebotich
>>>>>>>>>>>>
>>>>>>>>>>> Applied Numerical Algorithms Group
>>>>>>>>>>> Lawrence Berkeley National Laboratory
>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> David Trebotich
>>>>>>>>> Applied Numerical Algorithms Group
>>>>>>>>> Lawrence Berkeley National Laboratory
>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>
>>>>>>> David Trebotich
>>>>>>> Applied Numerical Algorithms Group
>>>>>>> Lawrence Berkeley National Laboratory
>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>> --
>>>> David Trebotich
>>>> Applied Numerical Algorithms Group
>>>> Lawrence Berkeley National Laboratory
>>>> (510) 486-5984 office
>>>> (510) 384-6868 mobile
>>>>
>>>>
>>>>
>>> --
>>> David Trebotich
>>> Applied Numerical Algorithms Group
>>> Computational Research Division
>>> Lawrence Berkeley National Laboratory(510) 486-5984 office(510) 384-6868
>>> mobile
>>>
>>>
>>>
>>
> --
> David Trebotich
> Applied Numerical Algorithms Group
> Lawrence Berkeley National Laboratory
> (510) 486-5984 office
> (510) 384-6868 mobile
>
>
>
--
What most experimenters take for granted before they begin their
experiments is infinitely more interesting than any results to which their
experiments lead.
-- Norbert Wiener
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20170110/7f0c6df1/attachment.html>
More information about the petsc-dev
mailing list