[petsc-dev] Fwd: no petsc on Edison
Satish Balay
balay at mcs.anl.gov
Tue Jan 10 15:28:39 CST 2017
Yup. Thats 4294967296*8bytes 34GB RAM - just for this one hash table?
Satish
On Tue, 10 Jan 2017, Kong, Fande wrote:
> On Tue, Jan 10, 2017 at 1:47 PM, Mark Adams <mfadams at lbl.gov> wrote:
>
> > We have a code that is failing on large scale runs on Edison at NERSC. We
> > ran with a debug version and we got this error message that I assume is
> > from a check that is done in debug. Is this a false positive? This is a 64
> > bit integer build.
> > Thanks,
> > Mark
> >
> > [5]PETSC ERROR: --------------------- Error Message
> > --------------------------------------------------------------
> > [5]PETSC ERROR: Argument out of range
> > [5]PETSC ERROR: A really huge hash is being requested.. cannot process:
> > 4294967296
> >
>
> Satish,
>
> The number "4294967296" is larger than the maximum number (2147321881) you
> put in the lookup.
>
> I guess your fixes do not help this one.
>
>
> Fande,
>
>
>
>
> > [5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html
> > <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.mcs.anl.gov_petsc_documentation_faq.html&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=BdTH9phOP3ipZiM21mw_gZrxPjWTeVcpXw9n-y7GECo&e=>
> > for trouble shooting.
> > [5]PETSC ERROR: Petsc Development GIT revision: v3.7.4-2584-g7175242 GIT
> > Date: 2016-12-21 13:19:16 -0600
> > [5]PETSC ERROR: /tmp/targetExec on a arch-xc30-dbg64-intel named nid00008
> > by u6338 Sat Jan 7 16:39:16 2017
> > [5]PETSC ERROR: Configure options --COPTFLAGS="-O0 -g -no-ipo"
> > --CXXOPTFLAGS="-O0 -g -no-ipo" --FOPTFLAGS="-O0 -g -ipo"
> > --download-parmetis --download-metis --download-hypre --with-ssl=0
> > --with-cc=cc --with-clib-autodetect=0 --with-cxx=CC
> > --with-cxxlib-autodetect=0 --with-debugging=1 --with-fc=ftn
> > --with-fortranlib-autodetect=0 --with-shared-libraries=0 --with-x=0
> > --with-mpiexec=srun LIBS=-lstdc++ --with-64-bit-indices
> > --prefix=/global/homes/m/madams/petsc_install/petscv3.7-x[16527]PETSC
> > ERROR: ----
> >
> > using:
> > PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc30-dbg64-intel/
> >
> > maybe go back to opt version?
> >
> >
> > On 12/22/2016 03:22 PM, Mark Adams wrote:
> >
> >> You configure with the size of an integer explicitly, ie,
> >> --with-64-bit-integers. I can't imagine there is anything bigger, but it
> >> would not be hard to do.
> >>
> >> On Thu, Dec 22, 2016 at 6:06 PM, David Trebotich <treb at hpcrdm.lbl.gov>
> >> wrote:
> >>
> >> i just committed changes to SPMD that Brian needed for signed long long.
> >>> Evidently petsc is now handling bigger matrices?
> >>>
> >>>
> >>> On 12/22/2016 2:57 PM, Mark Adams wrote:
> >>>
> >>> There are a few hits on stack exchange, google:
> >>>
> >>> "error: expression must have class type"
> >>>
> >>> I think intputT is a templated type and it is templated with a PetscInt.
> >>> You are calling the linearSize() method on a primitive type. That is my
> >>> best guess.
> >>>
> >>> On Thu, Dec 22, 2016 at 3:33 PM, David Trebotich <treb at hpcrd.lbl.gov>
> >>> wrote:
> >>>
> >>> building with dbg looks same:
> >>>>
> >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression must
> >>>> have class type
> >>>> return inputT.linearSize();
> >>>> ^
> >>>> detected during:
> >>>> instantiation of "int linearSize(const T &) [with
> >>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of
> >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> >>>> instantiation of "int MiniIVFAB<T>::size(const Box &, const
> >>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at line
> >>>> 155
> >>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> >>>> instantiation of "int BaseEBCellFAB<T>::size(const Box &,
> >>>> const Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at
> >>>> line
> >>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
> >>>> instantiation of "int LDOperator<T>::size(const T &, const
> >>>> Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
> >>>> cInt64={long
> >>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>> implicit generation of "LDOperator<T>::LDOperator() [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>> instantiation of class "LDOperator<T> [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>> instantiation of "void LevelData<T>::copyTo(const Interval
> >>>> &,
> >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> >>>> LDOperator<T>
> >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>> instantiation of "void LevelData<T>::copyTo(const Interval
> >>>> &,
> >>>> BoxLayoutData<T> &, const Interval &) const [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
> >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>> instantiation of "LevelData<T>::LevelData() [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
> >>>> "../srcLib/EBPetscSolver.cpp"
> >>>>
> >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression must
> >>>> have class type
> >>>> inputT.linearOut(a_outBuf);
> >>>> ^
> >>>> detected during:
> >>>> instantiation of "void linearOut(void *, const T &) [with
> >>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of
> >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> >>>> instantiation of "void MiniIVFAB<T>::linearOut(void *, const
> >>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
> >>>> long}}]"
> >>>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> >>>> instantiation of "void BaseEBCellFAB<T>::linearOut(void *,
> >>>> const Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
> >>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo
> >>>> ols/BoxLayoutData.H"
> >>>> instantiation of "void LDOperator<T>::linearOut(const T &,
> >>>> void *, const Box &, const Interval &) const [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>> implicit generation of "LDOperator<T>::LDOperator() [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>> instantiation of class "LDOperator<T> [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>> instantiation of "void LevelData<T>::copyTo(const Interval
> >>>> &,
> >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> >>>> LDOperator<T>
> >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>> instantiation of "void LevelData<T>::copyTo(const Interval
> >>>> &,
> >>>> BoxLayoutData<T> &, const Interval &) const [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
> >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>> instantiation of "LevelData<T>::LevelData() [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
> >>>> "../srcLib/EBPetscSolver.cpp"
> >>>>
> >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression must
> >>>> have class type
> >>>> a_outputT.linearIn(inBuf);
> >>>> ^
> >>>> detected during:
> >>>> instantiation of "void linearIn(T &, const void *) [with
> >>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of
> >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> >>>> instantiation of "void MiniIVFAB<T>::linearIn(void *, const
> >>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long long}}]" at
> >>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> >>>> instantiation of "void BaseEBCellFAB<T>::linearIn(void *,
> >>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long
> >>>> long}}]"
> >>>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
> >>>> instantiation of "void LDOperator<T>::linearIn(T &, void *,
> >>>> const Box &, const Interval &) const [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long
> >>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>> implicit generation of "LDOperator<T>::LDOperator() [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>> instantiation of class "LDOperator<T> [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>> instantiation of "void LevelData<T>::copyTo(const Interval
> >>>> &,
> >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> >>>> LDOperator<T>
> >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>> instantiation of "void LevelData<T>::copyTo(const Interval
> >>>> &,
> >>>> BoxLayoutData<T> &, const Interval &) const [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
> >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>> instantiation of "LevelData<T>::LevelData() [with
> >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
> >>>> "../srcLib/EBPetscSolver.cpp"
> >>>>
> >>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2)
> >>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.DEBUG.MP
> >>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__3d.Linux.64.CC.ftn.DEBUG.MP&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=HAhvWGeoB7HMK7Clyrfh_x-R465qxP-CNXK4zqhrCuE&e=>
> >>>> I.PETSC/EBPetscSolver.o]
> >>>> Error 2
> >>>>
> >>>>
> >>>> On 12/22/2016 09:42 AM, Mark Adams wrote:
> >>>>
> >>>> I have build a debug version (opt64 --> dbg64). You might try that.
> >>>>>
> >>>>> On Wed, Dec 21, 2016 at 9:46 PM, Mark Adams <mfadams at lbl.gov> wrote:
> >>>>>
> >>>>>
> >>>>>
> >>>>>> On Wed, Dec 21, 2016 at 2:25 PM, David Trebotich <treb at hpcrd.lbl.gov>
> >>>>>> wrote:
> >>>>>>
> >>>>>> This wasn't happening until after you rebuilt petsc. So I am
> >>>>>> wondering
> >>>>>>
> >>>>>>> if you upgraded or changed something??
> >>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>> Humm, let me rebuild. This is on Edison I assume.
> >>>>>>
> >>>>>> Try PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc3
> >>>>>> 0-opt64-intel
> >>>>>> (again)
> >>>>>>
> >>>>>> This is a new build. I would also do a deep clean on your end, of
> >>>>>> course.
> >>>>>>
> >>>>>> I see a DCH_USE_COMPLEX ...
> >>>>>>
> >>>>>> Also, I would try a debug build just to get some data. This is some
> >>>>>> strange problem of something is out of synch.
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>> On 12/19/2016 05:05 PM, Mark Adams wrote:
> >>>>>>>
> >>>>>>> On Mon, Dec 19, 2016 at 6:35 PM, David Trebotich <treb at hpcrd.lbl.gov
> >>>>>>> >
> >>>>>>>
> >>>>>>>> wrote:
> >>>>>>>>
> >>>>>>>> I am sorry, you mean I need to add that to environment variables?
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>> The PETSC_ARCH is hardwired for the size of integers so you would
> >>>>>>>> use
> >>>>>>>> PETSC_ARCH=arch-xc30-opt-intel to get 32 bit ints (I don't know of
> >>>>>>>> this
> >>>>>>>> installation ever being used). But now that I think about it you
> >>>>>>>> always
> >>>>>>>> use
> >>>>>>>> 64 bit ints and you need to.
> >>>>>>>>
> >>>>>>>> So what is going on here ... it looks like an object has been
> >>>>>>>> templated
> >>>>>>>> on
> >>>>>>>> a PetscInt and is getting mixed up. I don't think you ever use 32
> >>>>>>>> bit
> >>>>>>>> ints
> >>>>>>>> in PETSc so it looks like you regressed here... I don't have a lot
> >>>>>>>> of
> >>>>>>>> experience with templates. I'd ask Brian or Dan.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> On 12/19/2016 03:34 PM, Mark Adams wrote:
> >>>>>>>>>
> >>>>>>>>> There is a: arch-xc30-opt-intel
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>> On Mon, Dec 19, 2016 at 6:25 PM, David Trebotich <
> >>>>>>>>>> treb at hpcrd.lbl.gov>
> >>>>>>>>>> wrote:
> >>>>>>>>>>
> >>>>>>>>>> Hey Mark-
> >>>>>>>>>>
> >>>>>>>>>> We have had this issue recently and am wondering if you know what
> >>>>>>>>>>
> >>>>>>>>>>> the
> >>>>>>>>>>> problem is. Maybe an int vs. PetscInt vs. PetscInt64 kind of
> >>>>>>>>>>> thing?
> >>>>>>>>>>>
> >>>>>>>>>>> CC -O2 -fast -no-ipo -std=c++11 -O3 -m64
> >>>>>>>>>>> -qopt-multi-version-aggressive
> >>>>>>>>>>> -restrict -m64 -std=c++11 -Wno-unknown-pragmas -diag-disable 3180
> >>>>>>>>>>> -DCH_SPACEDIM=3 -DCH_Linux -DNDEBUG -DCH_MPI
> >>>>>>>>>>> -DMPICH_SKIP_MPICXX
> >>>>>>>>>>> -ULAM_WANT_MPI2CPP -DMPI_NO_CPPBIND -DCH_USE_COMPLEX
> >>>>>>>>>>> -DCH_USE_EB
> >>>>>>>>>>> -DCH_USE_MEMORY_TRACKING -DCH_USE_64 -DCH_USE_DOUBLE
> >>>>>>>>>>> -DCH_USE_HDF5
> >>>>>>>>>>> -I/opt/cray/hdf5-parallel/1.8.16/INTEL/15.0/include -I.
> >>>>>>>>>>> -I../srcBCG
> >>>>>>>>>>> -I../srcLib -I../srcAdvectDiffuseCrunch_BCG
> >>>>>>>>>>> -I../srcCrunchFlow_BCG
> >>>>>>>>>>> -I../srcCrunchFlow_BCG/modules -DCH_USE_PETSC
> >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
> >>>>>>>>>>> intel/include
> >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
> >>>>>>>>>>> intel/include
> >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
> >>>>>>>>>>> intel/include
> >>>>>>>>>>> -DCH_FORT_UNDERSCORE -I../../../Chombo/lib/src/EBAM
> >>>>>>>>>>> RTimeDependent
> >>>>>>>>>>> -I../../../Chombo/lib/src/EBAMRElliptic
> >>>>>>>>>>> -I../../../Chombo/lib/src/EBAM
> >>>>>>>>>>> RTools
> >>>>>>>>>>> -I../../../Chombo/lib/src/Workshop
> >>>>>>>>>>> -I../../../Chombo/lib/src/EBTo
> >>>>>>>>>>> ols
> >>>>>>>>>>> -I../../../Chombo/lib/src/AMRTimeDependent
> >>>>>>>>>>> -I../../../Chombo/lib/src/AMRElliptic
> >>>>>>>>>>> -I../../../Chombo/lib/src/AMRTools
> >>>>>>>>>>> -I../../../Chombo/lib/src/BoxT
> >>>>>>>>>>> ools
> >>>>>>>>>>> -I../../../Chombo/lib/src/BaseTools -DCH_LANG_CC -c
> >>>>>>>>>>> ../srcLib/EBPetscSolver.cpp -o o/3d.Linux.64.CC.ftn.OPTHIGH.M
> >>>>>>>>>>> PI.PETSC/EBPetscSolver.o
> >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression
> >>>>>>>>>>> must
> >>>>>>>>>>> have class type
> >>>>>>>>>>> return inputT.linearSize();
> >>>>>>>>>>> ^
> >>>>>>>>>>> detected during:
> >>>>>>>>>>> instantiation of "int linearSize(const T &) [with
> >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of
> >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> >>>>>>>>>>> instantiation of "int MiniIVFAB<T>::size(const Box &,
> >>>>>>>>>>> const
> >>>>>>>>>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at
> >>>>>>>>>>> line
> >>>>>>>>>>> 155
> >>>>>>>>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> >>>>>>>>>>> instantiation of "int BaseEBCellFAB<T>::size(const
> >>>>>>>>>>> Box
> >>>>>>>>>>> &,
> >>>>>>>>>>> const Interval &) const [with T=PetscInt={PetscInt64={long
> >>>>>>>>>>> long}}]" at
> >>>>>>>>>>> line
> >>>>>>>>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
> >>>>>>>>>>> instantiation of "int LDOperator<T>::size(const T &,
> >>>>>>>>>>> const
> >>>>>>>>>>> Box
> >>>>>>>>>>> &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
> >>>>>>>>>>> cInt64={long
> >>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
> >>>>>>>>>>> ols/LevelData.H"
> >>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator()
> >>>>>>>>>>> [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> >>>>>>>>>>> of
> >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>>>>>>>>> instantiation of class "LDOperator<T> [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> >>>>>>>>>>> of
> >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> >>>>>>>>>>> Interval &,
> >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> >>>>>>>>>>> LDOperator<T>
> >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> >>>>>>>>>>> long}}>]"
> >>>>>>>>>>> at
> >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> >>>>>>>>>>> Interval &,
> >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
> >>>>>>>>>>> of
> >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
> >>>>>>>>>>> of
> >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
> >>>>>>>>>>>
> >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression
> >>>>>>>>>>> must
> >>>>>>>>>>> have class type
> >>>>>>>>>>> inputT.linearOut(a_outBuf);
> >>>>>>>>>>> ^
> >>>>>>>>>>> detected during:
> >>>>>>>>>>> instantiation of "void linearOut(void *, const T &)
> >>>>>>>>>>> [with
> >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of
> >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> >>>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearOut(void
> >>>>>>>>>>> *,
> >>>>>>>>>>> const
> >>>>>>>>>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
> >>>>>>>>>>> long}}]"
> >>>>>>>>>>> at line 169 of "../../../Chombo/lib/src/EBToo
> >>>>>>>>>>> ls/BaseEBCellFABI.H"
> >>>>>>>>>>> instantiation of "void BaseEBCellFAB<T>::linearOut(vo
> >>>>>>>>>>> id
> >>>>>>>>>>> *,
> >>>>>>>>>>> const Box &, const Interval &) const [with
> >>>>>>>>>>> T=PetscInt={PetscInt64={long
> >>>>>>>>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo
> >>>>>>>>>>> ols/BoxLayoutData.H"
> >>>>>>>>>>> instantiation of "void LDOperator<T>::linearOut(const
> >>>>>>>>>>> T &,
> >>>>>>>>>>> void *, const Box &, const Interval &) const [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> >>>>>>>>>>> of
> >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator()
> >>>>>>>>>>> [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> >>>>>>>>>>> of
> >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>>>>>>>>> instantiation of class "LDOperator<T> [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> >>>>>>>>>>> of
> >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> >>>>>>>>>>> Interval &,
> >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> >>>>>>>>>>> LDOperator<T>
> >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> >>>>>>>>>>> long}}>]"
> >>>>>>>>>>> at
> >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> >>>>>>>>>>> Interval &,
> >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
> >>>>>>>>>>> of
> >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
> >>>>>>>>>>> of
> >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
> >>>>>>>>>>>
> >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression
> >>>>>>>>>>> must
> >>>>>>>>>>> have class type
> >>>>>>>>>>> a_outputT.linearIn(inBuf);
> >>>>>>>>>>> ^
> >>>>>>>>>>> detected during:
> >>>>>>>>>>> instantiation of "void linearIn(T &, const void *)
> >>>>>>>>>>> [with
> >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of
> >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> >>>>>>>>>>> instantiation of "void MiniIVFAB<T>::linearIn(void *,
> >>>>>>>>>>> const
> >>>>>>>>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long
> >>>>>>>>>>> long}}]"
> >>>>>>>>>>> at
> >>>>>>>>>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> >>>>>>>>>>> instantiation of "void BaseEBCellFAB<T>::linearIn(voi
> >>>>>>>>>>> d
> >>>>>>>>>>> *,
> >>>>>>>>>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long
> >>>>>>>>>>> long}}]"
> >>>>>>>>>>> at line 159 of "../../../Chombo/lib/src/BoxTo
> >>>>>>>>>>> ols/BoxLayoutData.H"
> >>>>>>>>>>> instantiation of "void LDOperator<T>::linearIn(T &,
> >>>>>>>>>>> void
> >>>>>>>>>>> *,
> >>>>>>>>>>> const Box &, const Interval &) const [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={Pets
> >>>>>>>>>>> cInt64={long
> >>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
> >>>>>>>>>>> ols/LevelData.H"
> >>>>>>>>>>> implicit generation of "LDOperator<T>::LDOperator()
> >>>>>>>>>>> [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> >>>>>>>>>>> of
> >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>>>>>>>>> instantiation of class "LDOperator<T> [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> >>>>>>>>>>> of
> >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> >>>>>>>>>>> Interval &,
> >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> >>>>>>>>>>> LDOperator<T>
> >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> >>>>>>>>>>> long}}>]"
> >>>>>>>>>>> at
> >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> >>>>>>>>>>> Interval &,
> >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
> >>>>>>>>>>> of
> >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with
> >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
> >>>>>>>>>>> of
> >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
> >>>>>>>>>>>
> >>>>>>>>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2)
> >>>>>>>>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.OPTHIGH.
> >>>>>>>>>>> MPI.PETSC/EBPetscSolver.o]
> >>>>>>>>>>> Error 2
> >>>>>>>>>>> make: *** [all-example] Error 2
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> On 12/19/2016 03:09 PM, Mark Adams wrote:
> >>>>>>>>>>>
> >>>>>>>>>>> Sorry cleaning up. insert "petsc_install" in the path:
> >>>>>>>>>>> "...madams/
> >>>>>>>>>>>
> >>>>>>>>>>> petsc_install/petscv3.6..."
> >>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> On Mon, Dec 19, 2016 at 5:43 PM, David Trebotich <
> >>>>>>>>>>>> treb at hpcrd.lbl.gov
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> Hey Mark-
> >>>>>>>>>>>>
> >>>>>>>>>>>>
> >>>>>>>>>>>> I seem to have lost contact with petsc over the weekend:
> >>>>>>>>>>>>
> >>>>>>>>>>>>> /global/homes/m/madams/petscv3.6-xc30-opt64-intel//lib/
> >>>>>>>>>>>>> petsc/conf/variables:
> >>>>>>>>>>>>> No such file or directory
> >>>>>>>>>>>>> Last chance .ex rule for target /global/homes/m/madams/petscv3
> >>>>>>>>>>>>> .6-xc30-opt64-intel//lib/petsc/conf/variables
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> setenv | grep petsc:
> >>>>>>>>>>>>> PE_PETSC_DEFAULT_VOLATILE_PKGCONFIG_PATH=/opt/cray/petsc/3.
> >>>>>>>>>>>>> 7.2.0/real/@PRGENV@/@PE_PETSC_DEFAULT_GENCOMPS@/@PE_PETSC_
> >>>>>>>>>>>>> DEFAULT_TARGET@/lib/pkgconfig
> >>>>>>>>>>>>> PETSC_DIR=/global/homes/m/madams/petscv3.6-xc30-opt64-intel/
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> Currently Loaded Modulefiles:
> >>>>>>>>>>>>> 1) modules/3.2.10.4
> >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__3.2.10.4&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=UN73DjcLzn6LGQKK_kwoLCLWgyM5YEeKwwHYYCHe1nw&e=>
> >>>>>>>>>>>>> 8) intel/15.0.1.133
> >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__15.0.1.133&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=Gix6rgPxH5UFQeKmDN6zAXMAmFezfJ1qY-723XuYrUE&e=>
> >>>>>>>>>>>>> 15) xpmem/0.1-2.0502.57015.1.15.ar
> >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__0.1-2D2.0502.57015.1.15.ar&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=DcDHbf2qyi7t-rquIoqAdDx5HPEa3BXjxxWGpgLVhBU&e=>i
> >>>>>>>>>>>>> 22)
> >>>>>>>>>>>>> cray-mpich/7.4.1
> >>>>>>>>>>>>> 2) nsg/1.2.0 9)
> >>>>>>>>>>>>> cray-libsci/16.07.1
> >>>>>>>>>>>>> 16) dvs/2.5_0.9.0-1.0502.1958.2.55.ari 23)
> >>>>>>>>>>>>> slurm/edison
> >>>>>>>>>>>>> 3) eswrap/1.3.3-1.020200.1278.0 10)
> >>>>>>>>>>>>> udreg/2.3.2-1.0502.9889.2.20.ari 17)
> >>>>>>>>>>>>> alps/5.2.3-2.0502.9295.14.14.a
> >>>>>>>>>>>>> ri
> >>>>>>>>>>>>> 24) altd/2.0
> >>>>>>>>>>>>> 4) switch/1.0-1.0502.57058.1.58.ari 11)
> >>>>>>>>>>>>> ugni/6.0-1.0502.10245.9.9.ari 18) rca/
> >>>>>>>>>>>>> 1.0.0-2.0502.57212.2.56.ar
> >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__1.0.0-2D2.0502.57212.2.56.ar&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&s=KaOFCQYgi4MV721r1zVhLb666-2L2dmTfExdbRrrB1s&e=>
> >>>>>>>>>>>>> i
> >>>>>>>>>>>>> 25) darshan/2.3.1
> >>>>>>>>>>>>> 5) craype-ivybridge 12) pmi/
> >>>>>>>>>>>>> 5.0.10-1.0000.11050.0.0.ari 19) atp/2.0.2 26)
> >>>>>>>>>>>>> emacs/24.2
> >>>>>>>>>>>>> 6) craype-network-aries 13)
> >>>>>>>>>>>>> dmapp/7.0.1-1.0502.10246.8.47.ari 20) PrgEnv-intel/5.2.56
> >>>>>>>>>>>>> 27)
> >>>>>>>>>>>>> cray-hdf5-parallel/1.8.16
> >>>>>>>>>>>>> 7) craype/2.4.2 14)
> >>>>>>>>>>>>> gni-headers/4.0-1.0502.10317.9.2.ari 21) cray-shmem/7.4.1
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> Thanks.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> treb
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> --
> >>>>>>>>>>>>> David Trebotich
> >>>>>>>>>>>>> Applied Numerical Algorithms Group
> >>>>>>>>>>>>> Lawrence Berkeley National Laboratory
> >>>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> >>>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> --
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>> David Trebotich
> >>>>>>>>>>>>
> >>>>>>>>>>> Applied Numerical Algorithms Group
> >>>>>>>>>>> Lawrence Berkeley National Laboratory
> >>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> >>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> --
> >>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> David Trebotich
> >>>>>>>>> Applied Numerical Algorithms Group
> >>>>>>>>> Lawrence Berkeley National Laboratory
> >>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> >>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> --
> >>>>>>>>
> >>>>>>> David Trebotich
> >>>>>>> Applied Numerical Algorithms Group
> >>>>>>> Lawrence Berkeley National Laboratory
> >>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> >>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>
> >>>>> --
> >>>> David Trebotich
> >>>> Applied Numerical Algorithms Group
> >>>> Lawrence Berkeley National Laboratory
> >>>> (510) 486-5984 office
> >>>> (510) 384-6868 mobile
> >>>>
> >>>>
> >>>>
> >>> --
> >>> David Trebotich
> >>> Applied Numerical Algorithms Group
> >>> Computational Research Division
> >>> Lawrence Berkeley National Laboratory(510) 486-5984 office(510) 384-6868
> >>> mobile
> >>>
> >>>
> >>>
> >>
> > --
> > David Trebotich
> > Applied Numerical Algorithms Group
> > Lawrence Berkeley National Laboratory
> > (510) 486-5984 office
> > (510) 384-6868 mobile
> >
> >
> >
>
More information about the petsc-dev
mailing list