[petsc-dev] Fwd: no petsc on Edison
Mark Adams
mfadams at lbl.gov
Tue Jan 10 22:33:42 CST 2017
On Tue, Jan 10, 2017 at 4:28 PM, Satish Balay <balay at mcs.anl.gov> wrote:
> Yup. Thats 4294967296*8bytes 34GB RAM - just for this one hash table?
>
Humm, that is crazy large.
Treb: I would like to get the stack trace. Can you please send the whole
output or grep on "[5]" (or any proc that fails) to get a stack trace. And
can you tell me how many global equations you have here.
> Satish
>
> On Tue, 10 Jan 2017, Kong, Fande wrote:
>
> > On Tue, Jan 10, 2017 at 1:47 PM, Mark Adams <mfadams at lbl.gov> wrote:
> >
> > > We have a code that is failing on large scale runs on Edison at NERSC.
> We
> > > ran with a debug version and we got this error message that I assume is
> > > from a check that is done in debug. Is this a false positive? This is
> a 64
> > > bit integer build.
> > > Thanks,
> > > Mark
> > >
> > > [5]PETSC ERROR: --------------------- Error Message
> > > --------------------------------------------------------------
> > > [5]PETSC ERROR: Argument out of range
> > > [5]PETSC ERROR: A really huge hash is being requested.. cannot process:
> > > 4294967296
> > >
> >
> > Satish,
> >
> > The number "4294967296" is larger than the maximum number (2147321881)
> you
> > put in the lookup.
> >
> > I guess your fixes do not help this one.
> >
> >
> > Fande,
> >
> >
> >
> >
> > > [5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/d
> ocumentation/faq.html
> > > <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.
> mcs.anl.gov_petsc_documentation_faq.html&d=DQMFaQ&c=54IZrppP
> QZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtN
> aS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVt
> sFIoN1ABdechuuE&s=BdTH9phOP3ipZiM21mw_gZrxPjWTeVcpXw9n-y7GECo&e=>
> > > for trouble shooting.
> > > [5]PETSC ERROR: Petsc Development GIT revision: v3.7.4-2584-g7175242
> GIT
> > > Date: 2016-12-21 13:19:16 -0600
> > > [5]PETSC ERROR: /tmp/targetExec on a arch-xc30-dbg64-intel named
> nid00008
> > > by u6338 Sat Jan 7 16:39:16 2017
> > > [5]PETSC ERROR: Configure options --COPTFLAGS="-O0 -g -no-ipo"
> > > --CXXOPTFLAGS="-O0 -g -no-ipo" --FOPTFLAGS="-O0 -g -ipo"
> > > --download-parmetis --download-metis --download-hypre --with-ssl=0
> > > --with-cc=cc --with-clib-autodetect=0 --with-cxx=CC
> > > --with-cxxlib-autodetect=0 --with-debugging=1 --with-fc=ftn
> > > --with-fortranlib-autodetect=0 --with-shared-libraries=0 --with-x=0
> > > --with-mpiexec=srun LIBS=-lstdc++ --with-64-bit-indices
> > > --prefix=/global/homes/m/madams/petsc_install/petscv3.7-x[16527]PETSC
> > > ERROR: ----
> > >
> > > using:
> > > PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-
> xc30-dbg64-intel/
> > >
> > > maybe go back to opt version?
> > >
> > >
> > > On 12/22/2016 03:22 PM, Mark Adams wrote:
> > >
> > >> You configure with the size of an integer explicitly, ie,
> > >> --with-64-bit-integers. I can't imagine there is anything bigger, but
> it
> > >> would not be hard to do.
> > >>
> > >> On Thu, Dec 22, 2016 at 6:06 PM, David Trebotich <treb at hpcrdm.lbl.gov
> >
> > >> wrote:
> > >>
> > >> i just committed changes to SPMD that Brian needed for signed long
> long.
> > >>> Evidently petsc is now handling bigger matrices?
> > >>>
> > >>>
> > >>> On 12/22/2016 2:57 PM, Mark Adams wrote:
> > >>>
> > >>> There are a few hits on stack exchange, google:
> > >>>
> > >>> "error: expression must have class type"
> > >>>
> > >>> I think intputT is a templated type and it is templated with a
> PetscInt.
> > >>> You are calling the linearSize() method on a primitive type. That is
> my
> > >>> best guess.
> > >>>
> > >>> On Thu, Dec 22, 2016 at 3:33 PM, David Trebotich <treb at hpcrd.lbl.gov
> >
> > >>> wrote:
> > >>>
> > >>> building with dbg looks same:
> > >>>>
> > >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression
> must
> > >>>> have class type
> > >>>> return inputT.linearSize();
> > >>>> ^
> > >>>> detected during:
> > >>>> instantiation of "int linearSize(const T &) [with
> > >>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of
> > >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>> instantiation of "int MiniIVFAB<T>::size(const Box &,
> const
> > >>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at
> line
> > >>>> 155
> > >>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> > >>>> instantiation of "int BaseEBCellFAB<T>::size(const Box
> &,
> > >>>> const Interval &) const [with T=PetscInt={PetscInt64={long long}}]"
> at
> > >>>> line
> > >>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
> > >>>> instantiation of "int LDOperator<T>::size(const T &,
> const
> > >>>> Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
> > >>>> cInt64={long
> > >>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
> ols/LevelData.H"
> > >>>> implicit generation of "LDOperator<T>::LDOperator()
> [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>> instantiation of class "LDOperator<T> [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>> instantiation of "void LevelData<T>::copyTo(const
> Interval
> > >>>> &,
> > >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> > >>>> LDOperator<T>
> > >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> long}}>]" at
> > >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>> instantiation of "void LevelData<T>::copyTo(const
> Interval
> > >>>> &,
> > >>>> BoxLayoutData<T> &, const Interval &) const [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
> > >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>> instantiation of "LevelData<T>::LevelData() [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
> > >>>> "../srcLib/EBPetscSolver.cpp"
> > >>>>
> > >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression
> must
> > >>>> have class type
> > >>>> inputT.linearOut(a_outBuf);
> > >>>> ^
> > >>>> detected during:
> > >>>> instantiation of "void linearOut(void *, const T &)
> [with
> > >>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of
> > >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>> instantiation of "void MiniIVFAB<T>::linearOut(void *,
> const
> > >>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
> > >>>> long}}]"
> > >>>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> > >>>> instantiation of "void BaseEBCellFAB<T>::linearOut(void
> *,
> > >>>> const Box &, const Interval &) const [with
> T=PetscInt={PetscInt64={long
> > >>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo
> > >>>> ols/BoxLayoutData.H"
> > >>>> instantiation of "void LDOperator<T>::linearOut(const T
> &,
> > >>>> void *, const Box &, const Interval &) const [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>> implicit generation of "LDOperator<T>::LDOperator()
> [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>> instantiation of class "LDOperator<T> [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>> instantiation of "void LevelData<T>::copyTo(const
> Interval
> > >>>> &,
> > >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> > >>>> LDOperator<T>
> > >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> long}}>]" at
> > >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>> instantiation of "void LevelData<T>::copyTo(const
> Interval
> > >>>> &,
> > >>>> BoxLayoutData<T> &, const Interval &) const [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
> > >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>> instantiation of "LevelData<T>::LevelData() [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
> > >>>> "../srcLib/EBPetscSolver.cpp"
> > >>>>
> > >>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression
> must
> > >>>> have class type
> > >>>> a_outputT.linearIn(inBuf);
> > >>>> ^
> > >>>> detected during:
> > >>>> instantiation of "void linearIn(T &, const void *) [with
> > >>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of
> > >>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>> instantiation of "void MiniIVFAB<T>::linearIn(void *,
> const
> > >>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long
> long}}]" at
> > >>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> > >>>> instantiation of "void BaseEBCellFAB<T>::linearIn(void
> *,
> > >>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long
> > >>>> long}}]"
> > >>>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
> > >>>> instantiation of "void LDOperator<T>::linearIn(T &,
> void *,
> > >>>> const Box &, const Interval &) const [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long
> > >>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
> ols/LevelData.H"
> > >>>> implicit generation of "LDOperator<T>::LDOperator()
> [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>> instantiation of class "LDOperator<T> [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>> instantiation of "void LevelData<T>::copyTo(const
> Interval
> > >>>> &,
> > >>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> > >>>> LDOperator<T>
> > >>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> long}}>]" at
> > >>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>> instantiation of "void LevelData<T>::copyTo(const
> Interval
> > >>>> &,
> > >>>> BoxLayoutData<T> &, const Interval &) const [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
> > >>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>> instantiation of "LevelData<T>::LevelData() [with
> > >>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
> > >>>> "../srcLib/EBPetscSolver.cpp"
> > >>>>
> > >>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2)
> > >>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.DEBUG.MP
> > >>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__3d.
> Linux.64.CC.ftn.DEBUG.MP&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPf
> FD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4t
> s7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&
> s=HAhvWGeoB7HMK7Clyrfh_x-R465qxP-CNXK4zqhrCuE&e=>
> > >>>> I.PETSC/EBPetscSolver.o]
> > >>>> Error 2
> > >>>>
> > >>>>
> > >>>> On 12/22/2016 09:42 AM, Mark Adams wrote:
> > >>>>
> > >>>> I have build a debug version (opt64 --> dbg64). You might try that.
> > >>>>>
> > >>>>> On Wed, Dec 21, 2016 at 9:46 PM, Mark Adams <mfadams at lbl.gov>
> wrote:
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>>> On Wed, Dec 21, 2016 at 2:25 PM, David Trebotich <
> treb at hpcrd.lbl.gov>
> > >>>>>> wrote:
> > >>>>>>
> > >>>>>> This wasn't happening until after you rebuilt petsc. So I am
> > >>>>>> wondering
> > >>>>>>
> > >>>>>>> if you upgraded or changed something??
> > >>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>>> Humm, let me rebuild. This is on Edison I assume.
> > >>>>>>
> > >>>>>> Try PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc3
> > >>>>>> 0-opt64-intel
> > >>>>>> (again)
> > >>>>>>
> > >>>>>> This is a new build. I would also do a deep clean on your end, of
> > >>>>>> course.
> > >>>>>>
> > >>>>>> I see a DCH_USE_COMPLEX ...
> > >>>>>>
> > >>>>>> Also, I would try a debug build just to get some data. This is
> some
> > >>>>>> strange problem of something is out of synch.
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> On 12/19/2016 05:05 PM, Mark Adams wrote:
> > >>>>>>>
> > >>>>>>> On Mon, Dec 19, 2016 at 6:35 PM, David Trebotich <
> treb at hpcrd.lbl.gov
> > >>>>>>> >
> > >>>>>>>
> > >>>>>>>> wrote:
> > >>>>>>>>
> > >>>>>>>> I am sorry, you mean I need to add that to environment
> variables?
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>> The PETSC_ARCH is hardwired for the size of integers so you
> would
> > >>>>>>>> use
> > >>>>>>>> PETSC_ARCH=arch-xc30-opt-intel to get 32 bit ints (I don't know
> of
> > >>>>>>>> this
> > >>>>>>>> installation ever being used). But now that I think about it you
> > >>>>>>>> always
> > >>>>>>>> use
> > >>>>>>>> 64 bit ints and you need to.
> > >>>>>>>>
> > >>>>>>>> So what is going on here ... it looks like an object has been
> > >>>>>>>> templated
> > >>>>>>>> on
> > >>>>>>>> a PetscInt and is getting mixed up. I don't think you ever use
> 32
> > >>>>>>>> bit
> > >>>>>>>> ints
> > >>>>>>>> in PETSc so it looks like you regressed here... I don't have a
> lot
> > >>>>>>>> of
> > >>>>>>>> experience with templates. I'd ask Brian or Dan.
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> On 12/19/2016 03:34 PM, Mark Adams wrote:
> > >>>>>>>>>
> > >>>>>>>>> There is a: arch-xc30-opt-intel
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>> On Mon, Dec 19, 2016 at 6:25 PM, David Trebotich <
> > >>>>>>>>>> treb at hpcrd.lbl.gov>
> > >>>>>>>>>> wrote:
> > >>>>>>>>>>
> > >>>>>>>>>> Hey Mark-
> > >>>>>>>>>>
> > >>>>>>>>>> We have had this issue recently and am wondering if you know
> what
> > >>>>>>>>>>
> > >>>>>>>>>>> the
> > >>>>>>>>>>> problem is. Maybe an int vs. PetscInt vs. PetscInt64 kind of
> > >>>>>>>>>>> thing?
> > >>>>>>>>>>>
> > >>>>>>>>>>> CC -O2 -fast -no-ipo -std=c++11 -O3 -m64
> > >>>>>>>>>>> -qopt-multi-version-aggressive
> > >>>>>>>>>>> -restrict -m64 -std=c++11 -Wno-unknown-pragmas -diag-disable
> 3180
> > >>>>>>>>>>> -DCH_SPACEDIM=3 -DCH_Linux -DNDEBUG -DCH_MPI
> > >>>>>>>>>>> -DMPICH_SKIP_MPICXX
> > >>>>>>>>>>> -ULAM_WANT_MPI2CPP -DMPI_NO_CPPBIND -DCH_USE_COMPLEX
> > >>>>>>>>>>> -DCH_USE_EB
> > >>>>>>>>>>> -DCH_USE_MEMORY_TRACKING -DCH_USE_64 -DCH_USE_DOUBLE
> > >>>>>>>>>>> -DCH_USE_HDF5
> > >>>>>>>>>>> -I/opt/cray/hdf5-parallel/1.8.16/INTEL/15.0/include -I.
> > >>>>>>>>>>> -I../srcBCG
> > >>>>>>>>>>> -I../srcLib -I../srcAdvectDiffuseCrunch_BCG
> > >>>>>>>>>>> -I../srcCrunchFlow_BCG
> > >>>>>>>>>>> -I../srcCrunchFlow_BCG/modules -DCH_USE_PETSC
> > >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
> > >>>>>>>>>>> intel/include
> > >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
> > >>>>>>>>>>> intel/include
> > >>>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
> > >>>>>>>>>>> intel/include
> > >>>>>>>>>>> -DCH_FORT_UNDERSCORE -I../../../Chombo/lib/src/EBAM
> > >>>>>>>>>>> RTimeDependent
> > >>>>>>>>>>> -I../../../Chombo/lib/src/EBAMRElliptic
> > >>>>>>>>>>> -I../../../Chombo/lib/src/EBAM
> > >>>>>>>>>>> RTools
> > >>>>>>>>>>> -I../../../Chombo/lib/src/Workshop
> > >>>>>>>>>>> -I../../../Chombo/lib/src/EBTo
> > >>>>>>>>>>> ols
> > >>>>>>>>>>> -I../../../Chombo/lib/src/AMRTimeDependent
> > >>>>>>>>>>> -I../../../Chombo/lib/src/AMRElliptic
> > >>>>>>>>>>> -I../../../Chombo/lib/src/AMRTools
> > >>>>>>>>>>> -I../../../Chombo/lib/src/BoxT
> > >>>>>>>>>>> ools
> > >>>>>>>>>>> -I../../../Chombo/lib/src/BaseTools -DCH_LANG_CC -c
> > >>>>>>>>>>> ../srcLib/EBPetscSolver.cpp -o o/3d.Linux.64.CC.ftn.OPTHIGH.M
> > >>>>>>>>>>> PI.PETSC/EBPetscSolver.o
> > >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error:
> expression
> > >>>>>>>>>>> must
> > >>>>>>>>>>> have class type
> > >>>>>>>>>>> return inputT.linearSize();
> > >>>>>>>>>>> ^
> > >>>>>>>>>>> detected during:
> > >>>>>>>>>>> instantiation of "int linearSize(const T &) [with
> > >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of
> > >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>>>>>>>>> instantiation of "int MiniIVFAB<T>::size(const
> Box &,
> > >>>>>>>>>>> const
> > >>>>>>>>>>> Interval &) const [with T=PetscInt={PetscInt64={long
> long}}]" at
> > >>>>>>>>>>> line
> > >>>>>>>>>>> 155
> > >>>>>>>>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> > >>>>>>>>>>> instantiation of "int
> BaseEBCellFAB<T>::size(const
> > >>>>>>>>>>> Box
> > >>>>>>>>>>> &,
> > >>>>>>>>>>> const Interval &) const [with T=PetscInt={PetscInt64={long
> > >>>>>>>>>>> long}}]" at
> > >>>>>>>>>>> line
> > >>>>>>>>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
> > >>>>>>>>>>> instantiation of "int LDOperator<T>::size(const
> T &,
> > >>>>>>>>>>> const
> > >>>>>>>>>>> Box
> > >>>>>>>>>>> &, const Interval &) const [with
> T=BaseEBCellFAB<PetscInt={Pets
> > >>>>>>>>>>> cInt64={long
> > >>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
> > >>>>>>>>>>> ols/LevelData.H"
> > >>>>>>>>>>> implicit generation of
> "LDOperator<T>::LDOperator()
> > >>>>>>>>>>> [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 114
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>> instantiation of class "LDOperator<T> [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 114
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>>> Interval &,
> > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> > >>>>>>>>>>> LDOperator<T>
> > >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> > >>>>>>>>>>> long}}>]"
> > >>>>>>>>>>> at
> > >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>>> Interval &,
> > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 32
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 41
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
> > >>>>>>>>>>>
> > >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error:
> expression
> > >>>>>>>>>>> must
> > >>>>>>>>>>> have class type
> > >>>>>>>>>>> inputT.linearOut(a_outBuf);
> > >>>>>>>>>>> ^
> > >>>>>>>>>>> detected during:
> > >>>>>>>>>>> instantiation of "void linearOut(void *, const T
> &)
> > >>>>>>>>>>> [with
> > >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of
> > >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>>>>>>>>> instantiation of "void
> MiniIVFAB<T>::linearOut(void
> > >>>>>>>>>>> *,
> > >>>>>>>>>>> const
> > >>>>>>>>>>> Box &, const Interval &) const [with
> T=PetscInt={PetscInt64={long
> > >>>>>>>>>>> long}}]"
> > >>>>>>>>>>> at line 169 of "../../../Chombo/lib/src/EBToo
> > >>>>>>>>>>> ls/BaseEBCellFABI.H"
> > >>>>>>>>>>> instantiation of "void
> BaseEBCellFAB<T>::linearOut(vo
> > >>>>>>>>>>> id
> > >>>>>>>>>>> *,
> > >>>>>>>>>>> const Box &, const Interval &) const [with
> > >>>>>>>>>>> T=PetscInt={PetscInt64={long
> > >>>>>>>>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo
> > >>>>>>>>>>> ols/BoxLayoutData.H"
> > >>>>>>>>>>> instantiation of "void
> LDOperator<T>::linearOut(const
> > >>>>>>>>>>> T &,
> > >>>>>>>>>>> void *, const Box &, const Interval &) const [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 114
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>> implicit generation of
> "LDOperator<T>::LDOperator()
> > >>>>>>>>>>> [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 114
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>> instantiation of class "LDOperator<T> [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 114
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>>> Interval &,
> > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> > >>>>>>>>>>> LDOperator<T>
> > >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> > >>>>>>>>>>> long}}>]"
> > >>>>>>>>>>> at
> > >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>>> Interval &,
> > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 32
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 41
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
> > >>>>>>>>>>>
> > >>>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error:
> expression
> > >>>>>>>>>>> must
> > >>>>>>>>>>> have class type
> > >>>>>>>>>>> a_outputT.linearIn(inBuf);
> > >>>>>>>>>>> ^
> > >>>>>>>>>>> detected during:
> > >>>>>>>>>>> instantiation of "void linearIn(T &, const void
> *)
> > >>>>>>>>>>> [with
> > >>>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of
> > >>>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>>>>>>>>> instantiation of "void
> MiniIVFAB<T>::linearIn(void *,
> > >>>>>>>>>>> const
> > >>>>>>>>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long
> > >>>>>>>>>>> long}}]"
> > >>>>>>>>>>> at
> > >>>>>>>>>>> line 181 of "../../../Chombo/lib/src/EBToo
> ls/BaseEBCellFABI.H"
> > >>>>>>>>>>> instantiation of "void
> BaseEBCellFAB<T>::linearIn(voi
> > >>>>>>>>>>> d
> > >>>>>>>>>>> *,
> > >>>>>>>>>>> const Box &, const Interval &) [with
> T=PetscInt={PetscInt64={long
> > >>>>>>>>>>> long}}]"
> > >>>>>>>>>>> at line 159 of "../../../Chombo/lib/src/BoxTo
> > >>>>>>>>>>> ols/BoxLayoutData.H"
> > >>>>>>>>>>> instantiation of "void LDOperator<T>::linearIn(T
> &,
> > >>>>>>>>>>> void
> > >>>>>>>>>>> *,
> > >>>>>>>>>>> const Box &, const Interval &) const [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={Pets
> > >>>>>>>>>>> cInt64={long
> > >>>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
> > >>>>>>>>>>> ols/LevelData.H"
> > >>>>>>>>>>> implicit generation of
> "LDOperator<T>::LDOperator()
> > >>>>>>>>>>> [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 114
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>> instantiation of class "LDOperator<T> [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 114
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>>> Interval &,
> > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> > >>>>>>>>>>> LDOperator<T>
> > >>>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> > >>>>>>>>>>> long}}>]"
> > >>>>>>>>>>> at
> > >>>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>> instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>>> Interval &,
> > >>>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 32
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>> instantiation of "LevelData<T>::LevelData() [with
> > >>>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> line 41
> > >>>>>>>>>>> of
> > >>>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
> > >>>>>>>>>>>
> > >>>>>>>>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2)
> > >>>>>>>>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.OPTHIGH.
> > >>>>>>>>>>> MPI.PETSC/EBPetscSolver.o]
> > >>>>>>>>>>> Error 2
> > >>>>>>>>>>> make: *** [all-example] Error 2
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>> On 12/19/2016 03:09 PM, Mark Adams wrote:
> > >>>>>>>>>>>
> > >>>>>>>>>>> Sorry cleaning up. insert "petsc_install" in the path:
> > >>>>>>>>>>> "...madams/
> > >>>>>>>>>>>
> > >>>>>>>>>>> petsc_install/petscv3.6..."
> > >>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On Mon, Dec 19, 2016 at 5:43 PM, David Trebotich <
> > >>>>>>>>>>>> treb at hpcrd.lbl.gov
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> Hey Mark-
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> I seem to have lost contact with petsc over the weekend:
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>> /global/homes/m/madams/petscv3.6-xc30-opt64-intel//lib/
> > >>>>>>>>>>>>> petsc/conf/variables:
> > >>>>>>>>>>>>> No such file or directory
> > >>>>>>>>>>>>> Last chance .ex rule for target
> /global/homes/m/madams/petscv3
> > >>>>>>>>>>>>> .6-xc30-opt64-intel//lib/petsc/conf/variables
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> setenv | grep petsc:
> > >>>>>>>>>>>>> PE_PETSC_DEFAULT_VOLATILE_PKGC
> ONFIG_PATH=/opt/cray/petsc/3.
> > >>>>>>>>>>>>> 7.2.0/real/@PRGENV@/@PE_PETSC_DEFAULT_GENCOMPS@/@PE_PETSC_
> > >>>>>>>>>>>>> DEFAULT_TARGET@/lib/pkgconfig
> > >>>>>>>>>>>>> PETSC_DIR=/global/homes/m/mada
> ms/petscv3.6-xc30-opt64-intel/
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> Currently Loaded Modulefiles:
> > >>>>>>>>>>>>> 1) modules/3.2.10.4
> > >>>>>>>>>>>>> <https://urldefense.proofpoint
> .com/v2/url?u=http-3A__3.2.10.4&d=DQMFaQ&c=54IZrppPQZKX9mLzc
> GdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4t
> s7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&
> s=UN73DjcLzn6LGQKK_kwoLCLWgyM5YEeKwwHYYCHe1nw&e=>
> > >>>>>>>>>>>>> 8) intel/15.0.1.133
> > >>>>>>>>>>>>> <https://urldefense.proofpoint
> .com/v2/url?u=http-3A__15.0.1.133&d=DQMFaQ&c=54IZrppPQZKX9mL
> zcGdPfFD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV
> 4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuu
> E&s=Gix6rgPxH5UFQeKmDN6zAXMAmFezfJ1qY-723XuYrUE&e=>
> > >>>>>>>>>>>>> 15) xpmem/0.1-2.0502.57015.1.15.ar
> > >>>>>>>>>>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__0.1-
> 2D2.0502.57015.1.15.ar&d=DQMFaQ&c=54IZrppPQZKX9mLzcGdPf
> FD1hxrcB__aEkJFOKJFd00&r=DUUt3SRGI0_JgtNaS3udV68GRkgV4t
> s7XKfj2opmiCY&m=Jd9TVPRE-Ts5OmoJe38KFIo29VVtsFIoN1ABdechuuE&
> s=DcDHbf2qyi7t-rquIoqAdDx5HPEa3BXjxxWGpgLVhBU&e=>i
> > >>>>>>>>>>>>> 22)
> > >>>>>>>>>>>>> cray-mpich/7.4.1
> > >>>>>>>>>>>>> 2) nsg/1.2.0 9)
> > >>>>>>>>>>>>> cray-libsci/16.07.1
> > >>>>>>>>>>>>> 16) dvs/2.5_0.9.0-1.0502.1958.2.55.ari 23)
> > >>>>>>>>>>>>> slurm/edison
> > >>>>>>>>>>>>> 3) eswrap/1.3.3-1.020200.1278.0 10)
> > >>>>>>>>>>>>> udreg/2.3.2-1.0502.9889.2.20.ari 17)
> > >>>>>>>>>>>>> alps/5.2.3-2.0502.9295.14.14.a
> > >>>>>>>>>>>>> ri
> > >>>>>>>>>>>>> 24) altd/2.0
> > >>>>>>>>>>>>> 4) switch/1.0-1.0502.57058.1.58.ari 11)
> > >>>>>>>>>>>>> ugni/6.0-1.0502.10245.9.9.ari 18) rca/
> > >>>>>>>>>>>>> 1.0.0-2.0502.57212.2.56.ar
> > >>>>>>>>>>>>> <https://urldefense.proofpoint
> .com/v2/url?u=http-3A__1.0.0-2D2.0502.57212.2.56.ar&d=
> DQMFaQ&c=54IZrppPQZKX9mLzcGdPfFD1hxrcB__aEkJFOKJFd00&r=
> DUUt3SRGI0_JgtNaS3udV68GRkgV4ts7XKfj2opmiCY&m=Jd9TVPRE-Ts5Om
> oJe38KFIo29VVtsFIoN1ABdechuuE&s=KaOFCQYgi4MV721r1zVhLb666-2L
> 2dmTfExdbRrrB1s&e=>
> > >>>>>>>>>>>>> i
> > >>>>>>>>>>>>> 25) darshan/2.3.1
> > >>>>>>>>>>>>> 5) craype-ivybridge 12) pmi/
> > >>>>>>>>>>>>> 5.0.10-1.0000.11050.0.0.ari 19) atp/2.0.2 26)
> > >>>>>>>>>>>>> emacs/24.2
> > >>>>>>>>>>>>> 6) craype-network-aries 13)
> > >>>>>>>>>>>>> dmapp/7.0.1-1.0502.10246.8.47.ari 20)
> PrgEnv-intel/5.2.56
> > >>>>>>>>>>>>> 27)
> > >>>>>>>>>>>>> cray-hdf5-parallel/1.8.16
> > >>>>>>>>>>>>> 7) craype/2.4.2 14)
> > >>>>>>>>>>>>> gni-headers/4.0-1.0502.10317.9.2.ari 21) cray-shmem/7.4.1
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> Thanks.
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> treb
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> --
> > >>>>>>>>>>>>> David Trebotich
> > >>>>>>>>>>>>> Applied Numerical Algorithms Group
> > >>>>>>>>>>>>> Lawrence Berkeley National Laboratory
> > >>>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> > >>>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>> --
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>>>
> > >>>>>>>>>>>> David Trebotich
> > >>>>>>>>>>>>
> > >>>>>>>>>>> Applied Numerical Algorithms Group
> > >>>>>>>>>>> Lawrence Berkeley National Laboratory
> > >>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> > >>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>> --
> > >>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> David Trebotich
> > >>>>>>>>> Applied Numerical Algorithms Group
> > >>>>>>>>> Lawrence Berkeley National Laboratory
> > >>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> > >>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> --
> > >>>>>>>>
> > >>>>>>> David Trebotich
> > >>>>>>> Applied Numerical Algorithms Group
> > >>>>>>> Lawrence Berkeley National Laboratory
> > >>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> > >>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>> --
> > >>>> David Trebotich
> > >>>> Applied Numerical Algorithms Group
> > >>>> Lawrence Berkeley National Laboratory
> > >>>> (510) 486-5984 office
> > >>>> (510) 384-6868 mobile
> > >>>>
> > >>>>
> > >>>>
> > >>> --
> > >>> David Trebotich
> > >>> Applied Numerical Algorithms Group
> > >>> Computational Research Division
> > >>> Lawrence Berkeley National Laboratory(510) 486-5984 office(510)
> 384-6868
> > >>> mobile
> > >>>
> > >>>
> > >>>
> > >>
> > > --
> > > David Trebotich
> > > Applied Numerical Algorithms Group
> > > Lawrence Berkeley National Laboratory
> > > (510) 486-5984 office
> > > (510) 384-6868 mobile
> > >
> > >
> > >
> >
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-dev/attachments/20170110/3b4d43c6/attachment.html>
More information about the petsc-dev
mailing list