[petsc-dev] Fwd: no petsc on Edison

Satish Balay balay at mcs.anl.gov
Tue Jan 10 15:04:23 CST 2017


> cannot process: 4294967296

I need to add more entries for this size.

BTW: this is the ctable code that you added long time ago..

Satish

On Tue, 10 Jan 2017, Satish Balay wrote:

> Are you on master? If so can you try with latest?
> 
> or use these patches.
> https://bitbucket.org/petsc/petsc/commits/d742c75fd0d514f7fa1873d5b10984bc3f363031
> https://bitbucket.org/petsc/petsc/commits/952da9c592908439a79849c624703c9c85ef4977
> And see if you still encounter problems.
> 
> Satish
> 
> On Tue, 10 Jan 2017, Mark Adams wrote:
> 
> > We have a code that is failing on large scale runs on Edison at NERSC. We
> > ran with a debug version and we got this error message that I assume is
> > from a check that is done in debug. Is this a false positive? This is a 64
> > bit integer build.
> > Thanks,
> > Mark
> > 
> > [5]PETSC ERROR: --------------------- Error Message
> > --------------------------------------------------------------
> > [5]PETSC ERROR: Argument out of range
> > [5]PETSC ERROR: A really huge hash is being requested.. cannot process:
> > 4294967296
> > [5]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for
> > trouble shooting.
> > [5]PETSC ERROR: Petsc Development GIT revision: v3.7.4-2584-g7175242 GIT
> > Date: 2016-12-21 13:19:16 -0600
> > [5]PETSC ERROR: /tmp/targetExec on a arch-xc30-dbg64-intel named nid00008
> > by u6338 Sat Jan  7 16:39:16 2017
> > [5]PETSC ERROR: Configure options --COPTFLAGS="-O0 -g -no-ipo"
> > --CXXOPTFLAGS="-O0 -g -no-ipo" --FOPTFLAGS="-O0 -g -ipo"
> > --download-parmetis --download-metis --download-hypre --with-ssl=0
> > --with-cc=cc --with-clib-autodetect=0 --with-cxx=CC
> > --with-cxxlib-autodetect=0 --with-debugging=1 --with-fc=ftn
> > --with-fortranlib-autodetect=0 --with-shared-libraries=0 --with-x=0
> > --with-mpiexec=srun LIBS=-lstdc++ --with-64-bit-indices
> > --prefix=/global/homes/m/madams/petsc_install/petscv3.7-x[16527]PETSC
> > ERROR: ----
> > 
> > using:
> > PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc30-dbg64-intel/
> > 
> > maybe go back to opt version?
> > 
> > 
> > On 12/22/2016 03:22 PM, Mark Adams wrote:
> > 
> > > You configure with the size of an integer explicitly, ie,
> > > --with-64-bit-integers. I can't imagine there is anything bigger, but it
> > > would not be hard to do.
> > >
> > > On Thu, Dec 22, 2016 at 6:06 PM, David Trebotich <treb at hpcrdm.lbl.gov>
> > > wrote:
> > >
> > > i just committed changes to SPMD that Brian needed for signed long long.
> > >> Evidently petsc is now handling bigger matrices?
> > >>
> > >>
> > >> On 12/22/2016 2:57 PM, Mark Adams wrote:
> > >>
> > >> There are a few hits on stack exchange, google:
> > >>
> > >> "error: expression must have class type"
> > >>
> > >> I think intputT is a templated type and it is templated with a PetscInt.
> > >> You are calling the linearSize() method on a primitive type. That is my
> > >> best guess.
> > >>
> > >> On Thu, Dec 22, 2016 at 3:33 PM, David Trebotich <treb at hpcrd.lbl.gov>
> > >> wrote:
> > >>
> > >> building with dbg looks same:
> > >>>
> > >>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression must
> > >>> have class type
> > >>>     return inputT.linearSize();
> > >>>            ^
> > >>>           detected during:
> > >>>             instantiation of "int linearSize(const T &) [with
> > >>> T=PetscInt={PetscInt64={long long}}]" at line 128 of
> > >>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>             instantiation of "int MiniIVFAB<T>::size(const Box &, const
> > >>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at line 155
> > >>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> > >>>             instantiation of "int BaseEBCellFAB<T>::size(const Box &,
> > >>> const Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at
> > >>> line
> > >>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
> > >>>             instantiation of "int LDOperator<T>::size(const T &, const
> > >>> Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
> > >>> cInt64={long
> > >>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>             implicit generation of "LDOperator<T>::LDOperator() [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>             instantiation of class "LDOperator<T> [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
> > >>> BoxLayoutData<T> &, const Interval &, const Copier &, const LDOperator<T>
> > >>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> > >>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
> > >>> BoxLayoutData<T> &, const Interval &) const [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
> > >>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>             instantiation of "LevelData<T>::LevelData() [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
> > >>> "../srcLib/EBPetscSolver.cpp"
> > >>>
> > >>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression must
> > >>> have class type
> > >>>     inputT.linearOut(a_outBuf);
> > >>>     ^
> > >>>           detected during:
> > >>>             instantiation of "void linearOut(void *, const T &) [with
> > >>> T=PetscInt={PetscInt64={long long}}]" at line 155 of
> > >>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>             instantiation of "void MiniIVFAB<T>::linearOut(void *, const
> > >>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
> > >>> long}}]"
> > >>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> > >>>             instantiation of "void BaseEBCellFAB<T>::linearOut(void *,
> > >>> const Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
> > >>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo
> > >>> ols/BoxLayoutData.H"
> > >>>             instantiation of "void LDOperator<T>::linearOut(const T &,
> > >>> void *, const Box &, const Interval &) const [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>             implicit generation of "LDOperator<T>::LDOperator() [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>             instantiation of class "LDOperator<T> [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
> > >>> BoxLayoutData<T> &, const Interval &, const Copier &, const LDOperator<T>
> > >>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> > >>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
> > >>> BoxLayoutData<T> &, const Interval &) const [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
> > >>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>             instantiation of "LevelData<T>::LevelData() [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
> > >>> "../srcLib/EBPetscSolver.cpp"
> > >>>
> > >>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression must
> > >>> have class type
> > >>>     a_outputT.linearIn(inBuf);
> > >>>     ^
> > >>>           detected during:
> > >>>             instantiation of "void linearIn(T &, const void *) [with
> > >>> T=PetscInt={PetscInt64={long long}}]" at line 181 of
> > >>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>             instantiation of "void MiniIVFAB<T>::linearIn(void *, const
> > >>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long long}}]" at
> > >>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> > >>>             instantiation of "void BaseEBCellFAB<T>::linearIn(void *,
> > >>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long
> > >>> long}}]"
> > >>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
> > >>>             instantiation of "void LDOperator<T>::linearIn(T &, void *,
> > >>> const Box &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
> > >>> cInt64={long
> > >>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>             implicit generation of "LDOperator<T>::LDOperator() [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>             instantiation of class "LDOperator<T> [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114 of
> > >>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
> > >>> BoxLayoutData<T> &, const Interval &, const Copier &, const LDOperator<T>
> > >>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at
> > >>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>             instantiation of "void LevelData<T>::copyTo(const Interval &,
> > >>> BoxLayoutData<T> &, const Interval &) const [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32 of
> > >>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>             instantiation of "LevelData<T>::LevelData() [with
> > >>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41 of
> > >>> "../srcLib/EBPetscSolver.cpp"
> > >>>
> > >>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2)
> > >>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.DEBUG.MPI.PETSC/EBPetscSolver.o]
> > >>> Error 2
> > >>>
> > >>>
> > >>> On 12/22/2016 09:42 AM, Mark Adams wrote:
> > >>>
> > >>> I have build a debug version (opt64 --> dbg64). You might try that.
> > >>>>
> > >>>> On Wed, Dec 21, 2016 at 9:46 PM, Mark Adams <mfadams at lbl.gov> wrote:
> > >>>>
> > >>>>
> > >>>>
> > >>>>> On Wed, Dec 21, 2016 at 2:25 PM, David Trebotich <treb at hpcrd.lbl.gov>
> > >>>>> wrote:
> > >>>>>
> > >>>>> This wasn't happening until after you rebuilt petsc.  So I am wondering
> > >>>>>
> > >>>>>> if you upgraded or changed something??
> > >>>>>>
> > >>>>>>
> > >>>>>
> > >>>>> Humm, let me rebuild. This is on Edison I assume.
> > >>>>>
> > >>>>> Try PETSC_DIR=/global/homes/m/madams/petsc_install/petscv3.7-xc3
> > >>>>> 0-opt64-intel
> > >>>>> (again)
> > >>>>>
> > >>>>> This is a new build. I would also do a deep clean on your end, of
> > >>>>> course.
> > >>>>>
> > >>>>> I see a DCH_USE_COMPLEX ...
> > >>>>>
> > >>>>> Also, I would try a debug build just to get some data. This is some
> > >>>>> strange problem of something is out of synch.
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> On 12/19/2016 05:05 PM, Mark Adams wrote:
> > >>>>>>
> > >>>>>> On Mon, Dec 19, 2016 at 6:35 PM, David Trebotich <treb at hpcrd.lbl.gov>
> > >>>>>>
> > >>>>>>> wrote:
> > >>>>>>>
> > >>>>>>> I am sorry, you mean I need to add that to environment variables?
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>> The PETSC_ARCH is hardwired for the size of integers so you would use
> > >>>>>>> PETSC_ARCH=arch-xc30-opt-intel to get 32 bit ints (I don't know of
> > >>>>>>> this
> > >>>>>>> installation ever being used). But now that I think about it you
> > >>>>>>> always
> > >>>>>>> use
> > >>>>>>> 64 bit ints and you need to.
> > >>>>>>>
> > >>>>>>> So what is going on here ... it looks like an object has been
> > >>>>>>> templated
> > >>>>>>> on
> > >>>>>>> a PetscInt and is getting mixed up. I don't think you ever use 32 bit
> > >>>>>>> ints
> > >>>>>>> in PETSc so it looks like you regressed here... I don't have a lot of
> > >>>>>>> experience with templates. I'd ask Brian or Dan.
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> On 12/19/2016 03:34 PM, Mark Adams wrote:
> > >>>>>>>>
> > >>>>>>>> There is a: arch-xc30-opt-intel
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>> On Mon, Dec 19, 2016 at 6:25 PM, David Trebotich <
> > >>>>>>>>> treb at hpcrd.lbl.gov>
> > >>>>>>>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>> Hey Mark-
> > >>>>>>>>>
> > >>>>>>>>> We have had this issue recently and am wondering if you know what
> > >>>>>>>>>
> > >>>>>>>>>> the
> > >>>>>>>>>> problem is.  Maybe an int vs. PetscInt vs. PetscInt64 kind of
> > >>>>>>>>>> thing?
> > >>>>>>>>>>
> > >>>>>>>>>> CC  -O2 -fast -no-ipo -std=c++11 -O3 -m64
> > >>>>>>>>>> -qopt-multi-version-aggressive
> > >>>>>>>>>> -restrict -m64 -std=c++11 -Wno-unknown-pragmas -diag-disable 3180
> > >>>>>>>>>> -DCH_SPACEDIM=3 -DCH_Linux   -DNDEBUG  -DCH_MPI
> > >>>>>>>>>> -DMPICH_SKIP_MPICXX
> > >>>>>>>>>> -ULAM_WANT_MPI2CPP -DMPI_NO_CPPBIND     -DCH_USE_COMPLEX
> > >>>>>>>>>>  -DCH_USE_EB
> > >>>>>>>>>> -DCH_USE_MEMORY_TRACKING  -DCH_USE_64 -DCH_USE_DOUBLE
> > >>>>>>>>>> -DCH_USE_HDF5
> > >>>>>>>>>> -I/opt/cray/hdf5-parallel/1.8.16/INTEL/15.0/include    -I.
> > >>>>>>>>>> -I../srcBCG
> > >>>>>>>>>> -I../srcLib -I../srcAdvectDiffuseCrunch_BCG
> > >>>>>>>>>> -I../srcCrunchFlow_BCG
> > >>>>>>>>>> -I../srcCrunchFlow_BCG/modules    -DCH_USE_PETSC
> > >>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
> > >>>>>>>>>> intel/include
> > >>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
> > >>>>>>>>>> intel/include
> > >>>>>>>>>> -I/global/homes/m/madams/petsc_install/petscv3.6-xc30-opt64-
> > >>>>>>>>>> intel/include
> > >>>>>>>>>> -DCH_FORT_UNDERSCORE -I../../../Chombo/lib/src/EBAMRTimeDependent
> > >>>>>>>>>> -I../../../Chombo/lib/src/EBAMRElliptic
> > >>>>>>>>>> -I../../../Chombo/lib/src/EBAM
> > >>>>>>>>>> RTools
> > >>>>>>>>>> -I../../../Chombo/lib/src/Workshop -I../../../Chombo/lib/src/EBTo
> > >>>>>>>>>> ols
> > >>>>>>>>>> -I../../../Chombo/lib/src/AMRTimeDependent
> > >>>>>>>>>> -I../../../Chombo/lib/src/AMRElliptic
> > >>>>>>>>>> -I../../../Chombo/lib/src/AMRTools -I../../../Chombo/lib/src/BoxT
> > >>>>>>>>>> ools
> > >>>>>>>>>> -I../../../Chombo/lib/src/BaseTools  -DCH_LANG_CC -c
> > >>>>>>>>>> ../srcLib/EBPetscSolver.cpp -o o/3d.Linux.64.CC.ftn.OPTHIGH.M
> > >>>>>>>>>> PI.PETSC/EBPetscSolver.o
> > >>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(23): error: expression
> > >>>>>>>>>> must
> > >>>>>>>>>> have class type
> > >>>>>>>>>>     return inputT.linearSize();
> > >>>>>>>>>>            ^
> > >>>>>>>>>>           detected during:
> > >>>>>>>>>>             instantiation of "int linearSize(const T &) [with
> > >>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 128 of
> > >>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>>>>>>>>             instantiation of "int MiniIVFAB<T>::size(const Box &,
> > >>>>>>>>>> const
> > >>>>>>>>>> Interval &) const [with T=PetscInt={PetscInt64={long long}}]" at
> > >>>>>>>>>> line
> > >>>>>>>>>> 155
> > >>>>>>>>>> of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> > >>>>>>>>>>             instantiation of "int BaseEBCellFAB<T>::size(const Box
> > >>>>>>>>>> &,
> > >>>>>>>>>> const Interval &) const [with T=PetscInt={PetscInt64={long
> > >>>>>>>>>> long}}]" at
> > >>>>>>>>>> line
> > >>>>>>>>>> 149 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
> > >>>>>>>>>>             instantiation of "int LDOperator<T>::size(const T &,
> > >>>>>>>>>> const
> > >>>>>>>>>> Box
> > >>>>>>>>>> &, const Interval &) const [with T=BaseEBCellFAB<PetscInt={Pets
> > >>>>>>>>>> cInt64={long
> > >>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
> > >>>>>>>>>> ols/LevelData.H"
> > >>>>>>>>>>             implicit generation of "LDOperator<T>::LDOperator()
> > >>>>>>>>>> [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> > >>>>>>>>>> of
> > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>             instantiation of class "LDOperator<T> [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> > >>>>>>>>>> of
> > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>> Interval &,
> > >>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> > >>>>>>>>>> LDOperator<T>
> > >>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> > >>>>>>>>>> long}}>]"
> > >>>>>>>>>> at
> > >>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>> Interval &,
> > >>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
> > >>>>>>>>>> of
> > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>             instantiation of "LevelData<T>::LevelData() [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
> > >>>>>>>>>> of
> > >>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
> > >>>>>>>>>>
> > >>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(35): error: expression
> > >>>>>>>>>> must
> > >>>>>>>>>> have class type
> > >>>>>>>>>>     inputT.linearOut(a_outBuf);
> > >>>>>>>>>>     ^
> > >>>>>>>>>>           detected during:
> > >>>>>>>>>>             instantiation of "void linearOut(void *, const T &)
> > >>>>>>>>>> [with
> > >>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 155 of
> > >>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>>>>>>>>             instantiation of "void MiniIVFAB<T>::linearOut(void *,
> > >>>>>>>>>> const
> > >>>>>>>>>> Box &, const Interval &) const [with T=PetscInt={PetscInt64={long
> > >>>>>>>>>> long}}]"
> > >>>>>>>>>> at line 169 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> > >>>>>>>>>>             instantiation of "void BaseEBCellFAB<T>::linearOut(vo
> > >>>>>>>>>> id
> > >>>>>>>>>> *,
> > >>>>>>>>>> const Box &, const Interval &) const [with
> > >>>>>>>>>> T=PetscInt={PetscInt64={long
> > >>>>>>>>>> long}}]" at line 154 of "../../../Chombo/lib/src/BoxTo
> > >>>>>>>>>> ols/BoxLayoutData.H"
> > >>>>>>>>>>             instantiation of "void LDOperator<T>::linearOut(const
> > >>>>>>>>>> T &,
> > >>>>>>>>>> void *, const Box &, const Interval &) const [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> > >>>>>>>>>> of
> > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>             implicit generation of "LDOperator<T>::LDOperator()
> > >>>>>>>>>> [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> > >>>>>>>>>> of
> > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>             instantiation of class "LDOperator<T> [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> > >>>>>>>>>> of
> > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>> Interval &,
> > >>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> > >>>>>>>>>> LDOperator<T>
> > >>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> > >>>>>>>>>> long}}>]"
> > >>>>>>>>>> at
> > >>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>> Interval &,
> > >>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
> > >>>>>>>>>> of
> > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>             instantiation of "LevelData<T>::LevelData() [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
> > >>>>>>>>>> of
> > >>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
> > >>>>>>>>>>
> > >>>>>>>>>> ../../../Chombo/lib/src/BaseTools/SPMDI.H(29): error: expression
> > >>>>>>>>>> must
> > >>>>>>>>>> have class type
> > >>>>>>>>>>     a_outputT.linearIn(inBuf);
> > >>>>>>>>>>     ^
> > >>>>>>>>>>           detected during:
> > >>>>>>>>>>             instantiation of "void linearIn(T &, const void *)
> > >>>>>>>>>> [with
> > >>>>>>>>>> T=PetscInt={PetscInt64={long long}}]" at line 181 of
> > >>>>>>>>>> "../../../Chombo/lib/src/EBTools/MiniIVFABI.H"
> > >>>>>>>>>>             instantiation of "void MiniIVFAB<T>::linearIn(void *,
> > >>>>>>>>>> const
> > >>>>>>>>>> Box &, const Interval &) [with T=PetscInt={PetscInt64={long
> > >>>>>>>>>> long}}]"
> > >>>>>>>>>> at
> > >>>>>>>>>> line 181 of "../../../Chombo/lib/src/EBTools/BaseEBCellFABI.H"
> > >>>>>>>>>>             instantiation of "void BaseEBCellFAB<T>::linearIn(voi
> > >>>>>>>>>> d
> > >>>>>>>>>> *,
> > >>>>>>>>>> const Box &, const Interval &) [with T=PetscInt={PetscInt64={long
> > >>>>>>>>>> long}}]"
> > >>>>>>>>>> at line 159 of "../../../Chombo/lib/src/BoxTools/BoxLayoutData.H"
> > >>>>>>>>>>             instantiation of "void LDOperator<T>::linearIn(T &,
> > >>>>>>>>>> void
> > >>>>>>>>>> *,
> > >>>>>>>>>> const Box &, const Interval &) const [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={Pets
> > >>>>>>>>>> cInt64={long
> > >>>>>>>>>> long}}>]" at line 114 of "../../../Chombo/lib/src/BoxTo
> > >>>>>>>>>> ols/LevelData.H"
> > >>>>>>>>>>             implicit generation of "LDOperator<T>::LDOperator()
> > >>>>>>>>>> [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> > >>>>>>>>>> of
> > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>             instantiation of class "LDOperator<T> [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 114
> > >>>>>>>>>> of
> > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelData.H"
> > >>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>> Interval &,
> > >>>>>>>>>> BoxLayoutData<T> &, const Interval &, const Copier &, const
> > >>>>>>>>>> LDOperator<T>
> > >>>>>>>>>> &) const [with T=BaseEBCellFAB<PetscInt={PetscInt64={long
> > >>>>>>>>>> long}}>]"
> > >>>>>>>>>> at
> > >>>>>>>>>> line 213 of "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>             instantiation of "void LevelData<T>::copyTo(const
> > >>>>>>>>>> Interval &,
> > >>>>>>>>>> BoxLayoutData<T> &, const Interval &) const [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 32
> > >>>>>>>>>> of
> > >>>>>>>>>> "../../../Chombo/lib/src/BoxTools/LevelDataI.H"
> > >>>>>>>>>>             instantiation of "LevelData<T>::LevelData() [with
> > >>>>>>>>>> T=BaseEBCellFAB<PetscInt={PetscInt64={long long}}>]" at line 41
> > >>>>>>>>>> of
> > >>>>>>>>>> "../srcLib/EBPetscSolver.cpp"
> > >>>>>>>>>>
> > >>>>>>>>>> compilation aborted for ../srcLib/EBPetscSolver.cpp (code 2)
> > >>>>>>>>>> gmake[1]: *** [o/3d.Linux.64.CC.ftn.OPTHIGH.
> > >>>>>>>>>> MPI.PETSC/EBPetscSolver.o]
> > >>>>>>>>>> Error 2
> > >>>>>>>>>> make: *** [all-example] Error 2
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> On 12/19/2016 03:09 PM, Mark Adams wrote:
> > >>>>>>>>>>
> > >>>>>>>>>> Sorry cleaning up. insert "petsc_install" in the path: "...madams/
> > >>>>>>>>>>
> > >>>>>>>>>> petsc_install/petscv3.6..."
> > >>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>> On Mon, Dec 19, 2016 at 5:43 PM, David Trebotich <
> > >>>>>>>>>>> treb at hpcrd.lbl.gov
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>>> wrote:
> > >>>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>> Hey Mark-
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>> I seem to have lost contact with petsc over the weekend:
> > >>>>>>>>>>>
> > >>>>>>>>>>>> /global/homes/m/madams/petscv3.6-xc30-opt64-intel//lib/
> > >>>>>>>>>>>> petsc/conf/variables:
> > >>>>>>>>>>>> No such file or directory
> > >>>>>>>>>>>> Last chance .ex rule for target /global/homes/m/madams/petscv3
> > >>>>>>>>>>>> .6-xc30-opt64-intel//lib/petsc/conf/variables
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> setenv | grep petsc:
> > >>>>>>>>>>>> PE_PETSC_DEFAULT_VOLATILE_PKGCONFIG_PATH=/opt/cray/petsc/3.
> > >>>>>>>>>>>> 7.2.0/real/@PRGENV@/@PE_PETSC_DEFAULT_GENCOMPS@/@PE_PETSC_
> > >>>>>>>>>>>> DEFAULT_TARGET@/lib/pkgconfig
> > >>>>>>>>>>>> PETSC_DIR=/global/homes/m/madams/petscv3.6-xc30-opt64-intel/
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> Currently Loaded Modulefiles:
> > >>>>>>>>>>>>   1) modules/3.2.10.4                       8) intel/15.0.1.133
> > >>>>>>>>>>>>     15) xpmem/0.1-2.0502.57015.1.15.ari       22)
> > >>>>>>>>>>>> cray-mpich/7.4.1
> > >>>>>>>>>>>>   2) nsg/1.2.0                              9)
> > >>>>>>>>>>>> cray-libsci/16.07.1
> > >>>>>>>>>>>>       16) dvs/2.5_0.9.0-1.0502.1958.2.55.ari    23)
> > >>>>>>>>>>>> slurm/edison
> > >>>>>>>>>>>>   3) eswrap/1.3.3-1.020200.1278.0          10)
> > >>>>>>>>>>>> udreg/2.3.2-1.0502.9889.2.20.ari      17)
> > >>>>>>>>>>>> alps/5.2.3-2.0502.9295.14.14.a
> > >>>>>>>>>>>> ri
> > >>>>>>>>>>>>     24) altd/2.0
> > >>>>>>>>>>>>   4) switch/1.0-1.0502.57058.1.58.ari      11)
> > >>>>>>>>>>>> ugni/6.0-1.0502.10245.9.9.ari         18) rca/
> > >>>>>>>>>>>> 1.0.0-2.0502.57212.2.56.ar
> > >>>>>>>>>>>> i
> > >>>>>>>>>>>>      25) darshan/2.3.1
> > >>>>>>>>>>>>   5) craype-ivybridge                      12) pmi/
> > >>>>>>>>>>>> 5.0.10-1.0000.11050.0.0.ari       19) atp/2.0.2        26)
> > >>>>>>>>>>>> emacs/24.2
> > >>>>>>>>>>>>   6) craype-network-aries                  13)
> > >>>>>>>>>>>> dmapp/7.0.1-1.0502.10246.8.47.ari     20) PrgEnv-intel/5.2.56
> > >>>>>>>>>>>> 27)
> > >>>>>>>>>>>> cray-hdf5-parallel/1.8.16
> > >>>>>>>>>>>>   7) craype/2.4.2                          14)
> > >>>>>>>>>>>> gni-headers/4.0-1.0502.10317.9.2.ari  21) cray-shmem/7.4.1
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> Thanks.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> treb
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> --
> > >>>>>>>>>>>> David Trebotich
> > >>>>>>>>>>>> Applied Numerical Algorithms Group
> > >>>>>>>>>>>> Lawrence Berkeley National Laboratory
> > >>>>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> > >>>>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> --
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>> David Trebotich
> > >>>>>>>>>>>
> > >>>>>>>>>> Applied Numerical Algorithms Group
> > >>>>>>>>>> Lawrence Berkeley National Laboratory
> > >>>>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> > >>>>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> --
> > >>>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> David Trebotich
> > >>>>>>>> Applied Numerical Algorithms Group
> > >>>>>>>> Lawrence Berkeley National Laboratory
> > >>>>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> > >>>>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> --
> > >>>>>>>
> > >>>>>> David Trebotich
> > >>>>>> Applied Numerical Algorithms Group
> > >>>>>> Lawrence Berkeley National Laboratory
> > >>>>>> (510) 486-5984 <%28510%29%20486-5984> office
> > >>>>>> (510) 384-6868 <%28510%29%20384-6868> mobile
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>
> > >>>> --
> > >>> David Trebotich
> > >>> Applied Numerical Algorithms Group
> > >>> Lawrence Berkeley National Laboratory
> > >>> (510) 486-5984 office
> > >>> (510) 384-6868 mobile
> > >>>
> > >>>
> > >>>
> > >> --
> > >> David Trebotich
> > >> Applied Numerical Algorithms Group
> > >> Computational Research Division
> > >> Lawrence Berkeley National Laboratory(510) 486-5984 office(510) 384-6868
> > >> mobile
> > >>
> > >>
> > >>
> > >
> > 
> 
> 




More information about the petsc-dev mailing list