[petsc-users] A bad commit affects MOOSE

[Satish Balay]

PETSC_COMM_WORLD [via PetscCommDuplicate()] attempts to minimize calls to MPI_Comm_dup() - thus potentially avoiding such errors

http://www.mcs.anl.gov/petsc/petsc-current/docs/manualpages/Sys/PetscCommDuplicate.html

Satish

On Mon, 2 Apr 2018, Kong, Fande wrote:

> On Mon, Apr 2, 2018 at 4:23 PM, Satish Balay <balay at mcs.anl.gov> wrote:
> 
> > Does this 'standard test' use MPI_COMM_WORLD' to crate PETSc objects?
> >
> > If so - you could try changing to PETSC_COMM_WORLD
> >
> 
> 
> I do not think we are using PETSC_COMM_WORLD when creating PETSc objects.
> Why we can not use MPI_COMM_WORLD?
> 
> 
> Fande,
> 
> 
> >
> > Satish
> >
> >
> > On Mon, 2 Apr 2018, Kong, Fande wrote:
> >
> > > Hi All,
> > >
> > > I am trying to upgrade PETSc from 3.7.6 to 3.8.3 for MOOSE and its
> > > applications. I have a error message for a standard test:
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > *preconditioners/pbp.lots_of_variables: MPI had an
> > > errorpreconditioners/pbp.lots_of_variables:
> > > ------------------------------------------------
> > preconditioners/pbp.lots_of_variables:
> > > Other MPI error, error stack:preconditioners/pbp.lots_of_variables:
> > > PMPI_Comm_dup(177)..................: MPI_Comm_dup(comm=0x84000001,
> > > new_comm=0x97d1068) failedpreconditioners/pbp.lots_of_variables:
> > > PMPI_Comm_dup(162)..................:
> > > preconditioners/pbp.lots_of_variables:
> > > MPIR_Comm_dup_impl(57)..............:
> > > preconditioners/pbp.lots_of_variables:
> > > MPIR_Comm_copy(739).................:
> > > preconditioners/pbp.lots_of_variables:
> > > MPIR_Get_contextid_sparse_group(614): Too many communicators (0/2048
> > free
> > > on this process; ignore_id=0)*
> > >
> > >
> > > I did "git bisect', and the following commit introduces this issue:
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > *commit 49a781f5cee36db85e8d5b951eec29f10ac13593Author: Stefano Zampini
> > > <stefano.zampini at gmail.com <stefano.zampini at gmail.com>>Date:   Sat Nov 5
> > > 20:15:19 2016 +0300    PCHYPRE: use internal Mat of type MatHYPRE
> > > hpmat already stores two HYPRE vectors*
> > >
> > > Before I debug line-by-line, anyone has a clue on this?
> > >
> > >
> > > Fande,
> > >
> >
> >
>