[petsc-users] GAMG huge hash being requested

Justin Chang jychang48 at gmail.com
Sun Feb 19 03:05:33 CST 2017


Hi all,

So I am attempting to employ the DG1 finite element method on the poisson
equation using GAMG. When I attempt to solve a problem with roughly 4
million DOFs across 20 cores, i get this error:

Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    self.snes.solve(None, v)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
petsc4py.PETSc.Error: error code 63
[ 6] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[ 6] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[ 6] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 6] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 6] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[ 6] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[ 6] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[ 6] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[ 6] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 6] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 6] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 6] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 6] Argument out of range
[ 6] A really huge hash is being requested.. cannot process: 4096000
--------------------------------------------------------------------------
MPI_ABORT was invoked on rank 6 in communicator MPI_COMM_WORLD
with errorcode 1.

NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.
--------------------------------------------------------------------------
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
Traceback (most recent call last):
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
  File "pFiredrake.py", line 109, in <module>

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
    _solve_varproblem(*args, **kwargs)

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
      File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
solver.solve()
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    self.snes.solve(None, v)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
    self.snes.solve(None, v)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
    self.snes.solve(None, v)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
    self.snes.solve(None, v)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
    self.snes.solve(None, v)
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
petsc4py.PETSc.Error
solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
petsc4py.PETSc.Errorpetsc4py.PETSc.Errorpetsc4py.PETSc.Error:
solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
: error code 63
[ 3] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[ 3] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[ 3] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 3] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 3] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[ 3] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[ 3] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[ 3] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[ 3] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 3] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 3] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 3] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 3] Argument out of range
[ 3] A really huge hash is being requested.. cannot process: 4096000
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
: error code 63
[ 1] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[ 1] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[ 1] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 1] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 1] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[ 1] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[ 1] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[ 1] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[ 1] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 1] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 1] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 1] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 1] Argument out of range
[ 1] A really huge hash is being requested.. cannot process: 4096000
: error code 63
[17] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[17] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[17] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[17] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[17] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[17] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[17] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[17] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[17] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[17] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[17] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[17] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[17] Argument out of range
[17] A really huge hash is being requested.. cannot process: 4096000

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
error code 63
[ 5] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[ 5] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[ 5] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 5] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 5] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[ 5] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[ 5] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[ 5] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[ 5] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 5] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 5] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 5] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 5] Argument out of range
[ 5] A really huge hash is being requested.. cannot process: 4096000
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
    _solve_varproblem(*args, **kwargs)
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
petsc4py.PETSc.Error: error code 63
[ 9] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[ 9] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[ 9] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 9] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 9] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[ 9] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[ 9] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[ 9] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[ 9] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 9] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 9] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 9] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 9] Argument out of range
[ 9] A really huge hash is being requested.. cannot process: 4096000
    self.snes.solve(None, v)
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
    _solve_varproblem(*args, **kwargs)
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
petsc4py.PETSc.Error: error code 63
[ 4] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[ 4] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[ 4] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 4] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 4] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[ 4] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[ 4] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[ 4] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[ 4] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 4] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 4] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 4] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 4] Argument out of range
[ 4] A really huge hash is being requested.. cannot process: 4096000
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
    solver.solve()
    _solve_varproblem(*args, **kwargs)

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
    _solve_varproblem(*args, **kwargs)
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    solver.solve()

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    self.snes.solve(None, v)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
    self.snes.solve(None, v)

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
petsc4py.PETSc.Error: error code 63
[13] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[13] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[13] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[13] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[13] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[13] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[13] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[13] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[13] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[13] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[13] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[13] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[13] Argument out of range
[13] A really huge hash is being requested.. cannot process: 4096000
    solver.solve()
Traceback (most recent call last):
  File "pFiredrake.py", line 109, in <module>
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
    solver.solve()
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
petsc4py.PETSc.Error  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
: error code 63
[11] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[11] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[11] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[11] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[11] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[11] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[11] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[11] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[11] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[11] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[11] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[11] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[11] Argument out of range
[11] A really huge hash is being requested.. cannot process: 4096000
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve

solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    solver.solve()
    self.snes.solve(None, v)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    _solve_varproblem(*args, **kwargs)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    _solve_varproblem(*args, **kwargs)
    self.snes.solve(None, v)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 122, in solve
    self.snes.solve(None, v)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
    self.snes.solve(None, v)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
petsc4py.PETSc.Error: error code 63
[14] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[14] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[14] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[14] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[14] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[14] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[14] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[14] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[14] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[14] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[14] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[14] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[14] Argument out of range
[14] A really huge hash is being requested.. cannot process: 4096000
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
    self.snes.solve(None, v)
petsc4py.PETSc.Error: error code 63
[19] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[19] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[19] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[19] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[19] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[19] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[19] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[19] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[19] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[19] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[19] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[19] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[19] Argument out of range
[19] A really huge hash is being requested.. cannot process: 4096000
    _solve_varproblem(*args, **kwargs)
    self.snes.solve(None, v)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
    _solve_varproblem(*args, **kwargs)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
petsc4py.PETSc.Error: error code 63
[15] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[15] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[15] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[15] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[15] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[15] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[15] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[15] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[15] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[15] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[15] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[15] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[15] Argument out of range
[15] A really huge hash is being requested.. cannot process: 4096000
    self.snes.solve(None, v)
petsc4py.PETSc.Error: error code 63
[ 7] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[ 7] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[ 7] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 7] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 7] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[ 7] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[ 7] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[ 7] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[ 7] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 7] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 7] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 7] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 7] Argument out of range
[ 7] A really huge hash is being requested.. cannot process: 4096000
    solver.solve()
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
petsc4py.PETSc.Error  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
: error code 63
[12] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[12] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[12] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[12] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[12] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[12] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[12] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[12] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[12] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[12] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[12] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[12] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[12] Argument out of range
[12] A really huge hash is being requested.. cannot process: 4096000
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
    solver.solve()
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
line 152, in _solve_varproblem
petsc4py.PETSc.Error:   File "PETSc/SNES.pyx", line 537, in
petsc4py.PETSc.SNES.solve (src/petsc4py.PETSc.c:172359)
error code 63
[ 2] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[ 2] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[ 2] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 2] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 2] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[ 2] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[ 2] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[ 2] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[ 2] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 2] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 2] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 2] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 2] Argument out of range
[ 2] A really huge hash is being requested.. cannot process: 4096000
petsc4py.PETSc.Error  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
: error code 63
[ 8] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[ 8] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[ 8] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 8] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 8] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[ 8] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[ 8] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[ 8] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[ 8] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 8] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 8] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 8] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 8] Argument out of range
[ 8] A really huge hash is being requested.. cannot process: 4096000
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    solver.solve()
    solver.solve()
    self.snes.solve(None, v)
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
  File
"/home/jchang23/Software/firedrake/src/firedrake/firedrake/variational_solver.py",
line 220, in solve
    self.snes.solve(None, v)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
petsc4py.PETSc.Error    self.snes.solve(None, v)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
: error code 63
[18] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[18] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[18] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[18] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[18] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[18] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[18] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[18] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[18] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[18] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[18] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[18] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[18] Argument out of range
[18] A really huge hash is being requested.. cannot process: 4096000
    self.snes.solve(None, v)
  File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
(src/petsc4py.PETSc.c:172359)
petsc4py.PETSc.Errorpetsc4py.PETSc.Error: error code 63
[ 0] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[ 0] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[ 0] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 0] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[ 0] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[ 0] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[ 0] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[ 0] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[ 0] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 0] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[ 0] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 0] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[ 0] Argument out of range
[ 0] A really huge hash is being requested.. cannot process: 4096000
: error code 63
[16] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[16] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[16] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[16] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[16] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[16] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[16] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[16] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[16] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[16] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[16] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[16] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[16] Argument out of range
[16] A really huge hash is being requested.. cannot process: 4096000
petsc4py.PETSc.Error: error code 63
[10] SNESSolve() line 4128 in
/tmp/pip-FNpsya-build/src/snes/interface/snes.c
[10] SNESSolve_KSPONLY() line 40 in
/tmp/pip-FNpsya-build/src/snes/impls/ksponly/ksponly.c
[10] KSPSolve() line 620 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[10] KSPSetUp() line 393 in
/tmp/pip-FNpsya-build/src/ksp/ksp/interface/itfunc.c
[10] PCSetUp() line 968 in
/tmp/pip-FNpsya-build/src/ksp/pc/interface/precon.c
[10] PCSetUp_GAMG() line 524 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/gamg.c
[10] PCGAMGCoarsen_AGG() line 955 in
/tmp/pip-FNpsya-build/src/ksp/pc/impls/gamg/agg.c
[10] MatTransposeMatMult() line 9962 in
/tmp/pip-FNpsya-build/src/mat/interface/matrix.c
[10] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[10] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
/tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
[10] PetscTableCreate() line 52 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[10] PetscTableCreateHashSize() line 28 in
/tmp/pip-FNpsya-build/src/sys/utils/ctable.c
[10] Argument out of range
[10] A really huge hash is being requested.. cannot process: 4096000
[compute-0-0.local:31182] 19 more processes have sent help message
help-mpi-api.txt / mpi-abort
[compute-0-0.local:31182] Set MCA parameter "orte_base_help_aggregate" to 0
to see all help / error messages

However, if I use either ML or HYPRE i do not. When I downscale the problem
to roughly 1.7 million dofs, I get no such error with GAMG, but both ML and
HYPRE are still faster.

Something tells me I need to tune the GAMG parameters. Here's some -GAMG
related info that may help:

[0] PCSetUp_GAMG(): level 0) N=4096000, n data rows=1, n data cols=1,
nnz/row (ave)=55, np=20
[0] PCGAMGFilterGraph():      78.5842% nnz after filtering, with threshold
0., 55.8 nnz ave. (N=4096000)
[0] PCGAMGCoarsen_AGG(): Square Graph on level 1 of 1 to square

And if I run with -pc_gamg_threshold 0.08:

[0] PCSetUp_GAMG(): level 0) N=4096000, n data rows=1, n data cols=1,
nnz/row (ave)=55, np=20
[0] PCGAMGFilterGraph():      28.5842% nnz after filtering, with threshold
0.08, 55.8 nnz ave. (N=4096000)
[0] PCGAMGCoarsen_AGG(): Square Graph on level 1 of 1 to square

Any idea what to do here?

Thanks,
Justin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20170219/d365e663/attachment-0001.html>


More information about the petsc-users mailing list