[petsc-users] GAMG huge hash being requested

Matthew Knepley knepley at gmail.com
Sun Feb 19 08:56:13 CST 2017


Satish fixed this error. I believe the fix is now in master.

  Thanks,

     Matt

On Sun, Feb 19, 2017 at 3:05 AM, Justin Chang <jychang48 at gmail.com> wrote:

> Hi all,
>
> So I am attempting to employ the DG1 finite element method on the poisson
> equation using GAMG. When I attempt to solve a problem with roughly 4
> million DOFs across 20 cores, i get this error:
>
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     self.snes.solve(None, v)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
> petsc4py.PETSc.Error: error code 63
> [ 6] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [ 6] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [ 6] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 6] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 6] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [ 6] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [ 6] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [ 6] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [ 6] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 6] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 6] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 6] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 6] Argument out of range
> [ 6] A really huge hash is being requested.. cannot process: 4096000
> --------------------------------------------------------------------------
> MPI_ABORT was invoked on rank 6 in communicator MPI_COMM_WORLD
> with errorcode 1.
>
> NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
> You may or may not see output from other processes, depending on
> exactly when Open MPI kills them.
> --------------------------------------------------------------------------
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
> Traceback (most recent call last):
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>   File "pFiredrake.py", line 109, in <module>
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>     _solve_varproblem(*args, **kwargs)
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>       File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
> solver.solve()
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     self.snes.solve(None, v)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
>     self.snes.solve(None, v)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
>     self.snes.solve(None, v)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
>     self.snes.solve(None, v)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
>     self.snes.solve(None, v)
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
> petsc4py.PETSc.Error    solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
> petsc4py.PETSc.Errorpetsc4py.PETSc.Errorpetsc4py.PETSc.Error:
> solve(a==L,solution,options_prefix='fe_',solver_parameters=solver_params)
> : error code 63
> [ 3] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [ 3] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [ 3] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 3] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 3] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [ 3] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [ 3] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [ 3] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [ 3] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 3] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 3] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 3] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 3] Argument out of range
> [ 3] A really huge hash is being requested.. cannot process: 4096000
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
> : error code 63
> [ 1] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [ 1] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [ 1] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 1] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 1] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [ 1] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [ 1] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [ 1] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [ 1] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 1] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 1] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 1] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 1] Argument out of range
> [ 1] A really huge hash is being requested.. cannot process: 4096000
> : error code 63
> [17] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [17] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [17] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [17] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [17] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [17] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [17] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [17] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [17] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [17] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [17] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [17] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [17] Argument out of range
> [17] A really huge hash is being requested.. cannot process: 4096000
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
> error code 63
> [ 5] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [ 5] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [ 5] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 5] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 5] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [ 5] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [ 5] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [ 5] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [ 5] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 5] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 5] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 5] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 5] Argument out of range
> [ 5] A really huge hash is being requested.. cannot process: 4096000
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     _solve_varproblem(*args, **kwargs)
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
> petsc4py.PETSc.Error: error code 63
> [ 9] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [ 9] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [ 9] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 9] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 9] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [ 9] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [ 9] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [ 9] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [ 9] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 9] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 9] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 9] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 9] Argument out of range
> [ 9] A really huge hash is being requested.. cannot process: 4096000
>     self.snes.solve(None, v)
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>     _solve_varproblem(*args, **kwargs)
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
> petsc4py.PETSc.Error: error code 63
> [ 4] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [ 4] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [ 4] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 4] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 4] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [ 4] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [ 4] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [ 4] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [ 4] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 4] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 4] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 4] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 4] Argument out of range
> [ 4] A really huge hash is being requested.. cannot process: 4096000
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     solver.solve()
>     _solve_varproblem(*args, **kwargs)
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>     _solve_varproblem(*args, **kwargs)
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     solver.solve()
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     self.snes.solve(None, v)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
>     self.snes.solve(None, v)
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
> petsc4py.PETSc.Error: error code 63
> [13] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [13] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [13] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [13] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [13] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [13] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [13] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [13] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [13] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [13] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [13] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [13] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [13] Argument out of range
> [13] A really huge hash is being requested.. cannot process: 4096000
>     solver.solve()
> Traceback (most recent call last):
>   File "pFiredrake.py", line 109, in <module>
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>     solver.solve()
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
> petsc4py.PETSc.Error  File "/home/jchang23/Software/
> firedrake/src/firedrake/firedrake/solving.py", line 122, in solve
> : error code 63
> [11] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [11] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [11] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [11] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [11] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [11] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [11] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [11] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [11] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [11] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [11] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [11] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [11] Argument out of range
> [11] A really huge hash is being requested.. cannot process: 4096000
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     solve(a==L,solution,options_prefix='fe_',solver_
> parameters=solver_params)
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     solver.solve()
>     self.snes.solve(None, v)
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     _solve_varproblem(*args, **kwargs)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     _solve_varproblem(*args, **kwargs)
>     self.snes.solve(None, v)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 122, in solve
>     self.snes.solve(None, v)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
>     self.snes.solve(None, v)
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
> petsc4py.PETSc.Error: error code 63
> [14] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [14] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [14] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [14] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [14] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [14] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [14] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [14] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [14] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [14] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [14] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [14] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [14] Argument out of range
> [14] A really huge hash is being requested.. cannot process: 4096000
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>     self.snes.solve(None, v)
> petsc4py.PETSc.Error: error code 63
> [19] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [19] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [19] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [19] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [19] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [19] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [19] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [19] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [19] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [19] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [19] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [19] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [19] Argument out of range
> [19] A really huge hash is being requested.. cannot process: 4096000
>     _solve_varproblem(*args, **kwargs)
>     self.snes.solve(None, v)
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
>     _solve_varproblem(*args, **kwargs)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
> petsc4py.PETSc.Error: error code 63
> [15] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [15] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [15] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [15] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [15] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [15] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [15] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [15] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [15] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [15] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [15] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [15] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [15] Argument out of range
> [15] A really huge hash is being requested.. cannot process: 4096000
>     self.snes.solve(None, v)
> petsc4py.PETSc.Error: error code 63
> [ 7] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [ 7] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [ 7] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 7] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 7] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [ 7] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [ 7] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [ 7] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [ 7] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 7] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 7] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 7] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 7] Argument out of range
> [ 7] A really huge hash is being requested.. cannot process: 4096000
>     solver.solve()
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
> petsc4py.PETSc.Error  File "/home/jchang23/Software/
> firedrake/src/firedrake/firedrake/solving.py", line 152, in
> _solve_varproblem
> : error code 63
> [12] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [12] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [12] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [12] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [12] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [12] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [12] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [12] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [12] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [12] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [12] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [12] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [12] Argument out of range
> [12] A really huge hash is being requested.. cannot process: 4096000
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
>     solver.solve()
>   File "/home/jchang23/Software/firedrake/src/firedrake/firedrake/solving.py",
> line 152, in _solve_varproblem
> petsc4py.PETSc.Error:   File "PETSc/SNES.pyx", line 537, in
> petsc4py.PETSc.SNES.solve (src/petsc4py.PETSc.c:172359)
> error code 63
> [ 2] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [ 2] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [ 2] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 2] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 2] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [ 2] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [ 2] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [ 2] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [ 2] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 2] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 2] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 2] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 2] Argument out of range
> [ 2] A really huge hash is being requested.. cannot process: 4096000
> petsc4py.PETSc.Error  File "/home/jchang23/Software/
> firedrake/src/firedrake/firedrake/variational_solver.py", line 220, in
> solve
> : error code 63
> [ 8] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [ 8] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [ 8] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 8] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 8] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [ 8] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [ 8] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [ 8] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [ 8] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 8] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 8] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 8] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 8] Argument out of range
> [ 8] A really huge hash is being requested.. cannot process: 4096000
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     solver.solve()
>     solver.solve()
>     self.snes.solve(None, v)
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>   File "/home/jchang23/Software/firedrake/src/firedrake/
> firedrake/variational_solver.py", line 220, in solve
>     self.snes.solve(None, v)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
> petsc4py.PETSc.Error    self.snes.solve(None, v)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
> : error code 63
> [18] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [18] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [18] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [18] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [18] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [18] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [18] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [18] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [18] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [18] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [18] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [18] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [18] Argument out of range
> [18] A really huge hash is being requested.. cannot process: 4096000
>     self.snes.solve(None, v)
>   File "PETSc/SNES.pyx", line 537, in petsc4py.PETSc.SNES.solve
> (src/petsc4py.PETSc.c:172359)
> petsc4py.PETSc.Errorpetsc4py.PETSc.Error: error code 63
> [ 0] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [ 0] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [ 0] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 0] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [ 0] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [ 0] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [ 0] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [ 0] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [ 0] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 0] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [ 0] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 0] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [ 0] Argument out of range
> [ 0] A really huge hash is being requested.. cannot process: 4096000
> : error code 63
> [16] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [16] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [16] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [16] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [16] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [16] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [16] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [16] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [16] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [16] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [16] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [16] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [16] Argument out of range
> [16] A really huge hash is being requested.. cannot process: 4096000
> petsc4py.PETSc.Error: error code 63
> [10] SNESSolve() line 4128 in /tmp/pip-FNpsya-build/src/
> snes/interface/snes.c
> [10] SNESSolve_KSPONLY() line 40 in /tmp/pip-FNpsya-build/src/
> snes/impls/ksponly/ksponly.c
> [10] KSPSolve() line 620 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [10] KSPSetUp() line 393 in /tmp/pip-FNpsya-build/src/ksp/
> ksp/interface/itfunc.c
> [10] PCSetUp() line 968 in /tmp/pip-FNpsya-build/src/ksp/
> pc/interface/precon.c
> [10] PCSetUp_GAMG() line 524 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/gamg.c
> [10] PCGAMGCoarsen_AGG() line 955 in /tmp/pip-FNpsya-build/src/ksp/
> pc/impls/gamg/agg.c
> [10] MatTransposeMatMult() line 9962 in /tmp/pip-FNpsya-build/src/mat/
> interface/matrix.c
> [10] MatTransposeMatMult_MPIAIJ_MPIAIJ() line 902 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [10] MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ() line 1676 in
> /tmp/pip-FNpsya-build/src/mat/impls/aij/mpi/mpimatmatmult.c
> [10] PetscTableCreate() line 52 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [10] PetscTableCreateHashSize() line 28 in /tmp/pip-FNpsya-build/src/sys/
> utils/ctable.c
> [10] Argument out of range
> [10] A really huge hash is being requested.. cannot process: 4096000
> [compute-0-0.local:31182] 19 more processes have sent help message
> help-mpi-api.txt / mpi-abort
> [compute-0-0.local:31182] Set MCA parameter "orte_base_help_aggregate" to
> 0 to see all help / error messages
>
> However, if I use either ML or HYPRE i do not. When I downscale the
> problem to roughly 1.7 million dofs, I get no such error with GAMG, but
> both ML and HYPRE are still faster.
>
> Something tells me I need to tune the GAMG parameters. Here's some -GAMG
> related info that may help:
>
> [0] PCSetUp_GAMG(): level 0) N=4096000, n data rows=1, n data cols=1,
> nnz/row (ave)=55, np=20
> [0] PCGAMGFilterGraph():      78.5842% nnz after filtering, with threshold
> 0., 55.8 nnz ave. (N=4096000)
> [0] PCGAMGCoarsen_AGG(): Square Graph on level 1 of 1 to square
>
> And if I run with -pc_gamg_threshold 0.08:
>
> [0] PCSetUp_GAMG(): level 0) N=4096000, n data rows=1, n data cols=1,
> nnz/row (ave)=55, np=20
> [0] PCGAMGFilterGraph():      28.5842% nnz after filtering, with threshold
> 0.08, 55.8 nnz ave. (N=4096000)
> [0] PCGAMGCoarsen_AGG(): Square Graph on level 1 of 1 to square
>
> Any idea what to do here?
>
> Thanks,
> Justin
>
>


-- 
What most experimenters take for granted before they begin their
experiments is infinitely more interesting than any results to which their
experiments lead.
-- Norbert Wiener
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20170219/e94fdeb5/attachment-0001.html>


More information about the petsc-users mailing list