[petsc-users] MPICH error in KSPSolve

[John Mousel]

I'm running on Kraken and am currently working with 4320 cores. I get the
following error in KSPSolve.

[2711]:
(/ptmp/ulib/mpt/nightly/5.3/120211/mpich2/src/mpid/cray/src/adi/ptldev.c:2046)
PtlMEInsert failed with error : PTL_NO_SPACE
MHV_exe:
/ptmp/ulib/mpt/nightly/5.3/120211/mpich2/src/mpid/cray/src/adi/ptldev.c:2046:
MPIDI_CRAY_ptldev_desc_pkt: Assertion `0' failed.
forrtl: error (76): Abort trap signal
Image              PC                Routine            Line        Source
MHV_exe            00000000014758CB  Unknown               Unknown  Unknown
MHV_exe            000000000182ED43  Unknown               Unknown  Unknown
MHV_exe            0000000001829460  Unknown               Unknown  Unknown
MHV_exe            00000000017EDE3E  Unknown               Unknown  Unknown
MHV_exe            00000000017B3FE6  Unknown               Unknown  Unknown
MHV_exe            00000000017B3738  Unknown               Unknown  Unknown
MHV_exe            00000000017B2B12  Unknown               Unknown  Unknown
MHV_exe            00000000017B428F  Unknown               Unknown  Unknown
MHV_exe            000000000177FCE1  Unknown               Unknown  Unknown
MHV_exe            0000000001590A43  Unknown               Unknown  Unknown
MHV_exe            00000000014F909B  Unknown               Unknown  Unknown
MHV_exe            00000000014FF53B  Unknown               Unknown  Unknown
MHV_exe            00000000014A4E25  Unknown               Unknown  Unknown
MHV_exe            0000000001487D57  Unknown               Unknown  Unknown
MHV_exe            000000000147F726  Unknown               Unknown  Unknown
MHV_exe            000000000137A8D3  Unknown               Unknown  Unknown
MHV_exe            0000000000E97BF2  Unknown               Unknown  Unknown
MHV_exe            000000000098EAF1  Unknown               Unknown  Unknown
MHV_exe            0000000000989C20  Unknown               Unknown  Unknown
MHV_exe            000000000097A9C2  Unknown               Unknown  Unknown
MHV_exe            000000000082FF2D  axbsolve_                 539
PetscObjectsOperations.F90

This is somewhere in KSPSolve. Is there an MPICH environment variable that
needs tweaking? I couldn't really find much on this particular error.
The solver is BiCGStab with Hypre as a preconditioner.

-ksp_type bcgsl -pc_type hypre -pc_hypre_type boomeramg -ksp_monitor

Thanks,

John
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20120709/1b0db13a/attachment.html>