[petsc-users] Error with SuperLU_DIST (mkl related?)

[Eric Chamberland]

Hi,

I am just starting to debug a bug encountered with and only with 
SuperLU_Dist combined with MKL on a 2 processes validation test.

(the same test works fine with MUMPS on 2 processes).

I just noticed that the SuperLU_Dist version installed by PETSc 
configure script is 5.1.0 and the latest SuperLU_DIST is 5.1.3.

Before going further, I just want to ask:

Is there any specific reason to stick to 5.1.0?


Here is some more information:

On process 2 I have this printed in stdout:

Intel MKL ERROR: Parameter 6 was incorrect on entry to DTRSM .

and in stderr:

Test.ProblemeEFGen.opt: malloc.c:2369: sysmalloc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 *(sizeof(size_t))) - 1)) & ~((2 *(sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long) old_end & pagemask) == 0)' failed.
[saruman:15771] *** Process received signal ***

This is the 7th call to KSPSolve in the same execution. Here is the last 
KSPView:

KSP Object:(o_slin) 2 MPI processes
   type: preonly
   maximum iterations=10000, initial guess is zero
   tolerances:  relative=1e-05, absolute=1e-50, divergence=10000.
   left preconditioning
   using NONE norm type for convergence test
PC Object:(o_slin) 2 MPI processes
   type: lu
     LU: out-of-place factorization
     tolerance for zero pivot 2.22045e-14
     matrix ordering: natural
     factor fill ratio given 0., needed 0.
       Factored matrix follows:
         Mat Object:         2 MPI processes
           type: mpiaij
           rows=382, cols=382
           package used to perform factorization: superlu_dist
           total: nonzeros=0, allocated nonzeros=0
           total number of mallocs used during MatSetValues calls =0
             SuperLU_DIST run parameters:
               Process grid nprow 2 x npcol 1
               Equilibrate matrix TRUE
               Matrix input mode 1
               Replace tiny pivots FALSE
               Use iterative refinement FALSE
               Processors in row 2 col partition 1
               Row permutation LargeDiag
               Column permutation METIS_AT_PLUS_A
               Parallel symbolic factorization FALSE
               Repeated factorization SamePattern
   linear system matrix = precond matrix:
   Mat Object:  (o_slin)   2 MPI processes
     type: mpiaij
     rows=382, cols=382
     total: nonzeros=4458, allocated nonzeros=4458
     total number of mallocs used during MatSetValues calls =0
       using I-node (on process 0) routines: found 109 nodes, limit used is 5

I know this information is not enough to help debug, but I would like to 
know if PETSc guys will upgrade to 5.1.3 before trying to debug anything.

Thanks,
Eric