[petsc-users] Preconditioned JFNK using SuperLU_dist for time dependent problems

[Hong Zhang]

Have you tried options '-mat_superlu_dist_equil NO
-mat_superlu_dist_rowperm NATURAL
-mat_superlu_dist_colperm NATURAL '?

In addition, how do you know mumps is not as fast as superlu_dist?

Hong

On Fri, Jul 29, 2011 at 1:11 PM, Barry Smith <bsmith at mcs.anl.gov> wrote:
>
>  Ok, next step is valgrind http://www.mcs.anl.gov/petsc/petsc-as/documentation/faq.html#valgrind
>
>   valgrind is an amazing tool (and I don't say the easily) to help track down memory corruption problems that otherwise are difficult to find.  It is likely that valgrind can resolve this issue in a few minutes.
>
>   Barry
>
>
>
> On Jul 29, 2011, at 12:52 PM, Travis C. Fisher wrote:
>
>> Barry,
>>
>> I added the line,
>> call MatSetOption(pcmat,MAT_NEW_NONZERO_LOCATION_ERR,PETSC_TRUE,ierr),
>> after the call to matrix assembly and do not get an error associated with the nonzero locations.
>>
>> Here is the error running superlu_dist with one processor.
>>
>> 0 SNES Function norm 9.448256037271e+02
>>       Nonzeros in L       21005940
>>       Nonzeros in U       21018240
>>       nonzeros in L+U     41958975
>>       nonzeros in LSUB    3914621
>> [0]PETSC ERROR: ------------------------------------------------------------------------
>> [0]PETSC ERROR: Caught signal number 11 SEGV: Segmentation Violation, probably memory access out of range
>> [0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
>> [0]PETSC ERROR: or see http://www.mcs.anl.gov/petsc/petsc-as/documentation/faq.html#valgrind[0]PETSC ERROR: or try http://valgrind.org on GNU/linux and Apple Mac OS X to find memory corruption errors
>> [0]PETSC ERROR: likely location of problem given in stack below
>> [0]PETSC ERROR: ---------------------  Stack Frames ------------------------------------
>> [0]PETSC ERROR: Note: The EXACT line numbers in the stack are not available,
>> [0]PETSC ERROR:       INSTEAD the line number of the start of the function
>> [0]PETSC ERROR:       is given.
>> [0]PETSC ERROR: [0] MatSolve_SuperLU_DIST line 117 /scratch/tfisher/petsc-dev/src/mat/impls/aij/mpi/superlu_dist/superlu_dist.c
>> [0]PETSC ERROR: [0] MatSolve line 3039 /scratch/tfisher/petsc-dev/src/mat/interface/matrix.c
>> [0]PETSC ERROR: [0] PCApply_LU line 202 /scratch/tfisher/petsc-dev/src/ksp/pc/impls/factor/lu/lu.c
>> [0]PETSC ERROR: [0] PCApply line 373 /scratch/tfisher/petsc-dev/src/ksp/pc/interface/precon.c
>> [0]PETSC ERROR: [0] KSPInitialResidual line 45 /scratch/tfisher/petsc-dev/src/ksp/ksp/interface/itres.c
>> [0]PETSC ERROR: [0] KSPSolve_LGMRES line 354 /scratch/tfisher/petsc-dev/src/ksp/ksp/impls/gmres/lgmres/lgmres.c
>> [0]PETSC ERROR: [0] KSPSolve line 330 /scratch/tfisher/petsc-dev/src/ksp/ksp/interface/itfunc.c
>> [0]PETSC ERROR: [0] SNES_KSPSolve line 3364 /scratch/tfisher/petsc-dev/src/snes/interface/snes.c
>> [0]PETSC ERROR: [0] SNESSolve_LS line 142 /scratch/tfisher/petsc-dev/src/snes/impls/ls/ls.c
>> [0]PETSC ERROR: [0] SNESSolve line 2617 /scratch/tfisher/petsc-dev/src/snes/interface/snes.c
>> [0]PETSC ERROR: --------------------- Error Message ------------------------------------
>> [0]PETSC ERROR: Signal received!
>> [0]PETSC ERROR: ------------------------------------------------------------------------
>> [0]PETSC ERROR: Petsc Development HG revision: 77f4001db099d653cddbbaf61d75c0cf8cf833fd  HG Date: Fri Jul 29 13:41:12 2011 +0200
>> [0]PETSC ERROR: See docs/changes/index.html for recent updates.
>> [0]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
>> [0]PETSC ERROR: See docs/index.html for manual pages.
>> [0]PETSC ERROR: ------------------------------------------------------------------------
>> [0]PETSC ERROR: ./HFCFS on a arch-linu named larss-nad by tcfishe1 Fri Jul 29 13:47:04 2011
>> [0]PETSC ERROR: Libraries linked from /ump/fldmd/home/tcfishe1/gnucompiled/lib
>> [0]PETSC ERROR: Configure run at Fri Jul 29 11:37:36 2011
>> [0]PETSC ERROR: Configure options --prefix=/ump/fldmd/home/tcfishe1/gnucompiled --download-fblas-lapack=yes --download-superlu_dist=yes --download-parmetis=yes --download-hypre=yes --download-mumps=yes --download-blacs=yes --download-scalapack=yes
>> [0]PETSC ERROR: ------------------------------------------------------------------------
>> [0]PETSC ERROR: User provided function() line 0 in unknown directory unknown file
>> --------------------------------------------------------------------------
>> MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
>> with errorcode 59.
>>
>> Thanks,
>>
>> Travis
>>
>
>