[petsc-users] superlu_dist and MatSolveTranspose

[Jed Brown]

Antoine De Blois <antoine.deblois at aero.bombardier.com> writes:

> Hello everyone,
>
> I am trying to solve a A^T x = b system. For my applications, I had
> realized that the MatSolveTranspose does not converge properly. 

What do you mean "does not converge properly"?  Can you send a test case
where the transpose solve should be equivalent, but is not?  We have
only a few tests for transpose solve and not all preconditioners support
it, but where it is supported, we want to ensure that it is correct.

> Therefore, I had implemented a MatTranspose followed by a
> MatSolve. This proved to converge perfectly (which is strange since
> the transposed matrix has the same eigenvalues as the
> untransposed...). The problem is that for bigger matrices, the
> MatTranspose is very costly and thus cannot be used.

Costly in terms of memory?  (I want you to be able to use
KSPSolveTranspose, but I'm curious what you're experiencing.)

> I tried using the superlu_dist package. Although it the package works perfectly for the MatSolve, I get the an "No support for this operation for this object type" error  with MatSolveTransopse. I reproduced the error using the MatView an ex10 tutorial. I can provide the matrix and rhs upon request. My command line was:
>
> ex10 -f0 A_and_rhs.bin -pc_type lu -pc_factor_mat_solver_package superlu_dist -trans
>
> So it there an additional parameter I need to use for the transposed solve?
>
> [0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
> [0]PETSC ERROR: No support for this operation for this object type
> [0]PETSC ERROR: Matrix type mpiaij

This is easy to add.  I'll do it now.

> [0]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
> [0]PETSC ERROR: Petsc Release Version 3.5.1, unknown
> [0]PETSC ERROR: /gpfs/fs1/aero/SOFTWARE/TOOLS/PROGRAMMING/petsc/src/ksp/ksp/examples/tutorials/ex10 on a ARGUS_impi_opt named hpc-user11 by ad007804 Thu Aug 28 16:41:15 2014
> [0]PETSC ERROR: Configure options --CFLAGS="-xHost -axAVX" --download-hypre --download-metis --download-ml --download-parmetis --download-scalapack --download-superlu_dist --download-mumps --with-c2html=0 --with-cc=mpiicc --with-fc=mpiifort --with-cxx=mpiicpc --with-debugging=yes --prefix=/gpfs/fs1/aero/SOFTWARE/TOOLS/PROGRAMMING/petsc/petsc-3.5.1 --with-cmake=/gpfs/fs1/aero/SOFTWARE/TOOLS/CMAKE/cmake-2.8.7/bin/cmake --with-valgrind=/gpfs/fs1/aero/SOFTWARE/TOOLS/PROGRAMMING/valgrind-3.9.0/bin/valgrind --with-shared-libraries=0
> [0]PETSC ERROR: #1 MatSolveTranspose() line 3473 in /gpfs/fs2/aero/SOFTWARE/TOOLS/PROGRAMMING/petsc/src/mat/interface/matrix.c
> [0]PETSC ERROR: #2 PCApplyTranspose_LU() line 214 in /gpfs/fs2/aero/SOFTWARE/TOOLS/PROGRAMMING/petsc/src/ksp/pc/impls/factor/lu/lu.c
> [0]PETSC ERROR: #3 PCApplyTranspose() line 573 in /gpfs/fs2/aero/SOFTWARE/TOOLS/PROGRAMMING/petsc/src/ksp/pc/interface/precon.c
> [0]PETSC ERROR: #4 KSP_PCApply() line 233 in /gpfs/fs2/aero/SOFTWARE/TOOLS/PROGRAMMING/petsc/include/petsc-private/kspimpl.h
> [0]PETSC ERROR: #5 KSPInitialResidual() line 63 in /gpfs/fs2/aero/SOFTWARE/TOOLS/PROGRAMMING/petsc/src/ksp/ksp/interface/itres.c
> [0]PETSC ERROR: #6 KSPSolve_GMRES() line 234 in /gpfs/fs2/aero/SOFTWARE/TOOLS/PROGRAMMING/petsc/src/ksp/ksp/impls/gmres/gmres.c
> [0]PETSC ERROR: #7 KSPSolveTranspose() line 704 in /gpfs/fs2/aero/SOFTWARE/TOOLS/PROGRAMMING/petsc/src/ksp/ksp/interface/itfunc.c
> [0]PETSC ERROR: #8 main() line 324 in /gpfs/fs1/aero/SOFTWARE/TOOLS/PROGRAMMING/petsc/src/ksp/ksp/examples/tutorials/ex10.c
>
> FYI, the transpose solve is a typical application for adjoint optimization. There should be a big adjoint community of developers that try to solve the transposed matrix.
>
> Any help is much appreciated,
> Best,
> Antoine
>
>
> Antoine DeBlois
> Specialiste ingenierie, MDO lead / Engineering Specialist, MDO lead
> Aéronautique / Aerospace
> 514-855-5001, x 50862
> antoine.deblois at aero.bombardier.com<mailto:antoine.deblois at aero.bombardier.com>
>
> 2351 Blvd Alfred-Nobel
> Montreal, Qc
> H4S 1A9
>
> [Description : Description : http://signatures.ca.aero.bombardier.net/eom_logo_164x39_fr.jpg]
> CONFIDENTIALITY NOTICE - This communication may contain privileged or confidential information.
> If you are not the intended recipient or received this communication by error, please notify the sender
> and delete the message without copying
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 818 bytes
Desc: not available
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20140828/4baf27fc/attachment-0001.pgp>