[petsc-users] FETI-DP implementation and call sequence

Fri Sep 5 19:08:27 CDT 2014

On Wed, 3 Sep 2014, Stefano Zampini wrote:

> FETIDP is in PETSc as a byproduct of the BDDC preconditioner (one is the dual of the other) and it does not have its own classes so far.
> 
> That said, you can experiment with FETI-DP only after having setup a BDDC preconditioner with the options and customization you prefer.
> Use http://www.mcs.anl.gov/petsc/petsc-dev/docs/manualpages/KSP/index.html for manual pages.
>  
> For an 'how to' with FETIDP, please see src/ksp/ksp/examples/tutorials/ex.59.c as Jed told you, specifically look at ComputeKSPFETIDP for obtaining the FETIDP matrix F (implemented Matrix-free) and the optimal FETIDP dirichlet preconditioner. Once you have F, you can use PCBDDCMatFETIDPGetRHS and PCBDDCMatFetiDPGetSolution to obtain a right-hand side for the FETIDP system and a physical solution from the solution of the FETIDP system.
> 
> I would recommend you to use the development version of the library and either use the ‘next’ branch or the ‘master' branch after having merged in the branch stefano_zampini/pcbddc-primalfixes. Note that ‘next’ also contains the new deluxe scaling operator for BDDC which is not available to use with FETI-DP.
> 
> If you have any other questions which can be useful for other PETSc users, please use the mailing list; otherwise you can contact me personally.
> 
> Stefano

Hm - this example is crashing for me.. [both with next and master+stefano_zampini/pcbddc-primalfixes]

Needs some debugging..

Satish

>>>>>>>>>>>
balay at asterix /home/balay/petsc/src/ksp/ksp/examples/tutorials (test)
$ make runex59
12a13,96
> [1]PETSC ERROR: [2]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
> [2]PETSC ERROR: Null argument, when expecting valid pointer
> [2]PETSC ERROR: Null Object: Parameter # 1
> [2]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
> [2]PETSC ERROR: Petsc Development GIT revision: v3.5.1-212-g160c54e  GIT Date: 2014-09-05 18:38:50 -0500
> [2]PETSC ERROR: [3]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
> [3]PETSC ERROR: Null argument, when expecting valid pointer
> [3]PETSC ERROR: Null Object: Parameter # 1
> [3]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
> [3]PETSC ERROR: Petsc Development GIT revision: v3.5.1-212-g160c54e  GIT Date: 2014-09-05 18:38:50 -0500
> [3]PETSC ERROR: ./ex59 on a arch-pcbddc named asterix.mcs.anl.gov by balay Fri Sep  5 19:04:27 2014
> [3]PETSC ERROR: Configure options --with-pcbddc=1 PETSC_ARCH=arch-pcbddc
> ./ex59 on a arch-pcbddc named asterix.mcs.anl.gov by balay Fri Sep  5 19:04:27 2014
> [2]PETSC ERROR: Configure options --with-pcbddc=1 PETSC_ARCH=arch-pcbddc
> [2]PETSC ERROR: #1 ISLocalToGlobalMappingRestoreBlockInfo() line 1146 in /home/balay/petsc/src/vec/is/utils/isltog.c
> [3]PETSC ERROR: #1 ISLocalToGlobalMappingRestoreBlockInfo() line 1146 in /home/balay/petsc/src/vec/is/utils/isltog.c
> [3]PETSC ERROR: [2]PETSC ERROR: #2 ISLocalToGlobalMappingRestoreInfo() line 1245 in /home/balay/petsc/src/vec/is/utils/isltog.c
> [2]PETSC ERROR: #2 ISLocalToGlobalMappingRestoreInfo() line 1245 in /home/balay/petsc/src/vec/is/utils/isltog.c
> [3]PETSC ERROR: #3 PCISDestroy() line 381 in /home/balay/petsc/src/ksp/pc/impls/is/pcis.c
> #3 PCISDestroy() line 381 in /home/balay/petsc/src/ksp/pc/impls/is/pcis.c
> [2]PETSC ERROR: [3]PETSC ERROR: #4 PCDestroy_BDDC() line 1373 in /home/balay/petsc/src/ksp/pc/impls/bddc/bddc.c
> #4 PCDestroy_BDDC() line 1373 in /home/balay/petsc/src/ksp/pc/impls/bddc/bddc.c
> [2]PETSC ERROR: #5 PCDestroy() line 121 in /home/balay/petsc/src/ksp/pc/interface/precon.c
> [3]PETSC ERROR: #5 PCDestroy() line 121 in /home/balay/petsc/src/ksp/pc/interface/precon.c
> [2]PETSC ERROR: #6 PCBDDCDestroyFETIDPPC() line 77 in /home/balay/petsc/src/ksp/pc/impls/bddc/bddcfetidp.c
> [3]PETSC ERROR: #6 PCBDDCDestroyFETIDPPC() line 77 in /home/balay/petsc/src/ksp/pc/impls/bddc/bddcfetidp.c
> [3]PETSC ERROR: [2]PETSC ERROR: #7 PCDestroy_Shell() line 194 in /home/balay/petsc/src/ksp/pc/impls/shell/shellpc.c
> [2]PETSC ERROR: #7 PCDestroy_Shell() line 194 in /home/balay/petsc/src/ksp/pc/impls/shell/shellpc.c
> [3]PETSC ERROR: #8 PCDestroy() line 121 in /home/balay/petsc/src/ksp/pc/interface/precon.c
> #8 PCDestroy() line 121 in /home/balay/petsc/src/ksp/pc/interface/precon.c
> [2]PETSC ERROR: #9 KSPDestroy() line 808 in /home/balay/petsc/src/ksp/ksp/interface/itfunc.c
> [3]PETSC ERROR: #9 KSPDestroy() line 808 in /home/balay/petsc/src/ksp/ksp/interface/itfunc.c
> [2]PETSC ERROR: #10 main() line 1088 in /home/balay/petsc/src/ksp/ksp/examples/tutorials/ex59.c
> [3]PETSC ERROR: #10 main() line 1088 in /home/balay/petsc/src/ksp/ksp/examples/tutorials/ex59.c
> [3]PETSC ERROR: [2]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
> ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
> application called MPI_Abort(MPI_COMM_WORLD, 85) - process 2
> application called MPI_Abort(MPI_COMM_WORLD, 85) - process 3
> --------------------- Error Message --------------------------------------------------------------
> [1]PETSC ERROR: Null argument, when expecting valid pointer
> [1]PETSC ERROR: Null Object: Parameter # 1
> [1]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
> [1]PETSC ERROR: Petsc Development GIT revision: v3.5.1-212-g160c54e  GIT Date: 2014-09-05 18:38:50 -0500
> [1]PETSC ERROR: ./ex59 on a arch-pcbddc named asterix.mcs.anl.gov by balay Fri Sep  5 19:04:27 2014
> [1]PETSC ERROR: Configure options --with-pcbddc=1 PETSC_ARCH=arch-pcbddc
> [1]PETSC ERROR: #1 ISLocalToGlobalMappingRestoreBlockInfo() line 1146 in /home/balay/petsc/src/vec/is/utils/isltog.c
> [1]PETSC ERROR: #2 ISLocalToGlobalMappingRestoreInfo() line 1245 in /home/balay/petsc/src/vec/is/utils/isltog.c
> [1]PETSC ERROR: #3 PCISDestroy() line 381 in /home/balay/petsc/src/ksp/pc/impls/is/pcis.c
> [1]PETSC ERROR: #4 PCDestroy_BDDC() line 1373 in /home/balay/petsc/src/ksp/pc/impls/bddc/bddc.c
> [1]PETSC ERROR: #5 PCDestroy() line 121 in /home/balay/petsc/src/ksp/pc/interface/precon.c
> [1]PETSC ERROR: #6 PCBDDCDestroyFETIDPPC() line 77 in /home/balay/petsc/src/ksp/pc/impls/bddc/bddcfetidp.c
> [1]PETSC ERROR: #7 PCDestroy_Shell() line 194 in /home/balay/petsc/src/ksp/pc/impls/shell/shellpc.c
> [1]PETSC ERROR: #8 PCDestroy() line 121 in /home/balay/petsc/src/ksp/pc/interface/precon.c
> [1]PETSC ERROR: #9 KSPDestroy() line 808 in /home/balay/petsc/src/ksp/ksp/interface/itfunc.c
> [1]PETSC ERROR: #10 main() line 1088 in /home/balay/petsc/src/ksp/ksp/examples/tutorials/ex59.c
> [1]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
> application called MPI_Abort(MPI_COMM_WORLD, 85) - process 1
> [0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
> [0]PETSC ERROR: Null argument, when expecting valid pointer
> [0]PETSC ERROR: Null Object: Parameter # 1
> [0]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
> [0]PETSC ERROR: Petsc Development GIT revision: v3.5.1-212-g160c54e  GIT Date: 2014-09-05 18:38:50 -0500
> [0]PETSC ERROR: ./ex59 on a arch-pcbddc named asterix.mcs.anl.gov by balay Fri Sep  5 19:04:27 2014
> [0]PETSC ERROR: Configure options --with-pcbddc=1 PETSC_ARCH=arch-pcbddc
> [0]PETSC ERROR: #1 ISLocalToGlobalMappingRestoreBlockInfo() line 1146 in /home/balay/petsc/src/vec/is/utils/isltog.c
> [0]PETSC ERROR: #2 ISLocalToGlobalMappingRestoreInfo() line 1245 in /home/balay/petsc/src/vec/is/utils/isltog.c
> [0]PETSC ERROR: #3 PCISDestroy() line 381 in /home/balay/petsc/src/ksp/pc/impls/is/pcis.c
> [0]PETSC ERROR: #4 PCDestroy_BDDC() line 1373 in /home/balay/petsc/src/ksp/pc/impls/bddc/bddc.c
> [0]PETSC ERROR: #5 PCDestroy() line 121 in /home/balay/petsc/src/ksp/pc/interface/precon.c
> [0]PETSC ERROR: #6 PCBDDCDestroyFETIDPPC() line 77 in /home/balay/petsc/src/ksp/pc/impls/bddc/bddcfetidp.c
> [0]PETSC ERROR: #7 PCDestroy_Shell() line 194 in /home/balay/petsc/src/ksp/pc/impls/shell/shellpc.c
> [0]PETSC ERROR: #8 PCDestroy() line 121 in /home/balay/petsc/src/ksp/pc/interface/precon.c
> [0]PETSC ERROR: #9 KSPDestroy() line 808 in /home/balay/petsc/src/ksp/ksp/interface/itfunc.c
> [0]PETSC ERROR: #10 main() line 1088 in /home/balay/petsc/src/ksp/ksp/examples/tutorials/ex59.c
> [0]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint at mcs.anl.gov----------
> application called MPI_Abort(MPI_COMM_WORLD, 85) - process 0
> 
> ===================================================================================
> =   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
> =   PID 14663 RUNNING AT asterix.mcs.anl.gov
> =   EXIT CODE: 85
> =   CLEANING UP REMAINING PROCESSES
> =   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
> ===================================================================================
/home/balay/petsc/src/ksp/ksp/examples/tutorials
Possible problem with ex59, diffs above
=========================================
balay at asterix /home/balay/petsc/src/ksp/ksp/examples/tutorials (test)
$ 