[petsc-dev] PetscSFSetUp doesn't work with MPIUni hence much of PETSc doesn't work with MPIuni?

[Barry Smith]

  It appears PetscCommBuildTwoSided_Allreduce (unlike all other MPI in PETSc) sends and receives messages to itself which is not supported by MPI-Uni.   How long has this been going on and can it be fixed?

  Barry


~/Src/petsc/src/dm/impls/plex/examples/tests (barry/fix-directory-layout=) arch-ctetgen
$ lldb ./ex3
(lldb) target create "./ex3"
Current executable set to './ex3' (x86_64).
(lldb) run
Process 7548 launched: './ex3' (x86_64)
Process 7548 stopped
* thread #1: tid = 0x1fee2a, 0x00007fff9bd47286 libsystem_kernel.dylib`__pthread_kill + 10, queue = 'com.apple.main-thread', stop reason = signal SIGABRT
    frame #0: 0x00007fff9bd47286 libsystem_kernel.dylib`__pthread_kill + 10
libsystem_kernel.dylib`__pthread_kill:
->  0x7fff9bd47286 <+10>: jae    0x7fff9bd47290            ; <+20>
    0x7fff9bd47288 <+12>: movq   %rax, %rdi
    0x7fff9bd4728b <+15>: jmp    0x7fff9bd42c53            ; cerror_nocancel
    0x7fff9bd47290 <+20>: retq   
(lldb) bt
* thread #1: tid = 0x1fee2a, 0x00007fff9bd47286 libsystem_kernel.dylib`__pthread_kill + 10, queue = 'com.apple.main-thread', stop reason = signal SIGABRT
  * frame #0: 0x00007fff9bd47286 libsystem_kernel.dylib`__pthread_kill + 10
    frame #1: 0x00007fff8fb3942f libsystem_pthread.dylib`pthread_kill + 90
    frame #2: 0x00007fff9badbb53 libsystem_c.dylib`abort + 129
    frame #3: 0x00000001001df9c3 libpetsc.3.05.dylib`Petsc_MPI_Abort(comm=2, errorcode=0) + 19 at mpi.c:171
    frame #4: 0x00000001000395ef libpetsc.3.05.dylib`PetscCommBuildTwoSided_Allreduce(comm=4, count=1, dtype=262148, nto=1, toranks=0x00000001029c8860, todata=0x00000001029ca860, nfrom=0x0000000102902264, fromranks=0x0000000102902268, fromdata=0x00007fff5fbfefc0) + 2319 at mpits.c:171
    frame #5: 0x0000000100038afd libpetsc.3.05.dylib`PetscCommBuildTwoSided(comm=4, count=1, dtype=262148, nto=1, toranks=0x00000001029c8860, todata=0x00000001029ca860, nfrom=0x0000000102902264, fromranks=0x0000000102902268, fromdata=0x00007fff5fbfefc0) + 717 at mpits.c:237
    frame #6: 0x000000010027e7ce libpetsc.3.05.dylib`PetscSFSetUp_Basic(sf=0x0000000102960a60) + 1086 at sfbasic.c:552
    frame #7: 0x00000001002975e8 libpetsc.3.05.dylib`PetscSFSetUp(sf=0x0000000102960a60) + 904 at sf.c:192
    frame #8: 0x00000001002a511d libpetsc.3.05.dylib`PetscSFBcastBegin(sf=0x0000000102960a60, unit=65544, rootdata=0x000000010293ee60, leafdata=0x00000001029c1860) + 1245 at sf.c:923
    frame #9: 0x0000000100d1db74 libpetsc.3.05.dylib`DMGlobalToLocalBegin(dm=0x000000010295a060, g=0x000000010293ca60, mode=INSERT_VALUES, l=0x0000000102942660) + 1508 at dm.c:1704
    frame #10: 0x0000000100cb9dcd libpetsc.3.05.dylib`DMPlexComputeL2Diff(dm=0x000000010295a060, funcs=0x00007fff5fbff808, ctxs=0x00007fff5fbff7c0, X=0x000000010293ca60, diff=0x00007fff5fbff790) + 1085 at plexfem.c:766
    frame #11: 0x000000010000a597 ex3`ComputeError_Plex + 775
    frame #12: 0x0000000100009ff9 ex3`ComputeError + 745
    frame #13: 0x00000001000072e0 ex3`CheckFunctions + 1040
    frame #14: 0x0000000100002249 ex3`main + 745
    frame #15: 0x00007fff998695c9 libdyld.dylib`start + 1
    frame #16: 0x00007fff998695c9 libdyld.dylib`start + 1
(lldb)