<div dir="ltr">Thanks Barry! I tried that and it seems to be working. This is what I did. It would be great if you could take a look at it and let me know if this is what you had in mind.<div><br></div>1. Collected Dirichlet rows locally<div><a href="https://github.com/IBAMR/IBAMR/blob/amneetb/acoustically-driven-flows/src/acoustic_streaming/AcousticStreamingPETScMatUtilities.cpp#L731">https://github.com/IBAMR/IBAMR/blob/amneetb/acoustically-driven-flows/src/acoustic_streaming/AcousticStreamingPETScMatUtilities.cpp#L731</a><br><div><a href="https://github.com/IBAMR/IBAMR/blob/amneetb/acoustically-driven-flows/src/acoustic_streaming/AcousticStreamingPETScMatUtilities.cpp#L797">https://github.com/IBAMR/IBAMR/blob/amneetb/acoustically-driven-flows/src/acoustic_streaming/AcousticStreamingPETScMatUtilities.cpp#L797</a><br><div><br><div><br></div><div>2. MPI_allgatherv Dirichlet rows</div><div><a href="https://github.com/IBAMR/IBAMR/blob/amneetb/acoustically-driven-flows/src/acoustic_streaming/AcousticStreamingPETScMatUtilities.cpp#L805-L810">https://github.com/IBAMR/IBAMR/blob/amneetb/acoustically-driven-flows/src/acoustic_streaming/AcousticStreamingPETScMatUtilities.cpp#L805-L810</a><br></div><div><br></div><div>3. Called the MatZeroRows function</div><div><a href="https://github.com/IBAMR/IBAMR/blob/amneetb/acoustically-driven-flows/src/acoustic_streaming/AcousticStreamingPETScMatUtilities.cpp#L812-L814">https://github.com/IBAMR/IBAMR/blob/amneetb/acoustically-driven-flows/src/acoustic_streaming/AcousticStreamingPETScMatUtilities.cpp#L812-L814</a><br></div><div><br><div><br></div><div> </div></div></div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Nov 29, 2023 at 11:32 AM Barry Smith <<a href="mailto:bsmith@petsc.dev">bsmith@petsc.dev</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><br id="m_-1051980424728766774lineBreakAtBeginningOfMessage"><div><br><blockquote type="cite"><div>On Nov 29, 2023, at 2:11 PM, Matthew Knepley <<a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>> wrote:</div><br><div><div dir="ltr"><div dir="ltr">On Wed, Nov 29, 2023 at 1:55 PM Amneet Bhalla <<a href="mailto:mail2amneet@gmail.com" target="_blank">mail2amneet@gmail.com</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">So the code logic is after the matrix is assembled, I iterate over all distributed patches in the domain to see which of the patch is abutting a Dirichlet boundary. Depending upon which patch abuts a physical and Dirichlet boundary, a processor will call this routine. However, that same processor is “owning” that DoF, which would be on its diagonal. </div><div dir="auto"><br></div><div dir="auto">I think Barry already mentioned this is not going to work unless I use the flag to not communicate explicitly. However, that flag is not working as it should over here for some reason.</div></blockquote><div><br></div><div>Oh, I do not think that is right.</div><div><br></div><div>Barry, when I look at the code, MPIU_Allreduce is always going to be called to fix up the nonzero_state. Am I wrong about that?</div></div></div></div></blockquote><div><br></div>  No, you are correct. I missed that in my earlier look. Setting those flags reduce the number of MPI reductions but does not eliminate them completely.</div><div><br></div><div>  MatZeroRows is collective (as its manual page indicates) so you have to do the second thing I suggested. Inside your for loop construct an array containing all the local</div><div>rows being zeroed and then make a single call by all MPI processes to MatZeroRows().  Note this is a small change of just a handful of lines of code.</div><div><br></div><div>   Barry</div><div><br><blockquote type="cite"><div><div dir="ltr"><div class="gmail_quote"><div><br></div><div>  Thanks,</div><div><br></div><div>    Matt</div><div></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">I can always change the matrix coefficients for Dirichlet rows during MatSetValues. However, that would lengthen my code and I was trying to avoid that. </div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Nov 29, 2023 at 10:02 AM Matthew Knepley <<a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">On Wed, Nov 29, 2023 at 12:30 PM Amneet Bhalla <<a href="mailto:mail2amneet@gmail.com" target="_blank">mail2amneet@gmail.com</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">Ok, I added both, but it still hangs. Here, is bt from all three tasks:</div></div></blockquote><div><br></div><div>It looks like two processes are calling AllReduce, but one is not. Are all procs not calling MatZeroRows?</div><div><br></div><div>  Thanks,</div><div><br></div><div>     Matt</div></div></div><div dir="ltr"><div class="gmail_quote"><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div>Task 1:</div><div><br></div><div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(47,180,29);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">amneetb</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">@</span><span style="font-variant-ligatures:no-common-ligatures">APSB-MacBook-Pro-16:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">~</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">$ lldb<span>  </span>-p 44691<span> </span></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) process attach --pid 44691</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 44691 stopped</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000018a2d750c</span><span style="font-variant-ligatures:no-common-ligatures"> libsystem_kernel.dylib`__semwait_signal + 8</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">libsystem_kernel.dylib`:</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">-><span> </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d750c <+8>:<span>  </span>b.lo <span>  </span>0x18a2d752c <span>              </span>; <+40></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7510 <+12>: pacibsp<span> </span></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7514 <+16>: stp<span>    </span>x29, x30, [sp, #-0x10]!</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7518 <+20>: mov<span>    </span>x29, sp</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Target 0: (fo_acoustic_streaming_solver_2d) stopped.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Executable module set to "/Users/amneetb/Softwares/IBAMR-Git/objs-dbg/tests/IBTK/fo_acoustic_streaming_solver_2d".</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Architecture set to: arm64-apple-macosx-.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">cont</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 44691 resuming</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 44691 stopped</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010ba40b60</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_POSIX_mpi_release_gather_release + 752</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">libpmpi.12.dylib`MPIDI_POSIX_mpi_release_gather_release:</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">-><span> </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10ba40b60 <+752>: add<span>    </span>w8, w8, #0x1</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10ba40b64 <+756>: ldr<span>    </span>w9, [x22]</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10ba40b68 <+760>: cmp<span>    </span>w8, w9</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10ba40b6c <+764>: <a href="http://b.lt/" target="_blank">b.lt</a> <span>  </span>0x10ba40b4c <span>              </span>; <+732></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Target 0: (fo_acoustic_streaming_solver_2d) stopped.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">bt</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>  </span>* frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010ba40b60</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_POSIX_mpi_release_gather_release + 752</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #1: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010ba48528</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_POSIX_mpi_allreduce_release_gather + 1088</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #2: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010ba47964</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_Allreduce_intra_composition_gamma + 368</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #3: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010ba35e78</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIR_Allreduce + 1588</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #4: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000103f587dc</span><span style="font-variant-ligatures:no-common-ligatures"> libmpi.12.dylib`MPI_Allreduce + 2280</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #5: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000106d67650</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`MatZeroRows_MPIAIJ(A=0x0000000105846470, N=1, rows=0x000000016dbfa9f4, diag=1, x=0x0000000000000000, b=0x0000000000000000) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">mpiaij.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">827</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">3</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #6: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000106aadfac</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`MatZeroRows(mat=0x0000000105846470, numRows=1, rows=0x000000016dbfa9f4, diag=1, x=0x0000000000000000, b=0x0000000000000000) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">matrix.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">5935</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">3</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #7: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x00000001023952d0</span><span style="font-variant-ligatures:no-common-ligatures"> fo_acoustic_streaming_solver_2d`IBAMR::AcousticStreamingPETScMatUtilities::constructPatchLevelFOAcousticStreamingOp(mat=0x000000016dc04168, omega=1, sound_speed=1, rho_idx=3, mu_idx=2, lambda_idx=4, u_bc_coefs=0x000000016dc04398, data_time=NaN, num_dofs_per_proc=size=3, u_dof_index_idx=27, p_dof_index_idx=28, patch_level=Pointer<SAMRAI::hier::PatchLevel<2> > @ 0x000000016dbfcec0, mu_interp_type=VC_HARMONIC_INTERP) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">AcousticStreamingPETScMatUtilities.cpp</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">799</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">36</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #8: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x00000001023acb8c</span><span style="font-variant-ligatures:no-common-ligatures"> fo_acoustic_streaming_solver_2d`IBAMR::FOAcousticStreamingPETScLevelSolver::initializeSolverStateSpecialized(this=0x000000016dc04018, x=0x000000016dc05778, (null)=0x000000016dc05680) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">FOAcousticStreamingPETScLevelSolver.cpp</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">149</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">5</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #9: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010254a2dc</span><span style="font-variant-ligatures:no-common-ligatures"> fo_acoustic_streaming_solver_2d`IBTK::PETScLevelSolver::initializeSolverState(this=0x000000016dc04018, x=0x000000016dc05778, b=0x000000016dc05680) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">PETScLevelSolver.cpp</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">340</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">5</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #10: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000102202e5c</span><span style="font-variant-ligatures:no-common-ligatures"> fo_acoustic_streaming_solver_2d`main(argc=11, argv=0x000000016dc07450) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">fo_acoustic_streaming_solver.cpp</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">400</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">22</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #11: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000189fbbf28</span><span style="font-variant-ligatures:no-common-ligatures"> dyld`start + 2236</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb)<span> </span></span></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr"><br></div><div class="gmail_attr">Task 2:</div><div class="gmail_attr"><br></div><div class="gmail_attr"><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(47,180,29);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">amneetb</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">@</span><span style="font-variant-ligatures:no-common-ligatures">APSB-MacBook-Pro-16:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">~</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">$ lldb<span>  </span>-p 44692<span> </span></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) process attach --pid 44692</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 44692 stopped</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000018a2d750c</span><span style="font-variant-ligatures:no-common-ligatures"> libsystem_kernel.dylib`__semwait_signal + 8</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">libsystem_kernel.dylib`:</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">-><span> </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d750c <+8>:<span>  </span>b.lo <span>  </span>0x18a2d752c <span>              </span>; <+40></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7510 <+12>: pacibsp<span> </span></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7514 <+16>: stp<span>    </span>x29, x30, [sp, #-0x10]!</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7518 <+20>: mov<span>    </span>x29, sp</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Target 0: (fo_acoustic_streaming_solver_2d) stopped.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Executable module set to "/Users/amneetb/Softwares/IBAMR-Git/objs-dbg/tests/IBTK/fo_acoustic_streaming_solver_2d".</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Architecture set to: arm64-apple-macosx-.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">cont</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 44692 resuming</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 44692 stopped</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010e5a022c</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_POSIX_mpi_barrier_release_gather + 516</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">libpmpi.12.dylib`MPIDI_POSIX_mpi_barrier_release_gather:</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">-><span> </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10e5a022c <+516>: ldr<span>    </span>x10, [x19, #0x4e8]</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10e5a0230 <+520>: cmp<span>    </span>x9, x10</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10e5a0234 <+524>: b.hs <span>  </span>0x10e5a0254 <span>              </span>; <+556></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10e5a0238 <+528>: add<span>    </span>w8, w8, #0x1</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Target 0: (fo_acoustic_streaming_solver_2d) stopped.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">bt</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>  </span>* frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010e5a022c</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_POSIX_mpi_barrier_release_gather + 516</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #1: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010e59fd14</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_SHM_mpi_barrier + 224</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #2: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010e59fb60</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_Barrier_intra_composition_alpha + 44</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #3: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010e585490</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIR_Barrier + 900</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #4: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000106ac5030</span><span style="font-variant-ligatures:no-common-ligatures"> libmpi.12.dylib`MPI_Barrier + 684</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #5: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000108e62638</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`PetscCommDuplicate(comm_in=1140850688, comm_out=0x00000001408ae4b0, first_tag=0x00000001408ae4e4) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">tagm.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">235</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">5</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #6: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000108e6a910</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`PetscHeaderCreate_Private(h=0x00000001408ae470, classid=1211228, class_name="KSP", descr="Krylov Method", mansec="KSP", comm=1140850688, destroy=(libpetsc.3.17.dylib`KSPDestroy at itfunc.c:1418), view=(libpetsc.3.17.dylib`KSPView at itcreate.c:113)) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">inherit.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">62</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">3</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #7: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010aa28010</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`KSPCreate(comm=1140850688, inksp=0x000000016b0a4160) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">itcreate.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">679</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">3</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #8: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x00000001050aa2f4</span><span style="font-variant-ligatures:no-common-ligatures"> fo_acoustic_streaming_solver_2d`IBTK::PETScLevelSolver::initializeSolverState(this=0x000000016b0a4018, x=0x000000016b0a5778, b=0x000000016b0a5680) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">PETScLevelSolver.cpp</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">344</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">12</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #9: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000104d62e5c</span><span style="font-variant-ligatures:no-common-ligatures"> fo_acoustic_streaming_solver_2d`main(argc=11, argv=0x000000016b0a7450) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">fo_acoustic_streaming_solver.cpp</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">400</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">22</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #10: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000189fbbf28</span><span style="font-variant-ligatures:no-common-ligatures"> dyld`start + 2236</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb)<span> </span></span></div></div><div dir="ltr" class="gmail_attr"><br></div><div dir="ltr" class="gmail_attr"><br></div><div class="gmail_attr">Task 3:</div><div class="gmail_attr"><br></div><div class="gmail_attr"><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(47,180,29);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">amneetb</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">@</span><span style="font-variant-ligatures:no-common-ligatures">APSB-MacBook-Pro-16:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">~</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">$ lldb<span>  </span>-p 44693<span> </span></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) process attach --pid 44693</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 44693 stopped</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000018a2d750c</span><span style="font-variant-ligatures:no-common-ligatures"> libsystem_kernel.dylib`__semwait_signal + 8</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">libsystem_kernel.dylib`:</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">-><span> </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d750c <+8>:<span>  </span>b.lo <span>  </span>0x18a2d752c <span>              </span>; <+40></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7510 <+12>: pacibsp<span> </span></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7514 <+16>: stp<span>    </span>x29, x30, [sp, #-0x10]!</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7518 <+20>: mov<span>    </span>x29, sp</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Target 0: (fo_acoustic_streaming_solver_2d) stopped.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Executable module set to "/Users/amneetb/Softwares/IBAMR-Git/objs-dbg/tests/IBTK/fo_acoustic_streaming_solver_2d".</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Architecture set to: arm64-apple-macosx-.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">cont</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 44693 resuming</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 44693 stopped</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010e59c68c</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_POSIX_mpi_release_gather_gather + 952</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">libpmpi.12.dylib`MPIDI_POSIX_mpi_release_gather_gather:</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">-><span> </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10e59c68c <+952>: ldr<span>    </span>w9, [x21]</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10e59c690 <+956>: cmp<span>    </span>w8, w9</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10e59c694 <+960>: <a href="http://b.lt/" target="_blank">b.lt</a> <span>  </span>0x10e59c670 <span>              </span>; <+924></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x10e59c698 <+964>: bl <span>    </span>0x10e59ce64 <span>              </span>; MPID_Progress_test</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Target 0: (fo_acoustic_streaming_solver_2d) stopped.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">bt</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>  </span>* frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010e59c68c</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_POSIX_mpi_release_gather_gather + 952</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #1: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010e5a44bc</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_POSIX_mpi_allreduce_release_gather + 980</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #2: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010e5a3964</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_Allreduce_intra_composition_gamma + 368</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #3: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010e591e78</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIR_Allreduce + 1588</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #4: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000106ab47dc</span><span style="font-variant-ligatures:no-common-ligatures"> libmpi.12.dylib`MPI_Allreduce + 2280</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #5: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x00000001098c3650</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`MatZeroRows_MPIAIJ(A=0x0000000136862270, N=1, rows=0x000000016b09e9f4, diag=1, x=0x0000000000000000, b=0x0000000000000000) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">mpiaij.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">827</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">3</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #6: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000109609fac</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`MatZeroRows(mat=0x0000000136862270, numRows=1, rows=0x000000016b09e9f4, diag=1, x=0x0000000000000000, b=0x0000000000000000) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">matrix.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">5935</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">3</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #7: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000104ef12d0</span><span style="font-variant-ligatures:no-common-ligatures"> fo_acoustic_streaming_solver_2d`IBAMR::AcousticStreamingPETScMatUtilities::constructPatchLevelFOAcousticStreamingOp(mat=0x000000016b0a8168, omega=1, sound_speed=1, rho_idx=3, mu_idx=2, lambda_idx=4, u_bc_coefs=0x000000016b0a8398, data_time=NaN, num_dofs_per_proc=size=3, u_dof_index_idx=27, p_dof_index_idx=28, patch_level=Pointer<SAMRAI::hier::PatchLevel<2> > @ 0x000000016b0a0ec0, mu_interp_type=VC_HARMONIC_INTERP) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">AcousticStreamingPETScMatUtilities.cpp</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">799</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">36</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #8: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000104f08b8c</span><span style="font-variant-ligatures:no-common-ligatures"> fo_acoustic_streaming_solver_2d`IBAMR::FOAcousticStreamingPETScLevelSolver::initializeSolverStateSpecialized(this=0x000000016b0a8018, x=0x000000016b0a9778, (null)=0x000000016b0a9680) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">FOAcousticStreamingPETScLevelSolver.cpp</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">149</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">5</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #9: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x00000001050a62dc</span><span style="font-variant-ligatures:no-common-ligatures"> fo_acoustic_streaming_solver_2d`IBTK::PETScLevelSolver::initializeSolverState(this=0x000000016b0a8018, x=0x000000016b0a9778, b=0x000000016b0a9680) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">PETScLevelSolver.cpp</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">340</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">5</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #10: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000104d5ee5c</span><span style="font-variant-ligatures:no-common-ligatures"> fo_acoustic_streaming_solver_2d`main(argc=11, argv=0x000000016b0ab450) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">fo_acoustic_streaming_solver.cpp</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">400</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">22</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #11: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000189fbbf28</span><span style="font-variant-ligatures:no-common-ligatures"> dyld`start + 2236</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb)<span> </span></span></div></div><div class="gmail_attr"><br></div><div class="gmail_attr"><br></div><div dir="ltr" class="gmail_attr">On Wed, Nov 29, 2023 at 7:22 AM Barry Smith <<a href="mailto:bsmith@petsc.dev" target="_blank">bsmith@petsc.dev</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><br id="m_-1051980424728766774m_3348039375066768974m_-4584621152542654680m_-1693869441833222533m_8830782000770525618lineBreakAtBeginningOfMessage"><div><br><blockquote type="cite"><div>On Nov 29, 2023, at 1:16 AM, Amneet Bhalla <<a href="mailto:mail2amneet@gmail.com" target="_blank">mail2amneet@gmail.com</a>> wrote:</div><br><div><div dir="ltr">BTW, I think you meant using MatSetOption(mat, <b>MAT_NO_OFF_PROC_ZERO_ROWS</b>, PETSC_TRUE)</div></div></blockquote><div><br></div>Yes</div><div><br><blockquote type="cite"><div><div dir="ltr"><span style="color:rgb(50,50,50);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI","Helvetica Neue",Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol";font-size:15px"> </span>instead ofMatSetOption(mat, <b>MAT_NO_OFF_PROC_ENTRIES</b>, PETSC_TRUE) ??</div></div></blockquote><div><br></div>  Please try setting both flags.</div><div><br><blockquote type="cite"><div><div dir="ltr"> However, that also did not help to overcome the MPI Barrier issue. </div></div></blockquote><div><br></div>  If there is still a problem please trap all the MPI processes when they hang in the debugger and send the output from using bt on all of them. This way</div><div>we can see the different places the different MPI processes are stuck at.</div><div><br></div><div><br><blockquote type="cite"><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Nov 28, 2023 at 9:57 PM Amneet Bhalla <<a href="mailto:mail2amneet@gmail.com" target="_blank">mail2amneet@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">I added that option but the code still gets stuck at the same call MatZeroRows with 3 processors. </div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Nov 28, 2023 at 7:23 PM Amneet Bhalla <<a href="mailto:mail2amneet@gmail.com" target="_blank">mail2amneet@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><br></div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Nov 28, 2023 at 6:42 PM Barry Smith <<a href="mailto:bsmith@petsc.dev" target="_blank">bsmith@petsc.dev</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div><br></div><div>  for (int comp = 0; comp < 2; ++comp)</div><div>                {</div><div>                .......</div><div>                    for (Box<NDIM>::Iterator bc(bc_coef_box); bc; bc++)</div><div>                    {</div><div>                       ......</div><div>                        if (IBTK::abs_equal_eps(b, 0.0))</div><div>                        {</div><div>                            const double diag_value = a;</div><div>                            ierr = MatZeroRows(mat, 1, &u_dof_index, diag_value, NULL, NULL);</div><div>                            IBTK_CHKERRQ(ierr);</div><div>                        }</div><div>                    }</div><div>                }</div><div><br></div><div>In general, this code will not work because each process calls MatZeroRows a different number of times, so it cannot match up with all the processes.</div><div><br></div><div>If u_dof_index is always local to the current process, you can call MatSetOption(mat, MAT_NO_OFF_PROC_ENTRIES,PETSC_TRUE) above the for loop and </div><div>the MatZeroRows will not synchronize across the MPI processes (since it does not need to and you told it that).</div></div></blockquote><div dir="auto"><br></div><div dir="auto">Yes, u_dof_index is going to be local and I put a check on it a few lines before calling MatZeroRows.</div><div dir="auto"><br></div><div dir="auto">Can MatSetOption() be called after the matrix has been assembled?</div><div dir="auto"><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div dir="auto"></div><div><br></div><div>If the u_dof_index will not always be local, then you need, on each process, to list all the u_dof_index for each process in an array and then call MatZeroRows()</div><div>once after the loop so it can exchange the needed information with the other MPI processes to get the row indices to the right place.</div></div><div><div><br></div><div>Barry</div><div><br></div><div><br></div><div><br></div><div><br><blockquote type="cite"><div>On Nov 28, 2023, at 6:44 PM, Amneet Bhalla <<a href="mailto:mail2amneet@gmail.com" target="_blank">mail2amneet@gmail.com</a>> wrote:</div><br><div><div dir="ltr"><div><br></div><div>Hi Folks, </div><div><br></div><div>I am using MatZeroRows() to set Dirichlet boundary conditions. This works fine for the serial run and the solver produces correct results (verified through analytical solution). However, when I run the case in parallel, the simulation gets stuck at MatZeroRows(). My understanding is that this function needs to be called after the MatAssemblyBegin{End}() has been called, and should be called by all processors. Here is that bit of the code which calls MatZeroRows() after the matrix has been assembled</div><br clear="all"><div><a href="https://github.com/IBAMR/IBAMR/blob/amneetb/acoustically-driven-flows/src/acoustic_streaming/AcousticStreamingPETScMatUtilities.cpp#L724-L801" target="_blank">https://github.com/IBAMR/IBAMR/blob/amneetb/acoustically-driven-flows/src/acoustic_streaming/AcousticStreamingPETScMatUtilities.cpp#L724-L801</a><br></div><span class="gmail_signature_prefix"><div><span class="gmail_signature_prefix"><br></span></div><div><span class="gmail_signature_prefix">I ran the parallel code (on 3 processors) in the debugger (-start_in_debugger). Below is the call stack from the processor that gets stuck</span></div><div><span class="gmail_signature_prefix"><br></span></div><div><span class="gmail_signature_prefix"><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">amneetb</span><span style="font-variant-ligatures:no-common-ligatures">@</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">APSB-MBP-16:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">~</span><span style="font-variant-ligatures:no-common-ligatures">$ lldb<span>  </span>-p 4307<span> </span></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) process attach --pid 4307</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 4307 stopped</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000018a2d750c</span><span style="font-variant-ligatures:no-common-ligatures"> libsystem_kernel.dylib`__semwait_signal + 8</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">libsystem_kernel.dylib`:</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">-><span> </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d750c <+8>:<span>  </span>b.lo <span>  </span>0x18a2d752c <span>              </span>; <+40></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7510 <+12>: pacibsp<span> </span></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7514 <+16>: stp<span>    </span>x29, x30, [sp, #-0x10]!</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x18a2d7518 <+20>: mov<span>    </span>x29, sp</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Target 0: (fo_acoustic_streaming_solver_2d) stopped.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Executable module set to "/Users/amneetb/Softwares/IBAMR-Git/objs-dbg/tests/IBTK/fo_acoustic_streaming_solver_2d".</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Architecture set to: arm64-apple-macosx-.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">cont</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 4307 resuming</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Process 4307 stopped</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000109d281b8</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_POSIX_mpi_barrier_release_gather + 400</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">libpmpi.12.dylib`MPIDI_POSIX_mpi_barrier_release_gather:</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">-><span> </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x109d281b8 <+400>: ldr<span>    </span>w9, [x24]</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x109d281bc <+404>: cmp<span>    </span>w8, w9</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x109d281c0 <+408>: <a href="http://b.lt/" target="_blank">b.lt</a> <span>  </span>0x109d281a0 <span>              </span>; <+376></span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)"><span>   </span></span><span style="font-variant-ligatures:no-common-ligatures"> 0x109d281c4 <+412>: bl <span>    </span>0x109d28e64 <span>              </span>; MPID_Progress_test</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">Target 0: (fo_acoustic_streaming_solver_2d) stopped.</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgba(97,97,97,0.91);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">(lldb) </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(242,242,242)">bt</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures">* thread #1, queue = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(47,180,29)">'com.apple.main-thread'</span><span style="font-variant-ligatures:no-common-ligatures">, stop reason = </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(180,36,25)">signal SIGSTOP</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>  </span>* frame #0: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000109d281b8</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_POSIX_mpi_barrier_release_gather + 400</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #1: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000109d27d14</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_SHM_mpi_barrier + 224</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #2: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000109d27b60</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIDI_Barrier_intra_composition_alpha + 44</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #3: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000109d0d490</span><span style="font-variant-ligatures:no-common-ligatures"> libpmpi.12.dylib`MPIR_Barrier + 900</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #4: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010224d030</span><span style="font-variant-ligatures:no-common-ligatures"> libmpi.12.dylib`MPI_Barrier + 684</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #5: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x00000001045ea638</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`PetscCommDuplicate(comm_in=-2080374782, comm_out=0x000000010300bcb0, first_tag=0x000000010300bce4) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">tagm.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">235</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">5</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #6: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x00000001045f2910</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`PetscHeaderCreate_Private(h=0x000000010300bc70, classid=1211227, class_name="PetscSF", descr="Star Forest", mansec="PetscSF", comm=-2080374782, destroy=(libpetsc.3.17.dylib`PetscSFDestroy at sf.c:224), view=(libpetsc.3.17.dylib`PetscSFView at sf.c:841)) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">inherit.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">62</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">3</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #7: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x00000001049cf820</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`PetscSFCreate(comm=-2080374782, sf=0x000000016f911a50) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">sf.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">62</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">3</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #8: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x0000000104cd3024</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`MatZeroRowsMapLocal_Private(A=0x00000001170c1270, N=1, rows=0x000000016f912cb4, nr=0x000000016f911df8, olrows=0x000000016f911e00) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">zerorows.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">36</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">5</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"><span style="font-variant-ligatures:no-common-ligatures"><span>    </span>frame #9: </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">0x000000010504ea50</span><span style="font-variant-ligatures:no-common-ligatures"> libpetsc.3.17.dylib`MatZeroRows_MPIAIJ(A=0x00000001170c1270, N=1, rows=0x000000016f912cb4, diag=1, x=0x0000000000000000, b=0x0000000000000000) at </span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(46,174,187)">mpiaij.c</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">768</span><span style="font-variant-ligatures:no-common-ligatures">:</span><span style="font-variant-ligatures:no-common-ligatures;color:rgb(159,160,28)">3</span></div><div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-variant-alternates:normal;font-kerning:auto;font-feature-settings:normal;font-stretch:normal;font-size:18px;line-height:normal;font-family:Monaco;color:rgb(242,242,242);background-color:rgba(0,0,0,0.85)"></div></span></div></span></div></div></blockquote></div></div></blockquote></div></div></blockquote></div></blockquote></div></div></blockquote></div></div></blockquote></div></div></blockquote></div></div></blockquote></div></div>
</blockquote></div><br clear="all"><div><br></div><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>-- Norbert Wiener</div><div><br></div><div><a href="http://www.cse.buffalo.edu/~knepley/" target="_blank">https://www.cse.buffalo.edu/~knepley/</a><br></div></div></div></div></div></div></div></div>
</div></blockquote></div><br></div></blockquote></div><br clear="all"><div><br></div><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div>--Amneet <br><br></div><div><br></div><div><br></div></div></div>