<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Mine works in serial but not in parallel.<div><br></div><div>It looks like vecs are created in MatLoad via MatMPIAIJSetPreallocation_MPIAIJ and they are not split wrt blocks. here is the stack trace again:</div><div><br></div><div><div>[0]PETSC ERROR: PetscSplitOwnership() line 93 in /Users/markadams/Codes/petsc-dev/src/sys/utils/psplit.c</div><div>[0]PETSC ERROR: PetscLayoutSetUp() line 147 in /Users/markadams/Codes/petsc-dev/src/vec/vec/impls/mpi/pmap.c</div><div>[0]PETSC ERROR: MatMPIAIJSetPreallocation_MPIAIJ() line 3194 in /Users/markadams/Codes/petsc-dev/src/mat/impls/aij/mpi/mpiaij.c</div><div>[0]PETSC ERROR: MatMPIAIJSetPreallocation() line 3928 in /Users/markadams/Codes/petsc-dev/src/mat/impls/aij/mpi/mpiaij.c</div><div>[0]PETSC ERROR: MatLoad_MPIAIJ() line 3442 in /Users/markadams/Codes/petsc-dev/src/mat/impls/aij/mpi/mpiaij.c</div><div>[0]PETSC ERROR: MatLoad() line 881 in /Users/markadams/Codes/petsc-dev/src/mat/interface/matrix.c</div><div>[0]PETSC ERROR: main() line 109 in src/ksp/ksp/examples/tutorials/ex10.c</div></div><div><br></div><div><br></div><div><br><div><div>On Jun 12, 2012, at 5:43 PM, Jed Brown wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div class="gmail_quote">On Tue, Jun 12, 2012 at 4:45 PM, Mark F. Adams <span dir="ltr"><<a href="mailto:mark.adams@columbia.edu" target="_blank">mark.adams@columbia.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>Satish beat me to it. I still get the same error ... did you use -mat_block_size 3?</div><div><br></div><div>I will look in to further.</div></blockquote></div><br><div><div>~/petsc/src/ksp/ksp/examples/tutorials$ ./ex10 -f0 binaryoutput-sym -ksp_monitor -pc_type gamg -mat_block_size 3</div>
<div>[0]PCSetData_AGG bs=3 MM=89373</div><div> 0 KSP Residual norm 4.854898290598e-03 </div><div> 1 KSP Residual norm 1.748948970672e-03 </div><div> 2 KSP Residual norm 1.098105829371e-03 </div><div> 3 KSP Residual norm 7.267836867590e-04 </div>
<div> 4 KSP Residual norm 4.752091560022e-04 </div><div> 5 KSP Residual norm 3.152074302240e-04 </div><div> 6 KSP Residual norm 1.998139269819e-04 </div><div> 7 KSP Residual norm 1.142295077940e-04 </div><div> 8 KSP Residual norm 6.107885553654e-05 </div>
<div> 9 KSP Residual norm 2.903395117932e-05 </div><div> 10 KSP Residual norm 1.748667302607e-05 </div><div> 11 KSP Residual norm 9.864255584167e-06 </div><div> 12 KSP Residual norm 5.077178570024e-06 </div><div> 13 KSP Residual norm 2.996102603244e-06 </div>
<div> 14 KSP Residual norm 2.293954251541e-06 </div><div> 15 KSP Residual norm 1.977076000505e-06 </div><div> 16 KSP Residual norm 1.729762967197e-06 </div><div> 17 KSP Residual norm 1.422352992308e-06 </div><div> 18 KSP Residual norm 1.063366577331e-06 </div>
<div> 19 KSP Residual norm 7.479518697501e-07 </div><div> 20 KSP Residual norm 4.861597752713e-07 </div><div> 21 KSP Residual norm 2.996075502312e-07 </div><div> 22 KSP Residual norm 1.962056634115e-07 </div><div> 23 KSP Residual norm 1.216036063867e-07 </div>
<div> 24 KSP Residual norm 8.556036439634e-08 </div><div> 25 KSP Residual norm 5.911194128322e-08 </div><div> 26 KSP Residual norm 3.784597093891e-08 </div><div>Number of iterations = 26</div><div>Residual norm 7.51457e-10</div>
</div>
</blockquote></div><br></div></body></html>