On Thu, Oct 25, 2012 at 9:43 AM, John Mousel <span dir="ltr"><<a href="mailto:john.mousel@gmail.com" target="_blank">john.mousel@gmail.com</a>></span> wrote:<br><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Jed,<br><br>That had occurred to me too. Unfortunately, my sys admins insist on using OpenMPI due to some issues they have with getting SGE to properly clean up processes with MVAPICH and MPICH2. Long story. Is there an option to get back to the previous default behavior? I couldn't find the documentation for -mat_bypass_jeds_more_efficient_algorithm_because_sysadmins_make_me.</blockquote>
<div><br></div><div>Pull</div><div><br></div><div><a href="https://bitbucket.org/petsc/petsc-dev/changeset/43e28ef1a420">https://bitbucket.org/petsc/petsc-dev/changeset/43e28ef1a420</a></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<span class="HOEnZb"><font color="#888888"><br>
<br>John</font></span><div class="HOEnZb"><div class="h5"><br><br><div class="gmail_quote">On Thu, Oct 25, 2012 at 9:33 AM, Jed Brown <span dir="ltr"><<a href="mailto:jedbrown@mcs.anl.gov" target="_blank">jedbrown@mcs.anl.gov</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
It's an Open MPI bug. I'll write the work-around, but have deadlines first.<br><br><a href="https://bitbucket.org/petsc/petsc-dev/issue/9/implement-petscsf-without-one-sided" target="_blank">https://bitbucket.org/petsc/petsc-dev/issue/9/implement-petscsf-without-one-sided</a><div>
<div><br>
<br><div class="gmail_quote">On Thu, Oct 25, 2012 at 9:23 AM, Mark F. Adams <span dir="ltr"><<a href="mailto:mark.adams@columbia.edu" target="_blank">mark.adams@columbia.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">The problem is detected in MatTranspose and Jed was messing with this a few weeks ago ...<div><div><div><br></div><div><br><div><div>On Oct 25, 2012, at 6:48 AM, John Mousel <<a href="mailto:john.mousel@gmail.com" target="_blank">john.mousel@gmail.com</a>> wrote:</div>
<br><blockquote type="cite">Mark,<br><br>Yes, this worked before pulling. I hadn't pulled on that machine in a few weeks though.<br><br>John<br><br><div class="gmail_quote">On Thu, Oct 25, 2012 at 1:18 AM, Mark F. Adams <span dir="ltr"><<a href="mailto:mark.adams@columbia.edu" target="_blank">mark.adams@columbia.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Did this work before the pull?<br>
<span><font color="#888888"><br>
Mark<br>
</font></span><div><div><br>
On Oct 24, 2012, at 8:04 PM, John Mousel <<a href="mailto:john.mousel@gmail.com" target="_blank">john.mousel@gmail.com</a>> wrote:<br>
<br>
> I just pulled and I'm getting the error below when running with GAMG.<br>
><br>
> [20]PETSC ERROR: --------------------- Error Message ------------------------------------<br>
> [20]PETSC ERROR: Corrupted Petsc object!<br>
> [20]PETSC ERROR: corrupted ta->count!<br>
> [20]PETSC ERROR: ------------------------------------------------------------------------<br>
> [20]PETSC ERROR: Petsc Development HG revision: 2b3cccd7bd8ff536f48616e4402b164ba9cd12d0 HG Date: Wed Oct 24 21:15:30 2012 -0500<br>
> [20]PETSC ERROR: See docs/changes/index.html for recent updates.<br>
> [73]PETSC ERROR: [20]PETSC ERROR: --------------------- Error Message ------------------------------------<br>
> See docs/faq.html for hints about trouble shooting.<br>
> [73]PETSC ERROR: [20]PETSC ERROR: See docs/index.html for manual pages.<br>
> Corrupted Petsc object!<br>
> [20]PETSC ERROR: [73]PETSC ERROR: ------------------------------------------------------------------------<br>
> corrupted ta->count!<br>
> [253]PETSC ERROR: --------------------- Error Message ------------------------------------<br>
> [253]PETSC ERROR: Corrupted Petsc object!<br>
> [253]PETSC ERROR: corrupted ta->count!<br>
> [253]PETSC ERROR: ------------------------------------------------------------------------<br>
> [253]PETSC ERROR: Petsc Development HG revision: 2b3cccd7bd8ff536f48616e4402b164ba9cd12d0 HG Date: Wed Oct 24 21:15:30 2012 -0500<br>
> [253]PETSC ERROR: See docs/changes/index.html for recent updates.<br>
> [253]PETSC ERROR: See docs/faq.html for hints about trouble shooting.<br>
> [253]PETSC ERROR: See docs/index.html for manual pages.<br>
> [253]PETSC ERROR: ------------------------------------------------------------------------<br>
> [253]PETSC ERROR: /nfsscratch/Users/jmousel/MHV/MHV_exe on a intel-opt named compute-6-165.local by jmousel Wed Oct 24 21:59:50 2012<br>
> [253]PETSC ERROR: Libraries linked from /Users/jmousel/SOFT/petsc-dev/intel-opt/lib<br>
> [253]PETSC ERROR: Configure run at Wed Oct 24 21:41:09 2012<br>
> [253]PETSC ERROR: Configure options --download-blacs=1 --download-cmake=1 --download-hypre=1 --download-metis=1 --download-ml=1 --download-parmetis=1 --download-scalapack=1 --with-blas-lapack-dir=/opt/intel/mkl/<a href="http://10.2.5.035/lib/em64t" target="_blank">10.2.5.035/lib/em64t</a> --with-debugging=0 --with-mpi-dir=/opt/openmpi/1.4.3/intel COPTFLAGS=-O2 FOPTFLAGS=-O2 PETSC_ARCH=intel-opt<br>
> [253]PETSC ERROR: ------------------------------------------------------------------------<br>
> [253]PETSC ERROR: PetscTableAddExpand() line 145 in src/sys/utils/ctable.c<br>
> [253]PETSC ERROR: PetscTableAdd() line 75 in src/sys/sf//Users/jmousel/SOFT/petsc-dev/include/petscctable.h<br>
> [253]PETSC ERROR: PetscSFSetGraph() line 327 in src/sys/sf/sf.c<br>
> [253]PETSC ERROR: PetscSFSetGraphLayout() line 595 in src/vec/vec/impls/mpi/pmap.c<br>
> [253]PETSC ERROR: MatTranspose_MPIAIJ() line 2130 in src/mat/impls/aij/mpi/mpiaij.c<br>
> [253]PETSC ERROR: MatTranspose() line 4350 in src/mat/interface/matrix.c<br>
> [253]PETSC ERROR: PCGAMGFilterGraph() line 136 in src/ksp/pc/impls/gamg/tools.c<br>
> [253]PETSC ERROR: PCGAMGgraph_AGG() line 979 in src/ksp/pc/impls/gamg/agg.c<br>
> [253]PETSC ERROR: PCSetUp_GAMG() line 685 in src/ksp/pc/impls/gamg/gamg.c<br>
> [253]PETSC ERROR: PCSetUp() line 832 in src/ksp/pc/interface/precon.c<br>
> [253]PETSC ERROR: KSPSetUp() line 278 in src/ksp/ksp/interface/itfunc.c<br>
> [253]PETSC ERROR: KSPSolve() line 402 in src/ksp/ksp/interface/itfunc.c<br>
> [73]PETSC ERROR: [20]PETSC ERROR: ------------------------------------------------------------------------<br>
> /nfsscratch/Users/jmousel/MHV/MHV_exe on a intel-opt named compute-1-16.local by jmousel Wed Oct 24 21:59:50 2012<br>
> [73]PETSC ERROR: [20]PETSC ERROR: Libraries linked from /Users/jmousel/SOFT/petsc-dev/intel-opt/lib<br>
> [35]PETSC ERROR: Petsc Development HG revision: 2b3cccd7bd8ff536f48616e4402b164ba9cd12d0 HG Date: Wed Oct 24 21:15:30 2012 -0500<br>
> [20]PETSC ERROR: [73]PETSC ERROR: See docs/changes/index.html for recent updates.<br>
> Configure run at Wed Oct 24 21:41:09 2012<br>
> --------------------- Error Message ------------------------------------<br>
> [73]PETSC ERROR: [20]PETSC ERROR: [35]PETSC ERROR: Configure options --download-blacs=1 --download-cmake=1 --download-hypre=1 --download-metis=1 --download-ml=1 --download-parmetis=1 --download-scalapack=1 --with-blas-lapack-dir=/opt/intel/mkl/<a href="http://10.2.5.035/lib/em64t" target="_blank">10.2.5.035/lib/em64t</a> --with-debugging=0 --with-mpi-dir=/opt/openmpi/1.4.3/intel COPTFLAGS=-O2 FOPTFLAGS=-O2 PETSC_ARCH=intel-opt<br>
> See docs/faq.html for hints about trouble shooting.<br>
<br>
</div></div></blockquote></div><br>
</blockquote></div><br></div></div></div></div></blockquote></div><br>
</div></div></blockquote></div><br>
</div></div></blockquote></div><br>