I already used Valgrind to check for memory and as far I can tell the program was working fine. At this stage my concern is mainly about the convergence of ksp solver. I can later try compiling with petsc-dev.<br><br>Thank you for your time,<br>
Ata<br><br><div class="gmail_quote">On Tue, Feb 1, 2011 at 3:34 PM, Barry Smith <span dir="ltr"><<a href="mailto:bsmith@mcs.anl.gov">bsmith@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<br>
Suggest running with valgrind <a href="http://www.mcs.anl.gov/petsc/petsc-as/documentation/faq.html#valgrind" target="_blank">http://www.mcs.anl.gov/petsc/petsc-as/documentation/faq.html#valgrind</a> to see if there is some memory corruption. If that doesn't help suggest a build with MPICH to see if the same or a different problem happens.<br>
<br>
Getting a partial error message like this is not normal and rarely seen.<br>
<font color="#888888"><br>
Barry<br>
</font><div><div></div><div class="h5"><br>
On Feb 1, 2011, at 3:32 PM, Matthew Knepley wrote:<br>
<br>
> On Tue, Feb 1, 2011 at 3:27 PM, Ataollah Mesgarnejad <<a href="mailto:amesga1@tigers.lsu.edu">amesga1@tigers.lsu.edu</a>> wrote:<br>
> I compile it with openmpi and it runs on 5 cores. And thats all the error message from PETSC. the compelete output looks like this:<br>
><br>
> Something is wrong with your output gathering. It would indicate the error, or a signal received.<br>
><br>
> Matt<br>
><br>
> [3]PETSC ERROR: MatHYPRE_IJMatrixCreate() line 76 in src/dm/da/utils/mhyp.c<br>
> [3]PETSC ERROR: PCSetUp_HYPRE() line 112 in src/ksp/pc/impls/hypre/hypre.c<br>
> [3]PETSC ERROR: PCSetUp() line 795 in src/ksp/pc/interface/precon.c<br>
> [3]PETSC ERROR: KSPSetUp() line 237 in src/ksp/ksp/interface/itfunc.c<br>
> [3]PETSC ERROR: KSPSolve() line 353 in src/ksp/ksp/interface/itfunc.c<br>
> [3]PETSC ERROR: UStep() line 511 in PFMAT-FD.cpp<br>
> [4]PETSC ERROR: MatHYPRE_IJMatrixCreate() line 76 in src/dm/da/utils/mhyp.c<br>
> [4]PETSC ERROR: PCSetUp_HYPRE() line 112 in src/ksp/pc/impls/hypre/hypre.c<br>
> [4]PETSC ERROR: PCSetUp() line 795 in src/ksp/pc/interface/precon.c<br>
> [4]PETSC ERROR: KSPSetUp() line 237 in src/ksp/ksp/interface/itfunc.c<br>
> [3]PETSC ERROR: main() line 95 in PFMAT-main.cpp<br>
> [4]PETSC ERROR: KSPSolve() line 353 in src/ksp/ksp/interface/itfunc.c<br>
> [4]PETSC ERROR: UStep() line 511 in PFMAT-FD.cpp<br>
> [4]PETSC ERROR: main() line 95 in PFMAT-main.cpp<br>
> --------------------------------------------------------------------------<br>
> MPI_ABORT was invoked on rank 3 in communicator MPI_COMM_WORLD<br>
> with errorcode 1.<br>
><br>
> NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.<br>
> You may or may not see output from other processes, depending on<br>
> exactly when Open MPI kills them.<br>
> --------------------------------------------------------------------------<br>
> --------------------------------------------------------------------------<br>
> mpirun has exited due to process rank 3 with PID 3845 on<br>
> node <a href="http://me-1203svr3.lsu.edu" target="_blank">me-1203svr3.lsu.edu</a> exiting without calling "finalize". This may<br>
> have caused other processes in the application to be<br>
> terminated by signals sent by mpirun (as reported here).<br>
><br>
> Best,<br>
> Ata<br>
><br>
> On Tue, Feb 1, 2011 at 2:35 PM, Barry Smith <<a href="mailto:bsmith@mcs.anl.gov">bsmith@mcs.anl.gov</a>> wrote:<br>
><br>
> Right preconditioner shouldn't matter to the preconditioner at all. What is the complete error message. Does it run on one process?<br>
><br>
> Barry<br>
><br>
> On Feb 1, 2011, at 2:32 PM, Ataollah Mesgarnejad wrote:<br>
><br>
> > Barry,<br>
> ><br>
> > I did as you said and now I receive these errors once I try to run the program:<br>
> ><br>
> > [3]PETSC ERROR: MatHYPRE_IJMatrixCreate() line 76 in src/dm/da/utils/mhyp.c<br>
> > [3]PETSC ERROR: PCSetUp_HYPRE() line 112 in src/ksp/pc/impls/hypre/hypre.c<br>
> > [3]PETSC ERROR: PCSetUp() line 795 in src/ksp/pc/interface/precon.c<br>
> > [3]PETSC ERROR: KSPSetUp() line 237 in src/ksp/ksp/interface/itfunc.c<br>
> > [3]PETSC ERROR: KSPSolve() line 353 in src/ksp/ksp/interface/itfunc.c<br>
> > [3]PETSC ERROR: UStep() line 511 in PFMAT-FD.cpp<br>
> > [4]PETSC ERROR: MatHYPRE_IJMatrixCreate() line 76 in src/dm/da/utils/mhyp.c<br>
> > [4]PETSC ERROR: PCSetUp_HYPRE() line 112 in src/ksp/pc/impls/hypre/hypre.c<br>
> > [4]PETSC ERROR: PCSetUp() line 795 in src/ksp/pc/interface/precon.c<br>
> > [4]PETSC ERROR: KSPSetUp() line 237 in src/ksp/ksp/interface/itfunc.c<br>
> > [3]PETSC ERROR: main() line 95 in PFMAT-main.cpp<br>
> > [4]PETSC ERROR: KSPSolve() line 353 in src/ksp/ksp/interface/itfunc.c<br>
> > [4]PETSC ERROR: UStep() line 511 in PFMAT-FD.cpp<br>
> > [4]PETSC ERROR: main() line 95 in PFMAT-main.cpp<br>
> ><br>
> > Does right preconditiong work with HYPRE?<br>
> > Best,<br>
> > Ata<br>
> ><br>
> > On Tue, Feb 1, 2011 at 2:21 PM, Barry Smith <<a href="mailto:bsmith@mcs.anl.gov">bsmith@mcs.anl.gov</a>> wrote:<br>
> ><br>
> > The simplest thing is to simply run with -ksp_monitor_true_residual and see how the convergence is going in the true residual norm also.<br>
> ><br>
> > You can also switch to right preconditioning with gmres and then the residual used by gmres is the true residual norm. Use -ksp_preconditioner_side right -ksp_norm_type unpreconditioned<br>
> ><br>
> > Barry<br>
> ><br>
> ><br>
> ><br>
> > On Feb 1, 2011, at 2:14 PM, Ataollah Mesgarnejad wrote:<br>
> ><br>
> > > Dear all,<br>
> > ><br>
> > > I'm using Ksp gmres with boomeramg preconditioning and I suspect that even though it converges in preconditioned norm it doesn't converge in true norm, but as I understand KSPSetNormType gmres does not support true residual norm? Is that correct and If it is, is there any other way to monitor the true norm? Do I need to Introduce my own convergence test?<br>
> > ><br>
> > > Best,<br>
> > > A. Mesgarnejad<br>
> ><br>
> ><br>
> ><br>
> ><br>
> > --<br>
> > A. Mesgarnejad<br>
> > PhD Student, Research Assistant<br>
> > Mechanical Engineering Department<br>
> > Louisiana State University<br>
> > 2203 Patrick F. Taylor Hall<br>
> > Baton Rouge, La 70803<br>
><br>
><br>
><br>
><br>
> --<br>
> A. Mesgarnejad<br>
> PhD Student, Research Assistant<br>
> Mechanical Engineering Department<br>
> Louisiana State University<br>
> 2203 Patrick F. Taylor Hall<br>
> Baton Rouge, La 70803<br>
><br>
><br>
><br>
> --<br>
> What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>
> -- Norbert Wiener<br>
<br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>A. Mesgarnejad<br>PhD Student, Research Assistant<br>Mechanical Engineering Department<br>Louisiana State University<br>2203 Patrick F. Taylor Hall<br>Baton Rouge, La 70803<br>