On Thu, Mar 12, 2009 at 1:50 PM, David Fuentes <span dir="ltr"><<a href="mailto:fuentesdt@gmail.com">fuentesdt@gmail.com</a>></span> wrote:<br><div class="gmail_quote"><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Thanks Matt,<br>
<br>
Is MatCreateMPIDense the recommended matrix type to interface w/ mumps ?<br>
Does it use a sparse direct storage or allocate the full n x n matrix?<font color="#888888"></font></blockquote><div><br>No, MUMPS is "sparse direct" so it uses MPIAIJ.<br> <br> Matt<br> </div><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<font color="#888888"><br>
df</font><div><div></div><div class="h5"><br>
On Thu, 12 Mar 2009, Matthew Knepley wrote:<br>
<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
You can try using a sparse direct solver like MUMPS instead of PETSc LU.<br>
<br>
Matt<br>
<br>
On Thu, Mar 12, 2009 at 9:17 AM, David Fuentes <<a href="mailto:fuentesdt@gmail.com" target="_blank">fuentesdt@gmail.com</a>> wrote:<br>
<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Thanks Hong,<br>
<br>
The complete error message is attached. I think I just had too big<br>
of a matrix. The matrix i'm trying to factor is 327680 x 327680<br>
<br>
<br>
[0]PETSC ERROR: --------------------- Error Message<br>
------------------------------------<br>
[0]PETSC ERROR: Out of memory. This could be due to allocating<br>
[0]PETSC ERROR: too large an object or bleeding by not properly<br>
[0]PETSC ERROR: destroying unneeded objects.<br>
[0]PETSC ERROR: Memory allocated 2047323584 Memory used by process<br>
2074058752<br>
[0]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.<br>
[0]PETSC ERROR: Memory requested 1258466480!<br>
[0]PETSC ERROR:<br>
------------------------------------------------------------------------<br>
[0]PETSC ERROR: Petsc Release Version 3.0.0, Patch 2, Wed Jan 14 22:57:05<br>
CST 2009<br>
[0]PETSC ERROR: See docs/changes/index.html for recent updates.<br>
[0]PETSC ERROR: See docs/faq.html for hints about trouble shooting.<br>
[0]PETSC ERROR: See docs/index.html for manual pages.<br>
[0]PETSC ERROR:<br>
------------------------------------------------------------------------<br>
[0]PETSC ERROR: ./RealTimeImaging on a gcc-4.1.2 named DIPWS019 by dfuentes<br>
Wed Mar 11 20:30:37 2009<br>
[0]PETSC ERROR: Libraries linked from<br>
/usr/local/petsc/petsc-3.0.0-p2/gcc-4.1.2-mpich2-1.0.7-dbg/lib<br>
[0]PETSC ERROR: Configure run at Sat Jan 31 06:53:09 2009<br>
[0]PETSC ERROR: Configure options --download-f-blas-lapack=ifneeded<br>
--with-mpi-dir=/usr/local --with-matlab=1 --with-matlab-engine=1<br>
--with-matlab-dir=/usr/local/matlab2007a --CFLAGS=-fPIC --with-shared=0<br>
[0]PETSC ERROR:<br>
------------------------------------------------------------------------<br>
[0]PETSC ERROR: PetscMallocAlign() line 61 in src/sys/memory/mal.c<br>
[0]PETSC ERROR: PetscTrMallocDefault() line 194 in src/sys/memory/mtr.c<br>
[0]PETSC ERROR: PetscFreeSpaceGet() line 14 in src/mat/utils/freespace.c<br>
[0]PETSC ERROR: MatLUFactorSymbolic_SeqAIJ() line 381 in<br>
src/mat/impls/aij/seq/aijfact.c<br>
[0]PETSC ERROR: MatLUFactorSymbolic() line 2289 in<br>
src/mat/interface/matrix.c<br>
[0]PETSC ERROR: KalmanFilter::DirectStateUpdate() line 456 in<br>
unknowndirectory/src/KalmanFilter.cxx<br>
[0]PETSC ERROR: GeneratePRFTmap() line 182 in<br>
unknowndirectory/src/MainDriver.cxx<br>
[0]PETSC ERROR: main() line 90 in unknowndirectory/src/MainDriver.cxx<br>
application called MPI_Abort(MPI_COMM_WORLD, 55) - process 0[unset]:<br>
aborting job:<br>
application called MPI_Abort(MPI_COMM_WORLD, 55) - process 0<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
On Thu, 12 Mar 2009, Hong Zhang wrote:<br>
<br>
<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
David,<br>
<br>
I do not see any problem with the calling sequence.<br>
<br>
The memory is determined in MatLUFactorSymbolic().<br>
Does your code crashes within MatLUFactorSymbolic()?<br>
Please send us complete error message.<br>
<br>
Hong<br>
<br>
On Wed, 11 Mar 2009, David Fuentes wrote:<br>
<br>
<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Hello,<br>
<br>
I have a sparse matrix, A, with which I want to solve multiple right hand<br>
sides<br>
with a direct solver. Is this the correct call sequence ?<br>
<br>
<br>
MatGetFactor(A,MAT_SOLVER_PETSC,MAT_FACTOR_LU,&Afact);<br>
IS isrow,iscol;<br>
MatGetOrdering(A,MATORDERING_ND,&isrow,&iscol);<br>
MatLUFactorSymbolic(Afact,A,isrow,iscol,&info);<br>
MatLUFactorNumeric(Afact,A,&info);<br>
MatMatSolve(Afact,B,X);<br>
<br>
<br>
my solve keeps running out of memory<br>
<br>
"[0]PETSC ERROR: Memory requested xxx!"<br>
<br>
<br>
is this in bytes? I can't tell if the problem I'm trying to solve<br>
is too large form my machine or if I just have bug in the call sequence.<br>
<br>
<br>
<br>
<br>
thank you,<br>
David Fuentes<br>
<br>
<br>
</blockquote>
<br>
</blockquote></blockquote>
<br>
<br>
--<br>
What most experimenters take for granted before they begin their experiments<br>
is infinitely more interesting than any results to which their experiments<br>
lead.<br>
-- Norbert Wiener<br>
<br>
</blockquote>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>
-- Norbert Wiener<br>