[petsc-users] Error - Out of memory. This could be due to allocating too large an object or bleeding by not properly ...
TAY wee-beng
zonexo at gmail.com
Thu Feb 25 00:33:30 CST 2016
Hi,
I ran the code and it hangs again. However, adding -malloc_test doesn't
seem to do any thing. The output (attached) is the same w/o it.
Wonder if there's anything else I can do.
Thank you
Yours sincerely,
TAY wee-beng
On 24/2/2016 11:33 PM, Matthew Knepley wrote:
> On Wed, Feb 24, 2016 at 9:28 AM, TAY wee-beng <zonexo at gmail.com
> <mailto:zonexo at gmail.com>> wrote:
>
>
> On 24/2/2016 11:18 PM, Matthew Knepley wrote:
>> On Wed, Feb 24, 2016 at 9:16 AM, TAY wee-beng <zonexo at gmail.com
>> <mailto:zonexo at gmail.com>> wrote:
>>
>>
>> On 24/2/2016 9:12 PM, Matthew Knepley wrote:
>>> On Wed, Feb 24, 2016 at 1:54 AM, TAY wee-beng
>>> <zonexo at gmail.com <mailto:zonexo at gmail.com>> wrote:
>>>
>>>
>>> On 24/2/2016 10:28 AM, Matthew Knepley wrote:
>>>> On Tue, Feb 23, 2016 at 7:50 PM, TAY wee-beng
>>>> <zonexo at gmail.com <mailto:zonexo at gmail.com>> wrote:
>>>>
>>>> Hi,
>>>>
>>>> I got this error (also attached, full) when running
>>>> my code. It happens after a few thousand time steps.
>>>>
>>>> The strange thing is that for 2 different clusters,
>>>> it stops at 2 different time steps.
>>>>
>>>> I wonder if it's related to DM since this happens
>>>> after I added DM into my code.
>>>>
>>>> In this case, how can I find out the error? I'm
>>>> thinking valgrind may take very long and gives too
>>>> many false errors.
>>>>
>>>>
>>>> It is very easy to find leaks. You just run a few steps
>>>> with -malloc_dump and see what is left over.
>>>>
>>>> Matt
>>> Hi Matt,
>>>
>>> Do you mean running my a.out with the -malloc_dump and
>>> stop after a few time steps?
>>>
>>> What and how should I "see" then?
>>>
>>>
>>> -malloc_dump outputs all unfreed memory to the screen after
>>> PetscFinalize(), so you should see the leak.
>>> I guess it might be possible to keep creating things that
>>> you freed all at once at the end, but that is less likely.
>>>
>>> Matt
>> Hi,
>>
>> I got the output. I have zipped it since it's rather big. So
>> it seems to be from DM routines but can you help me where the
>> error is from?
>>
>>
>> Its really hard to tell by looking at it. What I do is remove
>> things until there is no leak, then progressively
>> put thing back in until I have the culprit. Then you can think
>> about what is not destroyed.
>>
>> Matt
> Ok so let me get this clear. When it shows:
>
> [21]Total space allocated 1728961264 bytes
> [21]1861664 bytes MatCheckCompressedRow() line 60 in
> /home/wtay/Codes/petsc-3.6.3/src/mat/utils/compressedrow.c
> [21]16 bytes PetscStrallocpy() line 188 in
> /home/wtay/Codes/petsc-3.6.3/src/sys/utils/str.c
> [21]624 bytes ISLocalToGlobalMappingCreate() line 270 in
> /home/wtay/Codes
>
> ....
>
> Does it mean that it's simply allocating space ie normal? Or does
> it show that there's memory leak ie error?
>
>
> I gave the wrong option. That dumps everything. Lets just look at the
> leaks with -malloc_test.
>
> Sorry about that,
>
> Matt
>
> If it's error, should I zoom in and debug around this time at this
> region?
>
> Thanks
>>
>> Thanks.
>>>
>>>>
>>>> --
>>>> Thank you
>>>>
>>>> Yours sincerely,
>>>>
>>>> TAY wee-beng
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> What most experimenters take for granted before they
>>>> begin their experiments is infinitely more interesting
>>>> than any results to which their experiments lead.
>>>> -- Norbert Wiener
>>>
>>>
>>>
>>>
>>> --
>>> What most experimenters take for granted before they begin
>>> their experiments is infinitely more interesting than any
>>> results to which their experiments lead.
>>> -- Norbert Wiener
>>
>>
>>
>>
>> --
>> What most experimenters take for granted before they begin their
>> experiments is infinitely more interesting than any results to
>> which their experiments lead.
>> -- Norbert Wiener
>
>
>
>
> --
> What most experimenters take for granted before they begin their
> experiments is infinitely more interesting than any results to which
> their experiments lead.
> -- Norbert Wiener
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20160225/a702d446/attachment-0001.html>
-------------- next part --------------
****************************************************************************
* hwloc has encountered what looks like an error from the operating system.
*
* L3 (cpuset 0x000003f0) intersects with NUMANode (P#0 cpuset 0x0000003f) without inclusion!
* Error occurred in topology.c line 942
*
* The following FAQ entry in a recent hwloc documentation may help:
* What should I do when hwloc reports "operating system" warnings?
* Otherwise please report this error message to the hwloc user's mailing list,
* along with the output+tarball generated by the hwloc-gather-topology script.
****************************************************************************
****************************************************************************
* hwloc has encountered what looks like an error from the operating system.
*
* L3 (cpuset 0x000003f0) intersects with NUMANode (P#0 cpuset 0x0000003f) without inclusion!
* Error occurred in topology.c line 942
*
* The following FAQ entry in a recent hwloc documentation may help:
* What should I do when hwloc reports "operating system" warnings?
* Otherwise please report this error message to the hwloc user's mailing list,
* along with the output+tarball generated by the hwloc-gather-topology script.
****************************************************************************
[13]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[13]PETSC ERROR: Out of memory. This could be due to allocating
[13]PETSC ERROR: too large an object or bleeding by not properly
[13]PETSC ERROR: destroying unneeded objects.
[6]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[6]PETSC ERROR: Out of memory. This could be due to allocating
[6]PETSC ERROR: too large an object or bleeding by not properly
[6]PETSC ERROR: destroying unneeded objects.
[17]PETSC ERROR: [6]PETSC ERROR: Memory allocated 0 Memory used by process 3595563008
[6]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.
[6]PETSC ERROR: Memory requested 37814445
[6]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[6]PETSC ERROR: Petsc Release Version 3.6.3, Dec, 03, 2015
[6]PETSC ERROR: ./a.out on a petsc-3.6.3_static_rel named n12-09 by wtay Wed Feb 24 16:57:03 2016
[6]PETSC ERROR: Configure options --with-mpi-dir=/opt/ud/openmpi-1.8.8/ --with-blas-lapack-dir=/opt/ud/intel_xe_2013sp1/mkl/lib/intel64/ --with-debugging=0 --download-hypre=1 --prefix=/home/wtay/Lib/petsc-3.6.3_static_rel --known-mpi-shared=0 --with-shared-libraries=0 --with-fortran-interfaces=1
[6]PETSC ERROR: #1 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[6]PETSC ERROR: #2 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[6]PETSC ERROR: #3 MatLUFactorNumeric() line 2946 in /home/wtay/Codes/petsc-3.6.3/src/mat/interface/matrix.c
[6]PETSC ERROR: #4 PCSetUp_ILU() line 233 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/factor/ilu/ilu.c
[6]PETSC ERROR: #5 PCSetUp() line 983 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[6]PETSC ERROR: #6 KSPSetUp() line 332 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[6]PETSC ERROR: #7 KSPSolve() line 546 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[6]PETSC ERROR: #8 PCApply_BJacobi_Singleblock() line 670 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/bjacobi/bjacobi.c
[6]PETSC ERROR: #9 PCApply() line 483 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[6]PETSC ERROR: #10 KSP_PCApply() line 242 in /home/wtay/Codes/petsc-3.6.3/include/petsc/private/kspimpl.h
[6]PETSC ERROR: #11 KSPInitialResidual() line 63 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itres.c
[6]PETSC ERROR: #12 KSPSolve_BCGS() line 50 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/impls/bcgs/bcgs.c
[6]PETSC ERROR: #13 KSPSolve() line 604 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[13]PETSC ERROR: Memory allocated 0 Memory used by process 3522146304
[13]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.
[13]PETSC ERROR: Memory requested 36360045
[13]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[13]PETSC ERROR: Petsc Release Version 3.6.3, Dec, 03, 2015
[13]PETSC ERROR: ./a.out on a petsc-3.6.3_static_rel named n12-09 by wtay Wed Feb 24 16:57:03 2016
[13]PETSC ERROR: Configure options --with-mpi-dir=/opt/ud/openmpi-1.8.8/ --with-blas-lapack-dir=/opt/ud/intel_xe_2013sp1/mkl/lib/intel64/ --with-debugging=0 --download-hypre=1 --prefix=/home/wtay/Lib/petsc-3.6.3_static_rel --known-mpi-shared=0 --with-shared-libraries=0 --with-fortran-interfaces=1
[13]PETSC ERROR: #1 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[13]PETSC ERROR: #2 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[13]PETSC ERROR: #3 MatLUFactorNumeric() line 2946 in /home/wtay/Codes/petsc-3.6.3/src/mat/interface/matrix.c
[13]PETSC ERROR: #4 PCSetUp_ILU() line 233 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/factor/ilu/ilu.c
[13]PETSC ERROR: #5 PCSetUp() line 983 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[13]PETSC ERROR: #6 KSPSetUp() line 332 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[13]PETSC ERROR: #7 KSPSolve() line 546 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[13]PETSC ERROR: #8 PCApply_BJacobi_Singleblock() line 670 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/bjacobi/bjacobi.c
[13]PETSC ERROR: #9 PCApply() line 483 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[13]PETSC ERROR: #10 KSP_PCApply() line 242 in /home/wtay/Codes/petsc-3.6.3/include/petsc/private/kspimpl.h
[13]PETSC ERROR: #11 KSPInitialResidual() line 63 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itres.c
[13]PETSC ERROR: #12 KSPSolve_BCGS() line 50 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/impls/bcgs/bcgs.c
[13]PETSC ERROR: #13 KSPSolve() line 604 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
--------------------- Error Message --------------------------------------------------------------
[33]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[33]PETSC ERROR: Out of memory. This could be due to allocating
[33]PETSC ERROR: too large an object or bleeding by not properly
[33]PETSC ERROR: destroying unneeded objects.
[33]PETSC ERROR: Memory allocated 0 Memory used by process 3518820352
[33]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.
[33]PETSC ERROR: Memory requested 36360045
[33]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[33]PETSC ERROR: Petsc Release Version 3.6.3, Dec, 03, 2015
[33]PETSC ERROR: ./a.out on a petsc-3.6.3_static_rel named n12-09 by wtay Wed Feb 24 16:57:03 2016
[33]PETSC ERROR: Configure options --with-mpi-dir=/opt/ud/openmpi-1.8.8/ --with-blas-lapack-dir=/opt/ud/intel_xe_2013sp1/mkl/lib/intel64/ --with-debugging=0 --download-hypre=1 --prefix=/home/wtay/Lib/petsc-3.6.3_static_rel --known-mpi-shared=0 --with-shared-libraries=0 --with-fortran-interfaces=1
[33]PETSC ERROR: #1 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[33]PETSC ERROR: #2 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[33]PETSC ERROR: #3 MatLUFactorNumeric() line 2946 in /home/wtay/Codes/petsc-3.6.3/src/mat/interface/matrix.c
[33]PETSC ERROR: #4 PCSetUp_ILU() line 233 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/factor/ilu/ilu.c
[33]PETSC ERROR: #5 PCSetUp() line 983 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[33]PETSC ERROR: #6 KSPSetUp() line 332 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[33]PETSC ERROR: #7 KSPSolve() line 546 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[33]PETSC ERROR: #8 PCApply_BJacobi_Singleblock() line 670 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/bjacobi/bjacobi.c
[33]PETSC ERROR: #9 PCApply() line 483 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[33]PETSC ERROR: #10 KSP_PCApply() line 242 in /home/wtay/Codes/petsc-3.6.3/include/petsc/private/kspimpl.h
[33]PETSC ERROR: #11 KSPInitialResidual() line 63 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itres.c
[33]PETSC ERROR: #12 KSPSolve_BCGS() line 50 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/impls/bcgs/bcgs.c
[33]PETSC ERROR: #13 KSPSolve() line 604 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[17]PETSC ERROR: Out of memory. This could be due to allocating
[9]PETSC ERROR: [17]PETSC ERROR: too large an object or bleeding by not properly
[17]PETSC ERROR: destroying unneeded objects.
[21]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[21]PETSC ERROR: Out of memory. This could be due to allocating
[21]PETSC ERROR: too large an object or bleeding by not properly
[21]PETSC ERROR: destroying unneeded objects.
[17]PETSC ERROR: Memory allocated 0 Memory used by process 3505258496
[17]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.
[17]PETSC ERROR: Memory requested 36360045
[17]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[17]PETSC ERROR: Petsc Release Version 3.6.3, Dec, 03, 2015
[17]PETSC ERROR: ./a.out on a petsc-3.6.3_static_rel named n12-09 by wtay Wed Feb 24 16:57:03 2016
[17]PETSC ERROR: Configure options --with-mpi-dir=/opt/ud/openmpi-1.8.8/ --with-blas-lapack-dir=/opt/ud/intel_xe_2013sp1/mkl/lib/intel64/ --with-debugging=0 --download-hypre=1 --prefix=/home/wtay/Lib/petsc-3.6.3_static_rel --known-mpi-shared=0 --with-shared-libraries=0 --with-fortran-interfaces=1
[17]PETSC ERROR: #1 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[17]PETSC ERROR: #2 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[21]PETSC ERROR: Memory allocated 0 Memory used by process 3549990912
[21]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.
[21]PETSC ERROR: Memory requested 36360045
[21]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[21]PETSC ERROR: Petsc Release Version 3.6.3, Dec, 03, 2015
[21]PETSC ERROR: ./a.out on a petsc-3.6.3_static_rel named n12-09 by wtay Wed Feb 24 16:57:03 2016
[21]PETSC ERROR: Configure options --with-mpi-dir=/opt/ud/openmpi-1.8.8/ --with-blas-lapack-dir=/opt/ud/intel_xe_2013sp1/mkl/lib/intel64/ --with-debugging=0 --download-hypre=1 --prefix=/home/wtay/Lib/petsc-3.6.3_static_rel --known-mpi-shared=0 --with-shared-libraries=0 --with-fortran-interfaces=1
[21]PETSC ERROR: #1 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[21]PETSC ERROR: #2 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[21]PETSC ERROR: #3 MatLUFactorNumeric() line 2946 in /home/wtay/Codes/petsc-3.6.3/src/mat/interface/matrix.c
[21]PETSC ERROR: #4 PCSetUp_ILU() line 233 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/factor/ilu/ilu.c
[21]PETSC ERROR: #5 PCSetUp() line 983 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[21]PETSC ERROR: #6 KSPSetUp() line 332 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[21]PETSC ERROR: [25]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[25]PETSC ERROR: Out of memory. This could be due to allocating
[25]PETSC ERROR: too large an object or bleeding by not properly
[25]PETSC ERROR: destroying unneeded objects.
[17]PETSC ERROR: #3 MatLUFactorNumeric() line 2946 in /home/wtay/Codes/petsc-3.6.3/src/mat/interface/matrix.c
[17]PETSC ERROR: #4 PCSetUp_ILU() line 233 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/factor/ilu/ilu.c
[17]PETSC ERROR: #7 KSPSolve() line 546 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[21]PETSC ERROR: #8 PCApply_BJacobi_Singleblock() line 670 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/bjacobi/bjacobi.c
[21]PETSC ERROR: #9 PCApply() line 483 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[21]PETSC ERROR: #10 KSP_PCApply() line 242 in /home/wtay/Codes/petsc-3.6.3/include/petsc/private/kspimpl.h
[21]PETSC ERROR: #11 KSPInitialResidual() line 63 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itres.c
[21]PETSC ERROR: #12 KSPSolve_BCGS() line 50 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/impls/bcgs/bcgs.c
[21]PETSC ERROR: #13 KSPSolve() line 604 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
#5 PCSetUp() line 983 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[17]PETSC ERROR: #6 KSPSetUp() line 332 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[17]PETSC ERROR: #7 KSPSolve() line 546 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[17]PETSC ERROR: #8 PCApply_BJacobi_Singleblock() line 670 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/bjacobi/bjacobi.c
[17]PETSC ERROR: #9 PCApply() line 483 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[17]PETSC ERROR: #10 KSP_PCApply() line 242 in /home/wtay/Codes/petsc-3.6.3/include/petsc/private/kspimpl.h
[17]PETSC ERROR: #11 KSPInitialResidual() line 63 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itres.c
[17]PETSC ERROR: #12 KSPSolve_BCGS() line 50 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/impls/bcgs/bcgs.c
[17]PETSC ERROR: #13 KSPSolve() line 604 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[1]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[1]PETSC ERROR: Out of memory. This could be due to allocating
[1]PETSC ERROR: too large an object or bleeding by not properly
[1]PETSC ERROR: destroying unneeded objects.
[25]PETSC ERROR: Memory allocated 0 Memory used by process 3515305984
[25]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.
[25]PETSC ERROR: Memory requested 36360045
[25]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[25]PETSC ERROR: Petsc Release Version 3.6.3, Dec, 03, 2015
[25]PETSC ERROR: ./a.out on a petsc-3.6.3_static_rel named n12-09 by wtay Wed Feb 24 16:57:03 2016
[25]PETSC ERROR: Configure options --with-mpi-dir=/opt/ud/openmpi-1.8.8/ --with-blas-lapack-dir=/opt/ud/intel_xe_2013sp1/mkl/lib/intel64/ --with-debugging=0 --download-hypre=1 --prefix=/home/wtay/Lib/petsc-3.6.3_static_rel --known-mpi-shared=0 --with-shared-libraries=0 --with-fortran-interfaces=1
[25]PETSC ERROR: #1 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[25]PETSC ERROR: #2 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[25]PETSC ERROR: #3 MatLUFactorNumeric() line 2946 in /home/wtay/Codes/petsc-3.6.3/src/mat/interface/matrix.c
[25]PETSC ERROR: #4 PCSetUp_ILU() line 233 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/factor/ilu/ilu.c
[25]PETSC ERROR: #5 PCSetUp() line 983 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[25]PETSC ERROR: #6 KSPSetUp() line 332 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[25]PETSC ERROR: #7 KSPSolve() line 546 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[25]PETSC ERROR: #8 PCApply_BJacobi_Singleblock() line 670 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/bjacobi/bjacobi.c
[1]PETSC ERROR: Memory allocated 0 Memory used by process 3497189376
[1]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.
[1]PETSC ERROR: Memory requested 37814445
[1]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[1]PETSC ERROR: Petsc Release Version 3.6.3, Dec, 03, 2015
[1]PETSC ERROR: ./a.out on a petsc-3.6.3_static_rel named n12-09 by wtay Wed Feb 24 16:57:03 2016
[1]PETSC ERROR: Configure options --with-mpi-dir=/opt/ud/openmpi-1.8.8/ --with-blas-lapack-dir=/opt/ud/intel_xe_2013sp1/mkl/lib/intel64/ --with-debugging=0 --download-hypre=1 --prefix=/home/wtay/Lib/petsc-3.6.3_static_rel --known-mpi-shared=0 --with-shared-libraries=0 --with-fortran-interfaces=1
[1]PETSC ERROR: #1 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[1]PETSC ERROR: #2 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[1]PETSC ERROR: #3 MatLUFactorNumeric() line 2946 in /home/wtay/Codes/petsc-3.6.3/src/mat/interface/matrix.c
[1]PETSC ERROR: #4 PCSetUp_ILU() line 233 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/factor/ilu/ilu.c
[1]PETSC ERROR: #5 PCSetUp() line 983 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[1]PETSC ERROR: #6 KSPSetUp() line 332 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[25]PETSC ERROR: #9 PCApply() line 483 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[25]PETSC ERROR: #10 KSP_PCApply() line 242 in /home/wtay/Codes/petsc-3.6.3/include/petsc/private/kspimpl.h
[25]PETSC ERROR: #11 KSPInitialResidual() line 63 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itres.c
[25]PETSC ERROR: #12 KSPSolve_BCGS() line 50 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/impls/bcgs/bcgs.c
[25]PETSC ERROR: #13 KSPSolve() line 604 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[1]PETSC ERROR: #7 KSPSolve() line 546 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[1]PETSC ERROR: #8 PCApply_BJacobi_Singleblock() line 670 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/bjacobi/bjacobi.c
[1]PETSC ERROR: #9 PCApply() line 483 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[1]PETSC ERROR: #10 KSP_PCApply() line 242 in /home/wtay/Codes/petsc-3.6.3/include/petsc/private/kspimpl.h
[1]PETSC ERROR: #11 KSPInitialResidual() line 63 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itres.c
[1]PETSC ERROR: #12 KSPSolve_BCGS() line 50 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/impls/bcgs/bcgs.c
[1]PETSC ERROR: #13 KSPSolve() line 604 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[41]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[41]PETSC ERROR: Out of memory. This could be due to allocating
[41]PETSC ERROR: too large an object or bleeding by not properly
[41]PETSC ERROR: destroying unneeded objects.
[41]PETSC ERROR: Memory allocated 0 Memory used by process 3544576000
[41]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.
[41]PETSC ERROR: Memory requested 36360045
[41]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[41]PETSC ERROR: Petsc Release Version 3.6.3, Dec, 03, 2015
[41]PETSC ERROR: ./a.out on a petsc-3.6.3_static_rel named n12-09 by wtay Wed Feb 24 16:57:03 2016
[41]PETSC ERROR: Configure options --with-mpi-dir=/opt/ud/openmpi-1.8.8/ --with-blas-lapack-dir=/opt/ud/intel_xe_2013sp1/mkl/lib/intel64/ --with-debugging=0 --download-hypre=1 --prefix=/home/wtay/Lib/petsc-3.6.3_static_rel --known-mpi-shared=0 --with-shared-libraries=0 --with-fortran-interfaces=1
[41]PETSC ERROR: #1 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[41]PETSC ERROR: #2 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[41]PETSC ERROR: #3 MatLUFactorNumeric() line 2946 in /home/wtay/Codes/petsc-3.6.3/src/mat/interface/matrix.c
[41]PETSC ERROR: #4 PCSetUp_ILU() line 233 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/factor/ilu/ilu.c
[41]PETSC ERROR: #5 PCSetUp() line 983 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[41]PETSC ERROR: #6 KSPSetUp() line 332 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[41]PETSC ERROR: #7 KSPSolve() line 546 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[41]PETSC ERROR: #8 PCApply_BJacobi_Singleblock() line 670 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/bjacobi/bjacobi.c
[41]PETSC ERROR: #9 PCApply() line 483 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[41]PETSC ERROR: #10 KSP_PCApply() line 242 in /home/wtay/Codes/petsc-3.6.3/include/petsc/private/kspimpl.h
[41]PETSC ERROR: #11 KSPInitialResidual() line 63 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itres.c
[41]PETSC ERROR: #12 KSPSolve_BCGS() line 50 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/impls/bcgs/bcgs.c
[41]PETSC ERROR: #13 KSPSolve() line 604 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
--------------------- Error Message --------------------------------------------------------------
[9]PETSC ERROR: Out of memory. This could be due to allocating
[9]PETSC ERROR: too large an object or bleeding by not properly
[9]PETSC ERROR: destroying unneeded objects.
[9]PETSC ERROR: Memory allocated 0 Memory used by process 3521380352
[9]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.
[9]PETSC ERROR: Memory requested 36360045
[9]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[9]PETSC ERROR: Petsc Release Version 3.6.3, Dec, 03, 2015
[9]PETSC ERROR: ./a.out on a petsc-3.6.3_static_rel named n12-09 by wtay Wed Feb 24 16:57:03 2016
[9]PETSC ERROR: Configure options --with-mpi-dir=/opt/ud/openmpi-1.8.8/ --with-blas-lapack-dir=/opt/ud/intel_xe_2013sp1/mkl/lib/intel64/ --with-debugging=0 --download-hypre=1 --prefix=/home/wtay/Lib/petsc-3.6.3_static_rel --known-mpi-shared=0 --with-shared-libraries=0 --with-fortran-interfaces=1
[9]PETSC ERROR: #1 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[9]PETSC ERROR: #2 MatLUFactorNumeric_SeqAIJ_Inode() line 1219 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[9]PETSC ERROR: #3 MatLUFactorNumeric() line 2946 in /home/wtay/Codes/petsc-3.6.3/src/mat/interface/matrix.c
[9]PETSC ERROR: #4 PCSetUp_ILU() line 233 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/factor/ilu/ilu.c
[9]PETSC ERROR: #5 PCSetUp() line 983 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[9]PETSC ERROR: #6 KSPSetUp() line 332 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[9]PETSC ERROR: #7 KSPSolve() line 546 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[9]PETSC ERROR: #8 PCApply_BJacobi_Singleblock() line 670 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/bjacobi/bjacobi.c
[9]PETSC ERROR: #9 PCApply() line 483 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[9]PETSC ERROR: #10 KSP_PCApply() line 242 in /home/wtay/Codes/petsc-3.6.3/include/petsc/private/kspimpl.h
[9]PETSC ERROR: #11 KSPInitialResidual() line 63 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itres.c
[9]PETSC ERROR: #12 KSPSolve_BCGS() line 50 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/impls/bcgs/bcgs.c
[9]PETSC ERROR: #13 KSPSolve() line 604 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[45]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[45]PETSC ERROR: Out of memory. This could be due to allocating
[45]PETSC ERROR: too large an object or bleeding by not properly
[45]PETSC ERROR: destroying unneeded objects.
[45]PETSC ERROR: Memory allocated 0 Memory used by process 3541323776
[45]PETSC ERROR: Try running with -malloc_dump or -malloc_log for info.
[45]PETSC ERROR: Memory requested 4545004
[45]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.
[45]PETSC ERROR: Petsc Release Version 3.6.3, Dec, 03, 2015
[45]PETSC ERROR: ./a.out on a petsc-3.6.3_static_rel named n12-09 by wtay Wed Feb 24 16:57:03 2016
[45]PETSC ERROR: Configure options --with-mpi-dir=/opt/ud/openmpi-1.8.8/ --with-blas-lapack-dir=/opt/ud/intel_xe_2013sp1/mkl/lib/intel64/ --with-debugging=0 --download-hypre=1 --prefix=/home/wtay/Lib/petsc-3.6.3_static_rel --known-mpi-shared=0 --with-shared-libraries=0 --with-fortran-interfaces=1
[45]PETSC ERROR: #1 MatLUFactorNumeric_SeqAIJ_Inode() line 1243 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[45]PETSC ERROR: #2 MatLUFactorNumeric_SeqAIJ_Inode() line 1243 in /home/wtay/Codes/petsc-3.6.3/src/mat/impls/aij/seq/inode.c
[45]PETSC ERROR: #3 MatLUFactorNumeric() line 2946 in /home/wtay/Codes/petsc-3.6.3/src/mat/interface/matrix.c
[45]PETSC ERROR: #4 PCSetUp_ILU() line 233 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/factor/ilu/ilu.c
[45]PETSC ERROR: #5 PCSetUp() line 983 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[45]PETSC ERROR: #6 KSPSetUp() line 332 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[45]PETSC ERROR: #7 KSPSolve() line 546 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
[45]PETSC ERROR: #8 PCApply_BJacobi_Singleblock() line 670 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/impls/bjacobi/bjacobi.c
[45]PETSC ERROR: #9 PCApply() line 483 in /home/wtay/Codes/petsc-3.6.3/src/ksp/pc/interface/precon.c
[45]PETSC ERROR: #10 KSP_PCApply() line 242 in /home/wtay/Codes/petsc-3.6.3/include/petsc/private/kspimpl.h
[45]PETSC ERROR: #11 KSPInitialResidual() line 63 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itres.c
[45]PETSC ERROR: #12 KSPSolve_BCGS() line 50 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/impls/bcgs/bcgs.c
[45]PETSC ERROR: #13 KSPSolve() line 604 in /home/wtay/Codes/petsc-3.6.3/src/ksp/ksp/interface/itfunc.c
More information about the petsc-users
mailing list