[petsc-dev] Lower memory DMDA

[Lisandro Dalcin]

On 8 May 2013 16:30, Barry Smith <bsmith at mcs.anl.gov> wrote:
>
> On May 8, 2013, at 7:54 AM, Peter Brune <prbrune at gmail.com> wrote:
>
>> DMGetCoordinateDM is, however, collective.  Looking deeper, it is created only when used, but setting uniform coordinates is using it.  We might want to be more upfront about this.  It's probably not their problem.
>
>     You guys are speculating too much. Create a DMDA characteristic for their code with reasonably large array dimensions and then -malloc_dump it (or something similar) to find out where the memory actually is. Then given this table of sizes propose changes, not before.
>

$ python test2-dalcinl.py  -malloc_dump | grep "\[ 0\]" | cut -f 2 -d
"]" | sort -r -n
12000000 bytes VecScatterCreate() line 1095 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
12000000 bytes VecScatterCreate() line 1095 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
12000000 bytes VecScatterCreate() line 1095 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
12000000 bytes VecScatterCreate() line 1095 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
12000000 bytes ISLocalToGlobalMappingCreate() line 211 in
/home/devel/petsc/3.3/src/vec/is/utils/isltog.c
12000000 bytes DMSetUp_DA_3D() line 1290 in
/home/devel/petsc/3.3/src/dm/impls/da/da3.c
4000000 bytes ISLocalToGlobalMappingBlock() line 254 in
/home/devel/petsc/3.3/src/vec/is/utils/isltog.c
3856 bytes DMCreate() line 41 in /home/devel/petsc/3.3/src/dm/interface/dm.c
816 bytes DMCreate_DA() line 235 in
/home/devel/petsc/3.3/src/dm/impls/da/dacreate.c
624 bytes PetscSFCreate() line 73 in /home/devel/petsc/3.3/src/sys/sf/sf.c
624 bytes PetscSFCreate() line 73 in /home/devel/petsc/3.3/src/sys/sf/sf.c
560 bytes VecScatterCreate() line 863 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
560 bytes VecScatterCreate() line 863 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
496 bytes ISLocalToGlobalMappingCreate() line 203 in
/home/devel/petsc/3.3/src/vec/is/utils/isltog.c
496 bytes ISLocalToGlobalMappingCreate() line 203 in
/home/devel/petsc/3.3/src/vec/is/utils/isltog.c
256 bytes DMCreate() line 41 in /home/devel/petsc/3.3/src/dm/interface/dm.c
112 bytes DMSetUp_DA_3D() line 694 in
/home/devel/petsc/3.3/src/dm/impls/da/da3.c
64 bytes VecScatterCreate() line 863 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
64 bytes VecScatterCreate() line 863 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
64 bytes PetscSFCreate() line 73 in /home/devel/petsc/3.3/src/sys/sf/sf.c
64 bytes PetscSFCreate() line 73 in /home/devel/petsc/3.3/src/sys/sf/sf.c
64 bytes ISLocalToGlobalMappingCreate() line 203 in
/home/devel/petsc/3.3/src/vec/is/utils/isltog.c
64 bytes ISLocalToGlobalMappingCreate() line 203 in
/home/devel/petsc/3.3/src/vec/is/utils/isltog.c
64 bytes DMCreate() line 41 in /home/devel/petsc/3.3/src/dm/interface/dm.c
48 bytes VecScatterCreate() line 1094 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
48 bytes VecScatterCreate() line 1094 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
48 bytes VecScatterCreate() line 1094 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
48 bytes VecScatterCreate() line 1094 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
32 bytes DMSetUp_DA_3D() line 216 in /home/devel/petsc/3.3/src/dm/impls/da/da3.c
16 bytes VecScatterCreate() line 863 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
16 bytes VecScatterCreate() line 863 in
/home/devel/petsc/3.3/src/vec/vec/utils/vscat.c
16 bytes PetscStrallocpy() line 186 in /home/devel/petsc/3.3/src/sys/utils/str.c
16 bytes PetscStrallocpy() line 186 in /home/devel/petsc/3.3/src/sys/utils/str.c
16 bytes PetscSFCreate() line 73 in /home/devel/petsc/3.3/src/sys/sf/sf.c
16 bytes PetscSFCreate() line 73 in /home/devel/petsc/3.3/src/sys/sf/sf.c
16 bytes PetscCommDuplicate() line 156 in
/home/devel/petsc/3.3/src/sys/objects/tagm.c
16 bytes PetscCommDuplicate() line 156 in
/home/devel/petsc/3.3/src/sys/objects/tagm.c
16 bytes ISLocalToGlobalMappingCreate() line 203 in
/home/devel/petsc/3.3/src/vec/is/utils/isltog.c
16 bytes ISLocalToGlobalMappingCreate() line 203 in
/home/devel/petsc/3.3/src/vec/is/utils/isltog.c
16 bytes DMSetUp_DA_3D() line 329 in /home/devel/petsc/3.3/src/dm/impls/da/da3.c
16 bytes DMSetUp_DA_3D() line 316 in /home/devel/petsc/3.3/src/dm/impls/da/da3.c
16 bytes DMSetUp_DA_3D() line 304 in /home/devel/petsc/3.3/src/dm/impls/da/da3.c



--
Lisandro Dalcin
---------------
CIMEC (INTEC/CONICET-UNL)
Predio CONICET-Santa Fe
Colectora RN 168 Km 472, Paraje El Pozo
3000 Santa Fe, Argentina
Tel: +54-342-4511594 (ext 1011)
Tel/Fax: +54-342-4511169