[petsc-users] Problem in MPI communicator

Michele Rosso michele.rosso84 at gmail.com
Mon Jun 9 22:56:13 CDT 2014


Hi,

I am trying to re-number the mpi ranks in order to have the domain 
decomposition obtained from DMDACreate3D() match the default 
decomposition provided by MPI_Cart_create(). I followed the method 
described in the FAQ:

         call PetscInitialize(PETSC_NULL_CHARACTER,ierr)
         call mpi_comm_rank(MPI_COMM_WORLD, rank, ierr)
         if(PETSC_COMM_WORLD/=MPI_COMM_WORLD) write(*,*) 'Communicator 
problem'
         x = rank / (pz*py);
         y = mod(rank,(pz*py))/pz
         z = mod(mod(rank,pz*py),pz)
         newrank = z*py*px + y*px + x;
         call mpi_comm_split(PETSC_COMM_WORLD, 1, newrank, newcomm, ierr)
         PETSC_COMM_WORLD = newcomm

I tried to run my code (it works fine with the standard PETSc 
decomposition) with the new decomposition but I received the error 
message;  I attached the full output. I run with only one processor to 
test the setup and I commented all the lines where I actually insert/get 
data into/from the PETSc arrays.
Could you please help fixing this?

Thanks,
Michele





-------------- next part --------------
[0] petscinitialize_(): (Fortran):PETSc successfully started: procs 1
[0] PetscGetHostName(): Rejecting domainname, likely is NIS nid27514.(none)
[0] petscinitialize_(): Running on machine: nid27514
[0] PetscCommDuplicate(): Duplicating a communicator -2080374779 -2080374778 max tags = 4194303
[0] PetscCommDuplicate(): Using internal PETSc communicator -2080374779 -2080374778
[0] PetscCommDuplicate(): Using internal PETSc communicator -2080374779 -2080374778
[0] PetscCommDuplicate(): Duplicating a communicator 1140850689 -2080374777 max tags = 4194303
[0] VecScatterCreate(): Sequential vector scatter with block indices
[0] VecScatterCreate(): Sequential vector scatter with block indices
Processor [0] M 128 N 32 P 32 m 1 n 1 p 1 w 1 s 1
X range of indices: 0 128, Y range of indices: 0 32, Z range of indices: 0 32
[0] MatAssemblyEnd_SeqAIJ(): Matrix size: 131072 X 131072; storage space: 0 unneeded,917504 used
[0] MatAssemblyEnd_SeqAIJ(): Number of mallocs during MatSetValues() is 0
[0] MatAssemblyEnd_SeqAIJ(): Maximum nonzeros in any row is 7
[0] Mat_CheckInode(): Found 131072 nodes out of 131072 rows. Not using Inode routines
[0] PetscCommDuplicate(): Using internal PETSc communicator -2080374779 -2080374778
[0] KSPSetNormType(): Warning: setting KSPNormType to skip computing the norm
 KSP convergence test is implicitly set to KSPSkipConverged
[0] KSPSetNormType(): Warning: setting KSPNormType to skip computing the norm
 KSP convergence test is implicitly set to KSPSkipConverged
[0] KSPSetNormType(): Warning: setting KSPNormType to skip computing the norm
 KSP convergence test is implicitly set to KSPSkipConverged
[0] KSPSetNormType(): Warning: setting KSPNormType to skip computing the norm
 KSP convergence test is implicitly set to KSPSkipConverged
[0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374777
[0] PetscCommDuplicate(): Using internal PETSc communicator -2080374779 -2080374778
[0]PETSC ERROR: --------------------- Error Message ------------------------------------
[0]PETSC ERROR: Null argument, when expecting valid pointer!
[0]PETSC ERROR: Null Object: Parameter # 2!
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: Petsc Release Version 3.4.4, Mar, 13, 2014 
[0]PETSC ERROR: See docs/changes/index.html for recent updates.
[0]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[0]PETSC ERROR: See docs/index.html for manual pages.
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: ./hit on a interlagos-64idx-gnu-dbg named nid27514 by mrosso Mon Jun  9 21:54:56 2014
[0]PETSC ERROR: Libraries linked from /u/sciteam/mrosso/LIBS/petsc-3.4.4/interlagos-64idx-gnu-dbg/lib
[0]PETSC ERROR: Configure run at Mon May 26 17:26:25 2014
[0]PETSC ERROR: Configure options --known-level1-dcache-size=16384 --known-level1-dcache-linesize=64 --known-level1-dcache-assoc=4 --known-memcmp-ok=1 --known-sizeof-char=1 --known-sizeof-void-p=8 --known-sizeof-short=2 --known-sizeof-int=4 --known-sizeof-long=8 --known-sizeof-long-long=8 --known-sizeof-float=4 --known-sizeof-double=8 --known-sizeof-size_t=8 --known-bits-per-byte=8 --known-sizeof-MPI_Comm=4 --known-sizeof-MPI_Fint=4 --known-mpi-long-double=1 --known-mpi-c-double-complex=1 --with-batch="1 " --known-mpi-shared="0 " --known-mpi-shared-libraries=0 --known-memcmp-ok  --with-blas-lapack-lib="-L/opt/acml/5.3.0/gfortran64/lib  -lacml" --with-x="0 " --with-debugging="1 " --with-clib-autodetect="0 " --with-cxxlib-autodetect="0 " --with-fortranlib-autodetect="0 " --with-shared-libraries="0 " --with-dynamic-loading="0 " --with-mpi-compilers="1 " --with-cc="cc " --with-cxx="CC " --with-fc="ftn " --with-64-bit-indices --download-blacs="1 " --download-scalapack="1 " --download-superlu_dist="1 " --download-metis="1 " --download-parmetis="1 " --download-hypre=1 PETSC_ARCH=interlagos-64idx-gnu-dbg
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: DMGlobalToLocalBegin_DA() line 17 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dagtol.c
[0]PETSC ERROR: DMGlobalToLocalBegin() line 1626 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
[0]PETSC ERROR: --------------------- Error Message ------------------------------------
[0]PETSC ERROR: Null argument, when expecting valid pointer!
[0]PETSC ERROR: Null Object: Parameter # 2!
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: Petsc Release Version 3.4.4, Mar, 13, 2014 
[0]PETSC ERROR: See docs/changes/index.html for recent updates.
[0]PETSC ERROR: See docs/faq.html for hints about trouble shooting.
[0]PETSC ERROR: See docs/index.html for manual pages.
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: ./hit on a interlagos-64idx-gnu-dbg named nid27514 by mrosso Mon Jun  9 21:54:56 2014
[0]PETSC ERROR: Libraries linked from /u/sciteam/mrosso/LIBS/petsc-3.4.4/interlagos-64idx-gnu-dbg/lib
[0]PETSC ERROR: Configure run at Mon May 26 17:26:25 2014
[0]PETSC ERROR: Configure options --known-level1-dcache-size=16384 --known-level1-dcache-linesize=64 --known-level1-dcache-assoc=4 --known-memcmp-ok=1 --known-sizeof-char=1 --known-sizeof-void-p=8 --known-sizeof-short=2 --known-sizeof-int=4 --known-sizeof-long=8 --known-sizeof-long-long=8 --known-sizeof-float=4 --known-sizeof-double=8 --known-sizeof-size_t=8 --known-bits-per-byte=8 --known-sizeof-MPI_Comm=4 --known-sizeof-MPI_Fint=4 --known-mpi-long-double=1 --known-mpi-c-double-complex=1 --with-batch="1 " --known-mpi-shared="0 " --known-mpi-shared-libraries=0 --known-memcmp-ok  --with-blas-lapack-lib="-L/opt/acml/5.3.0/gfortran64/lib  -lacml" --with-x="0 " --with-debugging="1 " --with-clib-autodetect="0 " --with-cxxlib-autodetect="0 " --with-fortranlib-autodetect="0 " --with-shared-libraries="0 " --with-dynamic-loading="0 " --with-mpi-compilers="1 " --with-cc="cc " --with-cxx="CC " --with-fc="ftn " --with-64-bit-indices --download-blacs="1 " --download-scalapack="1 " --download-superlu_dist="1 " --download-metis="1 " --download-parmetis="1 " --download-hypre=1 PETSC_ARCH=interlagos-64idx-gnu-dbg
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: DMGlobalToLocalEnd_DA() line 33 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dagtol.c
[0]PETSC ERROR: DMGlobalToLocalEnd() line 1669 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
[0] PetscCommDuplicate(): Using internal PETSc communicator 1140850689 -2080374777
[0] PetscFinalize(): PetscFinalize() called
[0] Petsc_DelViewer(): Removing viewer data attribute in an MPI_Comm -2080374778
[0] PetscCommDuplicate(): Duplicating a communicator 1140850688 -1006632960 max tags = 4194303
#PETSc Option Table entries:
-dm_view
-info
-ksp_converged_reason
-ksp_monitor_true_residual
-malloc_dump
-mg_coarse_pc_factor_mat_solver_package superlu_dist
-mg_coarse_pc_type lu
-mg_levels_ksp_max_it 1
-mg_levels_ksp_type richardson
-options_left
-pc_mg_galerkin
-pc_mg_levels 4
-pc_type mg
#End of PETSc Option Table entries
[0] Petsc_DelViewer(): Removing viewer data attribute in an MPI_Comm -1006632960
[0] Petsc_DelComm_Inner(): Removing reference to PETSc communicator embedded in a user MPI_Comm -1006632960
[0] Petsc_DelComm_Outer(): User MPI_Comm 1140850688 is being freed after removing reference from inner PETSc comm to this outer comm
[0] PetscCommDestroy(): Deleting PETSc MPI_Comm -1006632960
[0] Petsc_DelViewer(): Removing viewer data attribute in an MPI_Comm -1006632960
[0] Petsc_DelThreadComm(): Deleting thread communicator data in an MPI_Comm -1006632960
[0] Petsc_DelCounter(): Deleting counter data in an MPI_Comm -1006632960
There are 4 unused database options. They are:
Option left: name:-mg_coarse_pc_factor_mat_solver_package value: superlu_dist
Option left: name:-mg_coarse_pc_type value: lu
Option left: name:-mg_levels_ksp_max_it value: 1
Option left: name:-mg_levels_ksp_type value: richardson
[0]Total space allocated 7959408 bytes
[ 0]288 bytes PetscObjectListAdd() line 119 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/olist.c
      [0]  PetscObjectListAdd() line 119 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/olist.c
      [0]  PetscObjectCompose_Petsc() line 640 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  PetscObjectCompose() line 724 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  VecSetDM() line 182 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  VecDuplicate_MPI_DA() line 16 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  VecDuplicate() line 510 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vector.c
[ 0]80 bytes PetscObjectComposedDataIncreaseReal() line 170 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/state.c
      [0]  PetscObjectComposedDataIncreaseReal() line 170 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/state.c
      [0]  VecSet() line 564 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/rvector.c
      [0]  VecCreate_Seq() line 34 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec3.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  VecCreate_Standard() line 262 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/mpi/pbvec.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  VecDuplicate_MPI_DA() line 16 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  VecDuplicate() line 510 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vector.c
[ 0]80 bytes PetscObjectComposedDataIncreaseReal() line 168 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/state.c
      [0]  PetscObjectComposedDataIncreaseReal() line 168 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/state.c
      [0]  VecSet() line 564 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/rvector.c
      [0]  VecCreate_Seq() line 34 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec3.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  VecCreate_Standard() line 262 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/mpi/pbvec.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  VecDuplicate_MPI_DA() line 16 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  VecDuplicate() line 510 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vector.c
[ 0]16 bytes PetscStrallocpy() line 188 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/utils/str.c
      [0]  PetscStrallocpy() line 188 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/utils/str.c
      [0]  PetscObjectChangeTypeName() line 134 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/pname.c
      [0]  VecCreate_Seq_Private() line 1244 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec2.c
      [0]  VecCreate_Seq() line 34 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec3.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  VecCreate_Standard() line 262 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/mpi/pbvec.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  VecDuplicate_MPI_DA() line 16 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  VecDuplicate() line 510 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vector.c
[ 0]32 bytes VecCreate_Seq_Private() line 1245 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec2.c
      [0]  VecCreate_Seq_Private() line 1245 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec2.c
      [0]  VecCreate_Seq() line 34 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec3.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  VecCreate_Standard() line 262 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/mpi/pbvec.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  VecDuplicate_MPI_DA() line 16 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  VecDuplicate() line 510 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vector.c
[ 0]1048576 bytes VecCreate_Seq() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec3.c
      [0]  VecCreate_Seq() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec3.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  VecCreate_Standard() line 262 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/mpi/pbvec.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  VecDuplicate_MPI_DA() line 16 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  VecDuplicate() line 510 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vector.c
[ 0]528 bytes VecCreate() line 39 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/veccreate.c
      [0]  VecCreate() line 39 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/veccreate.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  VecDuplicate_MPI_DA() line 16 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  VecDuplicate() line 510 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vector.c
[ 0]64 bytes VecCreate() line 39 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/veccreate.c
      [0]  VecCreate() line 39 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/veccreate.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  VecDuplicate_MPI_DA() line 16 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  VecDuplicate() line 510 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vector.c
[ 0]1008 bytes VecCreate() line 39 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/veccreate.c
      [0]  VecCreate() line 39 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/veccreate.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  VecDuplicate_MPI_DA() line 16 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  VecDuplicate() line 510 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vector.c
[ 0]16 bytes PetscLayoutSetUp() line 156 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/pmap.c
      [0]  PetscLayoutSetUp() line 156 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/pmap.c
      [0]  VecCreate_Seq_Private() line 1244 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec2.c
      [0]  VecCreate_Seq() line 34 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec3.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  VecCreate_Standard() line 262 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/mpi/pbvec.c
      [0]  VecSetType() line 38 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/vecreg.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
[ 0]96 bytes PetscLayoutCreate() line 53 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/pmap.c
      [0]  PetscLayoutCreate() line 53 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/pmap.c
      [0]  VecCreate() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/veccreate.c
      [0]  DMCreateGlobalVector_DA() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dadist.c
      [0]  DMCreateGlobalVector() line 597 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
[ 0]1202240 bytes ISLocalToGlobalMappingCreate() line 235 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  ISLocalToGlobalMappingCreate() line 235 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  ISLocalToGlobalMappingCreateIS() line 128 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes ISLocalToGlobalMappingCreate() line 227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  ISLocalToGlobalMappingCreate() line 227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  ISLocalToGlobalMappingCreateIS() line 128 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]64 bytes ISLocalToGlobalMappingCreate() line 227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  ISLocalToGlobalMappingCreate() line 227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  ISLocalToGlobalMappingCreateIS() line 128 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]576 bytes ISLocalToGlobalMappingCreate() line 227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  ISLocalToGlobalMappingCreate() line 227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  ISLocalToGlobalMappingCreateIS() line 128 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/utils/isltog.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]1202240 bytes DMSetUp_DA_3D() line 1360 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA_3D() line 1360 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]1196032 bytes VecScatterCreate() line 1171 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 1171 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]1196032 bytes VecScatterCreate() line 1171 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 1171 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]80 bytes VecScatterCreate() line 1170 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 1170 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]80 bytes VecScatterCreate() line 1170 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 1170 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]64 bytes VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]640 bytes VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]224 bytes DMSetUp_DA_3D() line 729 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA_3D() line 729 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]1048576 bytes VecScatterCreate() line 1171 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 1171 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]1048576 bytes VecScatterCreate() line 1171 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 1171 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]80 bytes VecScatterCreate() line 1170 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 1170 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]80 bytes VecScatterCreate() line 1170 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 1170 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]64 bytes VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]640 bytes VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  VecScatterCreate() line 938 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/utils/vscat.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]32 bytes PetscCommDuplicate() line 151 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscCommDuplicate() line 151 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  VecCreate() line 32 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/interface/veccreate.c
      [0]  VecCreateSeqWithArray() line 1303 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/vec/impls/seq/bvec2.c
      [0]  DMSetUp_DA_3D() line 205 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
      [0]  DMSetUp_DA() line 15 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]32 bytes DMSetUp_DA() line 22 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp_DA() line 22 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes DMSetUp_DA() line 20 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp_DA() line 20 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dareg.c
      [0]  DMSetUp() line 474 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes DMDASetOwnershipRanges() line 576 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da.c
      [0]  DMDASetOwnershipRanges() line 576 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes DMDASetOwnershipRanges() line 568 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da.c
      [0]  DMDASetOwnershipRanges() line 568 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes DMDASetOwnershipRanges() line 560 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da.c
      [0]  DMDASetOwnershipRanges() line 560 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes PetscStrallocpy() line 188 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/utils/str.c
      [0]  PetscStrallocpy() line 188 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/utils/str.c
      [0]  PetscObjectChangeTypeName() line 134 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/pname.c
      [0]  DMSetType() line 2393 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes PetscStrallocpy() line 188 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/utils/str.c
      [0]  PetscStrallocpy() line 188 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/utils/str.c
      [0]  DMCreate_DA() line 279 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMSetType() line 2393 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]736 bytes DMCreate_DA() line 281 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMCreate_DA() line 281 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMSetType() line 2393 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]96 bytes PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]64 bytes PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]704 bytes PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]96 bytes PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]64 bytes PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]704 bytes PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  PetscSFCreate() line 43 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/vec/is/sf/interface/sf.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes PetscThreadCommReductionCreate() line 448 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcommred.c
      [0]  PetscThreadCommReductionCreate() line 448 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcommred.c
      [0]  PetscThreadCommWorldInitialize() line 1227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]512 bytes PetscThreadCommReductionCreate() line 440 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcommred.c
      [0]  PetscThreadCommReductionCreate() line 440 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcommred.c
      [0]  PetscThreadCommWorldInitialize() line 1227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]256 bytes PetscThreadCommReductionCreate() line 436 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcommred.c
      [0]  PetscThreadCommReductionCreate() line 436 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcommred.c
      [0]  PetscThreadCommWorldInitialize() line 1227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]1280 bytes PetscThreadCommReductionCreate() line 435 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcommred.c
      [0]  PetscThreadCommReductionCreate() line 435 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcommred.c
      [0]  PetscThreadCommWorldInitialize() line 1227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]32 bytes PetscThreadCommReductionCreate() line 432 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcommred.c
      [0]  PetscThreadCommReductionCreate() line 432 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcommred.c
      [0]  PetscThreadCommWorldInitialize() line 1227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]128 bytes PetscThreadCommWorldInitialize() line 1241 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscThreadCommWorldInitialize() line 1241 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]2560 bytes PetscThreadCommWorldInitialize() line 1240 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscThreadCommWorldInitialize() line 1240 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]32 bytes PetscThreadCommWorldInitialize() line 1232 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscThreadCommWorldInitialize() line 1232 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]16 bytes PetscThreadCommSetAffinities() line 423 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscThreadCommSetAffinities() line 423 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscThreadCommWorldInitialize() line 1227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]48 bytes PetscThreadCommCreate() line 150 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscThreadCommCreate() line 150 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscThreadCommWorldInitialize() line 1227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]336 bytes PetscThreadCommCreate() line 146 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscThreadCommCreate() line 146 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscThreadCommWorldInitialize() line 1227 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscGetThreadCommWorld() line 80 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommGetThreadComm() line 114 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/threadcomm/interface/threadcomm.c
      [0]  PetscCommDuplicate() line 139 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]32 bytes PetscCommDuplicate() line 151 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscCommDuplicate() line 151 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/tagm.c
      [0]  PetscHeaderCreate_Private() line 31 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/sys/objects/inherit.c
      [0]  DMCreate() line 72 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]240 bytes DMCreate() line 81 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMCreate() line 81 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]64 bytes DMCreate() line 81 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMCreate() line 81 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
[ 0]4112 bytes DMCreate() line 81 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMCreate() line 81 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/interface/dm.c
      [0]  DMDACreate() line 390 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/dacreate.c
      [0]  DMDACreate3d() line 1456 in /u/sciteam/mrosso/LIBS/petsc-3.4.4/src/dm/impls/da/da3.c
Application 4892110 resources: utime ~4s, stime ~0s, Rss ~88192, inblocks ~26785, outblocks ~93626


More information about the petsc-users mailing list