[petsc-users] Viewing DM Vector stored on Multiple GPUs

[Ashwin Srinath]

Here's the error message in it's entirety:

Vec Object: 2 MPI processes
  type: mpicusp
[0]PETSC ERROR: --------------------- Error Message
--------------------------------------------------------------
[0]PETSC ERROR: Null argument, when expecting valid pointer
[0]PETSC ERROR: Trying to copy from a null pointer
[0]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for
trouble shooting.
[0]PETSC ERROR: Petsc Development GIT revision: v3.4.4-4683-ga6c8f22  GIT
Date: 2014-06-24 11:28:06 -0500
[0]PETSC ERROR: /newscratch/atrikut/issue/main on a arch-linux2-cxx-debug
named node1774 by atrikut Tue Jun 24 21:59:13 2014
[0]PETSC ERROR: Configure options --with-cuda=1 --with-cusp=1
--with-cusp-dir=/home/atrikut/local/cusplibrary --with-thrust=1
--with-precision=double --with-cuda-arch=sm_21 --with-clanguage=cxx
--download-txpetscgpu=1 --with-shared-libraries=1
--with-cuda-dir=/opt/cuda-toolkit/5.5.22 --with-mpi-dir=/opt/mpich2/1.4
[0]PETSC ERROR: [1]PETSC ERROR: --------------------- Error Message
--------------------------------------------------------------
[1]PETSC ERROR: Null argument, when expecting valid pointer
[1]PETSC ERROR: Trying to copy from a null pointer
[1]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for
trouble shooting.
[1]PETSC ERROR: Petsc Development GIT revision: v3.4.4-4683-ga6c8f22  GIT
Date: 2014-06-24 11:28:06 -0500
[1]PETSC ERROR: /newscratch/atrikut/issue/main on a arch-linux2-cxx-debug
named node1774 by atrikut Tue Jun 24 21:59:13 2014
[1]PETSC ERROR: Configure options --with-cuda=1 --with-cusp=1
--with-cusp-dir=/home/atrikut/local/cusplibrary --with-thrust=1
--with-precision=double --with-cuda-arch=sm_21 --with-clanguage=cxx
--download-txpetscgpu=1 --with-shared-libraries=1
--with-cuda-dir=/opt/cuda-toolkit/5.5.22 --with-mpi-dir=/opt/mpich2/1.4
[1]PETSC ERROR: #1 PetscMemcpy() line 1892 in
/home/atrikut/local/petsc-dev/include/petscsys.h
[1]PETSC ERROR: #1 PetscMemcpy() line 1892 in
/home/atrikut/local/petsc-dev/include/petscsys.h
[0]PETSC ERROR: #2 VecScatterBegin_1() line 124 in
/home/atrikut/local/petsc-dev/include/../src/vec/vec/utils/vpscat.h
[0]PETSC ERROR: #3 VecScatterBegin() line 1724 in
/home/atrikut/local/petsc-dev/src/vec/vec/utils/vscat.c
[0]PETSC ERROR: #4 DMDAGlobalToNaturalBegin() line 171 in
/home/atrikut/local/petsc-dev/src/dm/impls/da/dagtol.c
#2 VecScatterBegin_1() line 124 in
/home/atrikut/local/petsc-dev/include/../src/vec/vec/utils/vpscat.h
[1]PETSC ERROR: #3 VecScatterBegin() line 1724 in
/home/atrikut/local/petsc-dev/src/vec/vec/utils/vscat.c
[0]PETSC ERROR: #5 VecView_MPI_DA() line 721 in
/home/atrikut/local/petsc-dev/src/dm/impls/da/gr2.c
[0]PETSC ERROR: [1]PETSC ERROR: #4 DMDAGlobalToNaturalBegin() line 171 in
/home/atrikut/local/petsc-dev/src/dm/impls/da/dagtol.c
[1]PETSC ERROR: #6 VecView() line 601 in
/home/atrikut/local/petsc-dev/src/vec/vec/interface/vector.c
#5 VecView_MPI_DA() line 721 in
/home/atrikut/local/petsc-dev/src/dm/impls/da/gr2.c
[1]PETSC ERROR: #6 VecView() line 601 in
/home/atrikut/local/petsc-dev/src/vec/vec/interface/vector.c
WARNING! There are options you set that were not used!
WARNING! could be spelling mistake, etc!
Option left: name:-vec_type value: cusp



On Tue, Jun 24, 2014 at 10:15 PM, Ashwin Srinath <ashwinsrnth at gmail.com>
wrote:

> Hello, petsc-users
>
> I'm having trouble *viewing* an mpicusp vector. Here's the simplest case
> that reproduces the problem:
>
> int main(int argc, char** argv) {
>
>         PetscInitialize(&argc, &argv, NULL, NULL);
>
>         DM da;
>         Vec V;
>
>         DMDACreate2d(   PETSC_COMM_WORLD,
>                         DM_BOUNDARY_NONE, DM_BOUNDARY_NONE,
>                         DMDA_STENCIL_BOX,
>                         5, 5,
>                         PETSC_DECIDE, PETSC_DECIDE,
>                         1,
>                         1,
>                         NULL, NULL,
>                         &da);
>
>         DMCreateGlobalVector(da, &V);
>
>         VecSet(V, 1);
>         VecView(V, PETSC_VIEWER_STDOUT_WORLD);
>
>         PetscFinalize();
>         return 0;
> }
>
> I get the error:
> [1]PETSC ERROR: Null argument, when expecting valid pointer
> [0]PETSC ERROR: Trying to copy from a null pointer
>
> I executed with the following command:
> mpiexec -n 2 ./main -dm_vec_type cusp -vec_type cusp
> Both GPUs are attached to two different processes.
>
> This program works fine for vecmpi vectors, i.e., -dm_vec_type mpi and
> -vec_type mpi. Also, I don't get an error unless I try to *view* the
> vector. Can someone please point out what I'm doing wrong?
>
> Thanks for your time,
> Ashwin Srinath
>
>
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/petsc-users/attachments/20140624/d3af7410/attachment.html>