Thanks, Barry.<br><br><div class="gmail_quote">On Wed, Feb 8, 2012 at 2:58 PM, Barry Smith <span dir="ltr"><<a href="mailto:bsmith@mcs.anl.gov">bsmith@mcs.anl.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
The "ghosted" forms of vectors is not supported currently with GPUs.<br>
<span class="HOEnZb"><font color="#888888"><br>
Barry<br>
</font></span><div class="HOEnZb"><div class="h5"><br>
On Feb 8, 2012, at 2:53 PM, recrusader wrote:<br>
<br>
> Dear PETSc developers,<br>
><br>
> I have FEM codes. It works very well in CPU computation.<br>
> Now, I add '-vec_type seqcusp -mat_type aijcusp' when running the<br>
> codes, I met the following errors. My question that whether there is<br>
> an example to demonstrate how to revise the codes for the conversion<br>
> from CPU to GPU.<br>
><br>
> In addition, 'seqcusp' and 'seqaijcusp' are used when vec and mat are<br>
> saved in one GPU card?<br>
><br>
> Thank you very much.<br>
><br>
> [0]PETSC ERROR: --------------------- Error Message<br>
> ------------------------------------<br>
> [0]PETSC ERROR: Invalid argument!<br>
> [0]PETSC ERROR: Vector type seqcusp does not have local representation!<br>
> [0]PETSC ERROR:<br>
> ------------------------------------------------------------------------<br>
> [0]PETSC ERROR: Petsc Release Version 3.2.0, Patch 3, Fri Sep 30<br>
> 10:28:33 CDT 2011<br>
> [0]PETSC ERROR: See docs/changes/index.html for recent updates.<br>
> [0]PETSC ERROR: See docs/faq.html for hints about trouble shooting.<br>
> [0]PETSC ERROR: See docs/index.html for manual pages.<br>
> [0]PETSC ERROR:<br>
> ------------------------------------------------------------------------<br>
> [0]PETSC ERROR:<br>
> /work/01820/ylu/libmesh_svn01232012/examples/myproj_sp1/myproj-opt on<br>
> a westmere- named <a href="http://c300-205.ls4.tacc.utexas.edu" target="_blank">c300-205.ls4.tacc.utexas.edu</a> by ylu Wed Feb 8<br>
> 14:34:46 2012<br>
> [0]PETSC ERROR: Libraries linked from<br>
> /opt/apps/intel11_1/mvapich2_1_6/petsc/3.2/westmere-cuda/lib<br>
> [0]PETSC ERROR: Configure run at Fri Dec 16 11:27:43 2011<br>
> [0]PETSC ERROR: Configure options --with-x=0 -with-pic<br>
> --with-external-packages-dir=/var/tmp/petsc-3.2-buildroot//opt/apps/intel11_1/mvapich2_1_6/petsc/3.2/externalpackages-cuda<br>
> --with-mpi-compilers=1 --with-mpi-dir=/opt/apps/intel11_1/mvapich2/1.6<br>
> --with-scalar-type=real --with-dynamic-loading=0<br>
> --with-shared-libraries=0 --with-chaco=1<br>
> --download-chaco=/home1/0000/build/rpms/SOURCES/petsc-externalpackages/Chaco-2.2.tar.gz<br>
> --with-spai=1 --download-spai=/home1/0000/build/rpms/SOURCES/petsc-externalpackages/spai_3.0-mar-06.tar.gz<br>
> --with-hypre=1 --download-hypre=/home1/0000/build/rpms/SOURCES/petsc-externalpackages/hypre-2.6.0b.tar.gz<br>
> --with-mumps=1 --download-mumps=/home1/0000/build/rpms/SOURCES/petsc-externalpackages/MUMPS_4.9.2.tar.gz<br>
> --with-scalapack=1<br>
> --download-scalapack=/home1/0000/build/rpms/SOURCES/petsc-externalpackages/scalapack.tgz<br>
> --with-blacs=1 --download-blacs=/home1/0000/build/rpms/SOURCES/petsc-externalpackages/blacs-dev.tar.gz<br>
> --with-spooles=1<br>
> --download-spooles=/home1/0000/build/rpms/SOURCES/petsc-externalpackages/spooles-2.2-dec-2008.tar.gz<br>
> --with-superlu=1<br>
> --download-superlu=/home1/0000/build/rpms/SOURCES/petsc-externalpackages/SuperLU_4.1-December_20_2010.tar.gz<br>
> --with-superlu_dist=1<br>
> --download-superlu_dist=/home1/0000/build/rpms/SOURCES/petsc-externalpackages/SuperLU_DIST_2.5-December_21_2010.tar.gz<br>
> --with-parmetis=1<br>
> --download-parmetis=/home1/0000/build/rpms/SOURCES/petsc-externalpackages/ParMetis-dev-p3.tar.gz<br>
> --with-debugging=no<br>
> --with-blas-lapack-dir=/opt/apps/intel/11.1/mkl/lib/em64t<br>
> --with-mpiexec=mpirun_rsh --with-cuda=1<br>
> --with-cuda-dir=/opt/apps/cuda/4.0/cuda/<br>
> --with-cusp-dir=/opt/apps/cuda/4.0/cuda/<br>
> --with-thrust-dir=/opt/apps/cuda/4.0/cuda/ --COPTFLAGS=-xW<br>
> --CXXOPTFLAGS=-xW --FOPTFLAGS=-xW<br>
> [0]PETSC ERROR:<br>
> ------------------------------------------------------------------------<br>
> [0]PETSC ERROR: VecGhostGetLocalForm() line 82 in<br>
> src/vec/vec/impls/mpi/commonmpvec.c<br>
> [0]PETSC ERROR: zero() line 974 in<br>
> "unknowndirectory/"/work/01820/ylu/libmesh_svn01232012/include/numerics/petsc_vector.h<br>
> application called MPI_Abort(comm=0x84000002, 62) - process 0<br>
><br>
> Best,<br>
> Yujie<br>
<br>
</div></div></blockquote></div><br>