<html><head></head><body><div style="font-family: Verdana;font-size: 12.0px;"><div>
<div>Thanks. I had addtionally to change <span style="white-space: pre-wrap;"> MatDenseGet/RestoreArrayRead(B,&barray); to MatDenseGet/RestoreArray(B,&barray); as I got </span></div>
<div> </div>
<div><span style="white-space: pre-wrap;">[1]PETSC ERROR: No support for this operation for this object type<br/>
[1]PETSC ERROR: Cannot locate function MatDenseRestoreArrayRead_C in object<br/>
[1]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.<br/>
[1]PETSC ERROR: Petsc Development GIT revision: v3.9.3-1202-ge6d955127a GIT Date: 2018-08-23 16:59:59 -0500<br/>
<br/>
[1]PETSC ERROR: #1 MatDenseRestoreArrayRead() line 1848 in /home/marius/prog/petsc/petsc/src/mat/impls/dense/seq/dense.c<br/>
[2]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------<br/>
[2]PETSC ERROR: No support for this operation for this object type<br/>
[2]PETSC ERROR: Cannot locate function MatDenseRestoreArrayRead_C in object<br/>
[2]PETSC ERROR: See http://www.mcs.anl.gov/petsc/documentation/faq.html for trouble shooting.<br/>
[2]PETSC ERROR: Petsc Development GIT revision: v3.9.3-1202-ge6d955127a GIT Date: 2018-08-23 16:59:59 -0500<br/>
<br/>
[2]PETSC ERROR: #1 MatDenseRestoreArrayRead() line 1848 in /home/marius/prog/petsc/petsc/src/mat/impls/dense/seq/dense.c<br/>
[2]PETSC ERROR: #2 MatDenseRestoreArrayRead_MPIDense() line 270 in /home/marius/prog/petsc/petsc/src/mat/impls/dense/mpi/mpidense.c<br/>
[2]PETSC ERROR: #3 MatDenseRestoreArrayRead() line 1848 in /home/marius/prog/petsc/petsc/src/mat/impls/dense/seq/dense.c</span></div>
<div> </div>
<div> </div>
<div>One more question, do I need to use MATAIJMKL as matrix type? It seems to work fine with MATAIJ. And another odd thing I realized is that when I use MatAXPY on two MATAIJMKL wit DIFFERENT_NONZERO_PATTERN the resulting matrix Y is of type MATAIJ.</div>
<div> </div>
<div>best,</div>
<div>Marius</div>
<div> </div>
<div> </div>
<div name="quote" style="margin:10px 5px 5px 10px; padding: 10px 0 10px 10px; border-left:2px solid #C3D9E5; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">
<div name="quoted-content">Marius,<br/>
<br/>
Try editing src/mat/impls/aij/mpi/mkl_cpardiso/mkl_cpardiso.c at the subroutine MatMatSolve_MKL_CPARDISO() and remove the lines<br/>
<br/>
ierr = PetscObjectTypeCompare((PetscObject)B,MATSEQDENSE,&flg);CHKERRQ(ierr);<br/>
if (!flg) SETERRQ(PetscObjectComm((PetscObject)A),PETSC_ERR_ARG_WRONG,"Matrix B must be MATSEQDENSE matrix");<br/>
ierr = PetscObjectTypeCompare((PetscObject)X,MATSEQDENSE,&flg);CHKERRQ(ierr);<br/>
if (!flg) SETERRQ(PetscObjectComm((PetscObject)A),PETSC_ERR_ARG_WRONG,"Matrix X must be MATSEQDENSE matrix");<br/>
<br/>
Run<br/>
<br/>
make gnumake<br/>
<br/>
then try compiling and running your application again.<br/>
<br/>
Barry<br/>
<br/>
It could be that this code was cut and pasted from some other solver (Mumps) and hence has checks for SEQDENSE that are not needed for MKL_CPARDISO.<br/>
<br/>
<br/>
> On Aug 31, 2018, at 2:03 AM, Marius Buerkle <mbuerkle@web.de> wrote:<br/>
><br/>
> Hi !<br/>
><br/>
> I tried to use MKL_CPARDISO solver in parallel but I get the following error<br/>
><br/>
> [0]PETSC ERROR: Invalid argument<br/>
> [0]PETSC ERROR: Matrix B must be MATSEQDENSE matrix<br/>
> [0]PETSC ERROR: See <a href="http://www.mcs.anl.gov/petsc/documentation/faq.html" target="_blank">http://www.mcs.anl.gov/petsc/documentation/faq.html</a> for trouble shooting.<br/>
> [0]PETSC ERROR: Petsc Development GIT revision: v3.9.3-1202-ge6d955127a GIT Date: 2018-08-23 16:59:59 -0500<br/>
> [0]PETSC ERROR: /home/marius/prog/ownstuff/fortran/programs/transomat_dev/transomat/transomat on a named tono-hpc1 by marius Fri Aug 31 15:57:15 2018<br/>
> [0]PETSC ERROR: Configure options --prefix=/home/marius/prog/petsc/master_opt --with-64-bit-indices=0 --CC=mpicc --COPTFLAGS="-O3 -march=native -g -std=c11" --CXX=mpicxx --CXXOPTFLAGS="-O3 -march=native -g -std=c++11" --FC=mpiifort --FOPTFLAGS="-O2 -xHost -g" --with-mpi=1 --with-x=1 --download-parmetis=yes --download-metis=yes --download-ptscotch=yes --download-scotch=yes --download-mumps=yes --with-blaslapack-lib="-L/home/marius/intel/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_blacs_intelmpi_lp64 -liomp5 -lpthread -lm -ldl" --with-scalapack-lib="-L/home/marius/intel/compilers_and_libraries_2018.3.222/linux/mkl/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_blacs_intelmpi_lp64 -liomp5 -lpthread -lm -ldl" --download-pastix=no --download-superlu_dist=yes --download-superlu_dist-commit=803c8ab665b33e9136b199c4521be465e026bb0d --download-hwloc=yes --with-mkl_pardiso-dir=/home/marius/intel/compilers_and_libraries_2018.3.222/linux/mkl --with-openmp=0 --with-pthread=0 --download-elemental=yes --download-elemental-commit=de7b5bea1abf5f626b91582f742cf99e2e551bff --with-mkl_cpardiso-dir=/home/marius/intel/compilers_and_libraries_2018.3.222/linux/mkl --with-mkl_sparse_optimize-dir=/home/marius/intel/compilers_and_libraries_2018.3.222/linux/mkl --with-mkl_sparse_sp2m-dir=/home/marius/intel/compilers_and_libraries_2018.3.222/linux/mkl --download-sowing=yes --with-cxx-dialect=c++11 --with-scalar-type=complex --with-debugging=0<br/>
> [0]PETSC ERROR: #1 MatMatSolve_MKL_CPARDISO() line 319 in /home/marius/prog/petsc/petsc/src/mat/impls/aij/mpi/mkl_cpardiso/mkl_cpardiso.c<br/>
> [0]PETSC ERROR: #2 MatMatSolve() line 3385 in /home/marius/prog/petsc/petsc/src/mat/interface/matrix.c<br/>
><br/>
><br/>
> I wonder isn't CPARDISO supposed to work with MATMPIDENSE ?<br/>
><br/>
> best,<br/>
> marius<br/>
</div>
</div>
</div></div></body></html>