<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-2">
<style type="text/css" style="display:none"><!--P{margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr" style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<p>Hello everyone,</p>
<p><br>
</p>
<p>I am trying to use PETSc with MUMPS in full openMP strategy motivated by data from
</p>
<p>SciPost Phys. 5, 045 (2018) which suggest that I can reduce RAM usage for particular system sizes in this way. </p>
<p>I cannot get it to work in the way it is described at </p>
<p><a href="https://www.mcs.anl.gov/petsc/petsc-current/docs/manualpages/Mat/MATSOLVERMUMPS.html">https://www.mcs.anl.gov/petsc/petsc-current/docs/manualpages/Mat/MATSOLVERMUMPS.html</a></p>
<p>Having configured PETSc with the following options: </p>
<p>Configure options --download-mpich --download-scalapack --download-cmake --with-openmp --download-metis --download-mumps --with-threadsafety --with-log=0 --with-debugging=0 --download-hwloc --with-blaslapack-dir=/opt/intel/Compiler/19.0/compilers_and_libraries_2019.4.243/linux/mkl
</p>
<p>(also with configured SLEPc which I need for shift-and-invert which requires LU decomposition from MUMPS) With OMP_NUM_THREADS=16 I execute:
</p>
<p>mpirun -n 2 ./my_program -mat_mumps_use_omp_threads 8</p>
<p>obtaining <br>
</p>
<p>[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------<br>
[0]PETSC ERROR: Argument out of range<br>
[0]PETSC ERROR: number of OpenMP threads 8 can not be < 1 or > the MPI shared memory communicator size 1</p>
<p>(...)<br>
</p>
<p>What should I do to be able to run the code with single (or few) MPI rank(s) and with MUMPS operating with 8 openMP threads? I will greatly appreciate any comments.</p>
<p><br>
</p>
<p>Thanks, Piotr<br>
</p>
<p><br>
</p>
<p><br>
</p>
<p><br>
</p>
<p><br>
<br>
</p>
</body>
</html>