<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<div dir="ltr">
<div>Myriam,<br>
</div>
- PETSc 3.6.4 (reference)<br>
- PETSc 3.10.4 without specific options<br>
- PETSc 3.10.4 with the three scalability options you mentionned<br>
<div>What are the 'three scalability options' here? </div>
<div>What is "MaxMemRSS", the max memory used by a single core? How many cores do you start with?<br>
</div>
<div><br>
</div>
<div>Do you have 'execution time scalability' plot?</div>
<div>Hong</div>
<div><br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, Mar 27, 2019 at 8:47 AM Mark Adams via petsc-dev <<a href="mailto:petsc-dev@mcs.anl.gov">petsc-dev@mcs.anl.gov</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">So is this the instructions that I should give him? This grad student is a quick study but he has not computing background. So we don't care what we use, we just want to work (easily).
<div><br>
</div>
<div>Thanks</div>
<div><br>
</div>
<div>
<div>Do not use "--download-fblaslapack=1". Set it to 0. Same for "--download-mpich=1".</div>
<div><br>
</div>
<div>Now do:</div>
<div><br>
</div>
<div>
<div>
<div>> module load mkl</div>
<div><br>
</div>
<div>> export BLAS_LAPACK_LOAD=--with-blas-lapack-dir=${MKLROOT}</div>
</div>
<div><br>
</div>
<div>
<div>> export PETSC_MPICH_HOME="${MPICH_HOME}"</div>
<div><br>
</div>
</div>
</div>
<div>And use </div>
<div><br>
</div>
<div>--with-cc=${MPICH_HOME}/mpicc --with-cxx=${MPICH_HOME}/mpicxx --with-fc=${MPICH_HOME}/mpif90</div>
<div><br>
</div>
<div>instead of clang++</div>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, Mar 27, 2019 at 9:30 AM Matthew Knepley <<a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div dir="ltr">On Wed, Mar 27, 2019 at 8:55 AM Victor Eijkhout via petsc-dev <<a href="mailto:petsc-dev@mcs.anl.gov" target="_blank">petsc-dev@mcs.anl.gov</a>> wrote:<br>
</div>
<div class="gmail_quote">
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<div>
<blockquote type="cite">
<div>On Mar 27, 2019, at 7:29 AM, Mark Adams <<a href="mailto:mfadams@lbl.gov" target="_blank">mfadams@lbl.gov</a>> wrote:</div>
<br class="gmail-m_8679624314341790787gmail-m_-7017015211972663507gmail-m_-2005668685365883435Apple-interchange-newline">
<div><span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline">How
should he configure to this? remove "--download-fblaslapack=1" and add ....</span></div>
</blockquote>
</div>
<br>
<div>1. If using gcc</div>
<div><br>
</div>
<div>
<div>module load mkl</div>
<div><br>
</div>
<div>with either compiler:</div>
<div><br>
</div>
<div>export BLAS_LAPACK_LOAD=--with-blas-lapack-dir=${MKLROOT}</div>
</div>
<div><br>
</div>
<div>2. We define MPICH_HOME for you.</div>
<div><br>
</div>
<div>With Intel MPI:</div>
<div><br>
</div>
<div>
<div> export PETSC_MPICH_HOME="${MPICH_HOME}/intel64"</div>
<div> export mpi="--with-mpi-compilers=1 --with-mpi-include=${TACC_IMPI_INC} --with-mpi-lib=${TACC_IMPI_LIB}/release_mt/libmpi.so”</div>
<div><br>
</div>
<div>with mvapich:</div>
<div><br>
</div>
<div> export PETSC_MPICH_HOME="${MPICH_HOME}"</div>
<div> export mpi="--with-mpi-compilers=1 --with-mpi-dir=${PETSC_MPICH_HOME}”</div>
</div>
<div><br>
</div>
<div>(looks like a little redundancy in my script)</div>
</div>
</blockquote>
<div><br>
</div>
<div>I think Satish now prefers</div>
<div><br>
</div>
<div> --with-cc=${MPICH_HOME}/mpicc --with-cxx=${MPICH_HOME}/mpicxx --with-fc=${MPICH_HOME}/mpif90</div>
<div><br>
</div>
<div> Thanks,</div>
<div><br>
</div>
<div> Matt</div>
<div> </div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<div>Victor.</div>
<div><br>
</div>
</div>
</blockquote>
</div>
<br clear="all">
<div><br>
</div>
-- <br>
<div dir="ltr" class="gmail-m_8679624314341790787gmail-m_-7017015211972663507gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>
-- Norbert Wiener</div>
<div><br>
</div>
<div><a href="http://www.cse.buffalo.edu/~knepley/" target="_blank">https://www.cse.buffalo.edu/~knepley/</a><br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</blockquote>
</div>
</body>
</html>