<!-- BaNnErBlUrFlE-BoDy-start -->
<!-- Preheader Text : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">
Pierre, petec and slepc libraries are found in the spack directory, but libhpddm_petsc is not. So it is not built during the spack install process. .. . .. . ./opt/spack/linux-sles15-zen3/gcc-12. 3. 0/petsc-3. 21. 0-tdljbqbgvde4zv6jr6tf7bbpae3rfkyg/lib/libpetsc. so
</div>
<!-- Preheader Text : END -->
<!-- Email Banner : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerStart</div>
<!--[if ((ie)|(mso))]>
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="padding: 16px 0px 16px 0px; direction: ltr" ><tr><td>
<table border="0" cellspacing="0" cellpadding="0" style="padding: 0px 10px 5px 6px; width: 100%; border-radius:4px; border-top:4px solid #90a4ae;background-color:#D0D8DC;"><tr><td valign="top">
<table align="left" border="0" cellspacing="0" cellpadding="0" style="padding: 4px 8px 4px 8px">
<tr><td style="color:#000000; font-family: 'Arial', sans-serif; font-weight:bold; font-size:14px; direction: ltr">
This Message Is From an External Sender
</td></tr>
<tr><td style="color:#000000; font-weight:normal; font-family: 'Arial', sans-serif; font-size:12px; direction: ltr">
This message came from outside your organization.
</td></tr>
</table>
</td></tr></table>
</td></tr></table>
<![endif]-->
<![if !((ie)|(mso))]>
<div dir="ltr" id="pfptBannercr62h0d" style="all: revert !important; display:block !important; text-align: left !important; margin:16px 0px 16px 0px !important; padding:8px 16px 8px 16px !important; border-radius: 4px !important; min-width: 200px !important; background-color: #D0D8DC !important; background-color: #D0D8DC; border-top: 4px solid #90a4ae !important; border-top: 4px solid #90a4ae;">
<div id="pfptBannercr62h0d" style="all: unset !important; float:left !important; display:block !important; margin: 0px 0px 1px 0px !important; max-width: 600px !important;">
<div id="pfptBannercr62h0d" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-weight:bold !important; font-weight:bold; font-size:14px !important; line-height:18px !important; line-height:18px">
This Message Is From an External Sender
</div>
<div id="pfptBannercr62h0d" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-weight:normal; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-size:12px !important; line-height:18px !important; line-height:18px; margin-top:2px !important;">
This message came from outside your organization.
</div>
</div>
<div style="clear: both !important; display: block !important; visibility: hidden !important; line-height: 0 !important; font-size: 0.01px !important; height: 0px"> </div>
</div>
<![endif]>
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerEnd</div>
<!-- Email Banner : END -->
<!-- BaNnErBlUrFlE-BoDy-end -->
<html>
<head><!-- BaNnErBlUrFlE-HeAdEr-start -->
<style>
#pfptBannercr62h0d { all: revert !important; display: block !important;
visibility: visible !important; opacity: 1 !important;
background-color: #D0D8DC !important;
max-width: none !important; max-height: none !important }
.pfptPrimaryButtoncr62h0d:hover, .pfptPrimaryButtoncr62h0d:focus {
background-color: #b4c1c7 !important; }
.pfptPrimaryButtoncr62h0d:active {
background-color: #90a4ae !important; }
</style>
<!-- BaNnErBlUrFlE-HeAdEr-end -->
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Pierre,</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
petec and slepc libraries are found in the spack directory, but libhpddm_petsc is not. So it is not built during the spack install process.</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
... ...</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
./opt/spack/linux-sles15-zen3/gcc-12.3.0/petsc-3.21.0-tdljbqbgvde4zv6jr6tf7bbpae3rfkyg/lib/libpetsc.so</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
./var/spack/environments/demo1/.spack-env/._view/6rqhi7tgwui4fjo74fgkkyq4lklghged/lib/libpetsc.so</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
... ...</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
./opt/spack/linux-sles15-zen3/gcc-12.3.0/slepc-3.21.0-qhuhkznl5rlhqknsdqervlevup6xiuyt/lib/libslepc.so</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
./var/spack/environments/demo1/.spack-env/._view/6rqhi7tgwui4fjo74fgkkyq4lklghged/lib/libslepc.so</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Thanks,</div>
<div class="elementToProof" style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Cho</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Pierre Jolivet <pierre@joliv.et><br>
<b>Sent:</b> Wednesday, May 8, 2024 11:01 PM<br>
<b>To:</b> Ng, Cho-Kuen <cho@slac.stanford.edu><br>
<b>Cc:</b> petsc-users@mcs.anl.gov <petsc-users@mcs.anl.gov><br>
<b>Subject:</b> Re: [petsc-users] About PC hpddm</font>
<div> </div>
</div>
<div style="line-break:after-white-space"><br id="x_lineBreakAtBeginningOfMessage">
<div><br>
<blockquote type="cite">
<div>On 9 May 2024, at 6:31 AM, Ng, Cho-Kuen via petsc-users <petsc-users@mcs.anl.gov> wrote:</div>
<br class="x_Apple-interchange-newline">
<div>
<div dir="ltr" id="x_pfptBanner96eece0" style="writing-mode:revert!important; color:revert!important; font-family:revert!important; font-feature-settings:revert!important; font-kerning:revert!important; font-size:revert!important; font-size-adjust:revert!important; font-stretch:revert!important; font-style:revert!important; font-variant-alternates:revert!important; font-variant-caps:revert!important; font-variant-east-asian:revert!important; font-variant-ligatures:revert!important; font-variant-numeric:revert!important; font-weight:revert!important; text-orientation:revert!important; zoom:revert!important; letter-spacing:revert!important; text-autospace:revert!important; align-content:revert!important; align-items:revert!important; align-self:revert!important; background-attachment:revert!important; background-blend-mode:revert!important; background-image:revert!important; background-position:revert!important; background-repeat:revert!important; background-size:revert!important; border-collapse:revert!important; box-sizing:revert!important; break-after:revert!important; break-before:revert!important; break-inside:revert!important; caption-side:revert!important; clear:revert!important; clip:revert!important; column-count:revert!important; column-fill:revert!important; column-gap:revert!important; column-rule-color:revert!important; column-rule-style:revert!important; column-rule-width:revert!important; column-span:revert!important; column-width:revert!important; content:revert!important; counter-increment:revert!important; counter-reset:revert!important; empty-cells:revert!important; flex:revert!important; flex-flow:revert!important; float:revert!important; image-orientation:revert!important; isolation:revert!important; justify-content:revert!important; justify-items:revert!important; line-break:revert!important; line-height:revert!important; list-style:revert!important; mix-blend-mode:revert!important; object-fit:revert!important; object-position:revert!important; order:revert!important; orphans:revert!important; outline:revert!important; overflow:revert!important; position:revert!important; quotes:revert!important; tab-size:revert!important; table-layout:revert!important; text-align:left!important; text-decoration-color:revert!important; text-decoration:revert!important; text-decoration-style:revert!important; text-emphasis-color:revert!important; text-emphasis-style:revert!important; text-indent:revert!important; text-justify:revert!important; text-overflow:revert!important; text-transform:revert!important; text-underline-position:revert!important; vertical-align:revert!important; white-space:revert!important; widows:revert!important; word-break:revert!important; z-index:revert!important; border-spacing:revert!important">
<div id="x_pfptBanner96eece0" style="writing-mode:unset!important; color:unset!important; font-family:unset!important; font-feature-settings:unset!important; font-kerning:unset!important; font-size:unset!important; font-size-adjust:unset!important; font-stretch:unset!important; font-style:unset!important; font-variant-alternates:unset!important; font-variant-caps:unset!important; font-variant-east-asian:unset!important; font-variant-ligatures:unset!important; font-variant-numeric:unset!important; font-weight:unset!important; text-orientation:unset!important; zoom:unset!important; letter-spacing:unset!important; text-autospace:unset!important; align-content:unset!important; align-items:unset!important; align-self:unset!important; background:unset!important; background-blend-mode:unset!important; border-collapse:unset!important; border:unset!important; box-sizing:unset!important; break-after:unset!important; break-before:unset!important; break-inside:unset!important; caption-side:unset!important; clear:unset!important; clip:unset!important; column-count:unset!important; column-fill:unset!important; column-gap:unset!important; column-rule-color:unset!important; column-rule-style:unset!important; column-rule-width:unset!important; column-span:unset!important; column-width:unset!important; content:unset!important; counter-increment:unset!important; counter-reset:unset!important; empty-cells:unset!important; flex:unset!important; flex-flow:unset!important; float:left!important; image-orientation:unset!important; isolation:unset!important; justify-content:unset!important; justify-items:unset!important; line-break:unset!important; line-height:unset!important; list-style:unset!important; mix-blend-mode:unset!important; object-fit:unset!important; object-position:unset!important; order:unset!important; orphans:unset!important; outline:unset!important; overflow:unset!important; position:unset!important; quotes:unset!important; tab-size:unset!important; table-layout:unset!important; text-align:unset!important; text-decoration-color:unset!important; text-decoration:unset!important; text-decoration-style:unset!important; text-emphasis-color:unset!important; text-emphasis-style:unset!important; text-indent:unset!important; text-justify:unset!important; text-overflow:unset!important; text-transform:unset!important; text-underline-position:unset!important; vertical-align:unset!important; white-space:unset!important; widows:unset!important; word-break:unset!important; z-index:unset!important; border-spacing:unset!important">
<div id="x_pfptBanner96eece0" style="writing-mode:unset!important; font-family:Arial,sans-serif!important; font-feature-settings:unset!important; font-kerning:unset!important; font-size:14px!important; font-size-adjust:unset!important; font-stretch:unset!important; font-style:unset!important; font-variant-alternates:unset!important; font-variant-caps:unset!important; font-variant-east-asian:unset!important; font-variant-ligatures:unset!important; font-variant-numeric:unset!important; font-weight:bold!important; text-orientation:unset!important; zoom:unset!important; letter-spacing:unset!important; align-content:unset!important; align-items:unset!important; align-self:unset!important; background-attachment:unset!important; background-blend-mode:unset!important; background-image:unset!important; background-position:unset!important; background-repeat:unset!important; background-size:unset!important; border-collapse:unset!important; border:unset!important; box-sizing:unset!important; break-after:unset!important; break-before:unset!important; break-inside:unset!important; caption-side:unset!important; clear:unset!important; clip:unset!important; column-count:unset!important; column-fill:unset!important; column-gap:unset!important; column-rule-color:unset!important; column-rule-style:unset!important; column-rule-width:unset!important; column-span:unset!important; column-width:unset!important; content:unset!important; counter-increment:unset!important; counter-reset:unset!important; empty-cells:unset!important; flex:unset!important; flex-flow:unset!important; float:unset!important; image-orientation:unset!important; isolation:unset!important; justify-content:unset!important; justify-items:unset!important; line-break:unset!important; line-height:18px!important; list-style:unset!important; mix-blend-mode:unset!important; object-fit:unset!important; object-position:unset!important; order:unset!important; orphans:unset!important; outline:unset!important; overflow:unset!important; position:unset!important; quotes:unset!important; tab-size:unset!important; table-layout:unset!important; text-align:unset!important; text-decoration-color:unset!important; text-decoration:unset!important; text-decoration-style:unset!important; text-emphasis-color:unset!important; text-emphasis-style:unset!important; text-indent:unset!important; text-overflow:unset!important; text-transform:unset!important; text-underline-position:unset!important; vertical-align:unset!important; white-space:unset!important; widows:unset!important; word-break:unset!important; z-index:unset!important; border-spacing:unset!important; word-spacing:unset!important; background-clip:unset!important; background-origin:unset!important; box-shadow:unset!important; text-combine-upright:unset!important">
This Message Is From an External Sender</div>
<div id="x_pfptBanner96eece0" style="writing-mode:unset!important; font-family:Arial,sans-serif!important; font-feature-settings:unset!important; font-kerning:unset!important; font-size:12px!important; font-size-adjust:unset!important; font-stretch:unset!important; font-style:unset!important; font-variant-alternates:unset!important; font-variant-caps:unset!important; font-variant-east-asian:unset!important; font-variant-ligatures:unset!important; font-variant-numeric:unset!important; font-weight:unset!important; text-orientation:unset!important; zoom:unset!important; letter-spacing:unset!important; align-content:unset!important; align-items:unset!important; align-self:unset!important; background-attachment:unset!important; background-blend-mode:unset!important; background-image:unset!important; background-position:unset!important; background-repeat:unset!important; background-size:unset!important; border-collapse:unset!important; border:unset!important; box-sizing:unset!important; break-after:unset!important; break-before:unset!important; break-inside:unset!important; caption-side:unset!important; clear:unset!important; clip:unset!important; column-count:unset!important; column-fill:unset!important; column-gap:unset!important; column-rule-color:unset!important; column-rule-style:unset!important; column-rule-width:unset!important; column-span:unset!important; column-width:unset!important; content:unset!important; counter-increment:unset!important; counter-reset:unset!important; empty-cells:unset!important; flex:unset!important; flex-flow:unset!important; float:unset!important; image-orientation:unset!important; isolation:unset!important; justify-content:unset!important; justify-items:unset!important; line-break:unset!important; line-height:18px!important; list-style:unset!important; mix-blend-mode:unset!important; object-fit:unset!important; object-position:unset!important; order:unset!important; orphans:unset!important; outline:unset!important; overflow:unset!important; position:unset!important; quotes:unset!important; tab-size:unset!important; table-layout:unset!important; text-align:unset!important; text-decoration-color:unset!important; text-decoration:unset!important; text-decoration-style:unset!important; text-emphasis-color:unset!important; text-emphasis-style:unset!important; text-indent:unset!important; text-overflow:unset!important; text-transform:unset!important; text-underline-position:unset!important; vertical-align:unset!important; white-space:unset!important; widows:unset!important; word-break:unset!important; z-index:unset!important; border-spacing:unset!important; word-spacing:unset!important; background-clip:unset!important; background-origin:unset!important; box-shadow:unset!important; text-combine-upright:unset!important">
This message came from outside your organization.</div>
</div>
<div style="height:0px; clear:both!important; display:block!important; visibility:hidden!important; line-height:0!important; font-size:0.01px!important">
</div>
</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
I used spack to install petsc with hpddm as follows.</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
<br>
</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
o spack install petsc+hpddm</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
o spack install slepc ^petsc+hpddm</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
<br>
</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
I got the following runtime error of finding the library hpddm_petsc.</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
<br>
</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
argv0 -ksp_converged_reason -ksp_view_final_residual -ksp_type gmres -pc_type hpddm -ksp_monitor -log_view -options_left -device_view </div>
<div style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
$$$$$$$$$$$$$$ buildmatrix petsc </div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
[6]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------</div>
<div style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
[6]PETSC ERROR: Petsc has generated inconsistent data</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
[6]PETSC ERROR: /global/cfs/cdirs/ace3p/software/spack/var/spack/environments/demo1/.spack-env/view/lib/libhpddm_petsc not found</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
<br>
</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
Is there something wrong with the install procedure?</div>
</div>
</blockquote>
<div><br>
</div>
<div>The command lines look OK to me (but I don’t know Spack).</div>
<div>I’m not sure where things are being installed.</div>
<div>Could you please send the path to:</div>
<div>1) libpetsc.so</div>
<div>2) libslepc.so</div>
<div>3) libhpddm_petsc.so</div>
<div>If there is a mismatch between some of these, you may want to set the environment variable SLEPC_DIR or the command line parameter -hpddm_dir.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Pierre</div>
<br>
<blockquote type="cite">
<div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
Thanks,</div>
<div class="x_elementToProof" style="font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
Cho</div>
</div>
</blockquote>
</div>
<br>
</div>
</body>
</html>