<!-- BaNnErBlUrFlE-BoDy-start -->
<!-- Preheader Text : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">
Hi Matt, I have attached the configuration file below. Thanks, Matt On 25 Jul 2024, at 11: 26 AM, Matthew Knepley <knepley@ gmail. com> wrote: On Wed, Jul 24, 2024 at 8: 37 PM Matthew Thomas <matthew. thomas1@ anu. edu. au> wrote: Hello
</div>
<!-- Preheader Text : END -->
<!-- Email Banner : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerStart</div>
<!--[if ((ie)|(mso))]>
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="padding: 16px 0px 16px 0px; direction: ltr" ><tr><td>
<table border="0" cellspacing="0" cellpadding="0" style="padding: 0px 10px 5px 6px; width: 100%; border-radius:4px; border-top:4px solid #90a4ae;background-color:#D0D8DC;"><tr><td valign="top">
<table align="left" border="0" cellspacing="0" cellpadding="0" style="padding: 4px 8px 4px 8px">
<tr><td style="color:#000000; font-family: 'Arial', sans-serif; font-weight:bold; font-size:14px; direction: ltr">
This Message Is From an External Sender
</td></tr>
<tr><td style="color:#000000; font-weight:normal; font-family: 'Arial', sans-serif; font-size:12px; direction: ltr">
This message came from outside your organization.
</td></tr>
</table>
</td></tr></table>
</td></tr></table>
<![endif]-->
<![if !((ie)|(mso))]>
<div dir="ltr" id="pfptBannerb43gw4g" style="all: revert !important; display:block !important; text-align: left !important; margin:16px 0px 16px 0px !important; padding:8px 16px 8px 16px !important; border-radius: 4px !important; min-width: 200px !important; background-color: #D0D8DC !important; background-color: #D0D8DC; border-top: 4px solid #90a4ae !important; border-top: 4px solid #90a4ae;">
<div id="pfptBannerb43gw4g" style="all: unset !important; float:left !important; display:block !important; margin: 0px 0px 1px 0px !important; max-width: 600px !important;">
<div id="pfptBannerb43gw4g" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-weight:bold !important; font-weight:bold; font-size:14px !important; line-height:18px !important; line-height:18px">
This Message Is From an External Sender
</div>
<div id="pfptBannerb43gw4g" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-weight:normal; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-size:12px !important; line-height:18px !important; line-height:18px; margin-top:2px !important;">
This message came from outside your organization.
</div>
</div>
<div style="clear: both !important; display: block !important; visibility: hidden !important; line-height: 0 !important; font-size: 0.01px !important; height: 0px"> </div>
</div>
<![endif]>
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerEnd</div>
<!-- Email Banner : END -->
<!-- BaNnErBlUrFlE-BoDy-end -->
<html>
<head><!-- BaNnErBlUrFlE-HeAdEr-start -->
<style>
#pfptBannerb43gw4g { all: revert !important; display: block !important;
visibility: visible !important; opacity: 1 !important;
background-color: #D0D8DC !important;
max-width: none !important; max-height: none !important }
.pfptPrimaryButtonb43gw4g:hover, .pfptPrimaryButtonb43gw4g:focus {
background-color: #b4c1c7 !important; }
.pfptPrimaryButtonb43gw4g:active {
background-color: #90a4ae !important; }
</style>
<!-- BaNnErBlUrFlE-HeAdEr-end -->
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<div style="line-break:after-white-space">Hi Matt,
<div><br>
</div>
<div>I have attached the configuration file below.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Matt</div>
<div><br>
</div>
<div><br>
</div>
<div></div>
</div>
<div style="line-break:after-white-space">
<div><br id="x_lineBreakAtBeginningOfMessage">
<div><br>
<blockquote type="cite">
<div>On 25 Jul 2024, at 11:26 AM, Matthew Knepley <knepley@gmail.com> wrote:</div>
<br class="x_Apple-interchange-newline">
<div>
<div dir="ltr" style="font-family:Helvetica; font-size:12px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none">
<div dir="ltr">On Wed, Jul 24, 2024 at 8:37 PM Matthew Thomas <<a href="mailto:matthew.thomas1@anu.edu.au">matthew.thomas1@anu.edu.au</a>> wrote:<br>
</div>
<div class="x_gmail_quote">
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left-width:1px; border-left-style:solid; border-left-color:rgb(204,204,204); padding-left:1ex">
<div>Hello Matt,
<div><br>
</div>
<div>Thanks for the help. I believe the problem is coming from an incorrect linking with MPI and PETSc. </div>
<div><br>
</div>
<div>I tried running with petscmpiexec from <span style="font-family:Menlo; font-size:11px">$PETSC_DIR/lib/petsc/bin/petscmpiexec.</span><font><span> This gave me the error </span></font></div>
<div><span style="font-family:Menlo; font-size:11px"><br>
</span></div>
<div><span style="font-family:Menlo; font-size:11px">Error build location not found! Please set PETSC_DIR and PETSC_ARCH correctly for this build.</span>
<div><br>
</div>
<div><br>
</div>
<div>Naturally I have set these two values and echo $PETSC_DIR gives the path I expect, so it seems like I am running my programs with a different version of MPI than petsc expects which could explain the memory usage.</div>
<div><br>
</div>
<div>Do you have any ideas how to fix this?</div>
</div>
</div>
</blockquote>
<div><br>
</div>
<div>Yes. First we determine what MPI you configured with. Send configure.log, which has this information.</div>
<div><br>
</div>
<div> Thanks,</div>
<div><br>
</div>
<div> Matt</div>
<div> </div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left-width:1px; border-left-style:solid; border-left-color:rgb(204,204,204); padding-left:1ex">
<div>
<div>
<div>Thanks,</div>
<div>Matt</div>
<div><br>
<blockquote type="cite">
<div>On 24 Jul 2024, at 8:41 PM, Matthew Knepley <<a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>> wrote:</div>
<br>
<div>
<table border="0" cellspacing="0" cellpadding="0" width="100%" align="left" style="font-family:Helvetica; letter-spacing:normal; text-transform:none; word-spacing:0px; text-decoration:none; border:0px; display:table; width:764px; table-layout:fixed; float:none">
<tbody style="display:block">
<tr>
<td valign="middle" width="1px" bgcolor="#A6A6A6" cellpadding="7px 2px 7px 2px" style="padding:7px 2px; background-color:rgb(166,166,166)">
</td>
<td valign="middle" width="100%" bgcolor="#EAEAEA" cellpadding="7px 5px 7px 15px" style="width:730px; background-color:rgb(234,234,234); padding:7px 5px 7px 15px; font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif; font-size:12px; font-weight:normal; color:rgb(33,33,33); text-align:left">
<div>You don't often get email from<span> </span><a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>.<span> </span><a href="https://urldefense.us/v3/__https://aka.ms/LearnAboutSenderIdentification__;!!G_uCfscf7eWS!dRBUqYBDOj9QHmnycbLUuktH6lG_1402EZUstkt_mXuc_Qjt6o_CVNgqncZyn7znHJWBTI0ASPvo3VLgqx-G5FI3ovuhtWw4Xcs$" target="_blank">Learn why this is important</a></div>
</td>
<td valign="middle" align="left" width="75px" bgcolor="#EAEAEA" cellpadding="7px 5px 7px 5px" style="width:75px; background-color:rgb(234,234,234); padding:7px 5px; font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif; font-size:12px; font-weight:normal; color:rgb(33,33,33); text-align:left">
</td>
</tr>
</tbody>
</table>
<div style="font-family:Helvetica; font-size:12px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none">
<div dir="ltr">
<div dir="ltr">On Tue, Jul 23, 2024 at 8:02 PM Matthew Thomas <<a href="mailto:matthew.thomas1@anu.edu.au" target="_blank">matthew.thomas1@anu.edu.au</a>> wrote:<br>
</div>
<div class="x_gmail_quote">
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left-width:1px; border-left-style:solid; border-left-color:rgb(204,204,204); padding-left:1ex">
<div>
<div>Hello Matt,
<div><br>
</div>
<div>I have attached the output with mat_view for 8 and 40 processors.</div>
<div><br>
</div>
<div>I am unsure what is meant by the matrix communicator and the partitioning. I am using the default behaviour in every case. How can I find this information?</div>
</div>
</div>
</blockquote>
<div><br>
</div>
<div>This shows that the matrix is taking the same amount of memory for 8 and 40 procs, so that is not your problem. Also,</div>
<div>it is a very small amount of memory:</div>
<div><br>
</div>
<div> 100K rows x 3 nz/row x 8 bytes/nz = 2.4 MB</div>
<div><br>
</div>
<div>and 50% overhead for indexing, so something under 4MB. I am not sure what is taking up the rest of the memory, but I do not</div>
<div>think it is PETSc from the log you included.</div>
<div><br>
</div>
<div> Thanks,</div>
<div><br>
</div>
<div> Matt</div>
<div> </div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left-width:1px; border-left-style:solid; border-left-color:rgb(204,204,204); padding-left:1ex">
<div>
<div>
<div>I have attached the log view as well if that helps.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Matt</div>
<div><br>
</div>
<div><br>
</div>
<div></div>
</div>
<div>
<div></div>
</div>
<div>
<div></div>
</div>
<div>
<div><br id="x_m_6493108037936797122m_8563020562509820717x_lineBreakAtBeginningOfMessage">
<div><br>
<blockquote type="cite">
<div>On 23 Jul 2024, at 9:24 PM, Matthew Knepley <<a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>> wrote:</div>
<br>
<div>
<table border="0" cellspacing="0" cellpadding="0" width="100%" align="left" style="font-family:Helvetica; letter-spacing:normal; text-transform:none; word-spacing:0px; text-decoration:none; border:0px; display:table; width:764px; table-layout:fixed; float:none">
<tbody style="display:block">
<tr>
<td valign="middle" width="1px" bgcolor="#A6A6A6" cellpadding="7px 2px 7px 2px" style="padding:7px 2px; background-color:rgb(166,166,166)">
</td>
<td valign="middle" width="100%" bgcolor="#EAEAEA" cellpadding="7px 5px 7px 15px" style="width:730px; background-color:rgb(234,234,234); padding:7px 5px 7px 15px; font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif; font-size:12px; font-weight:normal; color:rgb(33,33,33); text-align:left">
<div>You don't often get email from<span> </span><a href="mailto:knepley@gmail.com" target="_blank">knepley@gmail.com</a>.<span> </span><a href="https://urldefense.us/v3/__https://aka.ms/LearnAboutSenderIdentification__;!!G_uCfscf7eWS!dRBUqYBDOj9QHmnycbLUuktH6lG_1402EZUstkt_mXuc_Qjt6o_CVNgqncZyn7znHJWBTI0ASPvo3VLgqx-G5FI3ovuhtWw4Xcs$" target="_blank">Learn why this is important</a></div>
</td>
<td valign="middle" align="left" width="75px" bgcolor="#EAEAEA" cellpadding="7px 5px 7px 5px" style="width:75px; background-color:rgb(234,234,234); padding:7px 5px; font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif; font-size:12px; font-weight:normal; color:rgb(33,33,33); text-align:left">
</td>
</tr>
</tbody>
</table>
<div style="font-family:Helvetica; font-size:12px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none">
<div dir="ltr">Also, you could run with
<div><br>
</div>
<div> -mat_view ::ascii_info_detail</div>
<div><br>
</div>
<div>and send the output for both cases. The storage of matrix values is not redundant, so something else is</div>
<div>going on. First, what communicator do you use for the matrix, and what partitioning?</div>
<div><br>
</div>
<div> Thanks,</div>
<div><br>
</div>
<div> Matt</div>
</div>
<br>
<div>
<div dir="ltr">On Mon, Jul 22, 2024 at 10:27 PM Barry Smith <<a href="mailto:bsmith@petsc.dev" target="_blank">bsmith@petsc.dev</a>> wrote:<br>
</div>
<blockquote style="margin:0px 0px 0px 0.8ex; border-left-width:1px; border-left-style:solid; border-left-color:rgb(204,204,204); padding-left:1ex">
<div><u></u>
<div dir="ltr" id="x_m_6493108037936797122m_8563020562509820717x_m_-757208929489082788pfptBannerabjvbfv" style="display:block; text-align:left; margin:16px 0px; padding:8px 16px; border-radius:4px; min-width:200px; background-color:rgb(208,216,220); border-top-width:4px; border-top-style:solid; border-top-color:rgb(144,164,174)">
<div id="x_m_6493108037936797122m_8563020562509820717x_m_-757208929489082788pfptBannerabjvbfv" style="float:left; display:block; margin:0px 0px 1px; max-width:600px">
<div id="x_m_6493108037936797122m_8563020562509820717x_m_-757208929489082788pfptBannerabjvbfv" style="display:block; background-color:rgb(208,216,220); font-family:Arial,sans-serif; font-weight:bold; font-size:14px; line-height:18px">
This Message Is From an External Sender<span> </span></div>
<div id="x_m_6493108037936797122m_8563020562509820717x_m_-757208929489082788pfptBannerabjvbfv" style="font-weight:normal; display:block; background-color:rgb(208,216,220); font-family:Arial,sans-serif; font-size:12px; line-height:18px; margin-top:2px">
This message came from outside your organization.<span> </span></div>
</div>
<div style="height:0px; clear:both; display:block; line-height:0; font-size:0.01px">
</div>
</div>
<u></u>
<div>
<div><br>
</div>
Send the code.<br id="x_m_6493108037936797122m_8563020562509820717x_m_-757208929489082788lineBreakAtBeginningOfMessage">
<div><br>
<blockquote type="cite">
<div>On Jul 22, 2024, at 9:18 PM, Matthew Thomas via petsc-users <<a href="mailto:petsc-users@mcs.anl.gov" target="_blank">petsc-users@mcs.anl.gov</a>> wrote:</div>
<br>
<div>
<div dir="ltr" id="x_m_6493108037936797122m_8563020562509820717x_m_-757208929489082788pfptBanner73s8h0l" style="writing-mode:revert; color:revert; font-family:revert; font-feature-settings:revert; font-kerning:revert; font-size:revert; font-stretch:revert; font-variant-alternates:revert; font-variant-caps:revert; font-variant-east-asian:revert; font-variant-ligatures:revert; font-variant-numeric:revert; font-weight:revert; text-orientation:revert; zoom:revert; letter-spacing:revert; background-blend-mode:revert; background-image:revert; background-position:revert; background-repeat:revert; background-size:revert; border-collapse:revert; box-sizing:revert; break-after:revert; break-before:revert; break-inside:revert; caption-side:revert; clear:revert; column-width:revert; column-count:revert; column-fill:revert; column-gap:revert; column-rule-width:revert; column-rule-style:revert; column-rule-color:revert; column-span:revert; empty-cells:revert; float:revert; image-orientation:revert; isolation:revert; line-break:revert; line-height:revert; list-style:revert; mix-blend-mode:revert; object-fit:revert; object-position:revert; outline:revert; overflow:revert; quotes:revert; table-layout:revert; text-align:left; text-decoration:revert; text-emphasis-style:revert; text-emphasis-color:revert; text-indent:revert; text-overflow:revert; text-transform:revert; text-underline-position:revert; vertical-align:revert; white-space:revert; word-break:revert; border-spacing:revert; word-spacing:revert; background-clip:revert; background-origin:revert; text-combine-upright:revert; display:block; opacity:revert; background-color:rgb(208,216,220); border-bottom-width:revert; border-bottom-style:revert; border-bottom-color:revert; border-left-width:revert; border-left-style:revert; border-left-color:revert; border-right-width:revert; border-right-style:revert; border-right-color:revert; height:revert; max-height:revert; max-width:revert; min-height:revert; width:revert; margin:16px 0px; padding:8px 16px; border-radius:4px; min-width:200px; border-top-width:4px; border-top-style:solid; border-top-color:rgb(144,164,174)">
<div id="x_m_6493108037936797122m_8563020562509820717x_m_-757208929489082788pfptBanner73s8h0l" style="writing-mode:unset; color:unset; font-family:unset; font-feature-settings:unset; font-kerning:unset; font-size:unset; font-stretch:unset; font-variant-alternates:unset; font-variant-caps:unset; font-variant-east-asian:unset; font-variant-ligatures:unset; font-variant-numeric:unset; font-weight:unset; text-orientation:unset; zoom:unset; letter-spacing:unset; background:unset; background-blend-mode:unset; border-collapse:unset; border:unset; box-sizing:unset; break-after:unset; break-before:unset; break-inside:unset; caption-side:unset; clear:unset; column-width:unset; column-count:unset; column-fill:unset; column-gap:unset; column-rule-width:unset; column-rule-style:unset; column-rule-color:unset; column-span:unset; empty-cells:unset; float:left; image-orientation:unset; isolation:unset; line-break:unset; line-height:unset; list-style:unset; mix-blend-mode:unset; object-fit:unset; object-position:unset; outline:unset; overflow:unset; quotes:unset; table-layout:unset; text-align:unset; text-decoration:unset; text-emphasis-style:unset; text-emphasis-color:unset; text-indent:unset; text-overflow:unset; text-transform:unset; text-underline-position:unset; vertical-align:unset; white-space:unset; word-break:unset; border-spacing:unset; word-spacing:unset; text-combine-upright:unset; display:block; opacity:unset; border-radius:unset; height:unset; max-height:unset; min-height:unset; min-width:unset; padding:unset; width:unset; margin:0px 0px 1px; max-width:600px">
<div id="x_m_6493108037936797122m_8563020562509820717x_m_-757208929489082788pfptBanner73s8h0l" style="writing-mode:unset; font-family:Arial,sans-serif; font-feature-settings:unset; font-kerning:unset; font-size:14px; font-stretch:unset; font-variant-alternates:unset; font-variant-caps:unset; font-variant-east-asian:unset; font-variant-ligatures:unset; font-variant-numeric:unset; font-weight:bold; text-orientation:unset; zoom:unset; letter-spacing:unset; background-blend-mode:unset; background-image:unset; background-position:unset; background-repeat:unset; background-size:unset; border-collapse:unset; border:unset; box-sizing:unset; break-after:unset; break-before:unset; break-inside:unset; caption-side:unset; clear:unset; column-width:unset; column-count:unset; column-fill:unset; column-gap:unset; column-rule-width:unset; column-rule-style:unset; column-rule-color:unset; column-span:unset; empty-cells:unset; float:unset; image-orientation:unset; isolation:unset; line-break:unset; line-height:18px; list-style:unset; mix-blend-mode:unset; object-fit:unset; object-position:unset; outline:unset; overflow:unset; quotes:unset; table-layout:unset; text-align:unset; text-decoration:unset; text-emphasis-style:unset; text-emphasis-color:unset; text-indent:unset; text-overflow:unset; text-transform:unset; text-underline-position:unset; vertical-align:unset; white-space:unset; word-break:unset; border-spacing:unset; word-spacing:unset; background-clip:unset; background-origin:unset; text-combine-upright:unset; display:block; opacity:unset; background-color:rgb(208,216,220); border-radius:unset; height:unset; margin:unset; max-height:unset; max-width:unset; min-height:unset; min-width:unset; padding:unset; width:unset">
This Message Is From an External Sender</div>
<div id="x_m_6493108037936797122m_8563020562509820717x_m_-757208929489082788pfptBanner73s8h0l" style="writing-mode:unset; font-family:Arial,sans-serif; font-feature-settings:unset; font-kerning:unset; font-size:12px; font-stretch:unset; font-variant-alternates:unset; font-variant-caps:unset; font-variant-east-asian:unset; font-variant-ligatures:unset; font-variant-numeric:unset; font-weight:unset; text-orientation:unset; zoom:unset; letter-spacing:unset; background-blend-mode:unset; background-image:unset; background-position:unset; background-repeat:unset; background-size:unset; border-collapse:unset; border:unset; box-sizing:unset; break-after:unset; break-before:unset; break-inside:unset; caption-side:unset; clear:unset; column-width:unset; column-count:unset; column-fill:unset; column-gap:unset; column-rule-width:unset; column-rule-style:unset; column-rule-color:unset; column-span:unset; empty-cells:unset; float:unset; image-orientation:unset; isolation:unset; line-break:unset; line-height:18px; list-style:unset; mix-blend-mode:unset; object-fit:unset; object-position:unset; outline:unset; overflow:unset; quotes:unset; table-layout:unset; text-align:unset; text-decoration:unset; text-emphasis-style:unset; text-emphasis-color:unset; text-indent:unset; text-overflow:unset; text-transform:unset; text-underline-position:unset; vertical-align:unset; white-space:unset; word-break:unset; border-spacing:unset; word-spacing:unset; background-clip:unset; background-origin:unset; text-combine-upright:unset; display:block; opacity:unset; background-color:rgb(208,216,220); border-radius:unset; height:unset; margin-bottom:unset; margin-left:unset; margin-right:unset; max-height:unset; max-width:unset; min-height:unset; min-width:unset; padding:unset; width:unset; margin-top:2px">
This message came from outside your organization.</div>
</div>
<div style="height:0px; clear:both; display:block; line-height:0; font-size:0.01px">
</div>
</div>
<pre style="font-size:18px; font-style:normal; font-variant-caps:normal; font-weight:400; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; word-spacing:0px; text-decoration:none; font-family:sans-serif; white-space:pre-wrap">Hello,
I am using petsc and slepc to solve an eigenvalue problem for sparse matrices. When I run my code with double the number of processors, the memory usage also doubles.
I am able to reproduce this behaviour with ex1 of slepc’s hands on exercises.
The issue is occurring with petsc not with slepc as this still occurs when I remove the solve step and just create and assemble the petsc matrix.
With n=100000, this uses ~1Gb with 8 processors, but ~5Gb with 40 processors.
This was done with petsc 3.21.3, on linux compiled with Intel using Intel-MPI
Is this the expected behaviour? If not, how can I bug fix this?
Thanks,
Matt</pre>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
<br clear="all">
<div><br>
</div>
<span>--<span> </span></span><br>
<div dir="ltr">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>
-- Norbert Wiener</div>
<div><br>
</div>
<div><a href="https://urldefense.us/v3/__http://www.cse.buffalo.edu/*knepley/__;fg!!G_uCfscf7eWS!dRBUqYBDOj9QHmnycbLUuktH6lG_1402EZUstkt_mXuc_Qjt6o_CVNgqncZyn7znHJWBTI0ASPvo3VLgqx-G5FI3ovuh_hc2fPM$" originalsrc="http://www.cse.buffalo.edu/~knepley/" shash="q4AzAtRQa2WZKWFrskUhA+iBsPLJtudDRIlap5lNvvRZh21BSCZMNLzqsownrUXvOG+NLxFBEEv+EHXjP0XO6OTMx+i6xxbvcwLFrOiTg+ViMwDIztM4ro/AWsARtdDCIsoDRVLJQqD/mmTyWJEvCeVOscJUQqkX5upbUPJcFHU=" target="_blank">https://www.cse.buffalo.edu/~knepley/</a></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br clear="all">
<div><br>
</div>
<span class="x_gmail_signature_prefix">--<span> </span></span><br>
<div dir="ltr" class="x_gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>
-- Norbert Wiener</div>
<div><br>
</div>
<div><a href="https://urldefense.us/v3/__http://www.cse.buffalo.edu/*knepley/__;fg!!G_uCfscf7eWS!dRBUqYBDOj9QHmnycbLUuktH6lG_1402EZUstkt_mXuc_Qjt6o_CVNgqncZyn7znHJWBTI0ASPvo3VLgqx-G5FI3ovuh_hc2fPM$" originalsrc="http://www.cse.buffalo.edu/~knepley/" shash="Go9e3cnbTN4+lYM04qW82FNpatGwJq2KEP8gh2aSPvdC3pwZohD3Ae18qSlDImxhFK+SSNM9AmDlpCcxc6MYgtVEGi3tfLt6SsWOLpDsfwEfcFPjk3/syssaZUgiLpcCmM0ZQOy2AdXeRNg6rLUyuBy6tjs1qb49ruczfl4Ig/I=" target="_blank">https://www.cse.buffalo.edu/~knepley/</a></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
<br clear="all">
<div><br>
</div>
<span class="x_gmail_signature_prefix">--<span class="x_Apple-converted-space"> </span></span><br>
<div dir="ltr" class="x_gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>
-- Norbert Wiener</div>
<div><br>
</div>
<div><a href="https://urldefense.us/v3/__http://www.cse.buffalo.edu/*knepley/__;fg!!G_uCfscf7eWS!dRBUqYBDOj9QHmnycbLUuktH6lG_1402EZUstkt_mXuc_Qjt6o_CVNgqncZyn7znHJWBTI0ASPvo3VLgqx-G5FI3ovuh_hc2fPM$" originalsrc="http://www.cse.buffalo.edu/~knepley/" shash="wHW6v6A4apnv//P9g/uCPXVus+AlpXGR2bHLyYJ7W/XowPkUX8VAOsW027mmWOkpx64mA4qPUTpmBTEQvU1jWnoEWlm647JzK67qVpBXW+XW1xhdoKu0Vq5T2KrisXnYWiKVYSp/FjlWf0u+r7kuY1MuEHvlROkPh0vyzmsT7QU=" target="_blank">https://www.cse.buffalo.edu/~knepley/</a></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</body>
</html>