<div dir="ltr"><div dir="ltr">On Wed, Oct 28, 2020 at 3:13 PM Sajid Ali <<a href="mailto:sajidsyed2021@u.northwestern.edu">sajidsyed2021@u.northwestern.edu</a>> wrote:<br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><p style="margin:0px 0px 1.2em">Hi PETSc-developers, </p>
<p style="margin:0px 0px 1.2em">I have a few questions regarding changes to PETSc between version 3.13.5 and current master. I’m trying to run an application that worked with no issues with version 3.13.5 but isn’t working with the current master. </p>
<p style="margin:0px 0px 1.2em">[1] To assemble a matrix in this application I loop over all rows and have multiple calls to MatSetValuesStencil with INSERT_VALUES as the addv argument for all except one call which has ADD_VALUES. Final assembly is called after this loop. With PETSc-3.13.5 this ran with no errors but with PETSc-master I get : </p>
<pre style="font-family:Consolas,Inconsolata,Courier,monospace;font-size:1em;line-height:1.2em;margin:1.2em 0px"><code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;background-color:rgb(248,248,248);white-space:pre-wrap;overflow:auto;border-radius:3px;border:1px solid rgb(204,204,204);padding:0.5em 0.7em;display:block">Object is in wrong state
[0]PETSC ERROR: Cannot mix add values and insert values
</code></pre><p style="margin:0px 0px 1.2em">This is fixed by having a flush assembly in between two stages where the first stage has two loops with INSERT_VALUES and the second stage has a loop with ADD_VALUES.</p>
<p style="margin:0px 0px 1.2em">Did this change result from a bugfix or are users now expected to no longer mix add and insert values within the same loop ?</p></div></div></blockquote><div>We never checked before. You were never supposed to do that. It can break. </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><p style="margin:0px 0px 1.2em"> </p>
<p style="margin:0px 0px 1.2em">[2] To prevent re-building the preconditioner at all TSSteps, I had the command line argument <code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;padding:0px 0.3em;white-space:pre-wrap;border:1px solid rgb(234,234,234);background-color:rgb(248,248,248);border-radius:3px;display:inline">-snes_lag_preconditioner -1</code>. This did the job in 3.13.5 but with the current master I get the following error : </p>
<pre style="font-family:Consolas,Inconsolata,Courier,monospace;font-size:1em;line-height:1.2em;margin:1.2em 0px"><code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;background-color:rgb(248,248,248);white-space:pre-wrap;overflow:auto;border-radius:3px;border:1px solid rgb(204,204,204);padding:0.5em 0.7em;display:block">Cannot set the lag to -1 from the command line since the preconditioner must be built as least once, perhaps you mean -2
</code></pre><p style="margin:0px 0px 1.2em">I can however run the application without this option. If this is a breaking change, what is the new option to prevent re-building the preconditioner ?</p></div></div></blockquote><div>-1 means never build, but you have not built the preconditioner. Thus you probably want -2 which means build once and then not again.</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>
<p style="margin:0px 0px 1.2em">[3] Finally, I’m used the latest development version of MPICH for building both 3.13.5 and petsc-master and I get these warnings at exit : </p>
<pre style="font-family:Consolas,Inconsolata,Courier,monospace;font-size:1em;line-height:1.2em;margin:1.2em 0px"><code style="font-size:0.85em;font-family:Consolas,Inconsolata,Courier,monospace;margin:0px 0.15em;background-color:rgb(248,248,248);white-space:pre-wrap;overflow:auto;border-radius:3px;border:1px solid rgb(204,204,204);padding:0.5em 0.7em;display:block">[WARNING] yaksa: 2 leaked handles
.... (repeated N number of times where N is number of mpi ranks)
</code></pre><p style="margin:0px 0px 1.2em">Can this be safely neglected ?<br></p></div></div></blockquote><div>I don't know.</div><div><br></div><div>  Thanks,</div><div><br></div><div>     Matt </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><p style="margin:0px 0px 1.2em"></p><p style="margin:0px 0px 1.2em">Let me know if sharing either the application code and/or logs would be helpful and I can share either.<br></p>
<p style="margin:0px 0px 1.2em">Thank You,<br>Sajid Ali | PhD Candidate<br>Applied Physics<br>Northwestern University<br><a href="http://s-sajid-ali.github.io" target="_blank">s-sajid-ali.github.io</a></p>
<div title="MDH:PGRpdj5IaSBQRVRTYy1kZXZlbG9wZXJzLCA8YnI+PGJyPkkgaGF2ZSBhIGZldyBxdWVzdGlvbnMg
cmVnYXJkaW5nIGNoYW5nZXMgdG8gUEVUU2MgYmV0d2VlbiB2ZXJzaW9uIDMuMTMuNSBhbmQgY3Vy
cmVudCBtYXN0ZXIuIEknbSB0cnlpbmcgdG8gcnVuIGFuIGFwcGxpY2F0aW9uIHRoYXQgd29ya2Vk
IHdpdGggbm8gaXNzdWVzIHdpdGggdmVyc2lvbiAzLjEzLjUgYnV0IGlzbid0IHdvcmtpbmcgd2l0
aCB0aGUgY3VycmVudCBtYXN0ZXIuIDxicj48YnI+WzFdIFRvIGFzc2VtYmxlIGEgbWF0cml4IGlu
IHRoaXMgYXBwbGljYXRpb24gSSBsb29wIG92ZXIgYWxsIHJvd3MgYW5kIGhhdmUgbXVsdGlwbGUg
Y2FsbHMgdG8gTWF0U2V0VmFsdWVzIHdpdGggSU5TRVJUX1ZBTFVFUyBhcyB0aGUgYWRkdiBhcmd1
bWVudCBmb3IgYWxsIGV4Y2VwdCBvbmUgY2FsbCB3aGljaCBoYXMgQUREX1ZBTFVFUy4gRmluYWwg
YXNzZW1ibHkgaXMgY2FsbGVkIGFmdGVyIHRoaXMgbG9vcC4gV2l0aCBQRVRTYy0zLjEzLjUgdGhp
cyByYW4gd2l0aCBubyBlcnJvcnMgYnV0IHdpdGggUEVUU2MtbWFzdGVyIEkgZ2V0IDogPGJyPmBg
YDxicj5PYmplY3QgaXMgaW4gd3Jvbmcgc3RhdGU8YnI+WzBdUEVUU0MgRVJST1I6IENhbm5vdCBt
aXggYWRkIHZhbHVlcyBhbmQgaW5zZXJ0IHZhbHVlczxicj5gYGA8YnI+VGhpcyBpcyBmaXhlZCBi
eSBoYXZpbmcgZGlmZmVyZW50IGxvb3BzIGFuZCBhIGZsdXNoIGFzc2VtYmx5IGluIGJldHdlZW4g
d2hlcmUgdGhlIGZpcnN0IHNldCBvZiBsb29wcyBvbmx5IGhhdmUgSU5TRVJUX1ZBTFVFUyBhbmQg
dGhlIHNlY29uZCBzZXQgb25seSBoYXMgQUREX1ZBTFVFUy48YnI+PGJyPkRpZCB0aGlzIGNoYW5n
ZSByZXN1bHQgZnJvbSBhIGJ1Z2ZpeCBvciBhcmUgdXNlcnMgbm93IGV4cGVjdGVkIHRvIG5vIGxv
bmdlciBtaXggYWRkIGFuZCBpbnNlcnQgdmFsdWVzIHdpdGhpbiB0aGUgc2FtZSBsb29wID8gPGJy
Pjxicj5bMl0gVG8gcHJldmVudCByZS1idWlsZGluZyB0aGUgcHJlY29uZGl0aW9uZXIgYXQgYWxs
IFRTU3RlcHMsIEkgaGFkIHRoZSBjb21tYW5kIGxpbmUgYXJndW1lbnQgYC1zbmVzX2xhZ19wcmVj
b25kaXRpb25lciAtMWAuIFRoaXMgZGlkIHRoZSBqb2IgaW4gMy4xMy41IGJ1dCB3aXRoIHRoZSBj
dXJyZW50IG1hc3RlciBJIGdldCB0aGUgZm9sbG93aW5nIGVycm9yIDogPGJyPmBgYDxicj5DYW5u
b3Qgc2V0IHRoZSBsYWcgdG8gLTEgZnJvbSB0aGUgY29tbWFuZCBsaW5lIHNpbmNlIHRoZSBwcmVj
b25kaXRpb25lciBtdXN0IGJlIGJ1aWx0IDxzcGFuIHpldW00YzI9IlBSXzdfMCIgZGF0YS1kZG53
YWI9IlBSXzdfMCIgYXJpYS1pbnZhbGlkPSJncmFtbWFyIiBjbGFzcz0iTG0gbmciPmFzIGxlYXN0
PC9zcGFuPiBvbmNlLCBwZXJoYXBzIHlvdSBtZWFuIC0yPGJyPmBgYDxicj5JIGNhbiBob3dldmVy
IHJ1biB0aGUgYXBwbGljYXRpb24gd2l0aG91dCB0aGlzIG9wdGlvbi4gSWYgdGhpcyBpcyBhIGJy
ZWFraW5nIGNoYW5nZSwgd2hhdCBpcyB0aGUgbmV3IG9wdGlvbiB0byBwcmV2ZW50IHJlLWJ1aWxk
aW5nIHRoZSBwcmVjb25kaXRpb25lciA/PGJyPjxicj48L2Rpdj48ZGl2PlszXSBGaW5hbGx5LCBJ
J20gdXNlZCB0aGUgbGF0ZXN0IGRldmVsb3BtZW50IHZlcnNpb24gb2YgTVBJQ0ggZm9yIGJ1aWxk
aW5nIGJvdGggMy4xMy41IGFuZCBwZXRzYy1tYXN0ZXIgYW5kIEkgZ2V0IHRoZXNlIHdhcm5pbmdz
IGF0IGV4aXQgOiA8YnI+YGBgPGJyPltXQVJOSU5HXSB5YWtzYTogMiBsZWFrZWQgaGFuZGxlczxi
cj48L2Rpdj48ZGl2Pi4uLi4gKHJlcGVhdGVkIE4gbnVtYmVyIG9mIHRpbWVzIHdoZXJlIE4gaXMg
bnVtYmVyIG9mIG1waSByYW5rcyk8YnI+YGBgPGJyPjwvZGl2PjxkaXY+Q2FuIHRoaXMgYmUgc2Fm
ZWx5IG5lZ2xlY3RlZCA/PGJyPjwvZGl2PjxkaXY+PGJyPjwvZGl2PlRoYW5rIFlvdSwgPGJyPjxk
aXY+PGRpdiBkaXI9Imx0ciIgY2xhc3M9ImdtYWlsX3NpZ25hdHVyZSIgZGF0YS1zbWFydG1haWw9
ImdtYWlsX3NpZ25hdHVyZSI+PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2IGRpcj0ibHRyIj48ZGl2
PjxkaXYgZGlyPSJsdHIiPjxkaXYgc3R5bGU9ImZvbnQtc2l6ZToxMi44cHgiPlNhamlkIEFsaSB8
IFBoRCBDYW5kaWRhdGU8YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1zaXplOjEyLjhweCI+QXBw
bGllZCBQaHlzaWNzPGJyPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtc2l6ZToxMi44cHgiPk5vcnRo
d2VzdGVybiBVbml2ZXJzaXR5PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1zaXplOjEyLjhweCI+PGEg
aHJlZj0iaHR0cDovL3Mtc2FqaWQtYWxpLmdpdGh1Yi5pbyIgdGFyZ2V0PSJfYmxhbmsiPnMtc2Fq
aWQtYWxpLmdpdGh1Yi5pbzwvYT48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48
L2Rpdj48L2Rpdj4=" style="height:0px;width:0px;max-height:0px;max-width:0px;overflow:hidden;font-size:0em;padding:0px;margin:0px"></div></div></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br>-- Norbert Wiener</div><div><br></div><div><a href="http://www.cse.buffalo.edu/~knepley/" target="_blank">https://www.cse.buffalo.edu/~knepley/</a><br></div></div></div></div></div></div></div></div>