<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class=""><br class=""></div> So the programs output changes and should no longer match that in the output/* file yet the test harness does not error with a statement that the two outputs do not match? <div class=""><br class=""></div><div class=""> I noticed the gmakegentest.py is not being run before it runs the test? Does this mean it is just running all the old stuff which does match fine? </div><div class=""><br class=""></div><div class=""> Then either how petscdiff is called by the test harness has changed or petscdiff has changed and does not detect changes anymore </div><div class=""><br class=""></div><div class=""> BTW: I always use -f ./gmakefile.test test not just the gmakefile</div><div class=""><br class=""></div><div class=""> All the PETSc changes are trivial and can be seen with a simple diff, it is hard to believe they would cause this behavior but I guess they must.</div><div class=""><br class=""></div><div class=""> You can go to PETSC_ARCH/tests/snes/tests and run the ex13 shell script directly.</div><div class=""><br class=""></div><div class=""> Barry</div><div class=""><br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Dec 31, 2020, at 12:38 PM, Matthew Knepley <<a href="mailto:knepley@gmail.com" class="">knepley@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">I just pulled master, and simple alterations to tests do not produce a failure:<div class=""><br class=""></div><div class="">master *$:/PETSc3/petsc/petsc-dev$ PETSC_ARCH=arch-master-debug make -f ./gmakefile test search="snes_tests-ex13_bench" TIMEOUT=5000 EXTRA_OPTIONS="-dm_<br class="">refine 0"<br class="">Using MAKEFLAGS: EXTRA_OPTIONS=-dm_refine 0 TIMEOUT=5000 search=snes_tests-ex13_bench<br class=""> TEST arch-master-debug/tests/counts/snes_tests-ex13_bench.counts<br class=""> ok snes_tests-ex13_bench<br class=""> ok diff-snes_tests-ex13_bench<br class=""><div class=""><br class=""></div><div class="">I check that the runs produce different output when done manually.</div><div class=""><br class=""></div><div class="">Scott and Barry, could this be related to changed to testing?</div><div class=""><br class=""></div><div class=""> Thanks,</div><div class=""><br class=""></div><div class=""> Matt</div><div class=""><br class=""></div>-- <br class=""><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr" class=""><div class=""><div dir="ltr" class=""><div class=""><div dir="ltr" class=""><div class="">What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.<br class="">-- Norbert Wiener</div><div class=""><br class=""></div><div class=""><a href="http://www.cse.buffalo.edu/~knepley/" target="_blank" class="">https://www.cse.buffalo.edu/~knepley/</a><br class=""></div></div></div></div></div></div></div></div></div>
</div></blockquote></div><br class=""></div></body></html>