[petsc-dev] Introducing new "test harness" to PETSc

[Scott Kruger]

>> Right now, I am running stuff through 'make'. The % matching does not work, but searchin does. Moreover, in order to replace
>> output, I need to type DIFF=<crazy script>, so I would just do that by using Python with a short option, dumping that script,
>> calling it, and then deleting. Also, I want to be able to toss in arguments, since this makes it much simpler to debug tests. It
>> seems I will need a wrapper to the make.
>
>    Despite that fact that Jed thinks we all have direct access to his ~/bin all of these things need to be added to the test harness.
>
>     We need to get the % matching to work,

I have a pull request for that in.  In addition to combining search
and searchin methods, I have a $(shell $(PYTHON) <oneliner>) method.
Matt can try:
    make -f gmakefile echo_test pysearch='dm*plex*ex2*'
to see if it works for what he wants.

The shell method is a bit slower so I am keeping the other methods.

  we need a REPLACE=1 option,

Not done yet.

and a OPTIONS= option.

Isn't this the same as the already implemented TESTFLAGS?

Scott


These just haven't been done yet.




>
>   Barry
>
>>
>>   Matt
>>
>>
>>    Barry
>>
>>>
>>>   Matt
>>>
>>>   1) How do I run an individual test run?
>>>
>>> I use
>>>
>>>   make -f gmakefile test searchin=plex
>>>
>>> to run plex tests, and I think
>>>
>>>   make -f gmakefile test searchin=plex*ex1
>>>
>>> will work. However, how do I select ex1_2?
>>>
>>>   2) How do I replace the output which exists with the output of the current test run?
>>>
>>> This is amazingly useful after changes.
>>>
>>>   3) How do I give extra arguments with the make interface, rather than test_harness?
>>>
>>> Once I have all the functionality of my Python stuff,  I will throw it away.
>>>
>>>   Thanks,
>>>
>>>      Matt
>>>
>>>>
>>>> arch-c-exodus-master/tests/src/dm/impls/plex/examples/tests/runex1_gmsh_3.sh -v
>>>> not ok dm_impls_plex_tests-ex1_gmsh_3 /PETSc3/petsc/petsc-dev/arch-c-exodus-master/bin/mpiexec -n 3 ../ex1 -filename /meshes/square.msh -interpolate 1 -dm_view > ex1_gmsh_3.tmp 2> runex1_gmsh_3.err
>>>>
>>>> when I have
>>>>
>>>>   test:
>>>>     suffix: gmsh_3
>>>>     nsize: 3
>>>>     args: -filename ${DATAFILESPATH}/meshes/square.msh -interpolate 1 -dm_view
>>>>
>>>>    Matt
>>>>
>>>> --
>>>> What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.
>>>> -- Norbert Wiener
>>>
>>>
>>>
>>>
>>> --
>>> What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.
>>> -- Norbert Wiener
>>>
>>>
>>>
>>> --
>>> What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.
>>> -- Norbert Wiener
>>
>>
>>
>>
>> --
>> What most experimenters take for granted before they begin their experiments is infinitely more interesting than any results to which their experiments lead.
>> -- Norbert Wiener
>

-- 
Tech-X Corporation               kruger at txcorp.com
5621 Arapahoe Ave, Suite A       Phone: (720) 974-1841
Boulder, CO 80303                Fax:   (303) 448-7756