[Swift-devel] Test suite group status and display

[Justin M Wozniak]

Ok, so there are two user groups- users browsing the Swift web page 
looking for what Swift does and developers using nightly.sh .  I stress 
that nightly.sh is not used as a nightly script and should be renamed, 
although its core could be wrapped up as such.

Recent work has focused on getting nightly.sh to be a useful script for 
swift-devel types to 1) check that Swift works and 2) build up a test 
suite for various providers.  Sarah and David have been doing quite a bit 
of the latter recently.  HTML is produced as the output of these runs.

If some additional infrastructure was in there, it would be possible to 
run this under cron, index the results wrt time, and post something to the 
web, as the HTML is pretty nice.  However, we are currently focusing on 
getting Swift to run on the target sites and indexing the results wrt test 
sites (providers).

On Mon, 7 Feb 2011, Daniel S. Katz wrote:

> "not published" doesn't seem like it meets Mike's request of "a way for 
> users to see what tests are available".  Can the results be sent to a 
> web page?
>
> Dan
>
>
> On Feb 7, 2011, at 6:57 PM, Justin M Wozniak wrote:
>
>>
>> Yup, nightly.sh actually does use HTML green/red boxes and links to the 
>> script code.  However, the results are not indexed or published.  The 
>> tests are available.
>>
>> On Tue, 1 Feb 2011, Daniel S. Katz wrote:
>>
>>> Ideally, if these really are nightly tests, the swift web page would 
>>> have a matrix of these tests vs day that would show green/red boxes, 
>>> and would enable a user to click on a test and get to the code to be 
>>> able to run that test himself.
>>>
>>> Dan
>>>
>>>
>>> On Feb 1, 2011, at 12:02 PM, Michael Wilde wrote:
>>>
>>>> Im looking for from a way for users to see what tests are available, 
>>>> and which are reasonable to run in different settings and for various 
>>>> purposes. This should assist new users in initial testing and 
>>>> validation of their environment, as well as experienced users in 
>>>> knowing what tests are available and working (or not).
>>>>
>>>> Would it be useful to have an option to nightly.sh to display all the 
>>>> directories below tests/ that represent valid test groups?
>>>>
>>>> Something like: ./nighly.sh -g
>>>>
>>>> com$ find providers -type d | grep -v svn
>>>> providers
>>>> providers/local-pbs
>>>> providers/local-pbs/pads
>>>> providers/local-pbs/queenbee
>>>> providers/local-cobalt
>>>> providers/local-cobalt/surveyor
>>>> providers/local-cobalt/intrepid
>>>> providers/ssh
>>>> providers/sge-local
>>>> providers/local
>>>> providers/local-pbs-coasters
>>>> providers/ssh-pbs-coasters
>>>> com$
>>>>
>>>> Would it be useful to put a status file in each group dir to help identify what dirs are really groups, and what the current status of those tests are?
>>>>
>>>> - Mike
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Michael Wilde
>>>> Computation Institute, University of Chicago
>>>> Mathematics and Computer Science Division
>>>> Argonne National Laboratory
>>>>
>>>> _______________________________________________
>>>> Swift-devel mailing list
>>>> Swift-devel at ci.uchicago.edu
>>>> http://mail.ci.uchicago.edu/mailman/listinfo/swift-devel
>>>
>>>
>>
>> --
>> Justin M Wozniak
>
>

-- 
Justin M Wozniak