What test suites can you tell me about?

[Michael D. Crawford]

Can you tell me about any ready-to-use test suites, for any software package
that should run under Linux, that I can build and run to test the new kernel?

Besides running all these tests myself on my machine, I'm going to document them
in an article at:

http://linuxquality.sunsite.dk/articles/

(there are no articles there yet but I'm composing a couple that will be posted
soon)

For example, if you build Python (http://www.python.org) and say "make check",
it will run a bunch of python programs that test the correctness of the
programming language.

This is of interest in part because lots of the Python tests make system calls,
but also because it tests that the compilers generate correct code under the new
kernel (another test I do is, after I boot off a new kernel, I do "make clean",
build it again and boot off _that_).

"make exec" under the Mesa 3.4 library builds a bunch of graphics demos, a few
of which are kind of whizzy but most of which exercise a few basic functions in
OpenGL.  So one can watch that they don't crash, that the images look correctly
drawn and so on.  This enabled me to realize that DRI wasn't working under 2.4.0
but it was under 2.4.0-prerelease-ac5, which I've detailed in a separate
message.

Another test suite I know about comes with Kaffe (http://www.kaffe.org) and
verifies that Kaffe's implementation of Java is running correctly on your
system.

One I read about somewhere but have no clue where to get it is this memory
stress-testing tool that does lots of DMA and stuff off of the disks.

There must be a lot of these tools available, if only we had them listed all in
one place.

If you maintain such a test tool, it would be helpful if you provided the option
to run the whole suite completely unattended.  Mesa provides a good test for
lots of functions of the kernel, but one problem is that one has to quit the
tests after each one runs, usually by pressing the ESC key.  Unattended testing
also allows one to run lots of tests simultaneously to test a heavily loaded
system. 

In some cases, the tests really do need to have some user input, like navigating
around a 3D world or turning various rendering options on and off, but it's
possible the tests could be extended to allow this input from a script (Python
provides a nice way to bolt a script interpreter to any application).

Mike
-- 
Michael D. Crawford
GoingWare Inc. - Expert Software Development and Consulting
http://www.goingware.com/
[e-mail]

   Tilting at Windmills for a Better Tomorrow.