Smoke Tests

[Robert Burrell Donkin <ro...@gmail.com>]

i'm going to start taking a look at creating smoke tests for trunk.

i'm going to use the framework in IMAP that it uses for protocol-level
functional testing. it allows scripted tests to be run against
arbitrary streams. i think this will be a good basis for creating
smoke tests. for the moment, i'll factor out a library in the IMAP
product. this is unsatisfactory but we can review where the library
should end up later (we've had requests to make it more widely
available before).

i plan to add an additional target ('smoke') which unpacks a
distribution, runs some XSLT to reconfigure services to run against
high ports for testing then runs scripts for each supported service.
the aim is to establish that the packaged distributions still have
basic functionality but hopefully it should easy enough for people to
add more test scripts later. (i'd like to pick up some ideas about
james standard configuration for 3.0 but i'll do this in a separate
thread.)

- robert

---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org

Re: Smoke Tests

[Robert Burrell Donkin <ro...@gmail.com>]

On Sat, Nov 1, 2008 at 9:39 AM, Robert Burrell Donkin
<ro...@gmail.com> wrote:
> i'm going to start taking a look at creating smoke tests for trunk.

ok

i've now added minimal smoke tests for spring and phoenix. basically,
these just:

1. unpack
2. reconfigure to high ports
3. boot james
4. test whether these ports are open

but it picked up the current issue with phoenix so they are probably
reasonably useful as they are.

typing 'ant dist smoke' at the top line will test and build all
modules and deployments then smoke spring and phoenix. maven support
would require more maven foo than i have.

i haven't worked out how to make these tests run on windows yet.
setting aside the fact that i don't run windows (and so couldn't test
it), i don't know how to stop james from the command line in windows.
if anyone wants to support smoke on windows, i'm willing to help.

- robert

---------------------------------------------------------------------
To unsubscribe, e-mail: server-dev-unsubscribe@james.apache.org
For additional commands, e-mail: server-dev-help@james.apache.org