[ApacheDS] Integration test results

[Alex Karasulu <ak...@apache.org>]

On a (1.86 Ghz) Intel Core2 Duo machine with a weak (SATA 7200 RPM) drive I
got the following results for tests run from the root of the
bigbang-with-dependencies branch.  Meaning all the unit tests for shared run
as well.

For "mvn test" which runs 80% of the core integration tests with rollbacks:

1 Minute 40 Seconds


For "mvn -Dintegration test" which runs 80% of the core tests with rollbacks
and 20% of the core integration tests with a pristine server
(cleanup,reinstall,reconfig,restart).

6 Minutes 28 Seconds


Not too bad since we have not converted all the tests and nothing has yet
been done for the server-unit tests.  I think we can shrink this down to
about 2 and a half minutes for all integration tests.


Alex

Re: [ApacheDS] Integration test results

[Alex Karasulu <ak...@apache.org>]

Here's an update ...

Before the new framework running "mvn -Dintegration test" on core-unit
produced the following result on a core 2 duo 1.8 GHz machine with low
quality drives:

[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESSFUL
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 7 minutes 35 seconds
[INFO] Finished at: Sun Dec 09 01:55:07 EST 2007
[INFO] Final Memory: 13M/117M
[INFO]
------------------------------------------------------------------------

Now we moved all the tests to core-integ and modified then to use the new
framework.  You do not need to use the -Dintegration switch anymore.  The
integration tests since they take so little time run in the course of a
regular build.  When we do "mvn test" on the machine producing the results
above we get:

[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESSFUL
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 45 seconds
[INFO] Finished at: Sun Dec 09 01:59:39 EST 2007
[INFO] Final Memory: 12M/121M
[INFO]
------------------------------------------------------------------------

455 seconds / 45 seconds

That's a 10X improvement and a pretty dramatic result.  I ran out of time to
move on and do the server-unit stuff. I'm hoping someone can volunteer to do
this.  The infrastructure in terms of the change log service is there
already so this would be pretty easy to do. The core integ documentation is
rich and very similar to what's would be needed for server-integ.  Right now
server-unit takes about 5 minutes so that would probably shrink down to 10
seconds.  Combined it could take about 2 minutes to build, unit test and and
integration  test everything including shared, daemon, apacheds, and the
installers.

<warning>
To run server-unit and the mitosis integration tests tests you still need
the -Dintegration test switch.
</warning>


-Alex