[Db-derby Wiki] Update of "CdcTesting" by DeepaRemesh

[Apache Wiki <wi...@apache.org>]

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Db-derby Wiki" for change notification.

The following page has been changed by DeepaRemesh:
http://wiki.apache.org/db-derby/CdcTesting

New page:
= CDC Testing =

This page summarizes the status of Derby testing on J2ME/CDC/Foundation Profile using JSR169 (referred as CDC in rest of the document). 

== Goal ==

The goal is to have all tests that can be run in CDC to be enabled. There will be a subset of tests which cannot be run in CDC because of platform/JSR169 limitations. A part of the goal is to identify and list such tests with valid reason for their exclusion. 

== Plan ==

To achieve this goal:

* Exclude tests which fail in CDC. This is to ensure a clean run of derbyall in CDC. Specify the reason for exclude, if known. Otherwise, indicate that this needs further investigation. 

* For tests that can be run (at least partially) in CDC, modify the test/master files or split the test into two parts - for CDC and non-CDC environments. Some test failures could be possible bugs. Open JIRA issues for those.

* For tests that cannot be run, list a valid reason.


== Status ==

=== Current CDC Test Coverage ===

The numbers are based on tests run with IBM's WCTME5.7 j9 foundation jvm. Numbers may be approximate.

''Table of tests run in CDC by suite''

* Total - Number of tests run/Total number of tests in the suite [[BR]]
* Skipped - Number of tests which are skipped using excludes [[BR]]
* To be enabled - Number of tests which have to be enabled to run in CDC [[BR]]
* Cannot be run - Number of tests which need to be skipped because of platform/JSR169 limitations. 

|| '''Test Suite''' || '''Total'''  || '''Skipped'''|| '''To be enabled''' || '''Cannot be run''' || '''Comments'''||
|| derbylang || 112/143 || 31 || 31 || || ||
|| propertyinfo || 0/1 || 1 || 1 || || ||
|| storeall || 57/84 || 27 || 27 || || ||
|| storeunit || 5/5 || 0 || || || ||
|| unit || 3/4 || 1 || 1 || || ||
|| jdbcapi || 12/20 || 8 || 8 || || ||
|| jdbc20 || 8/10 || 2 || 2 || || ||
|| jdk14 || 0/10 || 10 || 10 || || ||
|| demo || 0/1 || 1 || 1 || || ||
|| simpledemo || 0/1 || 1 || 1 || || ||
|| nist || 126/126 || 0 || || || ||
|| multi || 1/1 || 1 || 1 || || ||
|| derbytools || 4/13 || 9 || 9 || || ||
|| i18nTest || 3/7 || 4 || 4 || || ||
|| Total || 77.2% || 22.8% || 22.8% || || ||

''Goal:'' To be enabled=0%. Do one of the following for each test which is skipped. [[BR]]
* Enable the tests to run in CDC. [[BR]]
* Add to list that cannot be run specifying reason.

=== Test suites which cannot be currently run in CDC ===

The following table lists the suite that cannot be currently run in CDC. 

|| '''Test Suite''' || '''Comments'''||
|| derbynetclientmats || Network Server not supported in CDC ||
|| derbynetmats || Network Server not supported in CDC ||
|| derbynetautostart || Network Server not supported in CDC ||
|| xa || XA not supported in CDC ||
|| encryptionAll || encryption not supported in CDC ||
|| encryption || encryption not supported in CDC ||

=== Tests which cannot be currently run in CDC ===

The following table lists tests which cannot be run in CDC. These must be tests that exclusively test features that are not supported by CDC/JSR169.

|| '''Test Suite''' || '''Test Name''' || '''Reason''' ||

''To be added.'' 

=== JIRA issues ===
 
The following JIRA issues have been opened for this effort.

|| '''Jira Entry''' || '''Comments''' || '''Status''' ||
|| [http://issues.apache.org/jira/browse/DERBY-398 DERBY-398] || Exclude tests which cannot be run in CDC  || Ongoing ||
|| [http://issues.apache.org/jira/browse/DERBY-447 DERBY-447] || Found by this effort  || Fixed ||
|| [http://issues.apache.org/jira/browse/DERBY-452 DERBY-452] || Found by this effort  || Fixed ||
|| [http://issues.apache.org/jira/browse/DERBY-453 DERBY-453] || Create a test wrapper to run tests using BigDecimal || In progress ||
|| [http://issues.apache.org/jira/browse/DERBY-470 DERBY-470] || Found by this effort || Fixed ||
|| [http://issues.apache.org/jira/browse/DERBY-542 DERBY-542] || Doc task for DERBY-470 || Open ||
|| [http://issues.apache.org/jira/browse/DERBY-518 DERBY-518] || Found by this effort || Fixed ||
|| [http://issues.apache.org/jira/browse/DERBY-597 DERBY-597] || Opened to enable more tests which use ij || In progress ||


=== Progress Table ===

The following table lists the svn revisions for fixes checked in for this effort:

|| '''Trunk Revision''' || '''10.1 Revision''' || '''Comment''' ||

''To be added.''