You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@uima.apache.org by Peter Klügl <pk...@uni-wuerzburg.de> on 2013/10/11 12:54:46 UTC

Jenkins UIMA Ruta tests

Hi,

I just noticed that one test case (QuantifierTest4 stackoverflow) fails,
but the jenkins build job does not report any failed tests.

Actually, the build job reports 27 tests in org.apache.uima.ruta
https://builds.apache.org/job/UIMA-Ruta/org.apache.uima$ruta-core/278/testReport/junit/

but the package contains 42 tests
https://svn.apache.org/repos/asf/uima/sandbox/ruta/trunk/ruta-core/src/test/java/org/apache/uima/ruta

Any idea why jenkins does not include all tests? My best guess right now
is that only test that end with "Test" are included.

Peter

Re: Jenkins UIMA Ruta tests

Posted by Peter Klügl <pk...@uni-wuerzburg.de>.
On 11.10.2013 14:05, Richard Eckart de Castilho wrote:
> Surefire only runs test classes Test*.java, *Test.java, *TestCase.java [1].
> There is also a bug (not sure if its still there) in Jenkins which makes it
> only recognize tests with failed asserts as failures, while tests in error
> are ignored. I'm afraid, I don't have the issue number handy.

Thanks for the pointers. I renamed the tests and they are included now.
(I always used Eclipse (not maven) for running the tests...)

After the tests have been included, the Cobertura test coverage
decreased... strange...

Peter


> -- Richard
>
> [1] http://maven.apache.org/surefire/maven-surefire-plugin/test-mojo.html#includes
>
> On 11.10.2013, at 12:54, Peter Klügl <pk...@uni-wuerzburg.de> wrote:
>
>> Hi,
>>
>> I just noticed that one test case (QuantifierTest4 stackoverflow) fails,
>> but the jenkins build job does not report any failed tests.
>>
>> Actually, the build job reports 27 tests in org.apache.uima.ruta
>> https://builds.apache.org/job/UIMA-Ruta/org.apache.uima$ruta-core/278/testReport/junit/
>>
>> but the package contains 42 tests
>> https://svn.apache.org/repos/asf/uima/sandbox/ruta/trunk/ruta-core/src/test/java/org/apache/uima/ruta
>>
>> Any idea why jenkins does not include all tests? My best guess right now
>> is that only test that end with "Test" are included.
>>
>> Peter


Re: Jenkins UIMA Ruta tests

Posted by Richard Eckart de Castilho <re...@apache.org>.
Surefire only runs test classes Test*.java, *Test.java, *TestCase.java [1].
There is also a bug (not sure if its still there) in Jenkins which makes it
only recognize tests with failed asserts as failures, while tests in error
are ignored. I'm afraid, I don't have the issue number handy.

-- Richard

[1] http://maven.apache.org/surefire/maven-surefire-plugin/test-mojo.html#includes

On 11.10.2013, at 12:54, Peter Klügl <pk...@uni-wuerzburg.de> wrote:

> Hi,
> 
> I just noticed that one test case (QuantifierTest4 stackoverflow) fails,
> but the jenkins build job does not report any failed tests.
> 
> Actually, the build job reports 27 tests in org.apache.uima.ruta
> https://builds.apache.org/job/UIMA-Ruta/org.apache.uima$ruta-core/278/testReport/junit/
> 
> but the package contains 42 tests
> https://svn.apache.org/repos/asf/uima/sandbox/ruta/trunk/ruta-core/src/test/java/org/apache/uima/ruta
> 
> Any idea why jenkins does not include all tests? My best guess right now
> is that only test that end with "Test" are included.
> 
> Peter