[Bug 55697] JUnit tests skipped by haltonerror or haltonfailure are missing from skipped test reporting

[bu...@apache.org]

https://issues.apache.org/bugzilla/show_bug.cgi?id=55697

--- Comment #1 from Michael Clarke <mi...@gmail.com> ---
I'm not sure there is a suitable fix for this.

If one of the classes that hasn't been executed was to return a suite
(therefore providing more tests to be run), be invoked by a runner that
identifies methods differently (different annotations or by alternative naming
conventions), use parameterised tests, or anything else that alters the number
of tests beyond what can be counted statically with the @Test annotation then
we're going to fail to count these tests properly.

We can count methods annotated with @Test (JUnit 4) or named test* (JUnit 3) in
un-executed classes, but this may lead to an inconsistent count when compared
to a successfully run suite. The ignored count was developed for tests that the
user had specifically ignored whilst tests were being executed, not that Ant
hadn't tried to execute, and I think trying to change it is just going to cause
further issues.

I therefore propose closing this as with a "won't fix" status.

-- 
You are receiving this mail because:
You are the assignee for the bug.