[jira] [Comment Edited] (SUREFIRE-2004) Empty report for single-module project with 'aggregate=true'

["Alexander Kriegisch (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SUREFIRE-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17487654#comment-17487654 ] 

Alexander Kriegisch edited comment on SUREFIRE-2004 at 2/6/22, 9:33 AM:
------------------------------------------------------------------------

I did not say anything to versions prior 2.4, but about versions 2.4+.

Why would you want me to check the integration tests? I am reporting something which is not working as expected for single-module projects, namely that in the case of a requested aggregate report the plugin should be smart enough to figure out that the reporter actually does not need to aggregate anything, because the aggregate for a single-module project is simply the same as a non-aggregate report for the same module. The reporter works for a pom-packaged root POM with a single child module, so I am expecting it to work for a single, jar-packaged module, too.

The plugin reports 0 executed tests, which is simply wrong and therefore a bug, no matter if that bug exists since plugin version 2.4 or maybe even 1.0.


was (Author: kriegaex):
I did not say anything to versions prior 2.4, but about versions 2.4+.

Why would you want me to check the integration tests? I am reporting something which is not working as expected for single-module projects, namely that in the case of a requested aggregate report the plugin should be smart enough to figure out that the reporter actually does not need to aggregate anything, because the aggregate for a single-module project is simply the same as a non-aggregate report for the same module. The reporter works for a pom-packaged root POM with a single child module, so I am expecting it to work for a single, jar-packaged module, too.

> Empty report for single-module project with 'aggregate=true'
> ------------------------------------------------------------
>
>                 Key: SUREFIRE-2004
>                 URL: https://issues.apache.org/jira/browse/SUREFIRE-2004
>             Project: Maven Surefire
>          Issue Type: Bug
>          Components: Maven Surefire Report Plugin
>    Affects Versions: 2.4, 3.0.0-M5
>            Reporter: Alexander Kriegisch
>            Priority: Major
>
> Using either {{-Daggregate=true}} on CLI or {{<aggregate>true</aggregate>}} in the plugin configuration leads to an empty report (i.e. zero tests reported) when e.g. executing
> {code:none}
> mvn -Dmaven.test.failure.ignore=true -Daggregate=true clean verify surefire-report:report-only
> {code}
> in the context of a single-module project. As soon as I make the root module pom-packaged and move the tests to into a child module, the aggregate report works.
> FYI, if I do not define the plugin and its version in my POM at all, the default version 2.4 used by Maven on my workstation has the same problem, so this does not seem to be a 3.0.0-M5 issue only.
> ----
> Background info about how and why I actually stumbled across this problem: I have an OSS multi-module project with lots of expensive UI tests. The full build can take 2.5 hours. I wanted to test a few CLI settings before creating an additional GitHub CI build workflow which can be run on demand and always runs all tests in all modules (ignoring errors and failures), no matter what. In the end, it is supposed to create a single-file aggregate HTML report which can easily be attached to the build and later is available for download, if the user so chooses in order to analyse failing tests comfortable and without having to scroll through build logs.  You get the picture, I guess. In the original project, there is a pom-packaged root POM, so the problem described in this issue does not occur there. I simply created a single-module dummy project in order to verify the effect of certain build options quickly and not having to wait for the slow original build to finish. Eventually, I noticed the issue described above.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)