[jira] [Commented] (KAFKA-12216) Improve flaky test reporting

["Ismael Juma (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17266913#comment-17266913 ] 

Ismael Juma commented on KAFKA-12216:
-------------------------------------

{quote}[https://github.com/jenkinsci/junit-plugin/issues/237]
{quote}
Seems like the upstream project welcomes contributions if anyone has cycles. :)

> Improve flaky test reporting
> ----------------------------
>
>                 Key: KAFKA-12216
>                 URL: https://issues.apache.org/jira/browse/KAFKA-12216
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Ismael Juma
>            Priority: Major
>
> Since Gradle 6.8, setting the following improves flaky test reporting by Gradle:
> {code:groovy}
>  reports.junitXml.mergeReruns = true
> {code}
> When this new option is enabled, if a test fails but is then retried and succeeds, its failures will be recorded as <flakyFailure> instead of <failure>, within one <testcase> (same as Maven when reruns are enabled).
> For Jenkins to understand this notation, we need to use the `JUnitFlakyTestDataPublisher`:
> {code:java}
> junit testResults: '**/build/test-results/**/TEST-*.xml', testDataPublishers: [[$class: 'JUnitFlakyTestDataPublisher']]
> {code}
> But this plugin doesn't seem to be installed in Apache Jenkins and is generally not actively maintained (last release was 5 years ago). I filed an issue on the core junit plugin for Jenkins:
> https://github.com/jenkinsci/junit-plugin/issues/237
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)