[jira] [Commented] (KAFKA-8164) Improve test passing rate by rerunning flaky tests

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16802836#comment-16802836 ] 

ASF GitHub Bot commented on KAFKA-8164:
---------------------------------------

viktorsomogyi commented on pull request #6506: KAFKA-8164: Add unitTestWithFlakyRetry and testWithFlakyRetry tasks
URL: https://github.com/apache/kafka/pull/6506
 
 
   These tasks run the tests and collect failures without failing the build. Failed tests are run again in a second turn and the build is failed only if there are test failures in this second run.
   
   ### Committer Checklist (excluded from commit message)
   - [ ] Verify design and implementation 
   - [ ] Verify test coverage and CI build status
   - [ ] Verify documentation (including upgrade notes)
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Improve test passing rate by rerunning flaky tests
> --------------------------------------------------
>
>                 Key: KAFKA-8164
>                 URL: https://issues.apache.org/jira/browse/KAFKA-8164
>             Project: Kafka
>          Issue Type: Improvement
>    Affects Versions: 2.3.0
>            Reporter: Viktor Somogyi-Vass
>            Assignee: Viktor Somogyi-Vass
>            Priority: Major
>
> Failing flaky tests are often a problem:
> * pull requests need to be rerun to achieve a green build
> * rerunning the whole build for a PR is resource and time consuming
> * green build give high confidence when releasing (and well, generally too) but flaky tests often erode this and annoying for the developers
> The aim of this JIRA is to provide an improvement which automatically retries any tests that are failed for the first run.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)