You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Benjamin Gonzalez (Jira)" <ji...@apache.org> on 2021/12/16 20:20:00 UTC
[jira] [Assigned] (BEAM-12672) Update all Precommits to rerun failed tests K times.
[ https://issues.apache.org/jira/browse/BEAM-12672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benjamin Gonzalez reassigned BEAM-12672:
----------------------------------------
Assignee: Benjamin Gonzalez
> Update all Precommits to rerun failed tests K times.
> ----------------------------------------------------
>
> Key: BEAM-12672
> URL: https://issues.apache.org/jira/browse/BEAM-12672
> Project: Beam
> Issue Type: Test
> Components: testing
> Reporter: Alex Amato
> Assignee: Benjamin Gonzalez
> Priority: P2
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> We should configure the precommit test suites to re-run failed tests a few (K) times.
> (A bonus feature would be to tag certain tests as known flakey, and run multiple attempts in parallel when the test is first ran)
> The benefits of this are to:
> * Not have flakey tests slow down PR reviews and merges.
> * And avoiding the need to repeatedly manually rerun the precommit test with a PR comment.
> * Getting a clear signal that failed tests are due to the code in the PR
> * Save computing resources (Rather than needing to run the entire test suite every time it fails, only the failed tests will rerun).
> (Its not realistic to have 0 flakeyness, so this is desirable to improve productivity, as it can take several attempts to have all the tests pass in a single run).
> Note: This does not mean that we should ignore flakey tests, which are sometimes indicative of bugs. We should continue to investigate those with a continuous test suite.
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)