[jira] [Updated] (BEAM-7714) Allow retries of PostCommit test suites per Python version

["Valentyn Tymofieiev (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-7714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Valentyn Tymofieiev updated BEAM-7714:
--------------------------------------
    Priority: Critical  (was: Blocker)

> Allow retries of PostCommit test suites per Python version
> ----------------------------------------------------------
>
>                 Key: BEAM-7714
>                 URL: https://issues.apache.org/jira/browse/BEAM-7714
>             Project: Beam
>          Issue Type: Sub-task
>          Components: testing
>            Reporter: Valentyn Tymofieiev
>            Assignee: Valentyn Tymofieiev
>            Priority: Critical
>             Fix For: Not applicable
>
>          Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> Currently Python PostCommit test executes 4 tests running the set of tests under Python 2.7, 3.5-3.7. When test execution fails due to a flake, contributors have to rerun the whole suite. Having a possibility to re-run test suite only for a particular version of Python would make it easier to receive a green run. 
> Some considerations:
>   - increasing number of Jenkins job will increase the number of slots required by postcommit, this will slow down the queue, unless we increase number of slots. We can investigate utilization of Jenkins workers to see if slot increase is advisable.
> - we could introduce phrase-only suites "Run Python 3.7 PostCommits", that will be separate jenkins jobs (1 suite, 1 slot) in addition to current jobs. phrase-only suites will not be triggered on the PR but will be triggered manually when users want to re-run tests for particular version. It may cause confusion on a PR though, since PR author will have to explain to reviewers that Python 3 Postcommit suite failed, but only 3.6 portion failed, and I re-ran Py3.6 portion only in this separate jenkins Job and it passed, so PR is safe to merge.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)