[jira] [Commented] (FLINK-25809) Introduce test infra for building FLIP-190 tests

["Francesco Guardiani (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-25809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17521664#comment-17521664 ] 

Francesco Guardiani commented on FLINK-25809:
---------------------------------------------

I won't have time to work on this anymore unfortunately. I had a couple of ideas in mind, so here is my WIP for who wants to take this over: [https://github.com/slinkydeveloper/flink/tree/upgrade-tests] . Note that the branch is quite old, and in the meantime we have reworked a couple of things, starting from the MiniClusterExtension, so this definitely needs a lot of work.

> Introduce test infra for building FLIP-190 tests 
> -------------------------------------------------
>
>                 Key: FLINK-25809
>                 URL: https://issues.apache.org/jira/browse/FLINK-25809
>             Project: Flink
>          Issue Type: Sub-task
>            Reporter: Francesco Guardiani
>            Assignee: Francesco Guardiani
>            Priority: Major
>
> The FLIP-190 requires to build a new test infra. For this test infra, we want to define test cases and data once, and then for each case we want to execute the following:
> * Integration test that roughly does {{create plan -> execute job -> trigger savepoint -> stop job -> restore plan -> restore savepoint -> execute job -> stop and assert}}. Plan and savepoint should be commited to git, so running this tests when a plan and savepoint is available will not regenerate plan and savepoint.
> * Change detection test to check that for the defined test cases, the plan hasn't been changed. Similar to the existing {{JsonPlanITCase}} tests.
> * Completeness of tests/Coverage, that is count how many times ExecNodes (including versions) are used in the test cases. Fail if an ExecNode version is never covered.
> Other requirements includes to "version" the test cases, that is for each test case we can retain different versions of the plan and savepoint, in order to make sure that after we introduce a new plan change, the old plan still continues to run



--
This message was sent by Atlassian Jira
(v8.20.1#820001)