[jira] [Updated] (FLINK-29665) Support flexible subpartition range divisions

["Lijie Wang (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-29665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lijie Wang updated FLINK-29665:
-------------------------------
    Description: Currently, the subpartition range division algorithm is fixed (data-independent), and the *TaskDeploymentDescriptor(TDD)* can be generated according to the number of subpartitions and downstream parallelism. In order to support dividing according to the amount of data in the subpartition range, the scheduler needs to support flexible subpartition range divisions. The scheduler will be responsible for deciding the subpartition range division infos for each job vertex, and then pass the division infos to job vertices when initializing them.

> Support flexible subpartition range divisions
> ---------------------------------------------
>
>                 Key: FLINK-29665
>                 URL: https://issues.apache.org/jira/browse/FLINK-29665
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Coordination
>            Reporter: Lijie Wang
>            Assignee: Lijie Wang
>            Priority: Major
>             Fix For: 1.17.0
>
>
> Currently, the subpartition range division algorithm is fixed (data-independent), and the *TaskDeploymentDescriptor(TDD)* can be generated according to the number of subpartitions and downstream parallelism. In order to support dividing according to the amount of data in the subpartition range, the scheduler needs to support flexible subpartition range divisions. The scheduler will be responsible for deciding the subpartition range division infos for each job vertex, and then pass the division infos to job vertices when initializing them.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)