You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Zhu Zhu (Jira)" <ji...@apache.org> on 2020/12/22 12:33:00 UTC
[jira] [Updated] (FLINK-20721) Remove unknown input channels and
process to update partitions
[ https://issues.apache.org/jira/browse/FLINK-20721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhu Zhu updated FLINK-20721:
----------------------------
Description:
With the latest pipelined region scheduling, Flink no longer launch a task before knowing the locations of all the partitions it consumes. `scheduleOrUpdateConsumers` is no longer needed and is removed in FLINK-20439.
Unknown input channels and the process to update it is also no longer needed. I'd propose to remove them and the benefits are:
1. simplifying the code of both scheduler and shuffle components
2. simplifying interfaces of ShuffleEnvironment and ShuffleDescriptor
3. ensure the assumptions in InputGate#resumeConsumption() implementations
4. allow to remove ScheduleMode#allowLazyDeployment() and later completely remove ScheduleMode
was:
With the latest pipelined region scheduling, Flink no longer launch a task before knowing the locations of all the partitions it consumes. `scheduleOrUpdateConsumers` is no longer needed so we removed it in FLINK-20439.
Unknown input channels and the process to update it is also no longer needed. I'd propose to remove them and the benefits are:
1. simplifying the code of both scheduler and shuffle components
2. simplifying interfaces of ShuffleEnvironment and ShuffleDescriptor
3. ensure the assumptions in InputGate#resumeConsumption() implementations
4. allow to remove ScheduleMode#allowLazyDeployment() and later completely remove ScheduleMode
> Remove unknown input channels and process to update partitions
> --------------------------------------------------------------
>
> Key: FLINK-20721
> URL: https://issues.apache.org/jira/browse/FLINK-20721
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination, Runtime / Network
> Affects Versions: 1.13.0
> Reporter: Zhu Zhu
> Priority: Major
> Fix For: 1.13.0
>
>
> With the latest pipelined region scheduling, Flink no longer launch a task before knowing the locations of all the partitions it consumes. `scheduleOrUpdateConsumers` is no longer needed and is removed in FLINK-20439.
> Unknown input channels and the process to update it is also no longer needed. I'd propose to remove them and the benefits are:
> 1. simplifying the code of both scheduler and shuffle components
> 2. simplifying interfaces of ShuffleEnvironment and ShuffleDescriptor
> 3. ensure the assumptions in InputGate#resumeConsumption() implementations
> 4. allow to remove ScheduleMode#allowLazyDeployment() and later completely remove ScheduleMode
--
This message was sent by Atlassian Jira
(v8.3.4#803005)