You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Chesnay Schepler (Jira)" <ji...@apache.org> on 2019/11/15 12:23:00 UTC
[jira] [Closed] (FLINK-14679) Add total number of partitions to
ResultPartitionDeploymentDescriptor
[ https://issues.apache.org/jira/browse/FLINK-14679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chesnay Schepler closed FLINK-14679.
------------------------------------
Resolution: Fixed
master: cc02399c4f4c1076153a18d7928720f95725d400
> Add total number of partitions to ResultPartitionDeploymentDescriptor
> ---------------------------------------------------------------------
>
> Key: FLINK-14679
> URL: https://issues.apache.org/jira/browse/FLINK-14679
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
> Reporter: Chesnay Schepler
> Assignee: Chesnay Schepler
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.10.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The ResourceManager requires some way to tell whether it has received all partitions for a given dataset; to ensure that a) no incomplete datasets are shows to the user [as completed] and b) to initiate a timeout-based cleanup of other partitions.
> Conversely, since the RM only has access to what the TaskExecutor sends, this information must also be accessible to the TE.
> A good candidate for placing this seems to be the {{ResultPartitionDeploymentDescriptor}} or {{PartitionDescriptor}}, as these already contain the DataSetID.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)