You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "zhijiang (JIRA)" <ji...@apache.org> on 2019/05/22 07:06:00 UTC
[jira] [Updated] (FLINK-6227) Introduce the
DataConsumptionException for downstream task failure
[ https://issues.apache.org/jira/browse/FLINK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhijiang updated FLINK-6227:
----------------------------
Description:
It is part of FLIP-1.
We define a new abstract special exception called PartitionException to indicate the downstream task failure in consuming upstream partition. This special exception is reported to JobMaster as a hint for unavailable partition data, and then JobMaster could track the upstream executions to restart for reproducing the partition data.
We make current PartitionNotFoundException extend PartitionException, because it is reasonable to restart producer task when the requested partition is already released.
was:
It is part of FLIP-1.
We define a new special exception to indicate the downstream task failure in consuming upstream data.
The {{JobManager}} will receive and consider this special exception to calculate the minimum connected sub-graph which is called {{FailoverRegion}}. So the {{DataConsumptionException}} should contain {{ResultPartitionID}} information for {{JobMaster}} tracking upstream executions.
> Introduce the DataConsumptionException for downstream task failure
> ------------------------------------------------------------------
>
> Key: FLINK-6227
> URL: https://issues.apache.org/jira/browse/FLINK-6227
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination, Runtime / Network
> Reporter: zhijiang
> Assignee: zhijiang
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> It is part of FLIP-1.
>
> We define a new abstract special exception called PartitionException to indicate the downstream task failure in consuming upstream partition. This special exception is reported to JobMaster as a hint for unavailable partition data, and then JobMaster could track the upstream executions to restart for reproducing the partition data.
> We make current PartitionNotFoundException extend PartitionException, because it is reasonable to restart producer task when the requested partition is already released.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)