[jira] [Comment Edited] (FLINK-24491) ExecutionGraphInfo may not be archived when the dispatcher terminates

["Matthias Pohl (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-24491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529392#comment-17529392 ] 

Matthias Pohl edited comment on FLINK-24491 at 4/28/22 8:05 PM:
----------------------------------------------------------------

1.14: f9d2c1c0d3aa7e72e95f1c75bcf7c77c1fceac22

The 1.14 backport required 1c492ed97fe2876041804b944c6cb370430b3519 and e0fb11741a000478852d51fa9f2823208e6717c6


was (Author: mapohl):
1.14: f9d2c1c0d3aa7e72e95f1c75bcf7c77c1fceac22

> ExecutionGraphInfo may not be archived when the dispatcher terminates
> ---------------------------------------------------------------------
>
>                 Key: FLINK-24491
>                 URL: https://issues.apache.org/jira/browse/FLINK-24491
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Coordination
>    Affects Versions: 1.15.0, 1.13.6, 1.14.4
>            Reporter: Zhilong Hong
>            Assignee: Matthias Pohl
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.16.0, 1.14.5, 1.15.1
>
>
> When a job finishes, its JobManagerRunnerResult will be processed in the callback of {{Dispatcher#runJob}}. In the callback, ExecutionGraphInfo will be archived by HistoryServerArchivist asynchronously. However, the CompletableFuture of the archiving is ignored. The job may be removed before the archiving is finished. For the batch job running in the per-job/application mode, the dispatcher will terminate itself once the job is finished. In this case, ExecutionGraphInfo may not be archived when the dispatcher terminates.
> If the ExecutionGraphInfo is lost, users are not able to know whether the batch job is finished normally or not. They have to refer to the logs for the result.
> The session mode is not affected, since the dispatcher won't terminate itself once the job is finished. The HistoryServerArchivist gets enough time to archive the ExcutionGraphInfo.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)