You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jun Qin (Jira)" <ji...@apache.org> on 2022/11/09 20:32:00 UTC

[jira] [Commented] (FLINK-25920) Allow receiving updates of CommittableSummary

    [ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17631274#comment-17631274 ] 

Jun Qin commented on FLINK-25920:
---------------------------------

Our customer also facing the same problem here with 1.15.1 + aligned checkpoint:

{code:bash}
Checkpointing Mode Exactly Once 
Checkpoint Storage FileSystemCheckpointStorage 
State Backend EmbeddedRocksDBStateBackend (also jobs with HashMapStateBackend)
Interval 5m 0s 
Timeout 5m 0s 
Minimum Pause Between Checkpoints 5m 0s 
Maximum Concurrent Checkpoints 1 
Unaligned Checkpoints Disabled 
Persist Checkpoints Externally Enabled (retain on cancellation) 
Tolerable Failed Checkpoints 5 
Checkpoints With Finished Tasks Enabled
{code}

Is there a workaround we can use?

> Allow receiving updates of CommittableSummary
> ---------------------------------------------
>
>                 Key: FLINK-25920
>                 URL: https://issues.apache.org/jira/browse/FLINK-25920
>             Project: Flink
>          Issue Type: Sub-task
>          Components: API / DataStream, Connectors / Common
>    Affects Versions: 1.15.0, 1.16.0
>            Reporter: Fabian Paul
>            Priority: Major
>
> In the case of unaligned checkpoints, it might happen that the checkpoint barrier overtakes the records and an empty committable summary is emitted that needs to be correct at a later point when the records arrive.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)