You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Rui Fan (Jira)" <ji...@apache.org> on 2023/12/07 15:00:00 UTC
[jira] [Commented] (FLINK-33693) Force aligned barrier logic doesn't work when the aligned checkpoint timeout is enabled
[ https://issues.apache.org/jira/browse/FLINK-33693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17794275#comment-17794275 ]
Rui Fan commented on FLINK-33693:
---------------------------------
Merged to
master<1.19> via : a4d14ec224bbaf498ca2e912ff51539872a34878
1.18 via : 3884f65a3d049acd5f092d5b48a1d02ff24b77e6
1.17 via : 2dd1076dbbf0f47e4b5d15e67e0265679397f93e
> Force aligned barrier logic doesn't work when the aligned checkpoint timeout is enabled
> ----------------------------------------------------------------------------------------
>
> Key: FLINK-33693
> URL: https://issues.apache.org/jira/browse/FLINK-33693
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
> Affects Versions: 1.18.0, 1.17.2
> Reporter: Rui Fan
> Assignee: Rui Fan
> Priority: Critical
> Labels: pull-request-available
> Attachments: image-2023-11-29-20-41-17-038.png
>
>
> FLINK-21945 will convert the unaligned checkpoint barrier and timeoutable aligned checkpoint barrier to force aligned barrier. However, Force aligned barrier logic doesn't work for timeoutable aligned checkpoint barrier.
>
> Bug at org.apache.flink.streaming.runtime.io.RecordWriterOutput#broadcastEvent, we will call withUnalignedUnsupported to transmit the unaligned checkpoint barrier to {color:#9876aa}FORCED_ALIGNED {color}barrier when the shuffle type cannot use unaligned checkpoint.
> However, the if has one condition: isPriorityEvent. When aligned checkpoint timeout is enabled, flink will emit one timeoutable barrier. It isn't PriorityEvent.
>
> But timeoutable barrier should call withUnalignedUnsupported here.
> !image-2023-11-29-20-41-17-038.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)