You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Danny Chen (Jira)" <ji...@apache.org> on 2023/01/07 02:59:00 UTC

[jira] [Commented] (HUDI-5506) StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event

    [ https://issues.apache.org/jira/browse/HUDI-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17655631#comment-17655631 ] 

Danny Chen commented on HUDI-5506:
----------------------------------

Fixed via master branch: ac296c702417461cedeef6e8974bd48c767a1b1c

> StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event
> ---------------------------------------------------------------------------------------------
>
>                 Key: HUDI-5506
>                 URL: https://issues.apache.org/jira/browse/HUDI-5506
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: flink
>    Affects Versions: 0.12.2
>            Reporter: Nicholas Jiang
>            Assignee: Nicholas Jiang
>            Priority: Blocker
>              Labels: pull-request-available
>             Fix For: 0.13.0
>
>         Attachments: image-2023-01-07-10-58-14-728.png
>
>
> AbstractStreamWriteFunction may get the different pending instant for checkpoint among the subtasks because the StreamWriteOperatorCoordinator may be committing the instant of the last completed checkpoint when AbstractStreamWriteFunction invokes snapshotState. StreamWriteOperatorCoordinator may not recommit with partial uncommitted write metadata event when handling the last boostrap event which is empty boostrap event.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)