You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "lothar (Jira)" <ji...@apache.org> on 2022/03/22 06:10:00 UTC

[jira] [Commented] (FLINK-26792) BufferedMutator failed when insert and update with a flush in Hbase Sink

    [ https://issues.apache.org/jira/browse/FLINK-26792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510242#comment-17510242 ] 

lothar commented on FLINK-26792:
--------------------------------

As far as I know, Hbase Sink use Put#Put(byte[] row) and Delete#Delete(byte[] row) in Hbase API, so Hbase will handle the request with HConstants.LATEST_TIMESTAMP.The HConstants.LATEST_TIMESTAMP in Hbase meaning is this  !image-2022-03-22-14-03-18-558.png|width=518,height=301!

Looks like when the Insert and Update(split into UPDATE_BEFORE and UPDATE_AFTER) in a flush, the delete marked the timestamp with server's current time, and the same as insert, so the insert data marked as deleted.

> BufferedMutator failed when insert and update with a flush in Hbase Sink
> ------------------------------------------------------------------------
>
>                 Key: FLINK-26792
>                 URL: https://issues.apache.org/jira/browse/FLINK-26792
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / HBase
>            Reporter: lothar
>            Priority: Major
>         Attachments: image-2022-03-22-14-03-18-558.png
>
>
> When I write data from Kafka to Hbase(CDC data contains Insert、Update), once the first insert data and update data with same rowkey in a flush, the data will be invalid.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)