You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "TE (Jira)" <ji...@apache.org> on 2022/08/10 10:30:00 UTC

[jira] [Created] (FLINK-28910) CDC From Mysql To Hbase Bugs

TE created FLINK-28910:
--------------------------

             Summary: CDC From Mysql To Hbase Bugs
                 Key: FLINK-28910
                 URL: https://issues.apache.org/jira/browse/FLINK-28910
             Project: Flink
          Issue Type: Bug
          Components: Connectors / HBase
            Reporter: TE


I use Flink for CDC from Mysql to Hbase.

The problem I encountered is that the Mysql record is updated (not deleted), but the record in hbase is deleted sometimes.

I tried to analyze the problem and found the reason as follows:

The update action of Mysql will be decomposed into delete + insert by Flink.
The Hbase connector uses a mutator to handle this set of actions.

However, if the order of these actions is not actively set, the processing of the mutator will not guarantee the order of execution.

Therefore, when the update of Mysql is triggered, it is possible that hbase actually performed the actions in the order of put + delete, resulting in the data being deleted.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)