You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@inlong.apache.org by GitBox <gi...@apache.org> on 2022/11/25 15:34:55 UTC

[GitHub] [inlong] gong opened a new pull request, #6637: [INLONG-6636][Sort] Keep metric computing consistent for source MySQL and sink HBase

gong opened a new pull request, #6637:
URL: https://github.com/apache/inlong/pull/6637

   
   ### Prepare a Pull Request
   
   - [INLONG-6636][Sort] Keep metric computing consistent for source MySQL and sink HBase
   
   - Fixes #6636 
   
   ### Motivation
   
   It generates four `RowKind` data: insert, update_before, update_after, delete when source is mysql cdc. 
   We will count all RowKind data when computing metric of mysql cdc. HBase use upsert to write data and only need three `RowKind` data: insert, update_after, delete. Flink runtime will optimize code when sync mysql-cdc to HBase. Flink will use DropUpdateBeforeFunction#filter `update_before` data. We need HBase computing four `RowKind` data to keep consistent with mysql-cdc. So we will change  return value to all `RowKind` type of HBaseDynamicTableSink#getChangelogMode.
   
   ### Modifications
   
   * Modify HBaseDynamicTableSink#getChangelogMode.
   * HBase skip `update_before` data .
   * MySQL cdc metric computing four `Rowkind` data.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [inlong] EMsnap merged pull request #6637: [INLONG-6636][Sort] Keep metric computing consistent for source MySQL and sink HBase

Posted by GitBox <gi...@apache.org>.
EMsnap merged PR #6637:
URL: https://github.com/apache/inlong/pull/6637


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org