Re: [I] [cdc] support debezium-json format with schema for kafka sync action [incubator-paimon]

["luckyLJY (via GitHub)" <gi...@apache.org>]

luckyLJY commented on issue #2701:
URL: https://github.com/apache/incubator-paimon/issues/2701#issuecomment-1922600703

   报错缺少主键。在整库cdc时。
   
   
   
   ---Original---
   From: "Xiaojian ***@***.***>
   Date: Mon, Jan 29, 2024 20:18 PM
   To: ***@***.***>;
   Cc: ***@***.******@***.***>;
   Subject: Re: [apache/incubator-paimon] [cdc] support debezium-json  formatwith schema for kafka sync action (Issue #2701)
   
   
   
   
      
   @zhangjun0x01 I remember this feature is already supported. Is there any problem now? 我记得这个功能已经支持了。现在有什么问题吗？
     
   The json given by flink-cdc does not contain the field pkNames, but the debezuim-json parsed in the source code needs to contain pkNames, otherwise when synchronizing multiple tables, it will report that the primary key does not have this exception.When it parses debezium-json, the required fields are as follows: private static final String FIELD_SCHEMA = "schema"; private static final String FIELD_PAYLOAD = "payload"; private static final String FIELD_BEFORE = "before"; private static final String FIELD_AFTER = "after"; private static final String FIELD_SOURCE = "source"; private static final String FIELD_PRIMARY = "pkNames"; private static final String FIELD_DB = "db"; private static final String FIELD_TYPE = "op"; private static final String OP_INSERT = "c"; private static final String OP_UPDATE = "u"; private static final String OP_DELETE = "d"; private static final String OP_READE = "r";
     
   hi  @zhangjun0x01 In the case of synchronizing multiple tables: multiple tables with different structures be stored in one topic, or multiple topics?
    
   —
   Reply to this email directly, view it on GitHub, or unsubscribe.
   You are receiving this because you were mentioned.Message ID: ***@***.***>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org