You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2021/04/02 07:09:50 UTC

[GitHub] [iceberg] zhangwcoder opened a new issue #2409: Flink cdc events with update or delete doesn't work in 0.11.0 branch 

zhangwcoder opened a new issue #2409:
URL: https://github.com/apache/iceberg/issues/2409


   Hi ,  i really need the new CDC feature write to the iceberg table。 I see the feature has completed in the branch  0.11.0 ，and i try this today ， but this feature dos not works 。
   First insert a record where Id = 1， and then use sql ”update tableA set xx = xxx where id = 1“ to update the record in mysql 。 But the iceberg table can't  distinguish the update event,   instead  two records that id = 1  appeared in the table ( I have correctly set the "equalityFieldColumns" fields ) 。 
   And then i delete this record in mysql ,  but this record still  in the iceberg table . 
   
   `List<String> pkNames = pkNames(database, tableName, parameterTool);
   
           FlinkSink.forRowData(env.addSource(consumer).flatMap(new IcebergTypeFunction()))
                   .table(table)
                   .tableLoader(tableLoader)
                   .writeParallelism(1)
                   .equalityFieldColumns(pkNames)
                   .build();`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] openinx commented on issue #2409: Flink cdc events with update or delete doesn't work in 0.11.0 branch

Posted by GitBox <gi...@apache.org>.
openinx commented on issue #2409:
URL: https://github.com/apache/iceberg/issues/2409#issuecomment-812463519


   @zhangwcoder ,  you may want to read this document here : https://github.com/apache/iceberg/pull/2410


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org