[GitHub] [iceberg] ayush-san commented on issue #2610: Flink CDC iceberg table have duplicate rows

[GitBox <gi...@apache.org>]

ayush-san commented on issue #2610:
URL: https://github.com/apache/iceberg/issues/2610#issuecomment-844075792


   @openinx All my tables are unpartitioned and not bucketed. 
   
   The changelog I have shared is the output of the flink aggregated data stream, but rowkind is set by debezium deserializer class. Only some updates are coming as duplicates, most of the updates are handled correctly as I am using v2 spec for the tables 
   
   ```
   // need to upgrade version to 2,otherwise 'java.lang.IllegalArgumentException: Cannot write
   // delete files in a v1 table'
   TableOperations tableOperations = ((BaseTable) icebergTable).operations();
   TableMetadata metadata = tableOperations.current();
   tableOperations.commit(metadata, metadata.upgradeToFormatVersion(2));
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org