[GitHub] [iceberg] Anando304 opened a new issue #3894: Row arity exception when executing row-level deletes from the top of an Iceberg table

[GitBox <gi...@apache.org>]

Anando304 opened a new issue #3894:
URL: https://github.com/apache/iceberg/issues/3894


   # Background
   I am running Iceberg 0.12.1 (with iceberg table V2) with Flink 1.12.1
   I have a Flink-connector-cdc hooked up to a postgres table. This CDC detects changes and pushes them to the sink which is a Hadoop Iceberg table.
   
   When I insert new rows to postgres, they propagate correctly to Iceberg.
   When I try to execute row-level deletes on those newly inserted rows, it propagates correctly.
   When I try to execute row-level deletes near the bottom-most rows of the table, it propagates correctly.
   
   # PROBLEM:
   However, when I try to delete rows from the top of the table such as at row indices 1 & 2, I get an exception java.lang.IllegalArgumentException: Row arity: 3, but serializer arity: 2. (refer to attached screenshot below)
   
   ![row_arity_problem](https://user-images.githubusercontent.com/45672939/149387223-47d95259-0b2a-4283-99e6-c636f511effa.png)
   
   ## Question
   I know this was an issue in previous versions of iceberg when someone tries to insert/delete rows. However the problem I’m having is when I am trying to delete rows from the very top rows of the table, only then I get the Row Arity Exception.
   
   Is this a known issue or is there a reason why the Iceberg tables are unable to process deletes on earlier(top rows, ie; row 1 2 3, …) rows? My iceberg table format is set to 2.
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org