You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@xtable.apache.org by "brishi19791 (via GitHub)" <gi...@apache.org> on 2025/05/09 21:35:49 UTC

[I] XTable performs incorrect schema sync during Delta to Iceberg conversion when a column is renamed in the Delta table. [incubator-xtable]

brishi19791 opened a new issue, #711:
URL: https://github.com/apache/incubator-xtable/issues/711

   ### Search before asking
   
   - [x] I had searched in the [issues](https://github.com/apache/incubator-xtable/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Please describe the bug 🐞
   
   I'm performing a Delta to Iceberg conversion using XTable. I renamed a column in the Delta table from "name" to "FullName". In the generated Iceberg schema, XTable removed the original "name" field (field ID: 2) and added a new field "FullName" with a new field ID: 5. Below is the Iceberg schema XTable generated:
    "schemas" : [ {
       "type" : "struct",
       "schema-id" : 0,
       "fields" : [ {
         "id" : 1,
         "name" : "id",
         "required" : false,
         "type" : "int"
       }, {
         "id" : 2,
         "name" : "name",
         "required" : false,
         "type" : "string"
       }, {
         "id" : 3,
         "name" : "role",
         "required" : false,
         "type" : "string"
       }, {
         "id" : 4,
         "name" : "address",
         "required" : false,
         "type" : "string"
       } ]
     }, {
       "type" : "struct",
       "schema-id" : 1,
       "fields" : [ {
         "id" : 1,
         "name" : "id",
         "required" : false,
         "type" : "int"
       }, {
         "id" : 3,
         "name" : "role",
         "required" : false,
         "type" : "string"
       }, {
         "id" : 4,
         "name" : "address",
         "required" : false,
         "type" : "string"
       }, {
         "id" : 5,
         "name" : "**FullName**",
         "required" : false,
         "type" : "string"
       } ]
     } ]
   
   XTable should have retained the original field ID (2) and simply updated the column name to "FullName" to reflect a rename, not a new field addition.
   
   ### Are you willing to submit PR?
   
   - [x] I am willing to submit a PR!
   - [ ] I am willing to submit a PR but need help getting started!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@xtable.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] XTable performs incorrect schema sync during Delta to Iceberg conversion when a column is renamed in the Delta table. [incubator-xtable]

Posted by "brishi19791 (via GitHub)" <gi...@apache.org>.
brishi19791 commented on issue #711:
URL: https://github.com/apache/incubator-xtable/issues/711#issuecomment-2867981897

   Hi @vinishjail97. this is during incremental sync


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@xtable.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] XTable performs incorrect schema sync during Delta to Iceberg conversion when a column is renamed in the Delta table. [incubator-xtable]

Posted by "vinishjail97 (via GitHub)" <gi...@apache.org>.
vinishjail97 commented on issue #711:
URL: https://github.com/apache/incubator-xtable/issues/711#issuecomment-2867935962

   @brishi19791 Did you see this issue when triggering a snapshot sync or an incremental sync?  


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@xtable.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org