You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@xtable.apache.org by "the-other-tim-brown (via GitHub)" <gi...@apache.org> on 2024/03/02 20:41:15 UTC

[I] Handle nullable record key field when translating to Iceberg [incubator-xtable]

the-other-tim-brown opened a new issue, #366:
URL: https://github.com/apache/incubator-xtable/issues/366

   Depending on how a Hudi table is created, the record key field can be created as a nullable field. This causes issues when we try to sync to Iceberg with this field marked as an identifier field. There are two options we can consider and test:
   1) Only set the Iceberg identifier field if the field is non-null and log a warning otherwise
   2) Interpret the Hudi record key field as non-null. Note: This may cause issues since the schema for the parquet file will be nullable.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@xtable.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Handle nullable record key field when translating to Iceberg [incubator-xtable]

Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown closed issue #366: Handle nullable record key field when translating to Iceberg
URL: https://github.com/apache/incubator-xtable/issues/366


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@xtable.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Handle nullable record key field when translating to Iceberg [incubator-xtable]

Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown commented on issue #366:
URL: https://github.com/apache/incubator-xtable/issues/366#issuecomment-1974904573

   Closing since this is already handled in the code. Approach for Option 1 was taken.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@xtable.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org