[I] How to infer partition fields from hudi source table and use them datasetConfig.yaml [incubator-xtable]

["rahul-ghiware (via GitHub)" <gi...@apache.org>]

rahul-ghiware opened a new issue, #411:
URL: https://github.com/apache/incubator-xtable/issues/411

   Hi Team,
   
   We're looking to infer partition fields (if any) associated with a given Hudi source table  and incorporate them into the datasetConfig.yaml file (as a `partitionSpec`) before running the XTable utility jar for data format conversion.
   
   Could someone please assist me with this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@xtable.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] How to infer partition fields from hudi source table and use them datasetConfig.yaml [incubator-xtable]

["the-other-tim-brown (via GitHub)" <gi...@apache.org>]

the-other-tim-brown commented on issue #411:
URL: https://github.com/apache/incubator-xtable/issues/411#issuecomment-2046265850

   Do you have access to the writer configs for these tables? You can infer based on the options used. https://hudi.apache.org/docs/key_generation
   
   [TimestampBasedKeyGenerator](https://github.com/apache/hudi/blob/master/hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/TimestampBasedKeyGenerator.java) and [CustomKeyGenerator](https://github.com/apache/hudi/blob/master/hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/CustomKeyGenerator.java) are the ones that would require the most effort since you need to also extract the output format for the partition when it is time based.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@xtable.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org