You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@xtable.apache.org by "sudhar91 (via GitHub)" <gi...@apache.org> on 2024/12/07 07:44:06 UTC

Re: [I] Implement a utility tool for syncing parquet files to all three formats delta, hudi, iceberg using file listing [incubator-xtable]

sudhar91 commented on issue #553:
URL: https://github.com/apache/incubator-xtable/issues/553#issuecomment-2524991485

   Hi @vinishjail97  
   I made the initial commit  and raised draft PR   while i am continuing to refactor the code  raised PR to get some feedback around approach. requesting your review here
   I was primarily validating against delta due to familiarity but will continue to test for other formats as well.
   I intentionally didn't  checkin the tests as i have started to see some weird  jar conflicts  will push once am done but i was building running on my local system to test
   
   TODO in my list 
   1. Improve exception  handling
   2. Simplify Certain logic
   3. Consistency in column stats population  
   4. Test different scenarios of parquet ( multiple partitions..etc)
   5. Add more coverage
   
   Your review comments and suggestion would be helpful  as i make changes further


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@xtable.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org