You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@xtable.apache.org by "sudhar91 (via GitHub)" <gi...@apache.org> on 2024/12/07 07:44:06 UTC
Re: [I] Implement a utility tool for syncing parquet files to all three formats delta, hudi, iceberg using file listing [incubator-xtable]
sudhar91 commented on issue #553:
URL: https://github.com/apache/incubator-xtable/issues/553#issuecomment-2524991485
Hi @vinishjail97
I made the initial commit and raised draft PR while i am continuing to refactor the code raised PR to get some feedback around approach. requesting your review here
I was primarily validating against delta due to familiarity but will continue to test for other formats as well.
I intentionally didn't checkin the tests as i have started to see some weird jar conflicts will push once am done but i was building running on my local system to test
TODO in my list
1. Improve exception handling
2. Simplify Certain logic
3. Consistency in column stats population
4. Test different scenarios of parquet ( multiple partitions..etc)
5. Add more coverage
Your review comments and suggestion would be helpful as i make changes further
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@xtable.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org