You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/05/28 02:38:28 UTC
[GitHub] [hudi] nsivabalan commented on issue #2987: [SUPPORT] Only able to retrieve last _hoodie_commit_time
nsivabalan commented on issue #2987:
URL: https://github.com/apache/hudi/issues/2987#issuecomment-850068596
I assume every commit updates all records. and by default if you read a table in hudi format in spark, it will return the latest snaphot and hence you are seeing just the last commit.
I can think of some hack that you can do. But not sure if there are some other elegant ways.
You can read the table in parquet format and retrieve all distinct commit times and then go from there. // don't think this is advisable though.
Also, if you have access to hudi-cli, you should be able to retrieve all commit info.
@n3nash @leesf @yanghua : any other ideas?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org