You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Balaji Varadarajan (Jira)" <ji...@apache.org> on 2020/07/21 09:10:00 UTC
[jira] [Commented] (HUDI-1116) Support time travel using timestamp
type
[ https://issues.apache.org/jira/browse/HUDI-1116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161883#comment-17161883 ]
Balaji Varadarajan commented on HUDI-1116:
------------------------------------------
One option is to provide a mapping utility which can help translate a timestamp to nearest commit time for the user to run query.
A udf like implementation would be ideal but not sure if it is possible.
> Support time travel using timestamp type
> ----------------------------------------
>
> Key: HUDI-1116
> URL: https://issues.apache.org/jira/browse/HUDI-1116
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Spark Integration
> Reporter: Balaji Varadarajan
> Priority: Major
>
>
> {{Currently, we use commit time to mimic time-travel queries. We need ability to handle time-travel with a proper timestamp provided.}}
> {{}}
> {{For e:g: }}
> {{spark.read .format(“hudi”).option(“timestampAsOf”, “2019-01-01”).load(“/path/to/my/table”)}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)