You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Danny Chen (Jira)" <ji...@apache.org> on 2023/08/29 02:18:00 UTC

[jira] [Updated] (HUDI-6725) Support efficient completion time queries on the timeline

     [ https://issues.apache.org/jira/browse/HUDI-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Danny Chen updated HUDI-6725:
-----------------------------
    Summary: Support efficient completion time queries on the timeline  (was: Support fast completion time queries on the timeline)

> Support efficient completion time queries on the timeline
> ---------------------------------------------------------
>
>                 Key: HUDI-6725
>                 URL: https://issues.apache.org/jira/browse/HUDI-6725
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: core
>            Reporter: Danny Chen
>            Assignee: Danny Chen
>            Priority: Major
>             Fix For: 1.0.0
>
>
> The basic idea is we do a eager loading of the completion time on archived timeline, for example, the last 3 days, and all the completed instants of the active timeline.
> If a query is asking about a completion time earlier than that time range, just do a lazy look up on the archvied timeline.
>  
> Probably we would write a completion time loader.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)