You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2024/01/30 22:27:00 UTC

[jira] [Commented] (HUDI-7320) hive-sync unexpectedly loads archived timeline

    [ https://issues.apache.org/jira/browse/HUDI-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17812499#comment-17812499 ] 

sivabalan narayanan commented on HUDI-7320:
-------------------------------------------

We did fix something on these lines already. Can you check if its reproducible w/ 0.14.0 as well ? 

 

> hive-sync unexpectedly loads archived timeline
> ----------------------------------------------
>
>                 Key: HUDI-7320
>                 URL: https://issues.apache.org/jira/browse/HUDI-7320
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: meta-sync
>    Affects Versions: 0.13.1
>            Reporter: Raymond Xu
>            Priority: Critical
>         Attachments: Screenshot 2024-01-16 at 5.49.25 PM.png, Screenshot 2024-01-16 at 5.49.30 PM.png
>
>
> investigation shows that hive-sync step loaded archived timeline and caused long delay in the overall write process. And full scan for changes in all partitions is not used. need to dig further.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)