You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Prashant Wason (Jira)" <ji...@apache.org> on 2023/10/05 01:42:02 UTC
[jira] [Updated] (HUDI-6265) Fix timeline check for meta sync
[ https://issues.apache.org/jira/browse/HUDI-6265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Prashant Wason updated HUDI-6265:
---------------------------------
Fix Version/s: 0.14.1
(was: 0.14.0)
> Fix timeline check for meta sync
> --------------------------------
>
> Key: HUDI-6265
> URL: https://issues.apache.org/jira/browse/HUDI-6265
> Project: Apache Hudi
> Issue Type: Bug
> Affects Versions: 0.13.0
> Reporter: Ethan Guo
> Assignee: Ethan Guo
> Priority: Critical
> Fix For: 0.14.1
>
>
> [https://github.com/apache/hudi/pull/7561/files#r1203654251]
> The following case where the timeline is like:
> {code:java}
> ts3.rollback, ts50.commit, ts51.commit, ts52.commit, ...{code}
> and ts49.commit and ts48.commit are archived.
> If we pass in ts47 as the exclusiveStartInstantTime at this point, activeTimeline.isBeforeTimelineStarts(exclusiveStartInstantTime) returns false. However, the active timeline misses ts48.commit and ts49.commit which are required for meta sync. This is a problem if ts48.commit or ts49.commit has partition changes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)