You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "leesf (Jira)" <ji...@apache.org> on 2019/09/04 03:49:00 UTC
[jira] [Commented] (HUDI-162) File System view must be built with
correct timeline actions
[ https://issues.apache.org/jira/browse/HUDI-162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921929#comment-16921929 ]
leesf commented on HUDI-162:
----------------------------
Fixed via master: ae3c02fb3fff47da8f20c4f9c8012a257a3df792
> File System view must be built with correct timeline actions
> -------------------------------------------------------------
>
> Key: HUDI-162
> URL: https://issues.apache.org/jira/browse/HUDI-162
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: Common Core
> Reporter: BALAJI VARADARAJAN
> Assignee: BALAJI VARADARAJAN
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> File System View is getting built with active timeline instead of commitsAndCompaction timeline. This is causing file-system to not return file-slices/data-files in some corner cases.
> Imagine an active timeline in timestamp order (previous instants are archived)
> # 20190628212214.clean
> # *20190628212214.commit*
> # 20190630110606.deltacommit
> Archiving retains last N instants by action, So, depending on some settings, after archiving, the active timeline would look like
> # 20190628212214.clean
> # 20190630110606.deltacommit
> Here, *20190628212214.commit* is archived but the clean instant (20190628212214.clean) which is earlier than the commit is still retained. In this scenario, file-slices with base instant time 20190628212214 becomes invalid and won't be returned
> Affects Version - 0.4.7
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)