You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Hui An (Jira)" <ji...@apache.org> on 2022/07/18 06:40:00 UTC
[jira] [Commented] (HUDI-3189) Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table
[ https://issues.apache.org/jira/browse/HUDI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567832#comment-17567832 ]
Hui An commented on HUDI-3189:
------------------------------
Hi [~shivnarayan] Are you working on this? If not, I can implement this feature if you don't mind.
> Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table
> -----------------------------------------------------------------------------------------------------
>
> Key: HUDI-3189
> URL: https://issues.apache.org/jira/browse/HUDI-3189
> Project: Apache Hudi
> Issue Type: Task
> Components: incremental-query
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Major
> Labels: sev:high
> Fix For: 0.12.0
>
> Original Estimate: 4h
> Remaining Estimate: 4h
>
> [https://github.com/apache/hudi/pull/3946]
> was added to fallback to full table scan with incremental query on 2 occasions:
> # files are cleaned up, but active timeline still returns the commits.
> # commits are archived.
>
> There are two follow ups from the original PR.
> a. fs.isExists() call should be routed to metadata table.
> b. Add similar support to MOR table.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)