[jira] [Created] (HUDI-3189) Follow up for fallback to full table scan with incremental query when files are cleaned up or achived

["sivabalan narayanan (Jira)" <ji...@apache.org>]

sivabalan narayanan created HUDI-3189:
-----------------------------------------

             Summary: Follow up for fallback to full table scan with incremental query when files are cleaned up or achived
                 Key: HUDI-3189
                 URL: https://issues.apache.org/jira/browse/HUDI-3189
             Project: Apache Hudi
          Issue Type: Task
          Components: Incremental Pull
            Reporter: sivabalan narayanan


[https://github.com/apache/hudi/pull/3946]

was added to fallback to full table scan with incremental query on 2 occasions:
 # files are cleaned up, but active timeline still returns the commits.
 # commits are archived. 

 

There are two follow ups from the original PR. 

a. fs.isExists() call should be routed to metadata table. 

b. Add similar support to MOR table. 

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)