[jira] [Created] (HUDI-3785) When any specific metadata table partition is disable, ensure to remove the entry from TableConfig

["sivabalan narayanan (Jira)" <ji...@apache.org>]

sivabalan narayanan created HUDI-3785:
-----------------------------------------

             Summary: When any specific metadata table partition is disable, ensure to remove the entry from TableConfig
                 Key: HUDI-3785
                 URL: https://issues.apache.org/jira/browse/HUDI-3785
             Project: Apache Hudi
          Issue Type: Bug
          Components: index, metadata
    Affects Versions: 0.11.0
            Reporter: sivabalan narayanan


as of now, if entire metadata table is disabled, we ensure we delete the directory and update the table config wrt fully available MDT partitions. 

 

but if a user enables col stats and disables it after sometime, we don't update the table config to remove col stats. and so the data skipping might still be reading col stats and serving the queries which might lead to data loss. 

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)