[jira] [Created] (HUDI-3782) Update metadata partitions table config when any of them is enabled/disabled

["Sagar Sumit (Jira)" <ji...@apache.org>]

Sagar Sumit created HUDI-3782:
---------------------------------

             Summary: Update metadata partitions table config when any of them is enabled/disabled
                 Key: HUDI-3782
                 URL: https://issues.apache.org/jira/browse/HUDI-3782
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Sagar Sumit
             Fix For: 0.11.0


Now that we have table configs for inflight and completed metadata partitions, and given that both reader and writer are going to rely on this config, we need to ensure that this config is updated properly even when any one of the metadata indexes is enabled/disabled.

For instance, let's say user started with metadata enabled and colstats enabed. Colstats partition was fully built and the table config got updated. Now, they disable it and we miss to update table config. So the writers won't update the colstats partition and it would be out of sync. Readers think that the table config has it so it's already in sync but that's incorrect. We need to handle this scenario like how we did for top level metadata enable/disable config in HUDI-3451



--
This message was sent by Atlassian Jira
(v8.20.1#820001)