You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "Yu-Wen Lai (Jira)" <ji...@apache.org> on 2021/11/19 17:25:00 UTC

[jira] [Created] (IMPALA-11032) Automatic Refresh of Metadata for Local Catalog after Compaction

Yu-Wen Lai created IMPALA-11032:
-----------------------------------

             Summary: Automatic Refresh of Metadata for Local Catalog after Compaction
                 Key: IMPALA-11032
                 URL: https://issues.apache.org/jira/browse/IMPALA-11032
             Project: IMPALA
          Issue Type: Improvement
          Components: Catalog
            Reporter: Yu-Wen Lai
            Assignee: Yu-Wen Lai


After Hive compaction for tables created in the Hive warehouse, queries(HIVE ACID table) made in Impala possibly fail with a FileNotFoundException if a file removed by the Hive cleaner.

In IMPALA-10801, we check latest compaction id before serving metadata from Catalogd. However, coordinators don't take advantage of that. Coordinators have local cache so we will have do the same compaction check for coordinator as well.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org