You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Yu-Wen Lai (Jira)" <ji...@apache.org> on 2021/12/22 05:14:00 UTC

[jira] [Resolved] (IMPALA-11032) Automatic Refresh of Metadata for Local Catalog after Compaction

     [ https://issues.apache.org/jira/browse/IMPALA-11032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yu-Wen Lai resolved IMPALA-11032.
---------------------------------
    Fix Version/s: Impala 4.1.0
       Resolution: Fixed

> Automatic Refresh of Metadata for Local Catalog after Compaction
> ----------------------------------------------------------------
>
>                 Key: IMPALA-11032
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11032
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Catalog
>            Reporter: Yu-Wen Lai
>            Assignee: Yu-Wen Lai
>            Priority: Major
>             Fix For: Impala 4.1.0
>
>
> After Hive compaction for tables created in the Hive warehouse, queries(HIVE ACID table) made in Impala possibly fail with a FileNotFoundException if a file removed by the Hive cleaner.
> In IMPALA-10801, we check latest compaction id before serving metadata from Catalogd. However, coordinators don't take advantage of that. Coordinators have local cache so we will have do the same compaction check for coordinator as well.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)