You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2022/03/04 15:32:00 UTC

[jira] [Resolved] (IMPALA-10737) Optimize Iceberg metadata handling

     [ https://issues.apache.org/jira/browse/IMPALA-10737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zoltán Borók-Nagy resolved IMPALA-10737.
----------------------------------------
    Fix Version/s: Impala 4.1.0
       Resolution: Fixed

> Optimize Iceberg metadata handling
> ----------------------------------
>
>                 Key: IMPALA-10737
>                 URL: https://issues.apache.org/jira/browse/IMPALA-10737
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>            Reporter: Zoltán Borók-Nagy
>            Assignee: Tamas Mate
>            Priority: Major
>              Labels: impala-iceberg
>             Fix For: Impala 4.1.0
>
>
> Currently we re-read Iceberg table metadata in several cases.
> We should rather keep it in memory and use it when possible.
> Also, when refreshing a table we should use Iceberg's refresh() API to avoid unnecessary re-reads of manifest files:
> [https://github.com/apache/iceberg/blob/282b6f9f1cae8d4fd5ff7c73de513ca91f01fddc/core/src/main/java/org/apache/iceberg/TableOperations.java#L45]
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org