You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2021/11/29 17:54:00 UTC
[jira] [Resolved] (IMPALA-11022) Impala uses wrong file descriptors for Iceberg tables in local catalog mode
[ https://issues.apache.org/jira/browse/IMPALA-11022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zoltán Borók-Nagy resolved IMPALA-11022.
----------------------------------------
Fix Version/s: Impala 4.1.0
Resolution: Fixed
> Impala uses wrong file descriptors for Iceberg tables in local catalog mode
> ---------------------------------------------------------------------------
>
> Key: IMPALA-11022
> URL: https://issues.apache.org/jira/browse/IMPALA-11022
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
> Fix For: Impala 4.1.0
>
>
> When local catalog mode is used, Impala retrieves the Iceberg snapshot from CatalogD. The response contains a map of the file descriptors.
> https://github.com/apache/impala/blob/b692a92fa2a2277a185fb5823592609b4603c0d8/fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java#L1006
> The file descriptors contain block location information, but the hosts are only referred by indexes.
> https://github.com/apache/impala/blob/b692a92fa2a2277a185fb5823592609b4603c0d8/common/fbs/CatalogObjects.fbs#L50
> In the Coordinator's local catalog the host indexes might refer to different hosts than in CatalogD. We should translate the host indexes to the coordinators host list. Similarly to the LocalFsTable:
> https://github.com/apache/impala/blob/b692a92fa2a2277a185fb5823592609b4603c0d8/fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java#L983
> https://github.com/apache/impala/blob/b692a92fa2a2277a185fb5823592609b4603c0d8/fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java#L1020-L1024
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org