You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "Tamas Mate (Code Review)" <ge...@cloudera.org> on 2022/01/28 15:20:09 UTC

[Impala-ASF-CR] IMPALA-11076: Reuse FDs loaded by HdfsTable during IcebergTable load

Tamas Mate has uploaded a new patch set (#3). ( http://gerrit.cloudera.org:8080/18160 )

Change subject: IMPALA-11076: Reuse FDs loaded by HdfsTable during IcebergTable load
......................................................................

IMPALA-11076: Reuse FDs loaded by HdfsTable during IcebergTable load

Impala used the FileSystem.getFileStatus() on every Iceberg DataFile to
create the FileDescriptors. This operation is redundant because there is
an internal HdfsTable inside the IcebergTable which loads the
FileDescriptors recursively as well earlier.

This commit updates the loadAllPartition operation to reuse the
HdfsTable's FileDescriptors.

Testing:
 - Executed the Iceberg tests.

Change-Id: Id49daec60237dd6c8cce92c00a09fd9a6e6479b4
---
M fe/src/main/java/org/apache/impala/catalog/FeIcebergTable.java
1 file changed, 29 insertions(+), 10 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/60/18160/3
-- 
To view, visit http://gerrit.cloudera.org:8080/18160
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Id49daec60237dd6c8cce92c00a09fd9a6e6479b4
Gerrit-Change-Number: 18160
Gerrit-PatchSet: 3
Gerrit-Owner: Tamas Mate <tm...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <im...@cloudera.com>
Gerrit-Reviewer: Tamas Mate <tm...@cloudera.com>
Gerrit-Reviewer: Zoltan Borok-Nagy <bo...@cloudera.com>