[jira] [Created] (IMPALA-15510) Avoid calling initial planFiles() when Iceberg REST Catalog is being used

["Zoltán Borók-Nagy (Jira)" <ji...@apache.org>]

Zoltán Borók-Nagy created IMPALA-15510:
------------------------------------------

             Summary: Avoid calling initial planFiles() when Iceberg REST Catalog is being used
                 Key: IMPALA-15510
                 URL: https://issues.apache.org/jira/browse/IMPALA-15510
             Project: IMPALA
          Issue Type: Improvement
          Components: Frontend
            Reporter: Zoltán Borók-Nagy


Currently Impala always issues a planFiles() Iceberg API call when it loads a table. It can be useful for caching, especially on HDFS, but quite unnecessary on object stores.

The Impala REST Client doesn't even cache the loaded table objects, i.e. the initial planFiles() by IcebergMetaProvider is completely wasteful.

We should avoid calling planFiles() (at least in IcebergMetaProvider), in which case only the IcebergScanPlanner would call it with all the query predicates.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)