You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "Zhi Tang (Jira)" <ji...@apache.org> on 2023/04/16 15:43:00 UTC

[jira] [Created] (IMPALA-12067) Avoid coordinator loading useless HDFS table’s partition metadata.

Zhi Tang created IMPALA-12067:
---------------------------------

             Summary: Avoid coordinator loading useless HDFS table’s partition metadata.
                 Key: IMPALA-12067
                 URL: https://issues.apache.org/jira/browse/IMPALA-12067
             Project: IMPALA
          Issue Type: Bug
            Reporter: Zhi Tang


Although catalogd propagates incremental metadata updates at the partition level, the coordinators still loads all of the table's partition metadata at query time, even if it is not being used. This is caused by coor needing to calculate the total hdFsbytes of the HDFS table. This can be optimized by transferring the computational logic to catalogd.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org