You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Fu Lili (Jira)" <ji...@apache.org> on 2023/10/20 11:01:00 UTC

[jira] [Created] (IMPALA-12509) Starting backend is very slow when querying an Iceberg table with a large number of files

Fu Lili created IMPALA-12509:
--------------------------------

             Summary: Starting backend is very slow when querying an Iceberg table with a large number of files
                 Key: IMPALA-12509
                 URL: https://issues.apache.org/jira/browse/IMPALA-12509
             Project: IMPALA
          Issue Type: Improvement
            Reporter: Fu Lili


We found that when querying an Iceberg table with a large number of files (>=200000), the Query Plan and start backends took an abnormal time (>= 2s). The reason was that unnecessary objects were serialized when building TQueryCtx. The main function involved is IcebergTable::toThriftDescriptor



--
This message was sent by Atlassian Jira
(v8.20.10#820010)