You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2024/05/30 13:32:00 UTC

[jira] [Created] (IMPALA-13117) Improve the heap usage during metadata loading and DDL/DML executions

Quanlong Huang created IMPALA-13117:
---------------------------------------

             Summary: Improve the heap usage during metadata loading and DDL/DML executions
                 Key: IMPALA-13117
                 URL: https://issues.apache.org/jira/browse/IMPALA-13117
             Project: IMPALA
          Issue Type: Improvement
          Components: Catalog
            Reporter: Quanlong Huang
            Assignee: Quanlong Huang


The JVM heap size of catalogd is not just used by the metadata cache. The in-progress metadata loading threads and DDL/DML executions also creates temp objects, which introduces spikes in the heap usage. We should improve the heap usage in this part, especially when the metadata loading is slow due to external slowness (e.g. listing files on S3).

CC [~myloginid@gmail.com] 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)