You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "Csaba Ringhofer (Jira)" <ji...@apache.org> on 2023/05/24 08:22:00 UTC

[jira] [Created] (IMPALA-12162) makeInsertEventData() can be slow during ACID writes

Csaba Ringhofer created IMPALA-12162:
----------------------------------------

             Summary: makeInsertEventData() can be slow during ACID writes
                 Key: IMPALA-12162
                 URL: https://issues.apache.org/jira/browse/IMPALA-12162
             Project: IMPALA
          Issue Type: Improvement
          Components: Catalog
            Reporter: Csaba Ringhofer


Saw some INSERTs where most of the time was spent in
https://github.com/apache/impala/blob/dc63ae514a445e3f197cab405b01a30c58015695/fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java#L7011

This was surprising, as I assumed that most of the time in updateCatalog()/createInsertEvents() is spent in HMS RPCs, but in the jstacks I saw it was mainly in calls to HDFS to compute checksum of files.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org