You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "Michael Smith (Jira)" <ji...@apache.org> on 2025/05/08 23:14:00 UTC

[jira] [Assigned] (IMPALA-12162) makeInsertEventData() can be slow in fetching file checksums

     [ https://issues.apache.org/jira/browse/IMPALA-12162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Smith reassigned IMPALA-12162:
--------------------------------------

    Assignee: Michael Smith  (was: Quanlong Huang)

> makeInsertEventData() can be slow in fetching file checksums
> ------------------------------------------------------------
>
>                 Key: IMPALA-12162
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12162
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Catalog
>            Reporter: Csaba Ringhofer
>            Assignee: Michael Smith
>            Priority: Critical
>
> Saw some INSERTs where most of the time was spent in
> https://github.com/apache/impala/blob/dc63ae514a445e3f197cab405b01a30c58015695/fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java#L7011
> This was surprising, as I assumed that most of the time in updateCatalog()/createInsertEvents() is spent in HMS RPCs, but in the jstacks I saw it was mainly in calls to HDFS to compute checksum of files.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org