You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2022/07/01 12:41:00 UTC

[jira] [Created] (IMPALA-11409) Skip UpdateCatalogMetrics if another thead is on-going in it

Quanlong Huang created IMPALA-11409:
---------------------------------------

             Summary: Skip UpdateCatalogMetrics if another thead is on-going in it
                 Key: IMPALA-11409
                 URL: https://issues.apache.org/jira/browse/IMPALA-11409
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
            Reporter: Quanlong Huang
            Assignee: Quanlong Huang


Impala coordinator tracks local metrics of the catalog, e.g. number of dbs/tables. When use_local_catalog is enabled, it also tracks the cache metrics, e.g. cache hit/miss count/rate.

These metrics are updated at the end of each statement, even for simple statements like "USE <db>", "SET var=xxx", "SELECT 1". The catalog update thread will also update the metrics in the end.

These metrics are global metrics of the local catalog cache. They are not specifit to a simple statement. It's a waste to update the metrics concurrently.

We've seen "hanging issues" that all statements, including the catalog update thread, are slowly executing the UpdateCatalogMetrics() function. See details in the attached jstack dump.

Indeed, if one thread is running the UpdateCatalogMetrics() function, the other threads can skip it and move forward.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org