You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Maxwell Guo (Jira)" <ji...@apache.org> on 2023/08/25 03:32:00 UTC

[jira] [Created] (IMPALA-12402) Add some configurations for CatalogMetaProvider's cache_

Maxwell Guo created IMPALA-12402:
------------------------------------

             Summary: Add some configurations for CatalogMetaProvider's cache_
                 Key: IMPALA-12402
                 URL: https://issues.apache.org/jira/browse/IMPALA-12402
             Project: IMPALA
          Issue Type: Improvement
          Components: fe
            Reporter: Maxwell Guo


when the cluster contains many db and tables such as if there are more than 100000 tables, and if we restart the impalad , the local cache_ CatalogMetaProvider's need to doing some loading process. 
As we know that the goole's guava cache 's concurrencyLevel os set to 4 by default. 
but if there is many tables the loading process will need more time and increase the probability of lock contention, see [here|https://github.com/google/guava/blob/master/guava/src/com/google/common/cache/CacheBuilder.java#L437]. 
So we propose to add some configurations here, the first is the concurrency of cache.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org