You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2025/05/15 05:44:00 UTC
[jira] [Updated] (IMPALA-14074) Support metadata cache warmup of some tables in catalogd startup
[ https://issues.apache.org/jira/browse/IMPALA-14074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Quanlong Huang updated IMPALA-14074:
------------------------------------
Description:
Users might want to warm up the metadata cache for some important tables after restarting catalogd. We can provide a configuration file loaded in catalogd startup that contains one table at a line. Catalogd triggers metadata loading of those tables in the background. Then users don't need to explictly run some queries to warm up the cache.
These tables will be added into the table loading queue, just like how PrioritizeLoadRequest triggered by queries does. So the concurrency is still controlled by num_metadata_loading_threads.
was:Users might want to warm up the metadata cache for some important tables after restarting catalogd. We can provide a configuration file loaded in catalogd startup that contains one table at a line. Catalogd triggers metadata loading of those tables in the background. Then users don't need to explictly run some queries to warm up the cache.
> Support metadata cache warmup of some tables in catalogd startup
> ----------------------------------------------------------------
>
> Key: IMPALA-14074
> URL: https://issues.apache.org/jira/browse/IMPALA-14074
> Project: IMPALA
> Issue Type: New Feature
> Components: Catalog
> Reporter: Quanlong Huang
> Priority: Critical
>
> Users might want to warm up the metadata cache for some important tables after restarting catalogd. We can provide a configuration file loaded in catalogd startup that contains one table at a line. Catalogd triggers metadata loading of those tables in the background. Then users don't need to explictly run some queries to warm up the cache.
> These tables will be added into the table loading queue, just like how PrioritizeLoadRequest triggered by queries does. So the concurrency is still controlled by num_metadata_loading_threads.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org