[jira] [Commented] (IMPALA-12573) Give configuration load_catalog_in_background more fine-grained configuration

["Quanlong Huang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-12573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814188#comment-17814188 ] 

Quanlong Huang commented on IMPALA-12573:
-----------------------------------------

{quote}But if we invalidate some table manually ,we may want them to load .
{quote}
I think using REFRESH in this case is better.

However, we do need some more fine-grained config if we want some tables be always loaded, e.g. some dimension tables. Maybe we can add two flags like load_dbs_in_background and load_tables_in_background.

> Give configuration load_catalog_in_background more fine-grained configuration
> -----------------------------------------------------------------------------
>
>                 Key: IMPALA-12573
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12573
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Catalog
>            Reporter: Maxwell Guo
>            Assignee: Maxwell Guo
>            Priority: Minor
>
> As we know if  load_catalog_in_background set to true, then the table meta will load async for catalogd.
> During this period when catalogd starts up, if the flag set to true, then all the table will load async, then the queue will be big . So we may left it to false by deafult. But if we invalidate some table manually ,we may want them to load . So I think we can introduce a new flag load_catalog_in_background_at_startup , we can set load_catalog_in_background_at_startup to false, and load_catalog_in_background to true by default. 
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org