You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Stamatis Zampetakis (Jira)" <ji...@apache.org> on 2022/10/21 07:21:01 UTC

[jira] [Updated] (HIVE-25933) when hive has 10w+ tables ,hs2 will start for a long time,because hs2 will load all table as materialized view with single thread,this is sensitive for online task

     [ https://issues.apache.org/jira/browse/HIVE-25933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stamatis Zampetakis updated HIVE-25933:
---------------------------------------
    Fix Version/s:     (was: 3.1.1)
                       (was: 3.1.2)

I cleared the fixVersion field since this ticket is still open. Please review this ticket and if the fix is already committed to a specific version please set the version accordingly and mark the ticket as RESOLVED.

According to the [JIRA guidelines|https://cwiki.apache.org/confluence/display/Hive/HowToContribute] the fixVersion should be set only when the issue is resolved/closed.

> when hive has 10w+ tables ,hs2 will start for a long time,because hs2 will load all table as materialized view with single thread,this is sensitive for online task
> -------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-25933
>                 URL: https://issues.apache.org/jira/browse/HIVE-25933
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Planning, Query Processor
>    Affects Versions: 2.3.5, 2.3.7, 2.3.8
>            Reporter: lkl
>            Priority: Major
>
> modify the class Hive.java, the method is getAllTableObjects ,materialized view is not used for hive2
> {code:java}
> /**
>  * Get all tables for the specified database.
>  * @param dbName
>  * @return List of table names
>  * @throws HiveException
>  */
> public List<Table> getAllTableObjects(String dbName) throws HiveException {
>   try {
>     List<String> tableNames = getMSC().getAllTables(dbName);
>     if(tableNames.size()>1){
>       tableNames = tableNames.subList(0,1);
>     }
>     return Lists.transform(getMSC().getTableObjectsByName(dbName,tableNames),
>             new com.google.common.base.Function<org.apache.hadoop.hive.metastore.api.Table, Table>() {
>               @Override
>               public Table apply(org.apache.hadoop.hive.metastore.api.Table table) {
>                 return new Table(table);
>               }
>             }
>     );
>   } catch (Exception e) {
>     throw new HiveException(e);
>   }
> } {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)