[jira] [Created] (HIVE-23199) Apache Hive Upgrade 3.1.2 each query is taking 10 seconds additional

["Praneeth Putha (Jira)" <ji...@apache.org>]

Praneeth Putha created HIVE-23199:
-------------------------------------

             Summary: Apache Hive Upgrade 3.1.2 each query is taking 10 seconds additional
                 Key: HIVE-23199
                 URL: https://issues.apache.org/jira/browse/HIVE-23199
             Project: Hive
          Issue Type: Bug
          Components: HiveServer2
    Affects Versions: 3.1.2
            Reporter: Praneeth Putha


We upgraded Apache Hive Server2 and Metastore service from 2.3.4 to 3.1.2 and hadoop jars from 2.8.5 to 3.2.0.

Use <database> or show databases is taking 10.2 seconds before upgrade it is 0.2 seconds.

Observations:

when i run use database. Compiling comand is completed in 0.73 seconds and to start execution query it took 10 seconds.

 

 

2020-04-14T12:22:48,173 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] conf.HiveConf: Using the default value passed in for log id: 58ad961c-26a8-41a0-a628-eb56c18e7ae2
2020-04-14T12:22:48,246 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: Compiling command(queryId=root_20200414122248_aa6e88cc-9490-4ec2-aee5-ea0bc076dbb2): use test_database
2020-04-14T12:22:48,915 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2020-04-14T12:22:48,942 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2020-04-14T12:22:48,944 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2020-04-14T12:22:48,949 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] metadata.Hive: Dumping metastore api call timing information for : compilation phase
2020-04-14T12:22:48,949 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] metadata.Hive: Total time spent in this metastore function was greater than 1000ms : getTableObjectsByName_(String, List, )=2884
2020-04-14T12:22:48,949 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] metadata.Hive: Total time spent in this metastore function was greater than 1000ms : getTables_(String, String, TableType, )=16779
2020-04-14T12:22:48,951 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: Completed compiling command(queryId=root_20200414122248_aa6e88cc-9490-4ec2-aee5-ea0bc076dbb2); Time taken: 0.73 seconds
2020-04-14T12:22:48,951 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] reexec.ReExecDriver: Execution #1 of query
2020-04-14T12:22:48,952 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2020-04-14T12:22:48,952 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: Executing command(queryId=root_20200414122248_aa6e88cc-9490-4ec2-aee5-ea0bc076dbb2): use test_database

{color:#FF0000} *– 10 seconds pause*{color} 

2020-04-14T12:22:58,981 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: Starting task [Stage-0:DDL] in serial mode
2020-04-14T12:22:59,003 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: Completed executing command(queryId=root_20200414122248_aa6e88cc-9490-4ec2-aee5-ea0bc076dbb2); Time taken: 10.051 seconds
2020-04-14T12:22:59,004 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: OK
2020-04-14T12:22:59,004 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2020-04-14T12:22:59,017 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] CliDriver: Time taken: 10.787 seconds
2020-04-14T12:22:59,028 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] conf.HiveConf: Using the default value passed in for log id: 58ad961c-26a8-41a0-a628-eb56c18e7ae2
2020-04-14T12:22:59,029 INFO [58ad961c-26a8-41a0-a628-eb56c18e7ae2 main] session.SessionState: Resetting thread name to main

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)