You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Alexander Alten-Lorenz (JIRA)" <ji...@apache.org> on 2013/03/11 07:55:13 UTC

[jira] [Created] (HIVE-4147) Slow Hive JDBC in concurrency mode to create/drop table

Alexander Alten-Lorenz created HIVE-4147:
--------------------------------------------

             Summary: Slow Hive JDBC in concurrency mode to create/drop table
                 Key: HIVE-4147
                 URL: https://issues.apache.org/jira/browse/HIVE-4147
             Project: Hive
          Issue Type: Improvement
          Components: JDBC
    Affects Versions: 0.10.0
            Reporter: Alexander Alten-Lorenz


It's very slow using hive jdbc in concurrency mode to create/drop table, which is 20 times slower than using HiveMetatstoreClient.

test steps: 
1. create 100 different hive table one by one by using hive jdbc: "create table ......" 
2. drop table one by one by using hive jdbc: "drop table ......" and timing 
3. create 100 different hive table one by one by using hive jdbc: "create table ......" 
4. drop tables one by one by using new HiveMetatstoreClient().dropTable("default", "table_name") and timing

results 
step 2 is 20 times slower than step 4. 
basically hive jdbc is 20 times slower than HiveMetatstoreClient not only create/table, but also the same kind of calls.

Dropping tables via this low level API could cause issues if there are any clients concurrently querying the table. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira