[jira] [Created] (HIVE-19490) Locking on Insert into for non native and managed tables.

["slim bouguerra (JIRA)" <ji...@apache.org>]

slim bouguerra created HIVE-19490:
-------------------------------------

             Summary: Locking on Insert into for non native and managed tables.
                 Key: HIVE-19490
                 URL: https://issues.apache.org/jira/browse/HIVE-19490
             Project: Hive
          Issue Type: Improvement
          Components: Druid integration
            Reporter: slim bouguerra


Current state of the art: 

Managed non native table like Druid Tables, will need to get a Lock on Insert into or insert Over write. The nature of this lock is set to Exclusive by default for any non native table.

This implies that Inserts into Druid table will Lock any read query as well during the execution of the insert into. IMO this lock (on insert into) is  not needed since the insert statement is appending data and the state of loading it is managed partially by Hive Storage handler hook and part of it by Druid. 

What i am proposing is to relax the lock level to shared for all non native tables on insert into operations and keep it as Exclusive Write for insert Overwrite for now.

 

Any feedback is welcome.

cc [~ekoifman] / [~ashutoshc] / [~jdere] / [~hagleitn]

Also am not sure what is the best way to unit test this currently am using debugger to check of locks are what i except, please let me know if there is a better way to do this. 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)