You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Eugene Koifman (JIRA)" <ji...@apache.org> on 2016/10/24 20:22:58 UTC

[jira] [Updated] (HIVE-15044) LockManager may be too coarse grained

     [ https://issues.apache.org/jira/browse/HIVE-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eugene Koifman updated HIVE-15044:
----------------------------------
    Description: 
Consider
{noformat}
create table target (a int, b int)
      partitioned by (p int, q int) clustered by (a) into 2  buckets 
      stored as orc TBLPROPERTIES ('transactional'='true')")
insert into target partition(p=1,q) values (1,2,3)
{noformat}

this insert will lock the whole table.  See 
{noformat}
DbTxnManager.acquireLocks()
switch (output.getType()) {
        case DUMMYPARTITION:   //
{noformat}

Insert operation runs with SHARED_READ lock but once HIVE-15032 is addressed this will be an issue for Update/Delete/Merge which use a more restrictive SHARED_WRITE lock.

This can probably be achieved using "like /db/table/part/*" predicate making the LM operations more expensive

  was:
Consider
{noformat}
create table target (a int, b int)
      partitioned by (p int, q int) clustered by (a) into 2  buckets 
      stored as orc TBLPROPERTIES ('transactional'='true')")
insert into target partition(p=1,q) values (1,2,3)
{noformat}

this insert will lock the whole table.  See 
{noformat}
DbTxnManager.acquireLocks()
switch (output.getType()) {
        case DUMMYPARTITION:   //
{noformat}

Insert operation runs with SHARED_READ lock but once HIVE-15032 is addressed this will be an issue for Update/Delete/Merge which use a more restrictive SHARED_WRITE lock.


> LockManager may be too coarse grained 
> --------------------------------------
>
>                 Key: HIVE-15044
>                 URL: https://issues.apache.org/jira/browse/HIVE-15044
>             Project: Hive
>          Issue Type: Improvement
>          Components: Transactions
>    Affects Versions: 1.0.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>
> Consider
> {noformat}
> create table target (a int, b int)
>       partitioned by (p int, q int) clustered by (a) into 2  buckets 
>       stored as orc TBLPROPERTIES ('transactional'='true')")
> insert into target partition(p=1,q) values (1,2,3)
> {noformat}
> this insert will lock the whole table.  See 
> {noformat}
> DbTxnManager.acquireLocks()
> switch (output.getType()) {
>         case DUMMYPARTITION:   //
> {noformat}
> Insert operation runs with SHARED_READ lock but once HIVE-15032 is addressed this will be an issue for Update/Delete/Merge which use a more restrictive SHARED_WRITE lock.
> This can probably be achieved using "like /db/table/part/*" predicate making the LM operations more expensive



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)