You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Eugene Koifman (JIRA)" <ji...@apache.org> on 2017/12/08 01:11:00 UTC
[jira] [Commented] (HIVE-16688) Make sure Alter Table to set
transaction=true acquires X lock
[ https://issues.apache.org/jira/browse/HIVE-16688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282865#comment-16282865 ]
Eugene Koifman commented on HIVE-16688:
---------------------------------------
this applies to converting to MM table which copies all existing files to a delta_x. Need to make sure a parallel insert does write data to partition root that won't be copied
> Make sure Alter Table to set transaction=true acquires X lock
> -------------------------------------------------------------
>
> Key: HIVE-16688
> URL: https://issues.apache.org/jira/browse/HIVE-16688
> Project: Hive
> Issue Type: Sub-task
> Components: Transactions
> Affects Versions: 1.3.0
> Reporter: Eugene Koifman
> Assignee: Eugene Koifman
> Priority: Critical
> Fix For: 3.0.0
>
> Attachments: HIVE-16688.01.patch, HIVE-16688.02.patch
>
>
> suppose we have non-acid table with some data
> An insert op starts (long running) (with hive.txn.strict.locking.mode=false this takes shared lock)
> An alter table runs to add (transactional=true)
> An update is run which will read the list of "original" files and assign IDs on the fly which are written to a delta file.
> The long running insert completes.
> Another update is run which now sees a different set of "original" files and will (most likely) assign different IDs.
> Need to make sure to mutex this
> To clarify: The X lock is acquired for "An alter table runs to add (transactional=true)"
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)