You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Lefty Leverenz (JIRA)" <ji...@apache.org> on 2017/11/14 02:49:01 UTC
[jira] [Comment Edited] (HIVE-14035) Enable predicate pushdown to
delta files created by ACID Transactions
[ https://issues.apache.org/jira/browse/HIVE-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15419834#comment-15419834 ]
Lefty Leverenz edited comment on HIVE-14035 at 11/14/17 2:48 AM:
-----------------------------------------------------------------
Doc note: Besides the design document, which should be added to the wiki, there is a new configuration parameter (*hive.txn.operational.properties*) that will need to be documented in the wiki for release 2.2.0.
* [Configuration Properties -- Transactions and Compactor | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-TransactionsandCompactor]
Added a TODOC2.2 label.
Update 13/Nov/17: *hive.txn.operational.properties* does not need to be documented. Its description is changed by HIVE-14878 and HIVE-17458.
was (Author: lefty@hortonworks.com):
Doc note: Besides the design document, which should be added to the wiki, there is a new configuration parameter (*hive.txn.operational.properties*) that will need to be documented in the wiki for release 2.2.0.
* [Configuration Properties -- Transactions and Compactor | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-TransactionsandCompactor]
Added a TODOC2.2 label.
> Enable predicate pushdown to delta files created by ACID Transactions
> ---------------------------------------------------------------------
>
> Key: HIVE-14035
> URL: https://issues.apache.org/jira/browse/HIVE-14035
> Project: Hive
> Issue Type: New Feature
> Components: Transactions
> Reporter: Saket Saurabh
> Assignee: Saket Saurabh
> Labels: TODOC2.2
> Fix For: 2.3.0
>
> Attachments: Design.Document.Improving ACID performance in Hive.01.docx, Design.Document.Improving ACID performance in Hive.02.docx, HIVE-14035.02.patch, HIVE-14035.03.patch, HIVE-14035.04.patch, HIVE-14035.05.patch, HIVE-14035.06.patch, HIVE-14035.07.patch, HIVE-14035.08.patch, HIVE-14035.09.patch, HIVE-14035.10.patch, HIVE-14035.11.patch, HIVE-14035.12.patch, HIVE-14035.13.patch, HIVE-14035.14.patch, HIVE-14035.15.patch, HIVE-14035.16.patch, HIVE-14035.17.patch, HIVE-14035.patch
>
>
> In current Hive version, delta files created by ACID transactions do not allow predicate pushdown if they contain any update/delete events. This is done to preserve correctness when following a multi-version approach during event collapsing, where an update event overwrites an existing insert event.
> This JIRA proposes to split an update event into a combination of a delete event followed by a new insert event, that can enable predicate push down to all delta files without breaking correctness. To support backward compatibility for this feature, this JIRA also proposes to add some sort of versioning to ACID that can allow different versions of ACID transactions to co-exist together.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)