You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/03/25 06:46:00 UTC
[jira] [Work logged] (HIVE-21109) Stats replication for ACID
tables.
[ https://issues.apache.org/jira/browse/HIVE-21109?focusedWorklogId=217846&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-217846 ]
ASF GitHub Bot logged work on HIVE-21109:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 25/Mar/19 06:45
Start Date: 25/Mar/19 06:45
Worklog Time Spent: 10m
Work Description: ashutosh-bapat commented on pull request #579: HIVE-21109 : Support stats replication for ACID tables.
URL: https://github.com/apache/hive/pull/579
During bootstrap we use a method similar to non-ACID tables to transfer statistics of an ACID table
from source to replica. However installing statistics of an ACID table requires a valid writeId and
writeId list. We use the table/partition's latest writeId and a valid transaction list containing
only that writeId to install the statistics in the metastore.
During incremental replication writeId is obtained from the UpdateStats event and valid writeId list
with that writeId marked as valid is used to install the column statistics. Table level statistics is
replicated by replaying corresponding ALTER_TABLE/ALTER_PARTITION event.
Further this commit has following related changes.
1. The table or the partition associated with the commit transaction event should have been created
when replaying corresponding events before commit transaction event. Thus there is no need to add
tasks for creating the table or the partition.
2 Maintain a list of open replicated transactions and use that to create valid transactions list
when replaying a replicated event.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 217846)
Time Spent: 10m
Remaining Estimate: 0h
> Stats replication for ACID tables.
> ----------------------------------
>
> Key: HIVE-21109
> URL: https://issues.apache.org/jira/browse/HIVE-21109
> Project: Hive
> Issue Type: Sub-task
> Reporter: Ashutosh Bapat
> Assignee: Ashutosh Bapat
> Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-21109.01.patch, HIVE-21109.02.patch, HIVE-21109.03.patch, HIVE-21109.04.patch, HIVE-21109.05.patch
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Transactional tables require a writeID associated with the stats update. This writeId needs to be in sync with the writeId on the source and hence needs to be replicated from the source.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)