You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/07/13 14:32:00 UTC
[jira] [Commented] (IMPALA-10724) Add mutable validWriteIdList
[ https://issues.apache.org/jira/browse/IMPALA-10724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17379919#comment-17379919 ]
ASF subversion and git services commented on IMPALA-10724:
----------------------------------------------------------
Commit 00c8e157ddcaec3f12a09ef410d8716b3dac03a4 in impala's branch refs/heads/master from Yu-Wen Lai
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=00c8e15 ]
IMPALA-10724: Add mutable validWriteIdList
In this patch, we add a new class for manually updating writeIdList.
In terms of updating writeIdList, we introduce three methods including
addOpenWriteId, addAbortedWriteIds, and addCommittedWriteIds.
We will use this class in MetastoreEventProcessor for fine-grained
table refreshing. With the control of writeIdList, we will be able to
update the transactional table partially and keep it consistent.
There are some restrictions for MutableValidWriteIdList.
1. We need to mark a writeId open before mark it committed/aborted.
2. We only allow two writeId state transitions, open -> committed or
open -> aborted. Any other transition is NOT allowed.
Change-Id: I28e60db0afd5d4398af24449b72abc928421f7c6
Reviewed-on: http://gerrit.cloudera.org:8080/17538
Tested-by: Impala Public Jenkins <im...@cloudera.com>
Reviewed-by: Quanlong Huang <hu...@gmail.com>
> Add mutable validWriteIdList
> ----------------------------
>
> Key: IMPALA-10724
> URL: https://issues.apache.org/jira/browse/IMPALA-10724
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Yu-Wen Lai
> Assignee: Yu-Wen Lai
> Priority: Major
>
> Although the current implementation for validWriteIdList is not strictly immutable, it is in some sense to provide a read-only view snapshot. This change is to add another class to provide functionalities for manipulating the writeIdList. We could use this to keep writeIdList up-to-date for event-based metadata refreshing.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org