You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Zsolt Miskolczi (Jira)" <ji...@apache.org> on 2022/09/13 07:42:00 UTC
[jira] [Resolved] (HIVE-26482) Create a unit test checking compaction output file names on a partitioned table
[ https://issues.apache.org/jira/browse/HIVE-26482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zsolt Miskolczi resolved HIVE-26482.
------------------------------------
Resolution: Fixed
> Create a unit test checking compaction output file names on a partitioned table
> -------------------------------------------------------------------------------
>
> Key: HIVE-26482
> URL: https://issues.apache.org/jira/browse/HIVE-26482
> Project: Hive
> Issue Type: Test
> Components: Hive
> Reporter: Zsolt Miskolczi
> Assignee: Zsolt Miskolczi
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Compaction output directories' writeIds only reflect the writeIds of the deltas it compacts, and not the max write id of the table
> Example:
> Pre-compaction...
> {code:java}
> Partition p=1 contains:
> delta_1_1
> delta_2_2
> partition p=2 contains
> delta_3_3
> delta_4_4
> {code}
> After minor compaction...
> {code:java}
> Partition p=1 contains:
> delta_1_2
> partition p=2 contains
> delta_3_4
> {code}
> AFAIK there are no unit tests that reflect this.
> TestTxnCommands2#testFullACIDAbortWithManyPartitions is a good template to start with.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)