You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Zsolt Miskolczi (Jira)" <ji...@apache.org> on 2022/09/13 07:42:00 UTC

[jira] [Resolved] (HIVE-26482) Create a unit test checking compaction output file names on a partitioned table

     [ https://issues.apache.org/jira/browse/HIVE-26482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zsolt Miskolczi resolved HIVE-26482.
------------------------------------
    Resolution: Fixed

> Create a unit test checking compaction output file names on a partitioned table
> -------------------------------------------------------------------------------
>
>                 Key: HIVE-26482
>                 URL: https://issues.apache.org/jira/browse/HIVE-26482
>             Project: Hive
>          Issue Type: Test
>          Components: Hive
>            Reporter: Zsolt Miskolczi
>            Assignee: Zsolt Miskolczi
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Compaction output directories' writeIds only reflect the writeIds of the deltas it compacts, and not the max write id of the table
> Example:
> Pre-compaction...
> {code:java}
> Partition p=1 contains:
> delta_1_1
> delta_2_2
> partition p=2 contains
> delta_3_3
> delta_4_4
> {code}
> After minor compaction...
> {code:java}
> Partition p=1 contains:
> delta_1_2
> partition p=2 contains
> delta_3_4
> {code}
> AFAIK there are no unit tests that reflect this.
> TestTxnCommands2#testFullACIDAbortWithManyPartitions is a good template to start with.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)