You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Denys Kuzmenko (Jira)" <ji...@apache.org> on 2026/04/15 17:33:00 UTC
[jira] [Updated] (HIVE-29567) Data loss in query-based major compaction
[ https://issues.apache.org/jira/browse/HIVE-29567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Denys Kuzmenko updated HIVE-29567:
----------------------------------
Summary: Data loss in query-based major compaction (was: Data loss bug in query-based major compaction)
> Data loss in query-based major compaction
> -----------------------------------------
>
> Key: HIVE-29567
> URL: https://issues.apache.org/jira/browse/HIVE-29567
> Project: Hive
> Issue Type: Bug
> Components: Transactions
> Affects Versions: 4.1.0, 4.2.0
> Reporter: Denys Kuzmenko
> Assignee: Denys Kuzmenko
> Priority: Major
> Labels: pull-request-available
>
> *Root Cause *
>
> HIVE-28238 introduced a data loss bug in query-based major compaction. The compaction INSERT query reads 0 rows because it treats the empty base directory created by the preceding CREATE TABLE step as a valid (committed) base, ignoring all delta directories.
> Before HIVE-28238, the *buggy* VALID_TXNS_KEY set by AcidCompactionService was never actually used for data reads. Each compaction subquery *opened its own implicit transaction* through the Driver, and the compaction chain of events masked the bug
--
This message was sent by Atlassian Jira
(v8.20.10#820010)