You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Dmitriy Fingerman (Jira)" <ji...@apache.org> on 2024/01/30 15:09:00 UTC

[jira] [Created] (HIVE-28047) Iceberg: Major QB Compaction with a single commit

Dmitriy Fingerman created HIVE-28047:
----------------------------------------

             Summary: Iceberg: Major QB Compaction with a single commit
                 Key: HIVE-28047
                 URL: https://issues.apache.org/jira/browse/HIVE-28047
             Project: Hive
          Issue Type: Improvement
            Reporter: Dmitriy Fingerman
            Assignee: Dmitriy Fingerman


Currently Hive Iceberg Major QB Compaction happens in 2 commits in a single transaction. First commit deletes all existing files and second commit inserts compacted data files. If a user queries the table using snapshot id of the first commit after the compaction, there will be no records returned which is invalid. Need to find a way to do it in one commit.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)