[jira] [Created] (HIVE-25777) ACID: Pick the compactor transaction over insert dir

["Gopal Vijayaraghavan (Jira)" <ji...@apache.org>]

Gopal Vijayaraghavan created HIVE-25777:
-------------------------------------------

             Summary: ACID: Pick the compactor transaction over insert dir
                 Key: HIVE-25777
                 URL: https://issues.apache.org/jira/browse/HIVE-25777
             Project: Hive
          Issue Type: Bug
          Components: Transactions
    Affects Versions: 3.1.2, 4.0.0
            Reporter: Gopal Vijayaraghavan


If there are two competing versions of a particular write-id, one from the compactor and another from the original insert, always pick the compactor one once it is committed.

If the directory structure looks like 

{code}
base_000011/
base_000011_v192/
{code}

Then always pick the v192 transaction if txnid=192 is committed.

This is required to ensure that the raw base_ dir can be deleted safely on non-atomic directory deletions (like s3), without a race condition between getSplits and the actual file-reader.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)