You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Antal Sinkovits (Jira)" <ji...@apache.org> on 2021/01/18 14:35:00 UTC

[jira] [Created] (HIVE-24653) Race condition between compactor marker generation and get splits

Antal Sinkovits created HIVE-24653:
--------------------------------------

             Summary: Race condition between compactor marker generation and get splits
                 Key: HIVE-24653
                 URL: https://issues.apache.org/jira/browse/HIVE-24653
             Project: Hive
          Issue Type: Bug
    Affects Versions: 3.1.2
            Reporter: Antal Sinkovits
            Assignee: Antal Sinkovits


In a rear scenario it's possible that the compactor moved the files in the final location before creating the compactor marker, so it can be fetched by get splits before the marker is created.

2020-09-14 04:55:25,978 [ERROR] ORC_GET_SPLITS #4 |io.AcidUtils|: Failed to read hdfs://host/warehouse/tablespace/managed/hive/database.db/table/partition=x/base_0011535/_metadata_acid: No content to map to Object due to end of input
java.io.EOFException: No content to map to Object due to end of input




--
This message was sent by Atlassian Jira
(v8.3.4#803005)