You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/01/18 14:44:00 UTC

[jira] [Updated] (HIVE-24653) Race condition between compactor marker generation and get splits

     [ https://issues.apache.org/jira/browse/HIVE-24653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated HIVE-24653:
----------------------------------
    Labels: pull-request-available  (was: )

> Race condition between compactor marker generation and get splits
> -----------------------------------------------------------------
>
>                 Key: HIVE-24653
>                 URL: https://issues.apache.org/jira/browse/HIVE-24653
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 3.1.2
>            Reporter: Antal Sinkovits
>            Assignee: Antal Sinkovits
>            Priority: Minor
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> In a rear scenario it's possible that the compactor moved the files in the final location before creating the compactor marker, so it can be fetched by get splits before the marker is created.
> 2020-09-14 04:55:25,978 [ERROR] ORC_GET_SPLITS #4 |io.AcidUtils|: Failed to read hdfs://host/warehouse/tablespace/managed/hive/database.db/table/partition=x/base_0011535/_metadata_acid: No content to map to Object due to end of input
> java.io.EOFException: No content to map to Object due to end of input



--
This message was sent by Atlassian Jira
(v8.3.4#803005)