You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Xuefu Zhang (JIRA)" <ji...@apache.org> on 2017/03/09 16:26:38 UTC

[jira] [Updated] (HIVE-16156) FileSinkOperator should delete existing output target when renaming

     [ https://issues.apache.org/jira/browse/HIVE-16156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xuefu Zhang updated HIVE-16156:
-------------------------------
    Status: Patch Available  (was: Open)

> FileSinkOperator should delete existing output target when renaming
> -------------------------------------------------------------------
>
>                 Key: HIVE-16156
>                 URL: https://issues.apache.org/jira/browse/HIVE-16156
>             Project: Hive
>          Issue Type: Bug
>          Components: Operators
>    Affects Versions: 1.1.0
>            Reporter: Xuefu Zhang
>            Assignee: Xuefu Zhang
>         Attachments: HIVE-16156.patch
>
>
> If a task get killed (for whatever a reason) after it completes the renaming the temp output to final output during commit, subsequent task attempts will fail when renaming because of the existence of the target output. This can happen, however rarely.
> Hive should check the existence of the target output and delete it before renaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)