[jira] [Commented] (HIVE-14895) CompactorMR.CompactorOutputCommitter race condition

["Sergio Peña (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15681525#comment-15681525 ] 

Sergio Peña commented on HIVE-14895:
------------------------------------

I'm moving this JIRA out of 2.1.1 release as it is not a blocker nor critical for a 2.1.1 RC version. Feel free to commit it to branch 2.1 if the patch is ready before the release.

> CompactorMR.CompactorOutputCommitter race condition
> ---------------------------------------------------
>
>                 Key: HIVE-14895
>                 URL: https://issues.apache.org/jira/browse/HIVE-14895
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>
> commitJob() method renames each file in TMP_LOCATION separately.  so someone may read FINAL_LOCATION and see only some of the files that should be there.
> Use FileSystem.getFileStatus(TMP_LOCATION) and just rename the dir.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)