You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Rajesh Balamohan (Jira)" <ji...@apache.org> on 2020/04/08 07:46:00 UTC

[jira] [Commented] (HIVE-23154) Fix race condition in Utilities::mvFileToFinalPath

    [ https://issues.apache.org/jira/browse/HIVE-23154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077918#comment-17077918 ] 

Rajesh Balamohan commented on HIVE-23154:
-----------------------------------------

RB: https://reviews.apache.org/r/72333/diff/1/

> Fix race condition in Utilities::mvFileToFinalPath
> --------------------------------------------------
>
>                 Key: HIVE-23154
>                 URL: https://issues.apache.org/jira/browse/HIVE-23154
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>            Reporter: Rajesh Balamohan
>            Priority: Major
>         Attachments: HIVE-23154.1.patch
>
>
> Utilities::mvFileToFinalPath is used for moving files from "/_tmp.-ext to "/-ext" folder. Tasks write data to "_tmp" . Before writing to final destination, they are moved to "-ext" folder. As part of it, it has checks to ensure that run-away task outputs are not copied to "-ext" folder.
> Currently, there is a race condition between computing the snapshot of files to be copied and the rename operation. Same issue persists in "insert into" case as well.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)