You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Rajesh Balamohan (Jira)" <ji...@apache.org> on 2020/04/08 07:46:00 UTC
[jira] [Commented] (HIVE-23154) Fix race condition in
Utilities::mvFileToFinalPath
[ https://issues.apache.org/jira/browse/HIVE-23154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077918#comment-17077918 ]
Rajesh Balamohan commented on HIVE-23154:
-----------------------------------------
RB: https://reviews.apache.org/r/72333/diff/1/
> Fix race condition in Utilities::mvFileToFinalPath
> --------------------------------------------------
>
> Key: HIVE-23154
> URL: https://issues.apache.org/jira/browse/HIVE-23154
> Project: Hive
> Issue Type: Improvement
> Components: HiveServer2
> Reporter: Rajesh Balamohan
> Priority: Major
> Attachments: HIVE-23154.1.patch
>
>
> Utilities::mvFileToFinalPath is used for moving files from "/_tmp.-ext to "/-ext" folder. Tasks write data to "_tmp" . Before writing to final destination, they are moved to "-ext" folder. As part of it, it has checks to ensure that run-away task outputs are not copied to "-ext" folder.
> Currently, there is a race condition between computing the snapshot of files to be copied and the rename operation. Same issue persists in "insert into" case as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)