You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Rajesh Balamohan (Jira)" <ji...@apache.org> on 2020/04/08 07:38:00 UTC

[jira] [Created] (HIVE-23154) Fix race condition in Utilities::mvFileToFinalPath

Rajesh Balamohan created HIVE-23154:
---------------------------------------

             Summary: Fix race condition in Utilities::mvFileToFinalPath
                 Key: HIVE-23154
                 URL: https://issues.apache.org/jira/browse/HIVE-23154
             Project: Hive
          Issue Type: Improvement
          Components: HiveServer2
            Reporter: Rajesh Balamohan
         Attachments: HIVE-23154.1.patch

Utilities::mvFileToFinalPath is used for moving files from "/_tmp.-ext to "/-ext" folder. Tasks write data to "_tmp" . Before writing to final destination, they are moved to "-ext" folder. As part of it, it has checks to ensure that run-away task outputs are not copied to "-ext" folder.

Currently, there is a race condition between computing the snapshot of files to be copied and the rename operation. Same issue persists in "insert into" case as well.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)