You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Ramesh Kumar Thangarajan (Jira)" <ji...@apache.org> on 2020/09/11 03:37:00 UTC

[jira] [Created] (HIVE-24145) Fix preemption issues in reducers and file sink operators

Ramesh Kumar Thangarajan created HIVE-24145:
-----------------------------------------------

             Summary: Fix preemption issues in reducers and file sink operators
                 Key: HIVE-24145
                 URL: https://issues.apache.org/jira/browse/HIVE-24145
             Project: Hive
          Issue Type: Bug
            Reporter: Ramesh Kumar Thangarajan
            Assignee: Ramesh Kumar Thangarajan


There are two issues because of preemption:
 # Reducers are getting reordered as part of optimizations because of which more preemption happen
 # Preemption in the middle of writing can cause the file to not close and lead to errors when we read the file later



--
This message was sent by Atlassian Jira
(v8.3.4#803005)