You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hive.apache.org by ku...@apache.org on 2020/04/27 08:55:10 UTC

[hive] branch master updated: HIVE-23286: The clean-up in case of an aborted FileSinkOperator is not correct for ACID direct insert (Marta Kuczora, reviewed by Peter Vary)

This is an automated email from the ASF dual-hosted git repository.

kuczoram pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
     new d6ad73c  HIVE-23286: The clean-up in case of an aborted FileSinkOperator is not correct for ACID direct insert (Marta Kuczora, reviewed by Peter Vary)
d6ad73c is described below

commit d6ad73c3615cc77a1ea9d16b2f287ec649aeb4cd
Author: Marta Kuczora <ku...@cloudera.com>
AuthorDate: Mon Apr 27 10:54:03 2020 +0200

    HIVE-23286: The clean-up in case of an aborted FileSinkOperator is not correct for ACID direct insert (Marta Kuczora, reviewed by Peter Vary)
---
 ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java b/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java
index d121a21..082f1cb 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java
@@ -1422,7 +1422,8 @@ public class FileSinkOperator extends TerminalOperator<FileSinkDesc> implements
       // Hadoop always call close() even if an Exception was thrown in map() or
       // reduce().
       for (FSPaths fsp : valToPaths.values()) {
-        fsp.abortWritersAndUpdaters(fs, abort, !autoDelete && isNativeTable() && !conf.isMmTable());
+        fsp.abortWritersAndUpdaters(fs, abort,
+            !autoDelete && isNativeTable() && !conf.isMmTable() && !conf.isDirectInsert());
       }
     }
     fsp = prevFsp = null;