[hive] branch master updated: HIVE-22754 : Trim some extra HDFS find file name calls that can be deduced using current TXN watermark (Slim Bouguerra via Ashutosh Chauhan)

[ha...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

hashutosh pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hive.git


The following commit(s) were added to refs/heads/master by this push:
     new eede04f  HIVE-22754 : Trim some extra HDFS find file name calls that can be deduced using current TXN watermark (Slim Bouguerra via Ashutosh Chauhan)
eede04f is described below

commit eede04f75d9ef7d8950f190896220385b671214a
Author: Slim Bouguerra <bs...@apache.org>
AuthorDate: Tue Jan 21 18:03:23 2020 -0800

    HIVE-22754 : Trim some extra HDFS find file name calls that can be deduced using current TXN watermark (Slim Bouguerra via Ashutosh Chauhan)
    
    Signed-off-by: Ashutosh Chauhan <ha...@apache.org>
---
 ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java | 3 +++
 1 file changed, 3 insertions(+)

diff --git a/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java b/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java
index 0ff9e1a..ed68e0f 100644
--- a/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java
+++ b/ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java
@@ -1633,6 +1633,9 @@ public class AcidUtils {
       //By definition there are no open txns with id < 1.
       return true;
     }
+    if (writeIdList.getMinOpenWriteId() != null && parsedBase.getWriteId() <= writeIdList.getMinOpenWriteId()) {
+      return true;
+    }
     if(isCompactedBase(parsedBase, fs, (HdfsDirSnapshot) null)) {
       return writeIdList.isValidBase(parsedBase.getWriteId());
     }