[jira] [Created] (HIVE-6913) Hive unable to find the hashtable file during complex multi-staged map join

["Brock Noland (JIRA)" <ji...@apache.org>]

Brock Noland created HIVE-6913:
----------------------------------

             Summary: Hive unable to find the hashtable file during complex multi-staged map join
                 Key: HIVE-6913
                 URL: https://issues.apache.org/jira/browse/HIVE-6913
             Project: Hive
          Issue Type: Bug
            Reporter: Brock Noland


If a query has multiple mapjoins and one of the tables to be mapjoined is empty, the query can result in a "no such file or directory" when looking for the hashtable.

This is because when we generate a dummy hash table, we do not close the TableScan (TS) operator for that table. Additionally, HashTableSinkOperator (HTSO) outputs it's hash tables in the closeOp method. However, when close is called on HTSO we check to ensure that all parents are closed: https://github.com/apache/hive/blob/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Operator.java#L333

which is not true on this case, because the TS operator for the empty table was never closed.



--
This message was sent by Atlassian JIRA
(v6.2#6252)