You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2016/11/17 23:16:58 UTC
[jira] [Created] (HIVE-15235) sortmergejoin can produce incorrect
plan wrt dummy operators
Sergey Shelukhin created HIVE-15235:
---------------------------------------
Summary: sortmergejoin can produce incorrect plan wrt dummy operators
Key: HIVE-15235
URL: https://issues.apache.org/jira/browse/HIVE-15235
Project: Hive
Issue Type: Bug
Reporter: Sergey Shelukhin
{noformat}
<MERGEJOIN>Id =13
<Children>
<SEL>Id =12
<Children>
<MAPJOIN>Id =10
<Children>
<FS>Id =11
<Children>
<\Children>
<Parent>Id = 10 null<\Parent>
<\FS>
<\Children>
<Parent>Id = 12 nullId = 9
<HASHTABLEDUMMY>Id =9
<Children>null
<\Children>
<Parent><\Parent>
<\HASHTABLEDUMMY><\Parent>
<\MAPJOIN>
<\Children>
<Parent>Id = 13 null<\Parent>
<\SEL>
<\Children>
{noformat}
This only happens when sortmergejoin is enabled.
This is on reduce size of a Tez job; during initialization, dummy operators are not initialized (presumably, they are not present in the work); that results in MapJoin not being initialized, even though its proper parent is.
Manifests as an NPE
{noformat}
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.MapJoinOperator.process(MapJoinOperator.java:350)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)