You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Jesus Camacho Rodriguez (Jira)" <ji...@apache.org> on 2020/08/25 21:56:00 UTC

[jira] [Created] (HIVE-24073) Execution exception in sort-merge semijoin

Jesus Camacho Rodriguez created HIVE-24073:
----------------------------------------------

             Summary: Execution exception in sort-merge semijoin
                 Key: HIVE-24073
                 URL: https://issues.apache.org/jira/browse/HIVE-24073
             Project: Hive
          Issue Type: Bug
          Components: Operators
            Reporter: Jesus Camacho Rodriguez
            Assignee: mahesh kumar behera


Working on HIVE-24001, we trigger an additional SJ conversion that leads to this exception at execution time:

{code}
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: Attempting to overwrite nextKeyWritables[1]
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:1063)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:685)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:707)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:707)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:707)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:707)
	at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.close(MapRecordProcessor.java:462)
	... 16 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: Attempting to overwrite nextKeyWritables[1]
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(GroupByOperator.java:1037)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.closeOp(GroupByOperator.java:1060)
	... 22 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Attempting to overwrite nextKeyWritables[1]
	at org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.processKey(CommonMergeJoinOperator.java:564)
	at org.apache.hadoop.hive.ql.exec.CommonMergeJoinOperator.process(CommonMergeJoinOperator.java:243)
	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:887)
	at org.apache.hadoop.hive.ql.exec.TezDummyStoreOperator.process(TezDummyStoreOperator.java:49)
	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:887)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.forward(GroupByOperator.java:1003)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.flush(GroupByOperator.java:1020)
	... 23 more
{code}

To reproduce, just set {{hive.auto.convert.sortmerge.join}} to {{true}} in the last query in {{auto_sortmerge_join_10.q}} after HIVE-24041 has been merged.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)