You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2018/04/10 19:33:00 UTC

[jira] [Commented] (HIVE-14981) Eliminate unnecessary MapJoin restriction in HIVE-11394

    [ https://issues.apache.org/jira/browse/HIVE-14981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432822#comment-16432822 ] 

Hive QA commented on HIVE-14981:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12833777/HIVE-14981.02.patch

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/10123/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/10123/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-10123/

Messages:
{noformat}
**** This message was trimmed, see log for full details ****
Falling back to three-way merge...
Applied patch to 'ql/src/java/org/apache/hadoop/hive/ql/plan/VectorMapJoinDesc.java' cleanly.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_between_columns.q.out:115
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_between_columns.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_binary_join_groupby.q.out:461
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_binary_join_groupby.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_char_mapjoin1.q.out:179
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_char_mapjoin1.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_decimal_mapjoin.q.out:126
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_decimal_mapjoin.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_include_no_sel.q.out:250
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_include_no_sel.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_inner_join.q.out:88
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_inner_join.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_interval_mapjoin.q.out:229
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_interval_mapjoin.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_left_outer_join2.q.out:318
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_left_outer_join2.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_leftsemi_mapjoin.q.out:3365
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_leftsemi_mapjoin.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_mapjoin_reduce.q.out:155
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_mapjoin_reduce.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_nullsafe_join.q.out:87
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_nullsafe_join.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_outer_join0.q.out:113
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_outer_join0.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_outer_join1.q.out:273
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_outer_join1.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vector_outer_join2.q.out:289
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vector_outer_join2.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/llap/vectorized_mapjoin.q.out:59
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/vectorized_mapjoin.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/spark/vector_decimal_mapjoin.q.out:170
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/spark/vector_decimal_mapjoin.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/spark/vector_inner_join.q.out:138
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/spark/vector_inner_join.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/spark/vector_outer_join0.q.out:155
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/spark/vector_outer_join0.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/spark/vector_outer_join1.q.out:315
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/spark/vector_outer_join1.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/spark/vector_outer_join2.q.out:371
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/spark/vector_outer_join2.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/spark/vectorized_mapjoin.q.out:104
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/spark/vectorized_mapjoin.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vector_between_columns.q.out:133
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_between_columns.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vector_binary_join_groupby.q.out:429
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_binary_join_groupby.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vector_char_mapjoin1.q.out:196
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_char_mapjoin1.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vector_decimal_mapjoin.q.out:144
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_decimal_mapjoin.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vector_include_no_sel.q.out:236
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_include_no_sel.q.out' with conflicts.
error: ql/src/test/results/clientpositive/vector_inner_join.q.out: does not exist in index
error: patch failed: ql/src/test/results/clientpositive/vector_interval_mapjoin.q.out:247
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_interval_mapjoin.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vector_left_outer_join2.q.out:334
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_left_outer_join2.q.out' with conflicts.
error: ql/src/test/results/clientpositive/vector_nullsafe_join.q.out: does not exist in index
error: patch failed: ql/src/test/results/clientpositive/vector_outer_join0.q.out:124
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_outer_join0.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vector_outer_join1.q.out:284
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_outer_join1.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vector_outer_join2.q.out:315
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_outer_join2.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vector_outer_join3.q.out:244
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_outer_join3.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vector_outer_join4.q.out:258
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_outer_join4.q.out' with conflicts.
error: ql/src/test/results/clientpositive/vector_outer_join5.q.out: does not exist in index
error: patch failed: ql/src/test/results/clientpositive/vector_outer_join6.q.out:134
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vector_outer_join6.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vectorized_mapjoin.q.out:76
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vectorized_mapjoin.q.out' with conflicts.
error: patch failed: ql/src/test/results/clientpositive/vectorized_mapjoin2.q.out:104
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/vectorized_mapjoin2.q.out' with conflicts.
error: src/java/org/apache/hadoop/hive/ql/optimizer/physical/Vectorizer.java: does not exist in index
error: src/java/org/apache/hadoop/hive/ql/plan/MapJoinDesc.java: does not exist in index
error: src/java/org/apache/hadoop/hive/ql/plan/VectorMapJoinDesc.java: does not exist in index
error: src/test/results/clientpositive/llap/vector_between_columns.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_binary_join_groupby.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_char_mapjoin1.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_decimal_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_include_no_sel.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_inner_join.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_interval_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_left_outer_join2.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_leftsemi_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_mapjoin_reduce.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_nullsafe_join.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_outer_join0.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_outer_join1.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_outer_join2.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorized_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_decimal_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_inner_join.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_outer_join0.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_outer_join1.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_outer_join2.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorized_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/vector_between_columns.q.out: does not exist in index
error: src/test/results/clientpositive/vector_binary_join_groupby.q.out: does not exist in index
error: src/test/results/clientpositive/vector_char_mapjoin1.q.out: does not exist in index
error: src/test/results/clientpositive/vector_decimal_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/vector_include_no_sel.q.out: does not exist in index
error: src/test/results/clientpositive/vector_inner_join.q.out: does not exist in index
error: src/test/results/clientpositive/vector_interval_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/vector_left_outer_join2.q.out: does not exist in index
error: src/test/results/clientpositive/vector_nullsafe_join.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join0.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join1.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join2.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join3.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join4.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join5.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join6.q.out: does not exist in index
error: src/test/results/clientpositive/vectorized_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/vectorized_mapjoin2.q.out: does not exist in index
error: java/org/apache/hadoop/hive/ql/optimizer/physical/Vectorizer.java: does not exist in index
error: java/org/apache/hadoop/hive/ql/plan/MapJoinDesc.java: does not exist in index
error: java/org/apache/hadoop/hive/ql/plan/VectorMapJoinDesc.java: does not exist in index
error: test/results/clientpositive/llap/vector_between_columns.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_binary_join_groupby.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_char_mapjoin1.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_decimal_mapjoin.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_include_no_sel.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_inner_join.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_interval_mapjoin.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_left_outer_join2.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_leftsemi_mapjoin.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_mapjoin_reduce.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_nullsafe_join.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_outer_join0.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_outer_join1.q.out: does not exist in index
error: test/results/clientpositive/llap/vector_outer_join2.q.out: does not exist in index
error: test/results/clientpositive/llap/vectorized_mapjoin.q.out: does not exist in index
error: test/results/clientpositive/spark/vector_decimal_mapjoin.q.out: does not exist in index
error: test/results/clientpositive/spark/vector_inner_join.q.out: does not exist in index
error: test/results/clientpositive/spark/vector_outer_join0.q.out: does not exist in index
error: test/results/clientpositive/spark/vector_outer_join1.q.out: does not exist in index
error: test/results/clientpositive/spark/vector_outer_join2.q.out: does not exist in index
error: test/results/clientpositive/spark/vectorized_mapjoin.q.out: does not exist in index
error: test/results/clientpositive/vector_between_columns.q.out: does not exist in index
error: test/results/clientpositive/vector_binary_join_groupby.q.out: does not exist in index
error: test/results/clientpositive/vector_char_mapjoin1.q.out: does not exist in index
error: test/results/clientpositive/vector_decimal_mapjoin.q.out: does not exist in index
error: test/results/clientpositive/vector_include_no_sel.q.out: does not exist in index
error: test/results/clientpositive/vector_inner_join.q.out: does not exist in index
error: test/results/clientpositive/vector_interval_mapjoin.q.out: does not exist in index
error: test/results/clientpositive/vector_left_outer_join2.q.out: does not exist in index
error: test/results/clientpositive/vector_nullsafe_join.q.out: does not exist in index
error: test/results/clientpositive/vector_outer_join0.q.out: does not exist in index
error: test/results/clientpositive/vector_outer_join1.q.out: does not exist in index
error: test/results/clientpositive/vector_outer_join2.q.out: does not exist in index
error: test/results/clientpositive/vector_outer_join3.q.out: does not exist in index
error: test/results/clientpositive/vector_outer_join4.q.out: does not exist in index
error: test/results/clientpositive/vector_outer_join5.q.out: does not exist in index
error: test/results/clientpositive/vector_outer_join6.q.out: does not exist in index
error: test/results/clientpositive/vectorized_mapjoin.q.out: does not exist in index
error: test/results/clientpositive/vectorized_mapjoin2.q.out: does not exist in index
The patch does not appear to apply with p0, p1, or p2
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12833777 - PreCommit-HIVE-Build

> Eliminate unnecessary MapJoin restriction in HIVE-11394
> -------------------------------------------------------
>
>                 Key: HIVE-14981
>                 URL: https://issues.apache.org/jira/browse/HIVE-14981
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 2.2.0
>            Reporter: Matt McCline
>            Assignee: Matt McCline
>            Priority: Critical
>             Fix For: 3.1.0
>
>         Attachments: HIVE-14981.01.patch, HIVE-14981.02.patch
>
>
> No Empty Key restriction for Native Vector MapJoin added with HIVE-11394 is unnecessary.  It caused Llap orc_llap.q test to timeout on Hive QA because regular VectorMapJoinOperator is too slow.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)