[jira] [Commented] (HIVE-10462) CBO (Calcite Return Path): MapJoin and SMBJoin conversion not triggered

["Ashutosh Chauhan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14513254#comment-14513254 ] 

Ashutosh Chauhan commented on HIVE-10462:
-----------------------------------------

I think this is a better approach. It keeps translation separate from new return path vs old return path. +1 
I guess you lifted these tests from other existing tests. In that case, we may not want to add these, since that will result in duplication once we enable return path by default. Else, if you wrote these new tests, we can keep them.

> CBO (Calcite Return Path): MapJoin and SMBJoin conversion not triggered
> -----------------------------------------------------------------------
>
>                 Key: HIVE-10462
>                 URL: https://issues.apache.org/jira/browse/HIVE-10462
>             Project: Hive
>          Issue Type: Sub-task
>          Components: CBO
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>             Fix For: 1.2.0
>
>         Attachments: HIVE-10462.01.patch, HIVE-10462.02.patch, HIVE-10462.03.patch, HIVE-10462.patch
>
>
> When the return path is on, the mapjoin conversion optimization fails as some DS in the Join descriptor have not been initialized properly.
> The failure can be reproduced with auto_join4.q. In particular, the following Exception is thrown:
> {noformat}
> org.apache.hadoop.hive.ql.parse.SemanticException: Generate Map Join Task Error: null
>         at org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinTaskDispatcher.processCurrentTask(CommonJoinTaskDispatcher.java:516)
>         at org.apache.hadoop.hive.ql.optimizer.physical.AbstractJoinTaskDispatcher.dispatch(AbstractJoinTaskDispatcher.java:179)
>         at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.dispatch(TaskGraphWalker.java:111)
>         at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.walk(TaskGraphWalker.java:180)
>         at org.apache.hadoop.hive.ql.lib.TaskGraphWalker.startWalking(TaskGraphWalker.java:125)
>         at org.apache.hadoop.hive.ql.optimizer.physical.CommonJoinResolver.resolve(CommonJoinResolver.java:79)
>         at org.apache.hadoop.hive.ql.optimizer.physical.PhysicalOptimizer.optimize(PhysicalOptimizer.java:107)
>         at org.apache.hadoop.hive.ql.parse.MapReduceCompiler.optimizeTaskPlan(MapReduceCompiler.java:270)
>         at org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(TaskCompiler.java:227)
>         at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10084)
>         at org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:203)
>         at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:225)
>         at org.apache.hadoop.hive.ql.parse.ExplainSemanticAnalyzer.analyzeInternal(ExplainSemanticAnalyzer.java:74)
>         at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:225)
> ...
> {noformat}
> SMBJoin conversion is not triggered either.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)