[jira] [Comment Edited] (HIVE-15227) Optimize join + gby into semijoin

["Ashutosh Chauhan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15709843#comment-15709843 ] 

Ashutosh Chauhan edited comment on HIVE-15227 at 11/30/16 9:33 PM:
-------------------------------------------------------------------

We can use CALCITE-1495 for changes in this rule. _auto_sortmerge_join_2.q_ is a flaky test. It fails intermittently even locally. Its a poorly written test since it depends on memory of system. 

By the way, I also added the flag {{hive.enable.semijoin.conversion}} for the rule. 
Pushed to master.  


was (Author: ashutoshc):
We can use CALCITE-1494 for changes in this rule. _auto_sortmerge_join_2.q_ is a flaky test. It fails intermittently even locally. Its a poorly written test since it depends on memory of system. 

By the way, I also added the flag {{hive.enable.semijoin.conversion}} for the rule. 
Pushed to master.  

> Optimize join + gby into semijoin
> ---------------------------------
>
>                 Key: HIVE-15227
>                 URL: https://issues.apache.org/jira/browse/HIVE-15227
>             Project: Hive
>          Issue Type: Bug
>          Components: Logical Optimizer
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 2.2.0
>
>         Attachments: HIVE-15227.2.patch, HIVE-15227.3.patch, HIVE-15227.4.patch, HIVE-15227.patch
>
>
> Calcite has a rule which can do this transformation. Lets take advantage of this since Hive has native Left semi join operator.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)