[jira] [Updated] (HIVE-3633) sort-merge join does not work with sub-queries

["Namit Jain (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-3633:
-----------------------------

    Attachment: hive.3633.8.patch
    
> sort-merge join does not work with sub-queries
> ----------------------------------------------
>
>                 Key: HIVE-3633
>                 URL: https://issues.apache.org/jira/browse/HIVE-3633
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.3633.1.patch, hive.3633.2.patch, hive.3633.3.patch, hive.3633.4.patch, hive.3633.5.patch, hive.3633.6.patch, hive.3633.7.patch, hive.3633.8.patch
>
>
> Consider the following query:
> create table smb_bucket_1(key int, value string) CLUSTERED BY (key) SORTED BY (key) INTO 6 BUCKETS STORED AS TEXTFILE;
> create table smb_bucket_2(key int, value string) CLUSTERED BY (key) SORTED BY (key) INTO 6 BUCKETS STORED AS TEXTFILE;
> -- load the above tables
> set hive.optimize.bucketmapjoin = true;
> set hive.optimize.bucketmapjoin.sortedmerge = true;
> set hive.input.format = org.apache.hadoop.hive.ql.io.BucketizedHiveInputFormat;
> explain
> select count(*) from
> (
> select /*+mapjoin(a)*/ a.key as key1, b.key as key2, a.value as value1, b.value as value2
> from smb_bucket_1 a join smb_bucket_2 b on a.key = b.key)
> subq;
> The above query does not use sort-merge join. This would be very useful as we automatically convert the queries to use sorting and bucketing properties for join.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Re: HIVE Project Reference for Learning

[Ashok Agarwal <aa...@gmail.com>]

Adarsh, You can search github for Hive projects, there are many having
implementation along with data.

Thanks
Ashok

On Mon, Dec 3, 2012 at 12:39 AM, Adarsh Sastry <ad...@yahoo.com>wrote:

> Hello:
> I am new to HADOOP. I had gone through and practiced various topics and
> basic exercises given in the HIVE text book. I am looking for a project to
> do as a POC and get a much thoroughunderstanding of HIVE. Can any one point
> me to any blog or site which has information & data about a project thats
> already implemented or designed for learners.
>
> Any help will be greatly appeciated.
>
> Rgds
> Adarsh

HIVE Project Reference for Learning

[Adarsh Sastry <ad...@yahoo.com>]

Hello:
I am new to HADOOP. I had gone through and practiced various topics and basic exercises given in the HIVE text book. I am looking for a project to do as a POC and get a much thoroughunderstanding of HIVE. Can any one point me to any blog or site which has information & data about a project thats already implemented or designed for learners. 
 
Any help will be greatly appeciated.
 
Rgds
Adarsh