You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Navis (JIRA)" <ji...@apache.org> on 2012/06/28 12:19:43 UTC

[jira] [Created] (HIVE-3210) Support Bucketed mapjoin on partitioned table which has two or more partitions

Navis created HIVE-3210:
---------------------------

             Summary: Support Bucketed mapjoin on partitioned table which has two or more partitions
                 Key: HIVE-3210
                 URL: https://issues.apache.org/jira/browse/HIVE-3210
             Project: Hive
          Issue Type: Improvement
          Components: Query Processor
    Affects Versions: 0.10.0
            Reporter: Navis
            Assignee: Navis
            Priority: Minor


Bucketed mapjoin on multiple partition seemed to have no reason to be prohibited and even safer than doing simple mapjoin.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3210) Support Bucketed mapjoin on partitioned table which has two or more partitions

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13416303#comment-13416303 ] 

Hudson commented on HIVE-3210:
------------------------------

Integrated in Hive-trunk-h0.21 #1548 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1548/])
    HIVE-3210 Support Bucketed mapjoin on partitioned table which has two or more partitions
(Navis via namit) (Revision 1362391)

     Result = SUCCESS
namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1362391
Files : 
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/BucketMapJoinOptimizer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/SortedMergeBucketMapJoinOptimizer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/PrunedPartitionList.java
* /hive/trunk/ql/src/test/queries/clientpositive/bucketmapjoin2.q
* /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin2.q.out
* /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative2.q.out

                
> Support Bucketed mapjoin on partitioned table which has two or more partitions
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-3210
>                 URL: https://issues.apache.org/jira/browse/HIVE-3210
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>
> Bucketed mapjoin on multiple partition seemed to have no reason to be prohibited and even safer than doing simple mapjoin.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3210) Support Bucketed mapjoin on partitioned table which has two or more partitions

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13414908#comment-13414908 ] 

Namit Jain commented on HIVE-3210:
----------------------------------

comments above
                
> Support Bucketed mapjoin on partitioned table which has two or more partitions
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-3210
>                 URL: https://issues.apache.org/jira/browse/HIVE-3210
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>
> Bucketed mapjoin on multiple partition seemed to have no reason to be prohibited and even safer than doing simple mapjoin.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3210) Support Bucketed mapjoin on partitioned table which has two or more partitions

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415372#comment-13415372 ] 

Namit Jain commented on HIVE-3210:
----------------------------------

+1
                
> Support Bucketed mapjoin on partitioned table which has two or more partitions
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-3210
>                 URL: https://issues.apache.org/jira/browse/HIVE-3210
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>
> Bucketed mapjoin on multiple partition seemed to have no reason to be prohibited and even safer than doing simple mapjoin.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3210) Support Bucketed mapjoin on partitioned table which has two or more partitions

Posted by "Navis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Navis updated HIVE-3210:
------------------------

    Status: Patch Available  (was: Open)

Fixed most of them and have some questions.
                
> Support Bucketed mapjoin on partitioned table which has two or more partitions
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-3210
>                 URL: https://issues.apache.org/jira/browse/HIVE-3210
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>
> Bucketed mapjoin on multiple partition seemed to have no reason to be prohibited and even safer than doing simple mapjoin.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3210) Support Bucketed mapjoin on partitioned table which has two or more partitions

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-3210:
-----------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

Committed. Thanks Navis
                
> Support Bucketed mapjoin on partitioned table which has two or more partitions
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-3210
>                 URL: https://issues.apache.org/jira/browse/HIVE-3210
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>
> Bucketed mapjoin on multiple partition seemed to have no reason to be prohibited and even safer than doing simple mapjoin.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3210) Support Bucketed mapjoin on partitioned table which has two or more partitions

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-3210:
-----------------------------

    Status: Open  (was: Patch Available)
    
> Support Bucketed mapjoin on partitioned table which has two or more partitions
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-3210
>                 URL: https://issues.apache.org/jira/browse/HIVE-3210
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>
> Bucketed mapjoin on multiple partition seemed to have no reason to be prohibited and even safer than doing simple mapjoin.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-3210) Support Bucketed mapjoin on partitioned table which has two or more partitions

Posted by "Navis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Navis updated HIVE-3210:
------------------------

    Status: Patch Available  (was: Open)

https://reviews.facebook.net/D3885
                
> Support Bucketed mapjoin on partitioned table which has two or more partitions
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-3210
>                 URL: https://issues.apache.org/jira/browse/HIVE-3210
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>
> Bucketed mapjoin on multiple partition seemed to have no reason to be prohibited and even safer than doing simple mapjoin.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-3210) Support Bucketed mapjoin on partitioned table which has two or more partitions

Posted by "Navis (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13415082#comment-13415082 ] 

Navis commented on HIVE-3210:
-----------------------------

Fixed test case as requested.
And.. I think existing test cases are also not valid (joining two table with no-common key). Notify me if it's intentional.
                
> Support Bucketed mapjoin on partitioned table which has two or more partitions
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-3210
>                 URL: https://issues.apache.org/jira/browse/HIVE-3210
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 0.10.0
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>
> Bucketed mapjoin on multiple partition seemed to have no reason to be prohibited and even safer than doing simple mapjoin.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira