You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "He Yongqiang (JIRA)" <ji...@apache.org> on 2011/04/19 10:31:06 UTC
[jira] [Created] (HIVE-2120) auto convert map join does not work
with queries that have a subquery alias
auto convert map join does not work with queries that have a subquery alias
---------------------------------------------------------------------------
Key: HIVE-2120
URL: https://issues.apache.org/jira/browse/HIVE-2120
Project: Hive
Issue Type: Bug
Reporter: He Yongqiang
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2120) auto convert map join may miss good
candidates
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-2120:
-------------------------------
Attachment: HIVE-2120.1.patch
> auto convert map join may miss good candidates
> ----------------------------------------------
>
> Key: HIVE-2120
> URL: https://issues.apache.org/jira/browse/HIVE-2120
> Project: Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: HIVE-2120.1.patch
>
>
> In case in a join, there is a subquery which does a simple select, the auto convert map join may miss a good candidate at run time. The plan generated is correct, but the selection at runtime has a bug.
> For example:
> set hive.smalltable.filesize=1000;
> create table src_one as select * from src where key=100;
> select count(1)
> from
> (
> select * from src
> ) subq
> join
> src_small on src.key = subq.key;
> The table src_small can be a small table. This is in the plan, but at runtime it gets filtered out.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2120) auto convert map join may miss good
candidates
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-2120:
---------------------------------
Component/s: Query Processor
Fix Version/s: 0.8.0
> auto convert map join may miss good candidates
> ----------------------------------------------
>
> Key: HIVE-2120
> URL: https://issues.apache.org/jira/browse/HIVE-2120
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Fix For: 0.8.0
>
> Attachments: HIVE-2120.1.patch
>
>
> In case in a join, there is a subquery which does a simple select, the auto convert map join may miss a good candidate at run time. The plan generated is correct, but the selection at runtime has a bug.
> For example:
> set hive.smalltable.filesize=1000;
> create table src_one as select * from src where key=100;
> select count(1)
> from
> (
> select * from src
> ) subq
> join
> src_small on src.key = subq.key;
> The table src_small can be a small table. This is in the plan, but at runtime it gets filtered out.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2120) auto convert map join may miss good
candidates
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13021990#comment-13021990 ]
Namit Jain commented on HIVE-2120:
----------------------------------
+1
> auto convert map join may miss good candidates
> ----------------------------------------------
>
> Key: HIVE-2120
> URL: https://issues.apache.org/jira/browse/HIVE-2120
> Project: Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: HIVE-2120.1.patch
>
>
> In case in a join, there is a subquery which does a simple select, the auto convert map join may miss a good candidate at run time. The plan generated is correct, but the selection at runtime has a bug.
> For example:
> set hive.smalltable.filesize=1000;
> create table src_one as select * from src where key=100;
> select count(1)
> from
> (
> select * from src
> ) subq
> join
> src_small on src.key = subq.key;
> The table src_small can be a small table. This is in the plan, but at runtime it gets filtered out.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2120) auto convert map join may miss good
candidates
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-2120:
-------------------------------
Status: Patch Available (was: Open)
No tests added, because the plan generation is correct, and the final output is also correct now.
The main difference is the execution path at runtime.
> auto convert map join may miss good candidates
> ----------------------------------------------
>
> Key: HIVE-2120
> URL: https://issues.apache.org/jira/browse/HIVE-2120
> Project: Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: HIVE-2120.1.patch
>
>
> In case in a join, there is a subquery which does a simple select, the auto convert map join may miss a good candidate at run time. The plan generated is correct, but the selection at runtime has a bug.
> For example:
> set hive.smalltable.filesize=1000;
> create table src_one as select * from src where key=100;
> select count(1)
> from
> (
> select * from src
> ) subq
> join
> src_small on src.key = subq.key;
> The table src_small can be a small table. This is in the plan, but at runtime it gets filtered out.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2120) auto convert map join may miss good
candidates
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-2120:
-----------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed. Thanks Yongqiang
> auto convert map join may miss good candidates
> ----------------------------------------------
>
> Key: HIVE-2120
> URL: https://issues.apache.org/jira/browse/HIVE-2120
> Project: Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: HIVE-2120.1.patch
>
>
> In case in a join, there is a subquery which does a simple select, the auto convert map join may miss a good candidate at run time. The plan generated is correct, but the selection at runtime has a bug.
> For example:
> set hive.smalltable.filesize=1000;
> create table src_one as select * from src where key=100;
> select count(1)
> from
> (
> select * from src
> ) subq
> join
> src_small on src.key = subq.key;
> The table src_small can be a small table. This is in the plan, but at runtime it gets filtered out.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2120) auto convert map join may miss good
candidates
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-2120:
-------------------------------
Description:
In case in a join, there is a subquery which does a simple select, the auto convert map join may miss a good candidate at run time. The plan generated is correct, but the selection at runtime has a bug.
For example:
set hive.smalltable.filesize=1000;
create table src_one as select * from src where key=100;
select count(1)
from
(
select * from src
) subq
join
src_small on src.key = subq.key;
The table src_small can be a small table. This is in the plan, but at runtime it gets filtered out.
Assignee: He Yongqiang
Summary: auto convert map join may miss good candidates (was: auto convert map join does not work with queries that have a subquery alias)
> auto convert map join may miss good candidates
> ----------------------------------------------
>
> Key: HIVE-2120
> URL: https://issues.apache.org/jira/browse/HIVE-2120
> Project: Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Attachments: HIVE-2120.1.patch
>
>
> In case in a join, there is a subquery which does a simple select, the auto convert map join may miss a good candidate at run time. The plan generated is correct, but the selection at runtime has a bug.
> For example:
> set hive.smalltable.filesize=1000;
> create table src_one as select * from src where key=100;
> select count(1)
> from
> (
> select * from src
> ) subq
> join
> src_small on src.key = subq.key;
> The table src_small can be a small table. This is in the plan, but at runtime it gets filtered out.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira