You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "He Yongqiang (JIRA)" <ji...@apache.org> on 2010/07/09 07:01:59 UTC
[jira] Created: (HIVE-1455) lateral view does not work with column
pruning
lateral view does not work with column pruning
-----------------------------------------------
Key: HIVE-1455
URL: https://issues.apache.org/jira/browse/HIVE-1455
Project: Hadoop Hive
Issue Type: Bug
Reporter: He Yongqiang
Assignee: He Yongqiang
Fix For: 0.6.0, 0.7.0
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-1455:
---------------------------------
Fix Version/s: (was: 0.7.0)
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-1455:
-------------------------------
Status: Patch Available (was: Open)
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HIVE-1455) lateral view does not work with column
pruning
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang reassigned HIVE-1455:
-------------------------------
Assignee: Paul Yang (was: He Yongqiang)
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-1455:
----------------------------
Attachment: HIVE-1455.4.patch
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (HIVE-1455) lateral view does not work with column
pruning
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach reopened HIVE-1455:
----------------------------------
Reopening for backport to 0.6
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-1455:
-------------------------------
Status: Resolved (was: Patch Available)
Fix Version/s: (was: 0.6.0)
Resolution: Fixed
Committed this patch to trunk. Thanks Paul!
Paul, if this patch also needs to be committed to branch0.6, can you also make a branch 0.6 patch for HIVE-1056?
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-1455:
----------------------------
Attachment: (was: HIVE-1455.3.patch)
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-1455:
-------------------------------
Attachment: hive.1455.2.patch
explaining this patch:
When the child operator is a UDTF operator, the column pruner should not do any prunning on it. This is because there is a (select * no compute) on the same input.
tests passed in my local.
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HIVE-1455) lateral view does not work with column
pruning
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang resolved HIVE-1455.
--------------------------------
Resolution: Fixed
committed to branch 0.6 together with hive-1056. Thanks Paul!
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1455) lateral view does not work with
column pruning
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12891498#action_12891498 ]
He Yongqiang commented on HIVE-1455:
------------------------------------
will do.
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
He Yongqiang updated HIVE-1455:
-------------------------------
Attachment: hive.1455.1.patch
running tests now.
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: hive.1455.1.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1455) lateral view does not work with
column pruning
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888632#action_12888632 ]
He Yongqiang commented on HIVE-1455:
------------------------------------
overall looks good. please remove the LOG.
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-1455:
----------------------------
Attachment: HIVE-1455.3.patch
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-1455:
----------------------------
Attachment: HIVE-1455.4.patch
Added an additional test case where we do a lateral view on a subquery.
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-1455:
---------------------------------
Fix Version/s: 0.6.0
Component/s: Query Processor
Let's backport this to the 0.6.0 branch.
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1455) lateral view does not work with
column pruning
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888685#action_12888685 ]
He Yongqiang commented on HIVE-1455:
------------------------------------
testcase loadpart_err failed. Paul, can you take a look?
[junit] Exception: null
[junit] java.lang.NullPointerException
[junit] at org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_loadpart_err(TestCliDriver.java:100)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at junit.framework.TestCase.runTest(TestCase.java:154)
[junit] at junit.framework.TestCase.runBare(TestCase.java:127)
[junit] at junit.framework.TestResult$1.protect(TestResult.java:106)
[junit] at junit.framework.TestResult.runProtected(TestResult.java:124)
[junit] at junit.framework.TestResult.run(TestResult.java:109)
[junit] at junit.framework.TestCase.run(TestCase.java:118)
[junit] at junit.framework.TestSuite.runTest(TestSuite.java:208)
[junit] at junit.framework.TestSuite.run(TestSuite.java:203)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:785)
[junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 19.916 sec
[junit] Test org.apache.hadoop.hive.cli.TestCliDriver FAILED
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1455) lateral view does not work with
column pruning
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892544#action_12892544 ]
He Yongqiang commented on HIVE-1455:
------------------------------------
running test.
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-1455:
----------------------------
Attachment: (was: HIVE-1455.4.patch)
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1455) lateral view does not work with column
pruning
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-1455:
----------------------------
Attachment: HIVE-1455.3.patch
This patch modifies the column pruner to create a special case for the lateral view join operator. This will result in more pruned columns.
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: He Yongqiang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1455) lateral view does not work with
column pruning
Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888636#action_12888636 ]
He Yongqiang commented on HIVE-1455:
------------------------------------
running test now.
> lateral view does not work with column pruning
> -----------------------------------------------
>
> Key: HIVE-1455
> URL: https://issues.apache.org/jira/browse/HIVE-1455
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: He Yongqiang
> Assignee: Paul Yang
> Fix For: 0.6.0, 0.7.0
>
> Attachments: HIVE-1455.3.patch, HIVE-1455.4.patch, hive.1455.1.patch, hive.1455.2.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.