You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Gang Tim Liu (JIRA)" <ji...@apache.org> on 2012/10/08 23:42:03 UTC
[jira] [Created] (HIVE-3554) Hive List Bucketing - Query logic
Gang Tim Liu created HIVE-3554:
----------------------------------
Summary: Hive List Bucketing - Query logic
Key: HIVE-3554
URL: https://issues.apache.org/jira/browse/HIVE-3554
Project: Hive
Issue Type: New Feature
Reporter: Gang Tim Liu
This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
This patch includes:
1. Query logic: hive chooses right sub-directory instead of partition directory.
2. alter table grammar which is required to support query logic
This patch doesn't include list bucketing DML. Main reasons:
1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation.
2. manageability. w/ DML, patch is getting bigger and hard to review
We still disable hive feature by default since DML is not in yet.
DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Status: Patch Available (was: Open)
patch available in attachment and D5955
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.10, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-3554:
-----------------------------
Comment: was deleted
(was: Sorry, that was for the wrong jira.
)
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Description:
This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
This patch includes:
1. Query logic: hive chooses right sub-directory instead of partition directory.
2. alter table grammar which is required to support query logic
This patch doesn't include list bucketing DML. Main reasons:
1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
We still disable hive feature by default since DML is not in yet.
DML will be in follow-up patch.
was:
This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
This patch includes:
1. Query logic: hive chooses right sub-directory instead of partition directory.
2. alter table grammar which is required to support query logic
This patch doesn't include list bucketing DML. Main reasons:
1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation.
2. manageability. w/ DML, patch is getting bigger and hard to review
We still disable hive feature by default since DML is not in yet.
DML will be in follow-up patch.
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.10
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.10, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488509#comment-13488509 ]
Gang Tim Liu commented on HIVE-3554:
------------------------------------
@Mark,
In general, alter skewed will overwrite previous setting
#2 and #3 have been covered in alter_skewed_table.q.
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488505#comment-13488505 ]
Mark Grover commented on HIVE-3554:
-----------------------------------
@Tim, I took a quick look at the patch and had a few questions for you.
1. Have you tested the following cases:
Test A: Renaming the skewed key
{code}
CREATE TABLE test (c1 STRING, c2 STRING) SKEWED BY (c1) ON ('x1');
ALTER TABLE test CHANGE c1 c STRING; -- Changing the type of the skewed key
SELECT * from test where c1='x1'; -- query with a skewed value
SELECT * from test where c1='x_something else'; -- query with a non-skewed value
{code}
Test B: Changing the type of the skewed key
{code}
CREATE TABLE test (c1 STRING, c2 STRING) SKEWED BY (c1) ON ('12');
ALTER TABLE test CHANGE c1 c1 INT; -- Changing the type of the skewed key
SELECT * from test where c1=12; -- query with a skewed value
SELECT * from test where c1=11; -- query with a non-skewed value
{code}
2. Is it possible for user to add/remove skewed keys once the skewed table has been created? If so, would it make sense to add a test case for that?
3. Is it possible for user to add/remove skewed values ('x1', 'x_something else', 12, 11, in above examples) once the skewed table has been created? If so, would it make sense to add a test case for that?
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489444#comment-13489444 ]
Gang Tim Liu commented on HIVE-3554:
------------------------------------
Hi Namit thank you so much Tim
Sent from my iPhone
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.10, HIVE-3554.patch.11, HIVE-3554.patch.12, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on HIVE-3554 started by Gang Tim Liu.
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu reassigned HIVE-3554:
----------------------------------
Assignee: Gang Tim Liu
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation.
> 2. manageability. w/ DML, patch is getting bigger and hard to review
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-3554:
-----------------------------
Comment: was deleted
(was: +1)
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489843#comment-13489843 ]
Hudson commented on HIVE-3554:
------------------------------
Integrated in Hive-trunk-h0.21 #1770 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1770/])
HIVE-3554 Hive List Bucketing - Query logic
(Gang Tim Liu via namit) (Revision 1404924)
Result = FAILURE
namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1404924
Files :
* /hive/trunk/common/src/java/org/apache/hadoop/hive/common/FileUtils.java
* /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
* /hive/trunk/conf/hive-default.xml.template
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ErrorMsg.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Partition.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/PrunerOperatorFactory.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/LBExprProcCtx.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/LBExprProcFactory.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/LBOpPartitionWalkerCtx.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/LBOpWalkerCtx.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/LBPartitionProcFactory.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/LBProcFactory.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/ListBucketingPruner.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/ListBucketingPrunerUtils.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ParseContext.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzerFactory.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/HiveOperation.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/ValidationUtility.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/optimizer
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/DynamicMultiDimeCollectionTest.java
* /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/optimizer/listbucketingpruner/ListBucketingPrunnerTest.java
* /hive/trunk/ql/src/test/queries/clientnegative/column_change_skewedcol_type1.q
* /hive/trunk/ql/src/test/queries/clientnegative/column_rename5.q
* /hive/trunk/ql/src/test/queries/clientnegative/create_skewed_table_col_name_value_no_mismatch.q
* /hive/trunk/ql/src/test/queries/clientnegative/create_skewed_table_dup_col_name.q
* /hive/trunk/ql/src/test/queries/clientnegative/create_skewed_table_failure_invalid_col_name.q
* /hive/trunk/ql/src/test/queries/clientnegative/invalid_config1.q
* /hive/trunk/ql/src/test/queries/clientpositive/alter_skewed_table.q
* /hive/trunk/ql/src/test/queries/clientpositive/create_skewed_table1.q
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_query_multiskew_1.q
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_query_multiskew_2.q
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_query_multiskew_3.q
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_query_oneskew_1.q
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_query_oneskew_2.q
* /hive/trunk/ql/src/test/queries/clientpositive/list_bucket_query_oneskew_3.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt1.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt10.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt11.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt12.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt13.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt14.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt15.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt16.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt17.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt18.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt19.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt2.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt20.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt3.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt4.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt5.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt6.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt7.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt8.q
* /hive/trunk/ql/src/test/queries/clientpositive/skewjoinopt9.q
* /hive/trunk/ql/src/test/results/clientnegative/column_change_skewedcol_type1.q.out
* /hive/trunk/ql/src/test/results/clientnegative/column_rename5.q.out
* /hive/trunk/ql/src/test/results/clientnegative/invalid_config1.q.out
* /hive/trunk/ql/src/test/results/clientpositive/alter_skewed_table.q.out
* /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_1.q.out
* /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out
* /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_3.q.out
* /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_1.q.out
* /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_2.q.out
* /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_3.q.out
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.10, HIVE-3554.patch.11, HIVE-3554.patch.12, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Status: Patch Available (was: In Progress)
Yes, link other issues.
Yes, patch is available.
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13473740#comment-13473740 ]
Carl Steinbach commented on HIVE-3554:
--------------------------------------
@Tim: I added some comments on phabricator. Also, can you please link this ticket to the other list bucketing tickets? Thanks.
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.7
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.8
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489261#comment-13489261 ]
Namit Jain commented on HIVE-3554:
----------------------------------
+1
will commit if tests pass
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.10, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.2
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-3554:
-----------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Committed. Thanks Tim
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.10, HIVE-3554.patch.11, HIVE-3554.patch.12, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Affects Version/s: 0.10.0
Status: Patch Available (was: Open)
patch is available.
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.12
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.10, HIVE-3554.patch.11, HIVE-3554.patch.12, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.1
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.5
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-3554:
---------------------------------
Status: Open (was: Patch Available)
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Status: Patch Available (was: In Progress)
patch is available for review.
https://reviews.facebook.net/D5955
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488954#comment-13488954 ]
Gang Tim Liu commented on HIVE-3554:
------------------------------------
@Mark,
It's also not allowed to change skewed column type. Code has supported it.
I am going to add a test case to cover it.
thanks
Tim
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.9
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489549#comment-13489549 ]
Gang Tim Liu commented on HIVE-3554:
------------------------------------
you welcome.
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.10, HIVE-3554.patch.11, HIVE-3554.patch.12, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.4
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.3
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13480117#comment-13480117 ]
Namit Jain commented on HIVE-3554:
----------------------------------
Sorry, that was for the wrong jira.
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13488920#comment-13488920 ]
Gang Tim Liu commented on HIVE-3554:
------------------------------------
@Mark,
It's not allowed to rename skewed column. It's been covered by column_rename5.q
thanks
Tim
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-3554:
-----------------------------
Status: Open (was: Patch Available)
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-3554:
-----------------------------
Status: Open (was: Patch Available)
comments on phabricator
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486659#comment-13486659 ]
Namit Jain commented on HIVE-3554:
----------------------------------
Can you upload the latest patch file ?
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gang Tim Liu updated HIVE-3554:
-------------------------------
Attachment: HIVE-3554.patch.11
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.10, HIVE-3554.patch.11, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487436#comment-13487436 ]
Gang Tim Liu commented on HIVE-3554:
------------------------------------
Yes, i update the latest patch file here.
Also in https://reviews.facebook.net/D5955
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Gang Tim Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on HIVE-3554 started by Gang Tim Liu.
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation.
> 2. manageability. w/ DML, patch is getting bigger and hard to review
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Mark Grover (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13489446#comment-13489446 ]
Mark Grover commented on HIVE-3554:
-----------------------------------
Thanks for the clarifications and the patch, Tim!
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 0.10.0
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.10, HIVE-3554.patch.11, HIVE-3554.patch.12, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5, HIVE-3554.patch.7, HIVE-3554.patch.8, HIVE-3554.patch.9
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3554) Hive List Bucketing - Query logic
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13480116#comment-13480116 ]
Namit Jain commented on HIVE-3554:
----------------------------------
+1
> Hive List Bucketing - Query logic
> ---------------------------------
>
> Key: HIVE-3554
> URL: https://issues.apache.org/jira/browse/HIVE-3554
> Project: Hive
> Issue Type: New Feature
> Reporter: Gang Tim Liu
> Assignee: Gang Tim Liu
> Attachments: HIVE-3554.patch.1, HIVE-3554.patch.2, HIVE-3554.patch.3, HIVE-3554.patch.4, HIVE-3554.patch.5
>
>
> This is part of efforts for list bucketing feature: https://cwiki.apache.org/Hive/listbucketing.html
> This patch includes:
> 1. Query logic: hive chooses right sub-directory instead of partition directory.
> 2. alter table grammar which is required to support query logic
> This patch doesn't include list bucketing DML. Main reasons:
> 1. risk. w/o DML, this patch won't impact any existing hive regression features since no touch on any data manipulation so that very low risk.
> 2. manageability. w/ DML, patch is getting bigger and hard to review. Removing DML, it's easy to review.
> We still disable hive feature by default since DML is not in yet.
> DML will be in follow-up patch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira