You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Mehant Baid (JIRA)" <ji...@apache.org> on 2014/11/08 21:38:33 UTC
[jira] [Commented] (DRILL-1610) Partition pruning not scanning all
the required partitions when we have hierarchical partitions
[ https://issues.apache.org/jira/browse/DRILL-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14203588#comment-14203588 ]
Mehant Baid commented on DRILL-1610:
------------------------------------
This seems to be working as expected for me. Could you please verify if you can still reproduce this behavior.
> Partition pruning not scanning all the required partitions when we have hierarchical partitions
> -----------------------------------------------------------------------------------------------
>
> Key: DRILL-1610
> URL: https://issues.apache.org/jira/browse/DRILL-1610
> Project: Apache Drill
> Issue Type: Bug
> Components: Query Planning & Optimization
> Affects Versions: 0.7.0
> Reporter: Rahul Challapalli
> Assignee: Mehant Baid
> Attachments: explain_plan_dfs.txt, explain_plan_hive.txt, hive.ddl, lineitem_hierarchical.zip
>
>
> git.commit.id.abbrev=6dca24a
> My data is organized in such a way that we have multiple year partitions and each year partition has 12 month partitions.
> Now the below query should look for all the records
> 1. all months under 1993
> 2. under the month 'dec' for all the years
> However drill seems to be ignoring the second case. This is happening with hive and dfs.
> Below are the queries :
> DFS :
> {code}
> explain plan for select
> l_orderkey,
> l_partkey,
> l_quantity,
> l_shipdate,
> l_shipinstruct
> from hive.lineitem_hierarchical where (`year` IN (1993) and l_orderkey>29600) or `month` IN ('dec');
> {code}
> Hive :
> {code}
> explain plan for select columns[0],
> columns[1],
> columns[4],
> columns[10],
> columns[13]
> from `/lineitem_hierarchical` where (dir0=1993 and columns[0]>29600) or dir1='dec';
> {code}
> Attached the sample data, hive ddl, and the explain plan outputs
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)