You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Jacques Nadeau (JIRA)" <ji...@apache.org> on 2014/11/13 18:30:34 UTC
[jira] [Assigned] (DRILL-1610) Partition pruning not scanning all
the required partitions when we have hierarchical partitions
[ https://issues.apache.org/jira/browse/DRILL-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jacques Nadeau reassigned DRILL-1610:
-------------------------------------
Assignee: (was: Mehant Baid)
> Partition pruning not scanning all the required partitions when we have hierarchical partitions
> -----------------------------------------------------------------------------------------------
>
> Key: DRILL-1610
> URL: https://issues.apache.org/jira/browse/DRILL-1610
> Project: Apache Drill
> Issue Type: Bug
> Components: Query Planning & Optimization
> Affects Versions: 0.7.0
> Reporter: Rahul Challapalli
> Attachments: DRILL-1610.patch, explain_plan_dfs.txt, explain_plan_hive.txt, hive.ddl, lineitem_hierarchical.zip
>
>
> git.commit.id.abbrev=6dca24a
> My data is organized in such a way that we have multiple year partitions and each year partition has 12 month partitions.
> Now the below query should look for all the records
> 1. all months under 1993
> 2. under the month 'dec' for all the years
> However drill seems to be ignoring the second case. This is happening with hive and dfs.
> Below are the queries :
> DFS :
> {code}
> explain plan for select
> l_orderkey,
> l_partkey,
> l_quantity,
> l_shipdate,
> l_shipinstruct
> from hive.lineitem_hierarchical where (`year` IN (1993) and l_orderkey>29600) or `month` IN ('dec');
> {code}
> Hive :
> {code}
> explain plan for select columns[0],
> columns[1],
> columns[4],
> columns[10],
> columns[13]
> from `/lineitem_hierarchical` where (dir0=1993 and columns[0]>29600) or dir1='dec';
> {code}
> Attached the sample data, hive ddl, and the explain plan outputs
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)