[jira] [Created] (DRILL-1610) Partition pruning not scanning all the required partitions when we have hierarchical partitions

["Rahul Challapalli (JIRA)" <ji...@apache.org>]

Rahul Challapalli created DRILL-1610:
----------------------------------------

             Summary: Partition pruning not scanning all the required partitions when we have hierarchical partitions
                 Key: DRILL-1610
                 URL: https://issues.apache.org/jira/browse/DRILL-1610
             Project: Apache Drill
          Issue Type: Bug
          Components: Query Planning & Optimization
    Affects Versions: 0.7.0
            Reporter: Rahul Challapalli
            Assignee: Mehant Baid


git.commit.id.abbrev=6dca24a

My data is organized in such a way that we have multiple year partitions and each year partition has 12 month partitions. 
Now the below query should look for all the records 
  1. all months under 1993 
  2. under the month 'dec' for all the years

However drill seems to be ignoring the second case. This is happening with hive and dfs.

Below are the queries :

DFS :
{code}
explain plan for select 
  l_orderkey, 
  l_partkey, 
  l_quantity, 
  l_shipdate, 
  l_shipinstruct 
from hive.lineitem_hierarchical where (`year` IN (1993) and l_orderkey>29600) or `month` IN ('dec');
{code}

Hive :
{code}
explain plan for select columns[0],
  columns[1],
  columns[4],
  columns[10],
  columns[13]
from `/lineitem_hierarchical` where (dir0=1993 and columns[0]>29600) or dir1='dec';
{code}

Attached the sample data, hive ddl, and the explain plan outputs



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)