You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Rahul Challapalli (JIRA)" <ji...@apache.org> on 2015/11/11 19:59:10 UTC

[jira] [Created] (DRILL-4072) Hive partition pruning not working with avro serde's

Rahul Challapalli created DRILL-4072:
----------------------------------------

             Summary: Hive partition pruning not working with avro serde's
                 Key: DRILL-4072
                 URL: https://issues.apache.org/jira/browse/DRILL-4072
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.3.0
            Reporter: Rahul Challapalli


git.commit.id.abbrev=e78e286

The below plan indicates that partition pruning is not happening

{code}
explain plan for select * from hive.episodes_partitioned where doctor > 4;
+------+------+
| text | json |
+------+------+
| 00-00    Screen
00-01      Project(title=[$0], air_date=[$1], doctor=[$2], doctor_pt=[$3])
00-02        Project(title=[$0], air_date=[$1], doctor=[$2], doctor_pt=[$3])
00-03          SelectionVectorRemover
00-04            Filter(condition=[>($2, 4)])
00-05              Scan(groupscan=[HiveScan [table=Table(dbName:default, tableName:episodes_partitioned), inputSplits=[maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=1/000000_0:0+367, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=11/000000_0:0+393, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=2/000000_0:0+371, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=4/000000_0:0+368, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=5/000000_0:0+357, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=6/000000_0:0+370, maprfs:///user/hive/warehouse/episodes_partitioned/doctor_pt=9/000000_0:0+350], columns=[`*`], numPartitions=7, partitions= [Partition(values:[1]), Partition(values:[11]), Partition(values:[2]), Partition(values:[4]), Partition(values:[5]), Partition(values:[6]), Partition(values:[9])]]])
{code}

I attached the data file and the hql required. Let me know if anything else is needed



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)