You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Aman Sinha (JIRA)" <ji...@apache.org> on 2014/09/30 02:04:34 UTC

[jira] [Commented] (DRILL-1465) Partition filter pushdown not happening for EasyGroupScan

    [ https://issues.apache.org/jira/browse/DRILL-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152560#comment-14152560 ] 

Aman Sinha commented on DRILL-1465:
-----------------------------------

Uploaded a patch for this issue.  Also added a whole bunch of Junit tests for push partition filter on all 3 formats: parquet, json and csv. 

> Partition filter pushdown not happening for EasyGroupScan
> ---------------------------------------------------------
>
>                 Key: DRILL-1465
>                 URL: https://issues.apache.org/jira/browse/DRILL-1465
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Query Planning & Optimization
>    Affects Versions: 0.5.0
>            Reporter: Aman Sinha
>            Assignee: Aman Sinha
>         Attachments: 0001-DRILL-1465-Enhance-push-partition-filter-rule-to-han.patch
>
>
> For EasyGroupScan that handles Json and Text formats, we are not getting the directory partition filters pushed down into the Scan.  One part of the reason is that the EasyGroupScan digest for a new scan that has a smaller selection of files is currently the same as the previous scan, so the planner ignores the new scan.  
> A second related issue is that the Filter can appear above either a Scan or a Project, so we need to be able to handle both cases during pushdown. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)