You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Arina Ielchiieva (JIRA)" <ji...@apache.org> on 2018/01/30 10:57:00 UTC
[jira] [Updated] (DRILL-6118) Handle item star columns during
project / filter push down and directory pruning
[ https://issues.apache.org/jira/browse/DRILL-6118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arina Ielchiieva updated DRILL-6118:
------------------------------------
Description:
Project push down, filter push down and partition pruning does not work with dynamically expanded column with is represented as star in ITEM operator: _ITEM($0, 'column_name')_ where $0 is a star.
This often occurs when view, sub-select or cte with star is issued.
To solve this issue we can create {{DrillFilterItemStarReWriterRule}} which will rewrite such ITEM operator before filter push down and directory pruning. For project into scan push down logic will be handled separately in already existing rule {{DrillPushProjectIntoScanRule}}. Basically, we can consider the following queries the same:
{{select col1 from t}}
{{select col1 from (select * from t)}}
*Use cases*
Since item star columns where not considered during
Examples:
*Filter push down*
was:
Project push down, filter push down and partition pruning does not work with dynamically expanded column with is represented as star in ITEM operator: _ITEM($0, 'column_name')_ where $0 is a star.
This often occurs when view, sub-select or cte with star is issued.
To solve this issue we can create {{DrillFilterItemStarReWriterRule}} which will rewrite such ITEM operator before filter push down and directory pruning. For project into scan push down logic will be handled separately in already existing rule {{DrillPushProjectIntoScanRule}}. Basically, we can consider the following queries the same:
{{select col1 from t}}
{{select col1 from (select * from t)}}
> Handle item star columns during project / filter push down and directory pruning
> ----------------------------------------------------------------------------------
>
> Key: DRILL-6118
> URL: https://issues.apache.org/jira/browse/DRILL-6118
> Project: Apache Drill
> Issue Type: Improvement
> Affects Versions: 1.12.0
> Reporter: Arina Ielchiieva
> Assignee: Arina Ielchiieva
> Priority: Major
> Fix For: 1.13.0
>
>
> Project push down, filter push down and partition pruning does not work with dynamically expanded column with is represented as star in ITEM operator: _ITEM($0, 'column_name')_ where $0 is a star.
> This often occurs when view, sub-select or cte with star is issued.
> To solve this issue we can create {{DrillFilterItemStarReWriterRule}} which will rewrite such ITEM operator before filter push down and directory pruning. For project into scan push down logic will be handled separately in already existing rule {{DrillPushProjectIntoScanRule}}. Basically, we can consider the following queries the same:
> {{select col1 from t}}
> {{select col1 from (select * from t)}}
> *Use cases*
> Since item star columns where not considered during
>
> Examples:
> *Filter push down*
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)