[jira] [Created] (DRILL-6099) Drill does not push limit past project (flatten) if it cannot be pushed into scan

["Gautam Kumar Parai (JIRA)" <ji...@apache.org>]

Gautam Kumar Parai created DRILL-6099:
-----------------------------------------

             Summary: Drill does not push limit past project (flatten) if it cannot be pushed into scan
                 Key: DRILL-6099
                 URL: https://issues.apache.org/jira/browse/DRILL-6099
             Project: Apache Drill
          Issue Type: Bug
    Affects Versions: 1.12.0
            Reporter: Gautam Kumar Parai
            Assignee: Gautam Kumar Parai
             Fix For: 1.13.0


It would be useful to have pushdown occur past flatten(project). Here is an example to illustrate the issue:

{{explain plan without implementation for }}{{select name, flatten(categories) as category from dfs.`/tmp/t_json_20` LIMIT 1;}}

{{DrillScreenRel}}{{  }}

{{  DrillLimitRel(fetch=[1])}}{{    }}

{{    DrillProjectRel(name=[$0], category=[FLATTEN($1)])}}

{{      DrillScanRel(table=[[dfs, /tmp/t_json_20]], groupscan=[EasyGroupScan [selectionRoot=maprfs:/tmp/t_json_20, numFiles=1, columns=[`name`, `categories`], files=[maprfs:///tmp/t_json_20/0_0_0.json]]])}}

================================================================= 

Content of 0_0_0.json

=================================================================

{

  "name" : "Eric Goldberg, MD",

  "categories" : [ "Doctors", "Health & Medical" ]

} {

  "name" : "Pine Cone Restaurant",

  "categories" : [ "Restaurants" ]

} {

  "name" : "Deforest Family Restaurant",

  "categories" : [ "American (Traditional)", "Restaurants" ]

} {

  "name" : "Culver's",

  "categories" : [ "Food", "Ice Cream & Frozen Yogurt", "Fast Food", "Restaurants" ]

} {

  "name" : "Chang Jiang Chinese Kitchen",

  "categories" : [ "Chinese", "Restaurants" ]

} 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)