[jira] [Commented] (PARQUET-295) Filter predicate should be able to filter on columns not specified in projection pushdown

["Julien Le Dem (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PARQUET-295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567624#comment-14567624 ] 

Julien Le Dem commented on PARQUET-295:
---------------------------------------

Agreed,
Also the field needed in the filter predicate that are not needed by the projection should not be materialized.

> Filter predicate should be able to filter on columns not specified in projection pushdown
> -----------------------------------------------------------------------------------------
>
>                 Key: PARQUET-295
>                 URL: https://issues.apache.org/jira/browse/PARQUET-295
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-mr
>    Affects Versions: 1.6.0
>            Reporter: Tim Chan
>            Priority: Minor
>
> When using both filter predicate and projection pushdown of columns, the column specified in the filter predicate, should not have to be specified in the projection pushdown. 
> For example, if I want the first names of students that are over the age of 16, then I should be able to specify ParquetInputFormat.setFilterPredicate(jobConf, IntColumn("age") > 16) and only have to specify ThriftReadSupport.setProjectionPushdown(jobConf, "fname")



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)