You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Julien Le Dem (JIRA)" <ji...@apache.org> on 2014/10/30 20:12:35 UTC

[jira] [Commented] (PARQUET-115) Pass a filter object to user defined predicate in filter2 api

    [ https://issues.apache.org/jira/browse/PARQUET-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190643#comment-14190643 ] 

Julien Le Dem commented on PARQUET-115:
---------------------------------------

Is this a duplicate of PARQUET-116 ?

> Pass a filter object to user defined predicate in filter2 api
> -------------------------------------------------------------
>
>                 Key: PARQUET-115
>                 URL: https://issues.apache.org/jira/browse/PARQUET-115
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-mr
>    Affects Versions: 1.6.0rc2
>            Reporter: Yash Datta
>            Priority: Minor
>             Fix For: parquet-mr_1.6.0
>
>
> Currently for creating a user defined predicate using the new filter api,  no value can be passed to create a dynamic filter at runtime. This reduces the usefulness of the user defined predicate, and  meaningful predicates cannot be created. We can add a generic Object value that is passed through the api, which can internally be used in the keep function of the user defined predicate for creating many different types of filters.
> For example, in spark sql, we can pass in a list of filter values for a where IN clause query and filter the row values based on that list.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)