You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Julien Le Dem (JIRA)" <ji...@apache.org> on 2014/10/30 20:12:35 UTC
[jira] [Commented] (PARQUET-115) Pass a filter object to user
defined predicate in filter2 api
[ https://issues.apache.org/jira/browse/PARQUET-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190643#comment-14190643 ]
Julien Le Dem commented on PARQUET-115:
---------------------------------------
Is this a duplicate of PARQUET-116 ?
> Pass a filter object to user defined predicate in filter2 api
> -------------------------------------------------------------
>
> Key: PARQUET-115
> URL: https://issues.apache.org/jira/browse/PARQUET-115
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-mr
> Affects Versions: 1.6.0rc2
> Reporter: Yash Datta
> Priority: Minor
> Fix For: parquet-mr_1.6.0
>
>
> Currently for creating a user defined predicate using the new filter api, no value can be passed to create a dynamic filter at runtime. This reduces the usefulness of the user defined predicate, and meaningful predicates cannot be created. We can add a generic Object value that is passed through the api, which can internally be used in the keep function of the user defined predicate for creating many different types of filters.
> For example, in spark sql, we can pass in a list of filter values for a where IN clause query and filter the row values based on that list.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)