[jira] [Updated] (PIG-4093) Predicate pushdown to support removing filters from pig plan

["Rohini Palaniswamy (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PIG-4093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohini Palaniswamy updated PIG-4093:
------------------------------------
    Fix Version/s:     (was: 0.16.0)
                   0.17.0

> Predicate pushdown to support removing filters from pig plan
> ------------------------------------------------------------
>
>                 Key: PIG-4093
>                 URL: https://issues.apache.org/jira/browse/PIG-4093
>             Project: Pig
>          Issue Type: Sub-task
>            Reporter: Rohini Palaniswamy
>             Fix For: 0.17.0
>
>
>    It is possible for the loaders to evaluate the pushed filter conditions. In that case it is not necessary to retain the filter conditions in the pig plan. So need to support two modes :
>     1) filter conditions are pushed into loader but also retained in pig plan as loader might do only best effort filtering based on block metadata
>     2) filter conditions are pushed into loader and removed from pig plan when the loader can evaluate the expression itself and filter out records. In this case, loader can do lazy deserialization adn avoid deserialization of the full record.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)