You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Cheolsoo Park (JIRA)" <ji...@apache.org> on 2013/10/10 22:11:42 UTC

[jira] [Comment Edited] (PIG-3461) Rewrite PartitionFilterOptimizer to make it work for all the cases

    [ https://issues.apache.org/jira/browse/PIG-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13791933#comment-13791933 ] 

Cheolsoo Park edited comment on PIG-3461 at 10/10/13 8:10 PM:
--------------------------------------------------------------

I just committed PIG-3510 to 0.12 branch. 

Regarding seriousness, this doesn't make jobs fail, but it definitely has production impact since it makes jobs run longer. I would vote for another RC, but if we can release 0.12.1 soon enough after 0.12.0 is out, that'll be fine too.


was (Author: cheolsoo):
I just committed PIG-3510 to 0.12 branch. 

Regarding seriousness, this doesn't make jobs fail, but it has definitely had production impact since it make jobs run longer. I would vote for another RC, but if we can release 0.12.1 soon enough after 0.12.0 is out, that'll be fine too.

> Rewrite PartitionFilterOptimizer to make it work for all the cases
> ------------------------------------------------------------------
>
>                 Key: PIG-3461
>                 URL: https://issues.apache.org/jira/browse/PIG-3461
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.11.1
>            Reporter: Aniket Mokashi
>            Assignee: Aniket Mokashi
>             Fix For: 0.12.0
>
>         Attachments: PIG-3461-2.patch, PIG-3461-4.patch, PIG-3461-6.patch
>
>
> Current algorithm for Partition Filter pushdown identification fails in several corner cases. We need to rewrite its logic so that it works in all cases and does the maximum possible filter pushdown.



--
This message was sent by Atlassian JIRA
(v6.1#6144)