You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2013/08/21 00:03:52 UTC

[jira] [Updated] (PIG-3385) DISTINCT no longer uses custom partitioner

     [ https://issues.apache.org/jira/browse/PIG-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Noguchi updated PIG-3385:
------------------------------

    Attachment: pig-3385-v01.patch

Wondering if custom partitioner ever worked for distinct.  

Looks like partitioner info is passed through POGlobalRearrange but "distinct" doesn't use it. 

Uploading an initial patch that just passes that info through PODistinct. 

It's the first time for me to touch the backend code. Appreciate if someone can take a look.  I'll upload a testcase next.
                
> DISTINCT no longer uses custom partitioner
> ------------------------------------------
>
>                 Key: PIG-3385
>                 URL: https://issues.apache.org/jira/browse/PIG-3385
>             Project: Pig
>          Issue Type: Bug
>          Components: documentation
>            Reporter: Will Oberman
>            Priority: Minor
>         Attachments: pig-3385-v01.patch
>
>
> From user@pig.apache.org:  It looks like an optimization was put in to make distinct use a special partitioner which prevents the user from setting the partitioner.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira