[jira] Updated: (PIG-646) Distinct UDF should report progress

["Santhosh Srinivasan (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PIG-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Santhosh Srinivasan updated PIG-646:
------------------------------------

    Attachment: PIG-646.patch

Attached patch fixes the issue with reporting progress in Distinct.java and also sets up the reporter correctly in PigCombiner.java and PigMapReduce.ReduceWithComparator. In addition there are unit test cases in TestBuiltin.java and TestEvalPipeline.java

All unit tests pass.

> Distinct UDF should report progress
> -----------------------------------
>
>                 Key: PIG-646
>                 URL: https://issues.apache.org/jira/browse/PIG-646
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Santhosh Srinivasan
>         Attachments: PIG-646.patch
>
>
> We have seen the case where if a bag passed to distinct UDF is too large to fit into main memory the job fails with a time out because no progress is reported.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.