You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2009/06/16 22:55:07 UTC

[jira] Updated: (PIG-850) Dump produce wrong result while "store into" is ok

     [ https://issues.apache.org/jira/browse/PIG-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Daniel Dai updated PIG-850:
---------------------------

    Attachment: PIG-850.patch

When we add extra limit map-reduce operator (see [PIG-364|http://issues.apache.org/jira/browse/PIG-364]), we should mark the output file in the original map-reduce as temporary; Otherwise, dump will pick the wrong output file.

> Dump produce wrong result while "store into" is ok
> --------------------------------------------------
>
>                 Key: PIG-850
>                 URL: https://issues.apache.org/jira/browse/PIG-850
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.2.0
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.3.0
>
>         Attachments: PIG-850.patch
>
>
> The following script will wrongly produce 20 output, however, if we change dump to "store into", the result is correct. Not sure if the problem is only for limited sort case.
> A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
> B = order A by gpa parallel 2;
> C = limit B 10;
> dump C;

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.