You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2014/03/18 19:41:44 UTC

[jira] [Commented] (PIG-3813) PigGenericMapBase runPipeline() method returns empty tuples and goes into infinite loop under certain conditions

    [ https://issues.apache.org/jira/browse/PIG-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939622#comment-13939622 ] 

Daniel Dai commented on PIG-3813:
---------------------------------

Seems LORank is generating the wrong uid. One thing missing in LORank is to keep generated uid across session, so a schema reset will not erase the old uid. We can refer to LOCogroup.groupKeyUidOnlySchema to fix LORank.

>  PigGenericMapBase  runPipeline() method returns empty tuples and goes into infinite loop under certain conditions
> ------------------------------------------------------------------------------------------------------------------
>
>                 Key: PIG-3813
>                 URL: https://issues.apache.org/jira/browse/PIG-3813
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.12.0
>            Reporter: Suhas Satish
>            Assignee: Cheolsoo Park
>            Priority: Critical
>         Attachments: PIG-3813-1.patch, test_data.txt
>
>
> When the following script is run, pig goes into an infinite loop. This was reproduced on pig trunk as of March 12, 2014 on apache hadoop 1.2. test_data.txt has been attached. 
> test.pig
> tWeek = LOAD '/tmp/test_data.txt' USING PigStorage ('|') AS (WEEK:int, DESCRIPTION:chararray, END_DATE:chararray, PERIOD:int);
> gTWeek = FOREACH tWeek GENERATE WEEK AS WEEK, PERIOD AS PERIOD;
> pWeek = FILTER gTWeek BY PERIOD == 201312;
> pWeekRanked = RANK pWeek BY WEEK ASC DENSE;
> gpWeekRanked = FOREACH pWeekRanked GENERATE $0;
> store gpWeekRanked into 'gpWeekRanked';
> describe gpWeekRanked;
> ---------------------------------------------------
> The res object of class Result, gets its value from leaf.getNextTuple()
> This gets an empty tuple 
> () 
> with STATUS_OK.
> SO the while(true) condition never gets an End of Processing (EOP) and so does not exit. 
>  



--
This message was sent by Atlassian JIRA
(v6.2#6252)