You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2014/03/18 19:41:44 UTC
[jira] [Commented] (PIG-3813) PigGenericMapBase runPipeline()
method returns empty tuples and goes into infinite loop under certain
conditions
[ https://issues.apache.org/jira/browse/PIG-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13939622#comment-13939622 ]
Daniel Dai commented on PIG-3813:
---------------------------------
Seems LORank is generating the wrong uid. One thing missing in LORank is to keep generated uid across session, so a schema reset will not erase the old uid. We can refer to LOCogroup.groupKeyUidOnlySchema to fix LORank.
> PigGenericMapBase runPipeline() method returns empty tuples and goes into infinite loop under certain conditions
> ------------------------------------------------------------------------------------------------------------------
>
> Key: PIG-3813
> URL: https://issues.apache.org/jira/browse/PIG-3813
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.12.0
> Reporter: Suhas Satish
> Assignee: Cheolsoo Park
> Priority: Critical
> Attachments: PIG-3813-1.patch, test_data.txt
>
>
> When the following script is run, pig goes into an infinite loop. This was reproduced on pig trunk as of March 12, 2014 on apache hadoop 1.2. test_data.txt has been attached.
> test.pig
> tWeek = LOAD '/tmp/test_data.txt' USING PigStorage ('|') AS (WEEK:int, DESCRIPTION:chararray, END_DATE:chararray, PERIOD:int);
> gTWeek = FOREACH tWeek GENERATE WEEK AS WEEK, PERIOD AS PERIOD;
> pWeek = FILTER gTWeek BY PERIOD == 201312;
> pWeekRanked = RANK pWeek BY WEEK ASC DENSE;
> gpWeekRanked = FOREACH pWeekRanked GENERATE $0;
> store gpWeekRanked into 'gpWeekRanked';
> describe gpWeekRanked;
> ---------------------------------------------------
> The res object of class Result, gets its value from leaf.getNextTuple()
> This gets an empty tuple
> ()
> with STATUS_OK.
> SO the while(true) condition never gets an End of Processing (EOP) and so does not exit.
>
--
This message was sent by Atlassian JIRA
(v6.2#6252)