You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Cheolsoo Park (JIRA)" <ji...@apache.org> on 2014/03/17 02:58:44 UTC

[jira] [Assigned] (PIG-3813) PigGenericMapBase runPipeline() method returns empty tuples and goes into infinite loop under certain conditions

     [ https://issues.apache.org/jira/browse/PIG-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Cheolsoo Park reassigned PIG-3813:
----------------------------------

    Assignee: Cheolsoo Park

[~ssatish] helped me to reproduce the issue at the meet-up. Thanks!

This seems like a column pruner bug. The query runs fine if I add {{SET pig.optimizer.rules.disabled ColumnMapKeyPrune}}.

Assigning to me.





>  PigGenericMapBase  runPipeline() method returns empty tuples and goes into infinite loop under certain conditions
> ------------------------------------------------------------------------------------------------------------------
>
>                 Key: PIG-3813
>                 URL: https://issues.apache.org/jira/browse/PIG-3813
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.12.0
>            Reporter: Suhas Satish
>            Assignee: Cheolsoo Park
>            Priority: Critical
>         Attachments: test_data.txt
>
>
> When the following script is run, pig goes into an infinite loop. This was reproduced on pig trunk as of March 12, 2014 on apache hadoop 1.2. test_data.txt has been attached. 
> test.pig
> tWeek = LOAD '/tmp/test_data.txt' USING PigStorage ('|') AS (WEEK:int, DESCRIPTION:chararray, END_DATE:chararray, PERIOD:int);
> gTWeek = FOREACH tWeek GENERATE WEEK AS WEEK, PERIOD AS PERIOD;
> pWeek = FILTER gTWeek BY PERIOD == 201312;
> pWeekRanked = RANK pWeek BY WEEK ASC DENSE;
> gpWeekRanked = FOREACH pWeekRanked GENERATE $0;
> store gpWeekRanked into 'gpWeekRanked';
> describe gpWeekRanked;
> ---------------------------------------------------
> The res object of class Result, gets its value from leaf.getNextTuple()
> This gets an empty tuple 
> () 
> with STATUS_OK.
> SO the while(true) condition never gets an End of Processing (EOP) and so does not exit. 
>  



--
This message was sent by Atlassian JIRA
(v6.2#6252)