You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2016/11/08 23:07:58 UTC

[jira] [Commented] (PIG-5055) Infinite loop with join by fixed index

    [ https://issues.apache.org/jira/browse/PIG-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649114#comment-15649114 ] 

Koji Noguchi commented on PIG-5055:
-----------------------------------

This seems to be due to having EMPTY Foreach being added in the logicalplan.

{noformat}
        |
        |---B2: (Name: LOForEach Schema: null)
            |   |
            |   (Name: LOGenerate[] Schema: null)
            |
            |---B2: (Name: LOFilter Schema: b0#1:int)ColumnPrune:OutputUids=[]ColumnPrune:InputUids=[1]
                |   |
                |   (Name: Equal Type: boolean Uid: 12)
                |   |
                |   |---b0:(Name: Project Type: int Uid: 1 Input: 0 Column: 0)
                |   |
                |   |---(Name: Constant Type: int Uid: 11)
                |
                |---B: (Name: LOForEach Schema: b0#1:int)ColumnPrune:OutputUids=[1]ColumnPrune:InputUids=[1]
                    |   |
                    |   (Name: LOGenerate[false] Schema: b0#1:int)ColumnPrune:OutputUids=[1]ColumnPrune:InputUids=[1]
                    |   |   |
                    |   |   (Name: Cast Type: int Uid: 1)
                    |   |   |
                    |   |   |---b0:(Name: Project Type: bytearray Uid: 1 Input: 0 Column: (*))
                    |   |
                    |   |---(Name: LOInnerLoad[0] Schema: b0#1:bytearray)
                    |
                    |---B: (Name: LOLoad Schema: b0#1:bytearray)ColumnPrune:OutputUids=[1]ColumnPrune:InputUids=[1]ColumnPrune:RequiredColumns=[0]RequiredFields:[0]
{noformat}

> Infinite loop with join by fixed index
> --------------------------------------
>
>                 Key: PIG-5055
>                 URL: https://issues.apache.org/jira/browse/PIG-5055
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Koji Noguchi
>            Assignee: Koji Noguchi
>
> Following pig script runs forever unless {{ColumnMapKeyPrune}} is disabled.
> {code}
> A = load 'input1.txt' as (a0:int, a1:int, a2:int);
> B = load 'input2.txt' as (b0:int, b1:int, b2:int);
> B2 = FILTER B by b0 == 0;
> C = join A by (1), B2 by (1) ;
> D = FOREACH C GENERATE A::a1, A::a2;
> store D into '/tmp/deleteme';
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)