You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2016/11/08 23:07:58 UTC
[jira] [Commented] (PIG-5055) Infinite loop with join by fixed
index
[ https://issues.apache.org/jira/browse/PIG-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649114#comment-15649114 ]
Koji Noguchi commented on PIG-5055:
-----------------------------------
This seems to be due to having EMPTY Foreach being added in the logicalplan.
{noformat}
|
|---B2: (Name: LOForEach Schema: null)
| |
| (Name: LOGenerate[] Schema: null)
|
|---B2: (Name: LOFilter Schema: b0#1:int)ColumnPrune:OutputUids=[]ColumnPrune:InputUids=[1]
| |
| (Name: Equal Type: boolean Uid: 12)
| |
| |---b0:(Name: Project Type: int Uid: 1 Input: 0 Column: 0)
| |
| |---(Name: Constant Type: int Uid: 11)
|
|---B: (Name: LOForEach Schema: b0#1:int)ColumnPrune:OutputUids=[1]ColumnPrune:InputUids=[1]
| |
| (Name: LOGenerate[false] Schema: b0#1:int)ColumnPrune:OutputUids=[1]ColumnPrune:InputUids=[1]
| | |
| | (Name: Cast Type: int Uid: 1)
| | |
| | |---b0:(Name: Project Type: bytearray Uid: 1 Input: 0 Column: (*))
| |
| |---(Name: LOInnerLoad[0] Schema: b0#1:bytearray)
|
|---B: (Name: LOLoad Schema: b0#1:bytearray)ColumnPrune:OutputUids=[1]ColumnPrune:InputUids=[1]ColumnPrune:RequiredColumns=[0]RequiredFields:[0]
{noformat}
> Infinite loop with join by fixed index
> --------------------------------------
>
> Key: PIG-5055
> URL: https://issues.apache.org/jira/browse/PIG-5055
> Project: Pig
> Issue Type: Bug
> Reporter: Koji Noguchi
> Assignee: Koji Noguchi
>
> Following pig script runs forever unless {{ColumnMapKeyPrune}} is disabled.
> {code}
> A = load 'input1.txt' as (a0:int, a1:int, a2:int);
> B = load 'input2.txt' as (b0:int, b1:int, b2:int);
> B2 = FILTER B by b0 == 0;
> C = join A by (1), B2 by (1) ;
> D = FOREACH C GENERATE A::a1, A::a2;
> store D into '/tmp/deleteme';
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)