You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2016/04/25 21:07:13 UTC

[jira] [Updated] (PIG-4653) Remove unwanted config set on Tez DAG, vertices and edges

     [ https://issues.apache.org/jira/browse/PIG-4653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohini Palaniswamy updated PIG-4653:
------------------------------------
    Fix Version/s:     (was: 0.16.0)
                   0.17.0

> Remove unwanted config set on Tez DAG, vertices and edges
> ---------------------------------------------------------
>
>                 Key: PIG-4653
>                 URL: https://issues.apache.org/jira/browse/PIG-4653
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.17.0
>
>
>    This is bloating up the data sent in DAG submission and causes some DAGs to fail with java.io.IOException: Requested data length 127200464 is longer than maximum configured RPC length 67108864. 
>   It also overwhelms Tez AM and make it hit OOM while processing getTask requests from 100s of tasks concurrently as the config payload in Input, Output and PigProcessor cause RPC buffers to overflow. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)