You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Daniel Dai (JIRA)" <ji...@apache.org> on 2015/11/10 00:24:11 UTC

[jira] [Commented] (PIG-4730) [Pig on Tez] Total parallelism estimation does not account load parallelism

    [ https://issues.apache.org/jira/browse/PIG-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14997638#comment-14997638 ] 

Daniel Dai commented on PIG-4730:
---------------------------------

+1

> [Pig on Tez] Total parallelism estimation does not account load parallelism
> ---------------------------------------------------------------------------
>
>                 Key: PIG-4730
>                 URL: https://issues.apache.org/jira/browse/PIG-4730
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: 0.16.0
>
>         Attachments: PIG-4730-1.patch
>
>
> Total parallelism estimation in ParallelismSetter which is used to auto increment AM size does not include parallelism of load vertices causing the estimation to be wrong and not incrementing AM memory in cases where it is needed leading to OOM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)