You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Eric Badger (JIRA)" <ji...@apache.org> on 2017/06/27 16:05:00 UTC

[jira] [Updated] (TEZ-3274) Vertex with MRInput and broadcast input does not respect slow start

     [ https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eric Badger updated TEZ-3274:
-----------------------------
    Attachment: TEZ-3274.005.patch

Thanks for the review, [~jeagles]! I addressed your comments in this new patch. I agree that we should address some style and coding practice issues in a follow up JIRA. That way we can address them in both the ShuffleVertexManager and RootInputVertexManager in a single patch.

> Vertex with MRInput and broadcast input does not respect slow start
> -------------------------------------------------------------------
>
>                 Key: TEZ-3274
>                 URL: https://issues.apache.org/jira/browse/TEZ-3274
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Jonathan Eagles
>            Assignee: Eric Badger
>         Attachments: TEZ-3274.001.patch, TEZ-3274.002.patch, TEZ-3274.003.patch, TEZ-3274.004.patch, TEZ-3274.005.patch
>
>
> Vertices with shuffle input and MRInput choose RootInputVertexManager (and not ShuffleVertexManager) and start containers and tasks immediately. In this scenario, resources can be wasted since they do not respect tez.shuffle-vertex-manager.min-src-fraction tez.shuffle-vertex-manager.max-src-fraction. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)