You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Hitesh Sharma (JIRA)" <ji...@apache.org> on 2018/10/17 07:38:00 UTC

[jira] [Created] (TEZ-4010) Use InputReadyVertexManager for broadcast connection

Hitesh Sharma created TEZ-4010:
----------------------------------

             Summary: Use InputReadyVertexManager for broadcast connection
                 Key: TEZ-4010
                 URL: https://issues.apache.org/jira/browse/TEZ-4010
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Hitesh Sharma


As per [VertexImpl::assignVertexManager|https://github.com/apache/tez/blob/39d76a656216d4843908279ef8eaa29a4cc83104/tez-dag/src/main/java/org/apache/tez/dag/app/dag/impl/VertexImpl.java#L2677] an ImmediateStartVertexManager is used for broadcast connections. This seems to be inefficient as tasks are started way before they can run in the DAG.

Thoughts on using InputReadyVertexManager for broadcast connections?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)