[jira] [Commented] (TEZ-802) Determination of Task Placement for 1-1 Edges

["Bikas Saha (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13975954#comment-13975954 ] 

Bikas Saha commented on TEZ-802:
--------------------------------

With TEZ-1018 it should be possible to use the InputReadyVertexManager to specify the locality of tasks where the locality is mainly dependent on the 1-1 source. This approach implements 1) above. Whenever there is a 1-1 only or a broadcast and 1-1 edge then tez can choose to automatically insert the InputReadyVertexManager.

Colocation of tasks by analyzing the DAG structure to determine co-location or by the user may be done separately as a future improvement.

> Determination of Task Placement for 1-1 Edges
> ---------------------------------------------
>
>                 Key: TEZ-802
>                 URL: https://issues.apache.org/jira/browse/TEZ-802
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Bikas Saha
>            Assignee: Bikas Saha
>
> Currently, task placement is determined by TaskLocationHints that are specified by the user in the API or during runtime. Everything else runs as without placement constraints. While this works for broadcase and scatter-gather edges, it does not work for 1-1 edges.



--
This message was sent by Atlassian JIRA
(v6.2#6252)