[jira] [Updated] (TEZ-3270) Scheduling policy in fair routing

["Ming Ma (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TEZ-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ming Ma updated TEZ-3270:
-------------------------
    Summary: Scheduling policy in fair routing  (was: Scheduling policy in Fair routing)

> Scheduling policy in fair routing
> ---------------------------------
>
>                 Key: TEZ-3270
>                 URL: https://issues.apache.org/jira/browse/TEZ-3270
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Ming Ma
>
> The scheduling considers the following factors:
> * Destination tasks’ dependency on source tasks defined by the routing policy.
> * Data locality.
> In the regular scatter­gather routing policy, each destination task depends on all source tasks. If
> slowstart is configured to be less than 1.0, destination tasks can be started as long as a portion
> of destination tasks have completed and can fetch data from all those completed source tasks.
> In fair routing, a destination task might depend on only a subset of source tasks thus there is no
> point of scheduling a destination task if none of the source tasks it depends on have completed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)