You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Ming Ma (JIRA)" <ji...@apache.org> on 2016/05/25 03:10:12 UTC

[jira] [Created] (TEZ-3270) Scheduling policy in Fair routing

Ming Ma created TEZ-3270:
----------------------------

             Summary: Scheduling policy in Fair routing
                 Key: TEZ-3270
                 URL: https://issues.apache.org/jira/browse/TEZ-3270
             Project: Apache Tez
          Issue Type: Sub-task
            Reporter: Ming Ma


The scheduling considers the following factors:

* Destination tasks’ dependency on source tasks defined by the routing policy.
* Data locality.
In the regular scattergather routing policy, each destination task depends on all source tasks. If
slowstart is configured to be less than 1.0, destination tasks can be started as long as a portion
of destination tasks have completed and can fetch data from all those completed source tasks.
In fair routing, a destination task might depend on only a subset of source tasks thus there is no
point of scheduling a destination task if none of the source tasks it depends on have completed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)