You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Ming Ma (JIRA)" <ji...@apache.org> on 2016/05/25 04:58:12 UTC
[jira] [Updated] (TEZ-3270) Data locality based scheduling policy
in fair routing
[ https://issues.apache.org/jira/browse/TEZ-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ming Ma updated TEZ-3270:
-------------------------
Summary: Data locality based scheduling policy in fair routing (was: Scheduling policy in fair routing)
> Data locality based scheduling policy in fair routing
> -----------------------------------------------------
>
> Key: TEZ-3270
> URL: https://issues.apache.org/jira/browse/TEZ-3270
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Ming Ma
>
> One of the scheduling factors is data locality. For a given completed task A, it is better to have its depending tasks in B run on the same host/container to reduce the network data transfer between the two. In addition, it might be better to pick larger partition task over smaller partition task. For example, in the above fair routing diagram, after task A1 has completed, task B1
> and/or task B2 can be scheduled on the same host/container as task A1Íž and B2 has higher priority than B1 given P2 is larger than P1.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)