You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Ming Ma (JIRA)" <ji...@apache.org> on 2016/10/04 01:00:43 UTC

[jira] [Updated] (TEZ-3269) Provide basic fair routing and scheduling functionality via custom VertexManager and EdgeManager

     [ https://issues.apache.org/jira/browse/TEZ-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ming Ma updated TEZ-3269:
-------------------------
    Attachment: TEZ-3269-3.patch

Thank you [~aplusplus]! The new patch has addressed the issues you raised. Regarding "why pendingTasks.size() would be zero?", it might be due to some test case with the the number of destination tasks set to zero and the old FairShufleVertexManager handling.

> Provide basic fair routing and scheduling functionality via custom VertexManager and EdgeManager
> ------------------------------------------------------------------------------------------------
>
>                 Key: TEZ-3269
>                 URL: https://issues.apache.org/jira/browse/TEZ-3269
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Ming Ma
>         Attachments: TEZ-3269-2.patch, TEZ-3269-3.patch, TEZ-3269.patch
>
>
> With TEZ-3206 and TEZ-3216, we can build a custom VertexManager and EdgeManager that uses partition stats to do fair routing as well as the scheduling based on destination tasks’ dependency on source tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)