You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Muhammad Samir Khan (JIRA)" <ji...@apache.org> on 2017/08/09 21:20:00 UTC

[jira] [Updated] (TEZ-3816) Ability to automatically speculate single-task vertices

     [ https://issues.apache.org/jira/browse/TEZ-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Muhammad Samir Khan updated TEZ-3816:
-------------------------------------
    Attachment: TEZ-3816.001.patch

Added ability to LegacyTaskRuntimeEstimator to speculate based on timeout for single task vertices.

> Ability to automatically speculate single-task vertices
> -------------------------------------------------------
>
>                 Key: TEZ-3816
>                 URL: https://issues.apache.org/jira/browse/TEZ-3816
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Muhammad Samir Khan
>            Assignee: Muhammad Samir Khan
>         Attachments: TEZ-3816.001.patch
>
>
> When a single-task vertex is unlucky, it lands on a very slow node. Speculation doesn't currently apply when there are no other tasks to compare with. It would be good to either have a configurable timeout after which the tasks automatically speculate.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)