You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Jonathan Turner Eagles (Jira)" <ji...@apache.org> on 2021/04/23 21:15:01 UTC

[jira] [Resolved] (TEZ-2431) Recovery of task events (eg. datamovement events) should not depend on ordering of task attempt events

     [ https://issues.apache.org/jira/browse/TEZ-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Turner Eagles resolved TEZ-2431.
-----------------------------------------
    Resolution: Won't Fix

Closing recovery v1 bugs/features.

> Recovery of task events (eg. datamovement events) should not depend on ordering of task attempt events
> ------------------------------------------------------------------------------------------------------
>
>                 Key: TEZ-2431
>                 URL: https://issues.apache.org/jira/browse/TEZ-2431
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Bikas Saha
>            Priority: Major
>
> Today, task attempt events need to go through verteximpl before reaching the task in order to maintain ordering guarantees for recovery. This causes these events to be routed twice through the dispatcher. This can cause overhead delays in large jobs. Also, this makes assumptions about event ordering which make the system fragile. Recovery should work independently of other system interactions so that evolution of other components is not affected by recovery unless it affects recovery logically. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)