[jira] [Commented] (TEZ-1517) Avoid sending routed events via the AsyncDispatcher

["Hitesh Shah (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114460#comment-14114460 ] 

Hitesh Shah commented on TEZ-1517:
----------------------------------

Seems reasonable. I am assuming that this is after the events pass VertexImpl routing hence recovery will not be affected. 

The only problem is the change is not thread-safe - list is a simple array list and function is not synchronized/locked as needed. 

> Avoid sending routed events via the AsyncDispatcher
> ---------------------------------------------------
>
>                 Key: TEZ-1517
>                 URL: https://issues.apache.org/jira/browse/TEZ-1517
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>            Priority: Critical
>         Attachments: TEZ-1517.1.txt
>
>
> Sending them via the queue ends up creating lots of unnecesaary objects (millions for a large job), as well as blocking the queue.
> Eventually, event routing should be handed over to a separate thread - so that the asyncdispatcher is unblocked to continue operations like launching tasks, etc.



--
This message was sent by Atlassian JIRA
(v6.2#6252)