[jira] [Commented] (YARN-4980) SchedulerEventDispatcher should not process by only a single EventProcessor thread

["stefanlee (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303252#comment-16303252 ] 

stefanlee commented on YARN-4980:
---------------------------------

[~chenfolin] hi,have you resolved this problem, or optimized it?

> SchedulerEventDispatcher should not process by only a single EventProcessor thread
> ----------------------------------------------------------------------------------
>
>                 Key: YARN-4980
>                 URL: https://issues.apache.org/jira/browse/YARN-4980
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.5.0, 2.6.4
>         Environment: 1 resourcemanager
> 500 nodemanager
> nodemanager heartbeat interval is 3 secs.
>            Reporter: ChenFolin
>
> I think only a single EventProcessor thread in SchedulerEventDispatcher to process event is unreasonable.
> I often see "Size of scheduler event-queue is 1000(2000..)..." at the resourcemanager log.
> Now I have 500 nodemanager , event process is slowly. If I  add another 200 nodemanagers , the situation will badly.
> ... so,can node events(node add/delete/update...) processed by multi threads?



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org