You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "ChenFolin (JIRA)" <ji...@apache.org> on 2016/04/21 08:59:25 UTC

[jira] [Created] (YARN-4980) SchedulerEventDispatcher should not process by only a single EventProcessor thread

ChenFolin created YARN-4980:
-------------------------------

             Summary: SchedulerEventDispatcher should not process by only a single EventProcessor thread
                 Key: YARN-4980
                 URL: https://issues.apache.org/jira/browse/YARN-4980
             Project: Hadoop YARN
          Issue Type: Bug
          Components: resourcemanager
    Affects Versions: 2.6.4, 2.5.0
         Environment: 1 resourcemanager
500 nodemanager
nodemanager heartbeat interval is 3 secs.

            Reporter: ChenFolin


I think only a single EventProcessor thread in SchedulerEventDispatcher to process event is unreasonable.

I often see "Size of scheduler event-queue is 1000(2000..)..." at the resourcemanager log.

Now I have 500 nodemanager , event process is slowly. If I  add another 200 nodemanagers , the situation will badly.

... so,can node events(node add/delete/update...) processed by multi threads?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)