You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org> on 2015/09/28 20:34:24 UTC

[jira] [Closed] (YARN-4047) ClientRMService getApplications has high scheduler lock contention

     [ https://issues.apache.org/jira/browse/YARN-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod Kumar Vavilapalli closed YARN-4047.
-----------------------------------------

> ClientRMService getApplications has high scheduler lock contention
> ------------------------------------------------------------------
>
>                 Key: YARN-4047
>                 URL: https://issues.apache.org/jira/browse/YARN-4047
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>              Labels: 2.6.1-candidate
>             Fix For: 2.6.1, 2.7.2
>
>         Attachments: YARN-4047.001.patch
>
>
> The getApplications call can be particuarly expensive because the code can call checkAccess on every application being tracked by the RM.  checkAccess will often call scheduler.checkAccess which will grab the big scheduler lock.  This can cause a lot of contention with the scheduler thread which is busy trying to process node heartbeats, app allocation requests, etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)