You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Chandni Singh (JIRA)" <ji...@apache.org> on 2018/08/14 19:44:00 UTC

[jira] [Updated] (YARN-8402) Yarn Service Destroy: Delete service entries from Zookeeper in the ServiceMaster instead of ServiceClient in the RM

     [ https://issues.apache.org/jira/browse/YARN-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chandni Singh updated YARN-8402:
--------------------------------
    Parent Issue: YARN-7054  (was: YARN-7512)

> Yarn Service Destroy: Delete service entries from Zookeeper in the ServiceMaster instead of ServiceClient in the RM
> -------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-8402
>                 URL: https://issues.apache.org/jira/browse/YARN-8402
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Chandni Singh
>            Assignee: Chandni Singh
>            Priority: Major
>
> RM slows down considerably when multiple services are destroyed simultaneously.
> 1. Started approx 1000 services
> 2. Destroyed all the 1000 services.
> Observed considerable slowness in RM after this. 
> The {{ServiceClient}} in RM uses the {{CuratorClient}} to delete zookeeper entries. 
> The zookeeper client is the bottleneck and this could be avoided if the zookeeper entry can be deleted from the AM and then the {{ServiceClient}} can kill the app.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org