You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Gopal Vijayaraghavan (Jira)" <ji...@apache.org> on 2019/10/08 05:31:00 UTC

[jira] [Created] (HADOOP-16641) RPC: Heavy contention on Configuration.getClassByNameOrNull

Gopal Vijayaraghavan created HADOOP-16641:
---------------------------------------------

             Summary: RPC: Heavy contention on Configuration.getClassByNameOrNull 
                 Key: HADOOP-16641
                 URL: https://issues.apache.org/jira/browse/HADOOP-16641
             Project: Hadoop Common
          Issue Type: Bug
            Reporter: Gopal Vijayaraghavan
         Attachments: config-get-class-by-name.png

https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java#L2589

{code}
        map = Collections.synchronizedMap(
          new WeakHashMap<String, WeakReference<Class<?>>>());
{code}

This synchronizes all lookups across the same class-loader across all threads & yields rpc threads.

 !config-get-class-by-name.png! 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org