[jira] [Created] (HADOOP-17861) improve YARN Registry DNS Server qps

["YUBI LEE (Jira)" <ji...@apache.org>]

YUBI LEE created HADOOP-17861:
---------------------------------

             Summary: improve YARN Registry DNS Server qps
                 Key: HADOOP-17861
                 URL: https://issues.apache.org/jira/browse/HADOOP-17861
             Project: Hadoop Common
          Issue Type: Improvement
          Components: registry
    Affects Versions: 3.1.2
            Reporter: YUBI LEE


There are some points to improve the performance of YARN Registry DNS Server.

- Do not print unnecessary logs (It just needs change log4j.properties)
- Change some loglevels at points which can affect performance degradation.
- Use "newFixedThreadPool" instead of "newCachedThreadPool" to prevent OOM
- Use Blocking on TCP handler. Using non-blocking and sleeping some time("Thread.sleep(500)") is meaningless.

In our environment, QPS of original yarn dns server is about 5000 (UDP), 100 (TCP).
Now, QPS of our improved yarn dns server is about 47000 (UDP), 500 (TCP).


I will make a pull request at https://github.com/apache/hadoop soon.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org