[jira] [Created] (HDDS-7167) Set the right default number of reader threads for Hadoop-RPC

["Duong (Jira)" <ji...@apache.org>]

Duong created HDDS-7167:
---------------------------

             Summary: Set the right default number of reader threads for Hadoop-RPC
                 Key: HDDS-7167
                 URL: https://issues.apache.org/jira/browse/HDDS-7167
             Project: Apache Ozone
          Issue Type: Improvement
          Components: OM, SCM
            Reporter: Duong


Hadoop-RPC decouples the reading of RPC requests (readers) from connections and the executing RPC requests (handlers) by an in-memory blocking queue.

By default, there're 100 handler threads but only 1 reader thread, and this can easily be a bottleneck.

We did a raw RPC benchmark in OM and verified that the pure RPC performance can be improved by more than 3X just by increasing the number of readers to 10.

We should introduce a new config for the number of RPC readers in OM and SCM and define the right default value.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org