You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@ozone.apache.org by "Duong (Jira)" <ji...@apache.org> on 2022/08/23 17:54:00 UTC

[jira] [Assigned] (HDDS-7167) Set the right default number of reader threads for Hadoop-RPC

     [ https://issues.apache.org/jira/browse/HDDS-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Duong reassigned HDDS-7167:
---------------------------

    Assignee: Duong

> Set the right default number of reader threads for Hadoop-RPC
> -------------------------------------------------------------
>
>                 Key: HDDS-7167
>                 URL: https://issues.apache.org/jira/browse/HDDS-7167
>             Project: Apache Ozone
>          Issue Type: Improvement
>          Components: OM, SCM
>            Reporter: Duong
>            Assignee: Duong
>            Priority: Major
>
> Hadoop-RPC decouples the reading of RPC requests (readers) from connections and the executing RPC requests (handlers) by an in-memory blocking queue.
> By default, there're 100 handler threads but only 1 reader thread, and this can easily be a bottleneck.
> We did a raw RPC benchmark in OM and verified that the pure RPC performance can be improved by more than 3X just by increasing the number of readers to 10.
> We should introduce a new config for the number of RPC readers in OM and SCM and define the right default value.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org