You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "CR Hota (JIRA)" <ji...@apache.org> on 2018/05/29 18:17:00 UTC
[jira] [Updated] (HDFS-13633) RBF : Synchronous way to create RPC
client connections to NN
[ https://issues.apache.org/jira/browse/HDFS-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
CR Hota updated HDFS-13633:
---------------------------
Summary: RBF : Synchronous way to create RPC client connections to NN (was: Synchronous way to create RPC client connections to NN)
> RBF : Synchronous way to create RPC client connections to NN
> ------------------------------------------------------------
>
> Key: HDFS-13633
> URL: https://issues.apache.org/jira/browse/HDFS-13633
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: federation
> Reporter: CR Hota
> Priority: Major
>
> Currently the router code does the following.
> # IPC handler thread gets a connection from the pool, even if the connection is NOT usable.
> # At the same time the IPC thread also submits a request to connection creator thread for adding a new connection to the pool asynchronously.
> # The new connection is NOT utilized by the IPC threads that get back an unusable connection.
> With this approach burst behaviors of clients, fill up the pool without necessarily using the connections. Also the approach is indeterministic.
> We propose a flag that can allow router admins to control the behavior of getting connections by the IPC handler threads. The flag would allow to toggle ON/OFF asynchronous vs synchronous way of connection creation.
> In the new model, if a connection is unusable, IPC handler thread would go ahead and create a connection and add to the pool and utilize it subsequently. It would still utilize the unusable connection if the pool is full.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org