You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Brahma Reddy Battula (JIRA)" <ji...@apache.org> on 2019/06/25 02:38:00 UTC
[jira] [Updated] (HDFS-13633) RBF: Synchronous way to create RPC
client connections to NN
[ https://issues.apache.org/jira/browse/HDFS-13633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brahma Reddy Battula updated HDFS-13633:
----------------------------------------
Parent Issue: HDFS-14603 (was: HDFS-13891)
> RBF: Synchronous way to create RPC client connections to NN
> -----------------------------------------------------------
>
> Key: HDFS-13633
> URL: https://issues.apache.org/jira/browse/HDFS-13633
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: federation
> Reporter: CR Hota
> Assignee: CR Hota
> Priority: Major
>
> Currently the router code does the following.
> # IPC handler thread gets a connection from the pool, even if the connection is NOT usable.
> # At the same time the IPC thread also submits a request to connection creator thread for adding a new connection to the pool asynchronously.
> # The new connection is NOT utilized by the IPC threads that get back an unusable connection.
> With this approach burst behaviors of clients, fill up the pool without necessarily using the connections. Also the approach is indeterministic.
> We propose a flag that can allow router admins to control the behavior of getting connections by the IPC handler threads. The flag would allow to toggle ON/OFF asynchronous vs synchronous way of connection creation.
> In the new model, if a connection is unusable, IPC handler thread would go ahead and create a connection and add to the pool and utilize it subsequently. It would still utilize the unusable connection if the pool is full.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org