[jira] [Created] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

["Chen Liang (JIRA)" <ji...@apache.org>]

Chen Liang created HDFS-10932:
---------------------------------

             Summary: Ozone : fix XceiverClient slow shutdown
                 Key: HDFS-10932
                 URL: https://issues.apache.org/jira/browse/HDFS-10932
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Chen Liang
            Assignee: Chen Liang


Currently {{XceiverClient}} is the underlying entity of {{DistributedStorageHandler.newKeyWriter()}} and {{DistributedStorageHandler.newKeyReader()}}  for making call to container for read/write. When {{XceiverClient}} gets closed, {{group.shutdownGracefully()}} gets called, which is an asynchronous call. 

A problem is that this asynchronous call has default quiet period of 2 seconds before it actually shutdown, so if we have a burst of read/write calls, we would end up having threads created faster than they got terminated, reaching system limit at some point.

Ideally, this needs to be fixed with cached clients instead of creating new thread each time. This JIRA only tries to give a temporary fix for the time being.

Thanks [~anu] for the offline discussion.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org