[jira] [Created] (HDFS-15397) Blocks recovery could overwhelm KDC when using Kerberos for authentication

["Xiaoqiao He (Jira)" <ji...@apache.org>]

Xiaoqiao He created HDFS-15397:
----------------------------------

             Summary: Blocks recovery could overwhelm KDC when using Kerberos for authentication
                 Key: HDFS-15397
                 URL: https://issues.apache.org/jira/browse/HDFS-15397
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: datanode
            Reporter: Xiaoqiao He


It could overwhelm KDC if enable Kerberos for authentication when there are large number of blocks are triggered to recovery.
Consider killing one running application which opens large number files and writing, it will trigger block recovery, If `recoverblocks` commands are not under control, there will be huge number pairs between two DataNode need to auth when recovery, then it will overwhelm KDC if we enable Kerberos for authentication.
I would like to attach more information about the corner case.
Technically, we should control the concurrency when there are large number blocks need to recovery IMO.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org