You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Jing Zhao (JIRA)" <ji...@apache.org> on 2015/09/03 02:01:32 UTC
[jira] [Created] (HDFS-9011) Support splitting BlockReport of a
storage into multiple RPC
Jing Zhao created HDFS-9011:
-------------------------------
Summary: Support splitting BlockReport of a storage into multiple RPC
Key: HDFS-9011
URL: https://issues.apache.org/jira/browse/HDFS-9011
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Jing Zhao
Assignee: Jing Zhao
Currently if a DataNode has too many blocks (more than 1m by default), it sends multiple RPC to the NameNode for the block report, each RPC contains report for a single storage. However, in practice we've seen sometimes even a single storage can contains large amount of blocks and the report even exceeds the max RPC data length. It may be helpful to support sending multiple RPC for the block report of a storage.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)