You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Shuyan Zhang (Jira)" <ji...@apache.org> on 2023/11/06 04:22:00 UTC
[jira] [Resolved] (HDFS-17243) Add the parameter storage type for getBlocks method
[ https://issues.apache.org/jira/browse/HDFS-17243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shuyan Zhang resolved HDFS-17243.
---------------------------------
Fix Version/s: 3.4.0
Hadoop Flags: Reviewed
Resolution: Fixed
> Add the parameter storage type for getBlocks method
> ---------------------------------------------------
>
> Key: HDFS-17243
> URL: https://issues.apache.org/jira/browse/HDFS-17243
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: balamcer
> Reporter: Haiyang Hu
> Assignee: Haiyang Hu
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0
>
>
> When Balancer is running, it is found that there are many logs, such as
> {code:java}
> INFO balancer.Dispatcher (Dispatcher.java:markMovedIfGoodBlock(306)) - No striped internal block on source xxx:50010:SSD, block blk_-xxx_xxx size=982142783. Skipping.
> {code}
> these logs show that Balancer cannot to balancer SSD type sourceļ¼ and it causes that Balancer will frequently get blocks from NN through getBlocks RPC.
> The main reason is the storage type in the current Source is SSD, but now getBlocks obtains all list of blocks belonging to datanode, so need add the parameter storage type for getBlocks method
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org