You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Andrei Mikhalev (Jira)" <ji...@apache.org> on 2024/04/01 07:37:00 UTC
[jira] [Updated] (HDDS-9889) Refatoring tests related to dynamical adaptation for datanode limits in ContainerBalancer
[ https://issues.apache.org/jira/browse/HDDS-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Mikhalev updated HDDS-9889:
----------------------------------
Summary: Refatoring tests related to dynamical adaptation for datanode limits in ContainerBalancer (was: Configure adaptation for datanode limits in ContainerBalancer)
> Refatoring tests related to dynamical adaptation for datanode limits in ContainerBalancer
> -----------------------------------------------------------------------------------------
>
> Key: HDDS-9889
> URL: https://issues.apache.org/jira/browse/HDDS-9889
> Project: Apache Ozone
> Issue Type: Improvement
> Components: Balancer, SCM
> Affects Versions: 1.3.0, 1.4.0
> Environment: {*}OS{*}: Ubuntu 22.04.3 LTS, {*}Arch{*}: 64-bit, {*}Processor{*}: Intel Core i7-9750H CPU 2.6GHz x 12
> Reporter: Andrei Mikhalev
> Assignee: Andrei Mikhalev
> Priority: Major
> Labels: pull-request-available
>
> Dynamical adaptation (introduced in HDDS-5526) for {{datanodes.involved.max.percentage.per.iteration}} in container balancer doesn't work well in some cases.
> Sometimes the number of *under-utilized* nodes may not be sufficient to satisfy the limit about the max percent of datanodes participating in the balance iteration ({{{}datanodes.involved.max.percentage.per.iteration{}}}).
> Thus, collections of source and target datanodes are reset and balancing is skipped.
> The issue it can be easily detected when cluster has few nodes (< 10), for example 4 or 5.
>
> +Solution:+
>
> To fix this case we have to set {{datanodes.involved.max.percentage.per.iteration}} value to 100.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org