You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Jason O'Sullivan (Jira)" <ji...@apache.org> on 2025/12/05 12:12:00 UTC

[jira] [Created] (HDDS-14084) Highlight Data Nodes with Insufficient Write Space

Jason O'Sullivan created HDDS-14084:
---------------------------------------

             Summary: Highlight Data Nodes with Insufficient Write Space
                 Key: HDDS-14084
                 URL: https://issues.apache.org/jira/browse/HDDS-14084
             Project: Apache Ozone
          Issue Type: Bug
    Affects Versions: 1.4.1, 2.0.0, 2.1.0
            Reporter: Jason O'Sullivan
            Assignee: Jason O'Sullivan
             Fix For: 2.2.0


The *Data Node selection process* for forming new *Ratis pipelines* currently *silently ignores* nodes that do not meet the minimum space requirements for either metadata or data writes. This behaviour makes it difficult for operators to quickly identify and troubleshoot Data Nodes that are failing to join pipelines.



The following properties are used by the *Storage Container Manager (SCM)* during node selection to enforce minimum space requirements:
 * *Metadata Write Space:*

 ** {{ozone.scm.datanode.ratis.volume.free-space.min}} (Minimum free space required on the Data Node's disk volume for {*}Ratis metadata{*}.)

 * *Data Write Space:*

 ** {{ozone.scm.container.size}} (The target size of a container, which acts as the effective *minimum free space* required to allocate a new container for data.)

Currently, the reason for ignoring a Data Node is only recorded at the *DEBUG* log level.

We propose raising the log level for these specific space-check failures to *INFO* or *WARN* within the SCM node selection logic. This change will ensure that Data Nodes with insufficient write space (for either metadata or data) are *highlighted sooner* in the logs, providing immediate visibility to operators without requiring increased log verbosity for the entire system.



*Note:* While this change offers better visibility, it may lead to an increase in log output under heavy operation or when a large number of Data Nodes are consistently low on space.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org