[jira] [Created] (HDDS-11531) Collect iowait and system on the node.

["Shilun Fan (Jira)" <ji...@apache.org>]

Shilun Fan created HDDS-11531:
---------------------------------

             Summary: Collect iowait and system on the node.
                 Key: HDDS-11531
                 URL: https://issues.apache.org/jira/browse/HDDS-11531
             Project: Apache Ozone
          Issue Type: Sub-task
          Components: Ozone Datanode
            Reporter: Shilun Fan
            Assignee: Shilun Fan


This feature will periodically retrieve data from /proc/stat, parse the iowait and system information, and write it into metrics. In the future, we will report this metric to SCM so that it can skip high-load DNs when returning the pipeline DN list, decommison data transfers, creating pipelines, and balancing, thereby enhancing the system's access performance.

Parsing `/proc/stat` is a lightweight action that won't impose additional load on the system. This metric has good sensitivity to reflect the current IO performance of the DN. High IOWait typically indicates conditions during high-frequency read/write operations or when using `du` for HDD/SSD access. An increase in System time usually occurs during high-frequency read/write operations with NVMe. When these situations arise, the DN is no longer in optimal condition for data access or writing (as responses will be very slow), so we should find ways to skip such DNs during data access.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org