You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Zhaobo Huang (Jira)" <ji...@apache.org> on 2024/04/30 01:00:13 UTC
[jira] (HDFS-17303) Make WINDOW_SIZE and NUM_WINDOWS configurable.
[ https://issues.apache.org/jira/browse/HDFS-17303 ]
Zhaobo Huang deleted comment on HDFS-17303:
-------------------------------------
was (Author: JIRAUSER301546):
Hi, [~ayushtkn] [~tasanuma] [~tomscut], Everyone, if you have time, take a look this issue, Seek help, Thanks.
> Make WINDOW_SIZE and NUM_WINDOWS configurable.
> ----------------------------------------------
>
> Key: HDFS-17303
> URL: https://issues.apache.org/jira/browse/HDFS-17303
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Zhaobo Huang
> Priority: Major
>
> 1. The delay reported by DN to NN is an average delay of 3 hours, which confuses me.
> MutableRollingAverages: WINDOW_SIZE_MS_DEFAULT = 300_000 NUM_WINDOWS_DEFAULT = 36
> 2. There is a time limit for SlowNodes collected by nn, which is currently set to 5ms by default (dfs.datanode.slowpeer.low.threshold.ms), while the time threshold for printing SlowNode logs written downstream is 300ms (dfs.datanode.low.io.warning.threshold.ms).
> 3. Can changeing this window size and num to configurable param?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org