You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2024/05/07 05:03:00 UTC
[jira] [Commented] (HDFS-17303) Make WINDOW_SIZE and NUM_WINDOWS configurable.
[ https://issues.apache.org/jira/browse/HDFS-17303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844139#comment-17844139 ]
ASF GitHub Bot commented on HDFS-17303:
---------------------------------------
huangzhaobo99 opened a new pull request, #6801:
URL: https://github.com/apache/hadoop/pull/6801
<!--
Thanks for sending a pull request!
1. If this is your first time, please read our contributor guidelines: https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
2. Make sure your PR title starts with JIRA issue id, e.g., 'HADOOP-17799. Your PR title ...'.
-->
### Description of PR
1. The delay reported by DN to NN is an average delay of 3 hours.
MutableRollingAverages: WINDOW_SIZE_MS_DEFAULT = 300_000 NUM_WINDOWS_DEFAULT = 36
2. Changeing this window size and num to configurable param.
### How was this patch tested?
Add UT
> Make WINDOW_SIZE and NUM_WINDOWS configurable.
> ----------------------------------------------
>
> Key: HDFS-17303
> URL: https://issues.apache.org/jira/browse/HDFS-17303
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Zhaobo Huang
> Assignee: Zhaobo Huang
> Priority: Major
>
> 1. The delay reported by DN to NN is an average delay of 3 hours, which confuses me.
> MutableRollingAverages: WINDOW_SIZE_MS_DEFAULT = 300_000 NUM_WINDOWS_DEFAULT = 36
> 2. There is a time limit for SlowNodes collected by nn, which is currently set to 5ms by default (dfs.datanode.slowpeer.low.threshold.ms), while the time threshold for printing SlowNode logs written downstream is 300ms (dfs.datanode.low.io.warning.threshold.ms).
> 3. Can changeing this window size and num to configurable param?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org