You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Xiangyi Zhu (Jira)" <ji...@apache.org> on 2022/01/05 08:42:00 UTC
[jira] [Updated] (HDFS-16412) Add metrics to support obtaining file size distribution
[ https://issues.apache.org/jira/browse/HDFS-16412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiangyi Zhu updated HDFS-16412:
-------------------------------
Description:
Use RangeMapRange "Map<Long, MutableLong> fileSizeRange" to store counters at different intervals. RangeMap key is a specific interval, and value is the counter corresponding to the interval.
*Counter update:*
When the file size changes or the file is deleted, the file size is obtained, and the counter in the corresponding interval is called to update the counter.
*Interval division:*
The default is to initialize the startup according to the following interval, or it can be initialized through the configuration file.
0MB
0-16MB
16-32MB
32-64MB
64-128MB
128-256MB
256-512MB
>512MB
was:
Use RangeMapRange "Map<Long, MutableLong> fileSizeRange" to store counters at different intervals. RangeMap key is a specific interval, and value is the counter corresponding to the interval.
**
*Counter update:*
When the file size changes or the file is deleted, the file size is obtained, and the counter in the corresponding interval is called to update the counter.
**
*Interval division:*
The default is to initialize the startup according to the following interval, or it can be initialized through the configuration file.
0MB
0-16MB
16-32MB
32-64MB
64-128MB
128-256MB
256-512MB
>512MB
> Add metrics to support obtaining file size distribution
> -------------------------------------------------------
>
> Key: HDFS-16412
> URL: https://issues.apache.org/jira/browse/HDFS-16412
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: namenode
> Affects Versions: 3.4.0
> Reporter: Xiangyi Zhu
> Assignee: Xiangyi Zhu
> Priority: Minor
>
> Use RangeMapRange "Map<Long, MutableLong> fileSizeRange" to store counters at different intervals. RangeMap key is a specific interval, and value is the counter corresponding to the interval.
> *Counter update:*
> When the file size changes or the file is deleted, the file size is obtained, and the counter in the corresponding interval is called to update the counter.
> *Interval division:*
> The default is to initialize the startup according to the following interval, or it can be initialized through the configuration file.
> 0MB
> 0-16MB
> 16-32MB
> 32-64MB
> 64-128MB
> 128-256MB
> 256-512MB
> >512MB
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org