[jira] [Commented] (HADOOP-15726) Create utility to limit frequency of log statements

["Chen Zhang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-15726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16915487#comment-16915487 ] 

Chen Zhang commented on HADOOP-15726:
-------------------------------------

Hi [~xkrogen], the patch of this Jira only throttle log of write-lock, don't consider log of read-lock, any consideration here?

> Create utility to limit frequency of log statements
> ---------------------------------------------------
>
>                 Key: HADOOP-15726
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15726
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: common, util
>            Reporter: Erik Krogen
>            Assignee: Erik Krogen
>            Priority: Major
>             Fix For: 2.10.0, 3.2.0, 3.0.4, 3.1.2
>
>         Attachments: HADOOP-15726.000.patch, HADOOP-15726.001.patch, HADOOP-15726.002.patch, HADOOP-15726.003.patch, HDFS-15726-branch-3.0.003.patch
>
>
> There is a common pattern of logging a behavior that is normally extraneous. Under some circumstances, such a behavior becomes common, flooding the logs and making it difficult to see what else is going on in the system. Under such situations it is beneficial to limit how frequently the extraneous behavior is logged, while capturing some summary information about the suppressed log statements.
> This is currently implemented in {{FSNamesystemLock}} (in HDFS-10713). We have additional use cases for this in HDFS-13791, so this is a good time to create a common utility for different sites to share this logic.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org