[jira] [Updated] (HUDI-1305) Prevent log pollution from console metrics logger

["Vinoth Chandar (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HUDI-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinoth Chandar updated HUDI-1305:
---------------------------------
    Fix Version/s: 0.7.0

> Prevent log pollution from console metrics logger
> -------------------------------------------------
>
>                 Key: HUDI-1305
>                 URL: https://issues.apache.org/jira/browse/HUDI-1305
>             Project: Apache Hudi
>          Issue Type: Improvement
>            Reporter: Prashant Wason
>            Assignee: Prashant Wason
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 0.7.0
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> The logs are filled with Console metrics logger output. This is because of the following reasons:
> 1. The registration of Metrics Reporter is per JVM not per test
> 2. Once any metrics reporter is registered, it is never de-registered and hence always keeps publishing stats at 30 second intervals.
> Hence, once the TestHoodieConsoleMetrics reporter runs, the logs are polluted with metrics being printed to console. 
> test-trip-table_metadata.timer.deltacommit
>              count = 2
>          mean rate = 0.00 calls/second
>      1-minute rate = 0.00 calls/second
>      5-minute rate = 0.00 calls/second
>     15-minute rate = 0.07 calls/second
>                min = 702.76 milliseconds
>                max = 1347.67 milliseconds
>               mean = 1017.96 milliseconds
>             stddev = 322.38 milliseconds
>             median = 702.76 milliseconds
>               75% <= 1347.67 milliseconds
>               95% <= 1347.67 milliseconds
>               98% <= 1347.67 milliseconds
>               99% <= 1347.67 milliseconds
>             99.9% <= 1347.67 milliseconds



--
This message was sent by Atlassian Jira
(v8.3.4#803005)