You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jamie Grier (JIRA)" <ji...@apache.org> on 2019/04/01 18:54:00 UTC

[jira] [Closed] (FLINK-10484) New latency tracking metrics format causes metrics cardinality explosion

     [ https://issues.apache.org/jira/browse/FLINK-10484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jamie Grier closed FLINK-10484.
-------------------------------
    Resolution: Duplicate

> New latency tracking metrics format causes metrics cardinality explosion
> ------------------------------------------------------------------------
>
>                 Key: FLINK-10484
>                 URL: https://issues.apache.org/jira/browse/FLINK-10484
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Metrics
>    Affects Versions: 1.5.4, 1.6.0, 1.6.1
>            Reporter: Jamie Grier
>            Assignee: Jamie Grier
>            Priority: Critical
>
> The new metrics format for latency tracking causes huge metrics cardinality explosion due to the format and the fact that there is a metric reported for a every combination of source subtask index and operator subtask index.  Yikes!
> This format is actually responsible for basically taking down our metrics system due to DDOSing our metrics servers (at Lyft).
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)