You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jamie Grier (JIRA)" <ji...@apache.org> on 2018/10/02 23:35:00 UTC

[jira] [Created] (FLINK-10484) New latency tracking metrics format causes metrics cardinality explosion

Jamie Grier created FLINK-10484:
-----------------------------------

             Summary: New latency tracking metrics format causes metrics cardinality explosion
                 Key: FLINK-10484
                 URL: https://issues.apache.org/jira/browse/FLINK-10484
             Project: Flink
          Issue Type: Bug
          Components: Metrics
    Affects Versions: 1.5.4, 1.6.1, 1.6.0
            Reporter: Jamie Grier
            Assignee: Jamie Grier


The new metrics format for latency tracking causes huge metrics cardinality explosion due to the format and the fact that there is a metric reported for a every combination of source subtask index and operator subtask index.  Yikes!

This format is actually responsible for basically taking down our metrics system due to DDOSing our metrics servers (at Lyft).

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)