You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "fa zheng (Jira)" <ji...@apache.org> on 2019/12/05 08:10:00 UTC

[jira] [Commented] (FLINK-15000) Metrics is very slow when parallelism is over 1000

    [ https://issues.apache.org/jira/browse/FLINK-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988573#comment-16988573 ] 

fa zheng commented on FLINK-15000:
----------------------------------

it mainly caused by loading all metric once, in this case, there are 63599 metrics in total. It is not suitable to load all metric once, it will lead a performance problem.

> Metrics is very slow when parallelism is over 1000
> --------------------------------------------------
>
>                 Key: FLINK-15000
>                 URL: https://issues.apache.org/jira/browse/FLINK-15000
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Metrics
>    Affects Versions: 1.9.0
>            Reporter: fa zheng
>            Priority: Major
>             Fix For: 1.10.0, 1.11.0
>
>
> metrics in web ui are very slow when parallelism is over 1000. It's hard to add metric and choose one metric. I run carTopSpeedWindowingExample with command 
> {code:java}
> //代码占位符
> flink run -m yarn-cluster -p 1200 -yjm 60g -ytm 60g -yn 60 -ys 20 examples/streaming/TopSpeedWindowing.jar
> {code}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)