You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "lidesheng (Jira)" <ji...@apache.org> on 2020/12/04 07:25:00 UTC

[jira] [Closed] (FLINK-13813) metrics is different between overview ui and metric response

     [ https://issues.apache.org/jira/browse/FLINK-13813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

lidesheng closed FLINK-13813.
-----------------------------
    Resolution: Fixed

I got metrics by other ways

> metrics is different between overview ui and metric response
> ------------------------------------------------------------
>
>                 Key: FLINK-13813
>                 URL: https://issues.apache.org/jira/browse/FLINK-13813
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Web Frontend
>         Environment: Flink 1.8.1 with hdfs
>            Reporter: lidesheng
>            Priority: Major
>         Attachments: metrics.png, overview.png
>
>
> After a flink task is over, I get metrics by http request. The record count in response is different with job overview.After a flink task is over, I get metrics by http request. The record count in response is different with job overview.
> get http://x.x.x.x:8081/jobs/57969f3978edf3115354fab1a72fd0c8 returns:
> { "jid": "57969f3978edf3115354fab1a72fd0c8", "name": "3349_cjrw_1566177018152", "isStoppable": false, "state": "FINISHED", ... "vertices": [ \{ "id": "d1cdde18b91ef6ce7c6a1cfdfa9e968d", "name": "CHAIN DataSource (3349_cjrw_1566177018152/SOURCE/0) -> Map (3349_cjrw_1566177018152/AUDIT/0)", "parallelism": 1, "status": "FINISHED", ... "metrics": { "read-bytes": 0, "read-bytes-complete": true, "write-bytes": 555941888, "write-bytes-complete": true, "read-records": 0, "read-records-complete": true, "write-records": 5000000, "write-records-complete": true } ... } ... ] }}
> But, the metrics by http://x.x.x.x:8081/jobs/57969f3978edf3115354fab1a72fd0c8/vertices/d1cdde18b91ef6ce7c6a1cfdfa9e968d/metrics?get=0.numRecordsOut returns
> [\{"id":"0.numRecordsOut","value":"4084803"}]
> The overview record count is different with task metrics, please view the apppendix.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)