You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Liu (Jira)" <ji...@apache.org> on 2026/01/22 09:29:00 UTC
[jira] [Updated] (FLINK-38961) Display process metrics (CPU, Memory, I/O) on TaskManager Web UI
[ https://issues.apache.org/jira/browse/FLINK-38961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Liu updated FLINK-38961:
------------------------
Description:
h1. Summary
Add a new "Process Usage" panel on the TaskManager Metrics page of the Flink Web UI to display process-level metrics, including CPU usage, memory (RSS), and I/O statistics.
h1. Motivation
Currently, the TaskManager Metrics page in Flink Web UI only displays JVM and Flink-managed memory metrics. However, users often need to monitor process-level resource consumption to better understand the actual resource usage of TaskManagers.
When `metrics.system-resource` is enabled, Flink collects process-level metrics such as:
- `Process.CPU.Usage` - CPU usage percentage of the process
- `Process.Memory.RSS` - Resident Set Size (physical memory used by the process)
- `Process.IO.Read` / `Process.IO.Write` - I/O read and write bytes
These metrics are already available through the REST API but are not displayed in the Web UI, making it inconvenient for users to monitor them.
h1. Proposed Changes
1. *{*}Add a "Process Usage" card{*}* on the TaskManager Metrics page (`task-manager-metrics.component.html`) displaying:
- *{*}CPU{*}*: Process CPU usage percentage
- *{*}Memory{*}*: Process RSS (Resident Set Size)
- *{*}I/O{*}*: Combined read and write I/O bytes
2. *{*}Extend the metrics query{*}* in `task-manager-metrics.component.ts` to include:
- `Process.CPU.Usage`
- `Process.Memory.RSS`
- `Process.IO.Read`
- `Process.IO.Write`
h1. Prerequisites
Users need to enable system resource metrics by setting `metrics.system-resource: true` in the Flink configuration (it is disabled by default). If this option is not enabled, the process metrics will show as empty/zero.
h1. UI Mockup
The new "Process Usage" panel will be placed at the top of the TaskManager Metrics page, showing three columns:
- CPU (percentage with 6 decimal precision)
- Memory (humanized bytes format)
- I/O (sum of read and write bytes, humanized)
h1. Related Documentation
- [System Resource Metrics]([https://nightlies.apache.org/flink/flink-docs-stable/docs/ops/metrics/#system-resources])
was:
### Summary
Add a new "Process Usage" panel on the TaskManager Metrics page of the Flink Web UI to display process-level metrics, including CPU usage, memory (RSS), and I/O statistics.
### Motivation
Currently, the TaskManager Metrics page in Flink Web UI only displays JVM and Flink-managed memory metrics. However, users often need to monitor process-level resource consumption to better understand the actual resource usage of TaskManagers.
When `metrics.system-resource` is enabled, Flink collects process-level metrics such as:
- `Process.CPU.Usage` - CPU usage percentage of the process
- `Process.Memory.RSS` - Resident Set Size (physical memory used by the process)
- `Process.IO.Read` / `Process.IO.Write` - I/O read and write bytes
These metrics are already available through the REST API but are not displayed in the Web UI, making it inconvenient for users to monitor them.
### Proposed Changes
1. **Add a "Process Usage" card** on the TaskManager Metrics page (`task-manager-metrics.component.html`) displaying:
- **CPU**: Process CPU usage percentage
- **Memory**: Process RSS (Resident Set Size)
- **I/O**: Combined read and write I/O bytes
2. **Extend the metrics query** in `task-manager-metrics.component.ts` to include:
- `Process.CPU.Usage`
- `Process.Memory.RSS`
- `Process.IO.Read`
- `Process.IO.Write`
### Prerequisites
Users need to enable system resource metrics by setting `metrics.system-resource: true` in the Flink configuration (it is disabled by default). If this option is not enabled, the process metrics will show as empty/zero.
### UI Mockup
The new "Process Usage" panel will be placed at the top of the TaskManager Metrics page, showing three columns:
- CPU (percentage with 6 decimal precision)
- Memory (humanized bytes format)
- I/O (sum of read and write bytes, humanized)
### Related Documentation
- [System Resource Metrics](https://nightlies.apache.org/flink/flink-docs-stable/docs/ops/metrics/#system-resources)
> Display process metrics (CPU, Memory, I/O) on TaskManager Web UI
> ----------------------------------------------------------------
>
> Key: FLINK-38961
> URL: https://issues.apache.org/jira/browse/FLINK-38961
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Web Frontend
> Reporter: Liu
> Priority: Major
>
> h1. Summary
> Add a new "Process Usage" panel on the TaskManager Metrics page of the Flink Web UI to display process-level metrics, including CPU usage, memory (RSS), and I/O statistics.
> h1. Motivation
> Currently, the TaskManager Metrics page in Flink Web UI only displays JVM and Flink-managed memory metrics. However, users often need to monitor process-level resource consumption to better understand the actual resource usage of TaskManagers.
> When `metrics.system-resource` is enabled, Flink collects process-level metrics such as:
> - `Process.CPU.Usage` - CPU usage percentage of the process
> - `Process.Memory.RSS` - Resident Set Size (physical memory used by the process)
> - `Process.IO.Read` / `Process.IO.Write` - I/O read and write bytes
> These metrics are already available through the REST API but are not displayed in the Web UI, making it inconvenient for users to monitor them.
> h1. Proposed Changes
> 1. *{*}Add a "Process Usage" card{*}* on the TaskManager Metrics page (`task-manager-metrics.component.html`) displaying:
> - *{*}CPU{*}*: Process CPU usage percentage
> - *{*}Memory{*}*: Process RSS (Resident Set Size)
> - *{*}I/O{*}*: Combined read and write I/O bytes
> 2. *{*}Extend the metrics query{*}* in `task-manager-metrics.component.ts` to include:
> - `Process.CPU.Usage`
> - `Process.Memory.RSS`
> - `Process.IO.Read`
> - `Process.IO.Write`
> h1. Prerequisites
> Users need to enable system resource metrics by setting `metrics.system-resource: true` in the Flink configuration (it is disabled by default). If this option is not enabled, the process metrics will show as empty/zero.
> h1. UI Mockup
> The new "Process Usage" panel will be placed at the top of the TaskManager Metrics page, showing three columns:
> - CPU (percentage with 6 decimal precision)
> - Memory (humanized bytes format)
> - I/O (sum of read and write bytes, humanized)
> h1. Related Documentation
> - [System Resource Metrics]([https://nightlies.apache.org/flink/flink-docs-stable/docs/ops/metrics/#system-resources])
--
This message was sent by Atlassian Jira
(v8.20.10#820010)