You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2026/07/09 04:04:00 UTC
[jira] [Resolved] (SPARK-31987) Where to find Prometheus metrics path about executors in Spark 3
[ https://issues.apache.org/jira/browse/SPARK-31987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-31987.
----------------------------------
Resolution: Invalid
Resolving as Invalid — this is a usage/how-to question rather than a specific Spark defect or actionable change. Usage questions are best directed to user@spark.apache.org (https://spark.apache.org/community.html) or Stack Overflow (tag apache-spark). Findings from triage: Verified this is a pure usage/how-to question ("Where to find Prometheus metrics path about executors in Spark 3"), not a defect or actionable change. The feature genuinely exists and is documented: config UI_PROMETHEUS_ENABLED (spark.ui.prometheus.enabled, version 3.0.0) at core/src/main/scala/org/apache/spark/internal/config/UI.scala:113 exposes executor metrics at /metrics/executors/prometheus, backed by core/src/main/scala/org/apache/spark/status/api/v1/PrometheusResource.scala and PrometheusServlet.scala. docs/monitoring.md:900 and the endpoint table at lines 1169-1193 document /metrics/e
Please reopen with a concrete reproducer or a specific proposed change if this is actually a bug or an actionable improvement.
> Where to find Prometheus metrics path about executors in Spark 3
> ----------------------------------------------------------------
>
> Key: SPARK-31987
> URL: https://issues.apache.org/jira/browse/SPARK-31987
> Project: Spark
> Issue Type: Question
> Components: Examples
> Affects Versions: 3.0.0
> Reporter: Smith Cruise
> Priority: Major
> Labels: documentation
>
> I know in Spark 3.0, it supports Prometheus Sink. But I don't know where to get metrics about executors. I want to fetch realtime executor's *_filesystem.hdfs.read_bytes,_* etc.
>
> I have tried several paths, but it doesn't work. Could you please tell me the Prometheus metrics path about all executors?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org