[jira] [Updated] (SPARK-48223) PrometheusServlet does not work well with queryName in spark streaming metric names

["Mason Chen (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-48223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mason Chen updated SPARK-48223:
-------------------------------
    Summary: PrometheusServlet does not work well with queryName in spark streaming metric names  (was: PrometheusServlet does not work well with queryName in the metric name)

> PrometheusServlet does not work well with queryName in spark streaming metric names
> -----------------------------------------------------------------------------------
>
>                 Key: SPARK-48223
>                 URL: https://issues.apache.org/jira/browse/SPARK-48223
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.5.1, 3.3.4, 3.4.3
>            Reporter: Mason Chen
>            Priority: Major
>
> PrometheusServlet does not work well with queryName in the metric name.
> For driver metrics, the configuration `spark.metrics.namespace` allows the user to remove the app id from the metric name to build reusable dashboards and metric queries in external systems.
> Similarly, we need a feature to replace the query name in the spark streaming metric names to make dashboards and metric queries reusable. Ideally, the query name would be generated as a tag, instead of part of the metric name.
> This can be enabled if a feature flag is enabled, to not break existing users who are dependent of the existing metric format.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org