You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/08/10 14:08:00 UTC

[jira] [Assigned] (SPARK-44741) Spark StatsD metrics reported to support metrics filter option

     [ https://issues.apache.org/jira/browse/SPARK-44741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun reassigned SPARK-44741:
-------------------------------------

    Assignee: rameshkrishnan muthusamy

> Spark StatsD metrics reported to support metrics filter option 
> ---------------------------------------------------------------
>
>                 Key: SPARK-44741
>                 URL: https://issues.apache.org/jira/browse/SPARK-44741
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.4.1
>            Reporter: rameshkrishnan muthusamy
>            Assignee: rameshkrishnan muthusamy
>            Priority: Minor
>              Labels: Metrics, Sink, statsd
>
> Spark statsd metrics sink in the current state does not support metrics filtering option. 
> Though this option is available in the reporters it is not exposed in the statsD sink. An example of this can be looked at [https://github.com/apache/spark/blob/be9ffb37585fe421705ceaa52fe49b89c50703a3/core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala#L76]
>  
> This is a critical option to have when teams does not want all the metrics that are exposed by spark in the metrics monitoring platforms and switch to detailed metrics as and when needed. 
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org