You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wolfgang Buchner (Jira)" <ji...@apache.org> on 2020/10/13 08:52:00 UTC

[jira] [Created] (SPARK-33127) Change Executor filesystem.* metrics to type Counter

Wolfgang Buchner created SPARK-33127:
----------------------------------------

             Summary: Change Executor  filesystem.* metrics to type Counter
                 Key: SPARK-33127
                 URL: https://issues.apache.org/jira/browse/SPARK-33127
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 3.0.0, 2.4.5
            Reporter: Wolfgang Buchner


i recently integrated the spark executor metrics documented in [Spark Monitoring|https://spark.apache.org/docs/3.0.0/monitoring.html#component-instance--executor] into our prometheus based monitoring system.

In a discussion here [https://github.com/prometheus/jmx_exporter/pull/543] we noticed that the filesystem metrics are wrongly declared as type Gauge, although they are counter metrics.

 

I guess every spark version is affected which contains this metrics (i checked at least 2.4.5 and 3.0.0)

It is just a minor bug, but could be fixed at some point.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org