[jira] [Created] (SPARK-31711) Register the executor source with the metrics system when running in local mode.

["Luca Canali (Jira)" <ji...@apache.org>]

Luca Canali created SPARK-31711:
-----------------------------------

             Summary: Register the executor source with the metrics system when running in local mode.
                 Key: SPARK-31711
                 URL: https://issues.apache.org/jira/browse/SPARK-31711
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.0.0
            Reporter: Luca Canali


The Apache Spark metrics system provides many useful insights on the Spark workload. In particular, the [executor source metrics](https://github.com/apache/spark/blob/master/docs/monitoring.md#component-instance--executor) provide detailed info, including number of active tasks, some I/O metrics, and task metrics details. Executor source, contrary to other sources (for example ExecutorMetrics source), are not yet available when running in local mode.

This JIRA proposes to register the executor source with the Spark metrics system when running in local mode, as this can be very useful when testing and troubleshooting Spark workloads.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org