You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2019/10/08 05:42:26 UTC

[jira] [Resolved] (SPARK-24550) Add support for Kubernetes specific metrics

     [ https://issues.apache.org/jira/browse/SPARK-24550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-24550.
----------------------------------
    Resolution: Incomplete

> Add support for Kubernetes specific metrics
> -------------------------------------------
>
>                 Key: SPARK-24550
>                 URL: https://issues.apache.org/jira/browse/SPARK-24550
>             Project: Spark
>          Issue Type: New Feature
>          Components: Kubernetes
>    Affects Versions: 2.3.1
>            Reporter: Stavros Kontopoulos
>            Priority: Major
>              Labels: bulk-closed
>
> Spark by default offers a specific set of metrics for monitoring. It is possible to add platform specific metrics or enhance the existing ones if it makes sense. Here is an example for [mesos|https://github.com/apache/spark/pull/21516]. Some example of metrics that could be added are: number of blacklisted nodes, utilization of executors per node, evicted pods and driver restarts, back-off time when requesting executors etc...



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org