You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2021/11/30 03:00:02 UTC

[jira] [Assigned] (SPARK-37493) expose driver gc time and duration time

     [ https://issues.apache.org/jira/browse/SPARK-37493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-37493:
------------------------------------

    Assignee: Apache Spark

> expose driver gc time and duration time
> ---------------------------------------
>
>                 Key: SPARK-37493
>                 URL: https://issues.apache.org/jira/browse/SPARK-37493
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.2.1
>            Reporter: zhoubin
>            Assignee: Apache Spark
>            Priority: Major
>
> when we browse executor pages of driver side or history side sparkUI,driver's gc statistics is not acquired obviously ,thus making it hard to deside how to config the resource of driver.
>  
> we can use the application time as driver's task duration time, and use "TotalGCTime" to the JVMHeapMemory of ExecutorMetricType



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org