You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "zhoubin (Jira)" <ji...@apache.org> on 2021/11/30 02:20:00 UTC

[jira] [Created] (SPARK-37493) expose driver gc time

zhoubin created SPARK-37493:
-------------------------------

             Summary: expose driver gc time
                 Key: SPARK-37493
                 URL: https://issues.apache.org/jira/browse/SPARK-37493
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.2.1
            Reporter: zhoubin


when we browse executor pages of driver side or history side sparkUI,driver's gc statistics is not acquired obviously ,thus making it hard to deside how to config the resource of driver.

 

we can use the application time as driver's task duration time, and use "TotalGCTime" to the JVMHeapMemory of ExecutorMetricType



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org