[jira] [Assigned] (SPARK-36038) Basic speculation metrics at stage level

["Apache Spark (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-36038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-36038:
------------------------------------

    Assignee:     (was: Apache Spark)

> Basic speculation metrics at stage level
> ----------------------------------------
>
>                 Key: SPARK-36038
>                 URL: https://issues.apache.org/jira/browse/SPARK-36038
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.1.2
>            Reporter: Venkata krishnan Sowrirajan
>            Priority: Major
>             Fix For: 3.3.0
>
>
> Currently there are no speculation metrics available either at application level or at stage level. With in our platform, we have added speculation metrics at stage level as a summary similarly to the stage level metrics tracking numTotalSpeculated, numCompleted (successful), numFailed, numKilled etc. This enables us to effectively understand speculative execution feature at an application level and helps in further tuning the speculation configs.
> cc [~ron8hu]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org