[jira] [Resolved] (SPARK-36038) Basic speculation metrics at stage level

["Kousuke Saruta (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-36038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kousuke Saruta resolved SPARK-36038.
------------------------------------
    Fix Version/s: 3.3.0
         Assignee: Venkata krishnan Sowrirajan
       Resolution: Fixed

Issue resolved in https://github.com/apache/spark/pull/33253

> Basic speculation metrics at stage level
> ----------------------------------------
>
>                 Key: SPARK-36038
>                 URL: https://issues.apache.org/jira/browse/SPARK-36038
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.1.2
>            Reporter: Venkata krishnan Sowrirajan
>            Assignee: Venkata krishnan Sowrirajan
>            Priority: Major
>             Fix For: 3.3.0
>
>
> Currently there are no speculation metrics available either at application level or at stage level. With in our platform, we have added speculation metrics at stage level as a summary similarly to the stage level metrics tracking numTotalSpeculated, numCompleted (successful), numFailed, numKilled etc. This enables us to effectively understand speculative execution feature at an application level and helps in further tuning the speculation configs.
> cc [~ron8hu]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org