You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "John Zhuge (Jira)" <ji...@apache.org> on 2021/09/28 23:31:00 UTC

[jira] [Commented] (SPARK-36664) Log time spent waiting for cluster resources

    [ https://issues.apache.org/jira/browse/SPARK-36664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17421824#comment-17421824 ] 

John Zhuge commented on SPARK-36664:
------------------------------------

This can be very useful. For example, we'd like to track how long YARN jobs are stuck ACCEPTED state.

> Log time spent waiting for cluster resources
> --------------------------------------------
>
>                 Key: SPARK-36664
>                 URL: https://issues.apache.org/jira/browse/SPARK-36664
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.2.0, 3.3.0
>            Reporter: Holden Karau
>            Priority: Major
>
> To provide better visibility into why jobs might be running slow it would be useful to log when we are waiting for resources and how long we are waiting for resources so if there is an underlying cluster issue the user can be aware.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org