You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Gaurangi Saxena (Jira)" <ji...@apache.org> on 2020/09/02 19:46:00 UTC

[jira] [Comment Edited] (SPARK-32135) Show Spark Driver name on Spark history web page

    [ https://issues.apache.org/jira/browse/SPARK-32135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17189668#comment-17189668 ] 

Gaurangi Saxena edited comment on SPARK-32135 at 9/2/20, 7:45 PM:
------------------------------------------------------------------

[~tgraves] Apologies for the late response.

We would like to see the driver host of an application on the history server page. We could see it in executors page, but we would need 2 clicks to get there.

This feature is useful in a multi-cluster environment with a single JHS used to index history files for all clusters to understand on what cluster a job was executed. Driver-host will help identify the cluster. 

 

I have added another Jira (https://issues.apache.org/jira/browse/SPARK-32097) that will allow log-directory to accept wild-cards. Together these changes can help configuring a single UI for multiple spark clusters.

 

!image-2020-09-02-12-37-55-860.png!


was (Author: gaurangi):
[~tgraves] Apologies for the late response.

We would like to see the driver host of an application on the history server page. We could see it in executors page, but we would need 2 clicks to get there.

This feature is useful in a multi-cluster environment with a single JHS used to index history files for all clusters to understand on what cluster a job was executed. Driver-host will help identify the cluster. 

 

!image-2020-09-02-12-37-55-860.png!

> Show Spark Driver name on Spark history web page
> ------------------------------------------------
>
>                 Key: SPARK-32135
>                 URL: https://issues.apache.org/jira/browse/SPARK-32135
>             Project: Spark
>          Issue Type: Wish
>          Components: Spark Core
>    Affects Versions: 2.4.5
>            Reporter: Gaurangi Saxena
>            Priority: Minor
>         Attachments: image-2020-09-02-12-37-55-860.png
>
>
> We would like to see spark driver host on the history server web page



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org