You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2019/03/11 17:42:00 UTC

[jira] [Resolved] (SPARK-27061) Expose Driver UI port on driver service to access UI using service

     [ https://issues.apache.org/jira/browse/SPARK-27061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marcelo Vanzin resolved SPARK-27061.
------------------------------------
       Resolution: Fixed
    Fix Version/s: 3.0.0

Issue resolved by pull request 23990
[https://github.com/apache/spark/pull/23990]

> Expose Driver UI port on driver service to access UI using service
> ------------------------------------------------------------------
>
>                 Key: SPARK-27061
>                 URL: https://issues.apache.org/jira/browse/SPARK-27061
>             Project: Spark
>          Issue Type: Task
>          Components: Kubernetes
>    Affects Versions: 2.4.0
>            Reporter: Chandu Kavar
>            Priority: Minor
>              Labels: Kubernetes
>             Fix For: 3.0.0
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Currently, we can access the driver logs using 
> {{kubectl port-forward <driver-pod-name> 4040:4040}}
> mentioned in [https://spark.apache.org/docs/latest/running-on-kubernetes.html#accessing-driver-ui]
> We have users who submit spark jobs to Kubernetes, but they don't have access to the cluster. so, they can't user kubectl port-forward command.
> If we can expose 4040 port on driver service, we can easily relay these logs to UI using driver service and Nginx reverse proxy.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org