[jira] [Created] (SPARK-27061) Expose 4040 port on driver service to access logs using service

["Chandu Kavar (JIRA)" <ji...@apache.org>]

Chandu Kavar created SPARK-27061:
------------------------------------

             Summary: Expose 4040 port on driver service to access logs using service
                 Key: SPARK-27061
                 URL: https://issues.apache.org/jira/browse/SPARK-27061
             Project: Spark
          Issue Type: Task
          Components: Kubernetes
    Affects Versions: 2.4.0
            Reporter: Chandu Kavar


Currently, we can access the driver logs using 

{{kubectl port-forward <driver-pod-name> 4040:4040}}

mentioned in [https://spark.apache.org/docs/latest/running-on-kubernetes.html#accessing-driver-ui]

We have users who submit spark jobs to Kubernetes, but they don't have access to the cluster. so, they can't user kubectl port-forward command.

If we can expose 4040 port on driver service, we can easily relay these logs to UI using driver service and Nginx reverse proxy.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org