[GitHub] [spark] chandulal edited a comment on issue #23990: [SPARK-27061][K8S] Expose Driver UI port on driver service to access …

[GitBox <gi...@apache.org>]

chandulal edited a comment on issue #23990: [SPARK-27061][K8S] Expose Driver UI port on driver service to access …
URL: https://github.com/apache/spark/pull/23990#issuecomment-470349577
 
 
   > IIRC a headless service doesn't expose the port outside the k8s cluster, right?
   > 
   > If that's the case, in which situations is this useful?
   
   
   
   > IIRC a headless service doesn't expose the port outside the k8s cluster, right?
   > 
   > If that's the case, in which situations is this useful?
   
   Yes, It won't expose the port outside of the cluster. 
   
   Our use-case is we have users who submit spark jobs to Kubernetes cluster, but they don't have Kubernetes background and access to the cluster. But, we need to provide the spark job logs for the debugging. There are two ways to do that:
   1)  Port forward driver pod on 4040. (This won't work, because users don't have access to Kubernetes cluster)
   2)  Expose 4040 port on driver service. Then, we can easily relay these logs to UI using Nginx reverse proxy on all driver services.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org