[jira] [Commented] (SPARK-16085) Spark stand-alone ui redirects to RM application master UI for yarn-client mode

["Lve Chen (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395334#comment-15395334 ] 

Lve Chen commented on SPARK-16085:
----------------------------------

[~srowen] [~jerryshao] 

I'm in a similar circumstance where we are in a large YARN cluster but with only one yarn proxy server that runs along with yarn RM. Requests to access driver UI, both from human and possibly programs to get metrics via REST API, could easily blow up the yarn RM web port to which the yarn proxy server listens. 

I'm wondering whether it's a good approach to add a SPARK config to switch on and off this redirecting, so that the request to driver UI can go directly to the AM without going through yarn proxy server. I notice that there might be security reasons that SparkUI is redirecting this way, could you share your opinions on this? 

> Spark stand-alone ui redirects to RM application master UI for yarn-client mode
> -------------------------------------------------------------------------------
>
>                 Key: SPARK-16085
>                 URL: https://issues.apache.org/jira/browse/SPARK-16085
>             Project: Spark
>          Issue Type: Bug
>    Affects Versions: 1.6.1
>            Reporter: Yesha Vora
>
> Spark UI in yarn-client mode redirects to Application Master UI.
> Run sparkPi application in yarn-client mode.
> When application is running , SparkUI is shown as " http://<host>:4040"
> {code}
> 16/06/17 01:13:46 INFO AbstractConnector: Started SelectChannelConnector@0.0.0.0:4040
> 16/06/17 01:13:46 INFO Utils: Successfully started service 'SparkUI' on port 4040.
> 16/06/17 01:13:46 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://xx.xx.xx.xxx:4040
> {code}
> The spark UI should be accessible at " http://<host>:4040". It should not be redirect to Application master ui.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org