You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kousuke Saruta (JIRA)" <ji...@apache.org> on 2017/02/09 13:09:41 UTC
[jira] [Resolved] (SPARK-17874) Additional SSL port on
HistoryServer should be configurable
[ https://issues.apache.org/jira/browse/SPARK-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kousuke Saruta resolved SPARK-17874.
------------------------------------
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 2.2.0
> Additional SSL port on HistoryServer should be configurable
> -----------------------------------------------------------
>
> Key: SPARK-17874
> URL: https://issues.apache.org/jira/browse/SPARK-17874
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Affects Versions: 2.0.1
> Reporter: Andrew Ash
> Assignee: Marcelo Vanzin
> Fix For: 2.2.0
>
>
> When turning on SSL on the HistoryServer with {{spark.ssl.historyServer.enabled=true}} this opens up a second port, at the [hardcoded|https://github.com/apache/spark/blob/v2.0.1/core/src/main/scala/org/apache/spark/ui/JettyUtils.scala#L262] result of calculating {{spark.history.ui.port + 400}}, and sets up a redirect from the original (http) port to the new (https) port.
> {noformat}
> $ netstat -nlp | grep 23714
> (Not all processes could be identified, non-owned process info
> will not be shown, you would have to be root to see it all.)
> tcp 0 0 :::18080 :::* LISTEN 23714/java
> tcp 0 0 :::18480 :::* LISTEN 23714/java
> {noformat}
> By enabling {{spark.ssl.historyServer.enabled}} I would have expected the one open port to change protocol from http to https, not to have 1) additional ports open 2) the http port remain open 3) the additional port at a value I didn't specify.
> To fix this could take one of two approaches:
> Approach 1:
> - one port always, which is configured with {{spark.history.ui.port}}
> - the protocol on that port is http by default
> - or if {{spark.ssl.historyServer.enabled=true}} then it's https
> Approach 2:
> - add a new configuration item {{spark.history.ui.sslPort}} which configures the second port that starts up
> In approach 1 we probably need a way to specify to Spark jobs whether the history server has ssl or not, based on SPARK-16988
> That makes me think we should go with approach 2.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org