[jira] [Commented] (SPARK-5007) Try random port when startServiceOnPort to reduce the chance of port collision

["Reynold Xin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14264191#comment-14264191 ] 

Reynold Xin commented on SPARK-5007:
------------------------------------

[~yantangzhai] making it trying random ports makes it harder to configure firewalls. Maybe what you want is to allow a higher number of retries?


> Try random port when startServiceOnPort to reduce the chance of port collision
> ------------------------------------------------------------------------------
>
>                 Key: SPARK-5007
>                 URL: https://issues.apache.org/jira/browse/SPARK-5007
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: YanTang Zhai
>            Priority: Minor
>
> When multiple Spark programs are submitted at the same node (called springboard machine). The ports (default 4040) of these SparkUIs are from 4040 to 4056. Then the Spark programs submitted later would fail because of SparkUI port collision.
> The chance of port collision could be reduced by setting spark.ui.port or spark.port.maxRetries.
> However, I think it's better to try random port when startServiceOnPort to reduce the chance of port collision.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org