You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/05/14 09:34:00 UTC
[jira] [Resolved] (SPARK-7623) Spark prints "
SelectChannelConnector@0.0.0.0:4040: java.net.BindException: Address
already in use java.net.BindException: Address already in use" when run 2
spark in parallel
[ https://issues.apache.org/jira/browse/SPARK-7623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-7623.
------------------------------
Resolution: Not A Problem
That's just because it's resolving the port collision. The stack trace is unfortunate but from Jetty; I can imagine trying to quiet just logs from this one component. You can also assign different ports to different processes explicitly.
> Spark prints " SelectChannelConnector@0.0.0.0:4040: java.net.BindException: Address already in use java.net.BindException: Address already in use" when run 2 spark in parallel
> -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-7623
> URL: https://issues.apache.org/jira/browse/SPARK-7623
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.4.0
> Reporter: Yi Zhou
> Priority: Minor
>
> When run 2 Spark Sql in parallel via Spark SQL CLI, print below warning message:
> 15/05/14 09:17:26 WARN component.AbstractLifeCycle: FAILED SelectChannelConnector@0.0.0.0:4040: java.net.BindException: Address already in use
> java.net.BindException: Address already in use
> at sun.nio.ch.Net.bind0(Native Method)
> at sun.nio.ch.Net.bind(Net.java:437)
> at sun.nio.ch.Net.bind(Net.java:429)
> at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> at org.spark-project.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:187)
> at org.spark-project.jetty.server.AbstractConnector.doStart(AbstractConnector.java:316)
> at org.spark-project.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:265)
> at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
> at org.spark-project.jetty.server.Server.doStart(Server.java:293)
> at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
> at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUtils$$connect$1(JettyUtils.scala:220)
> at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.scala:230)
> at org.apache.spark.ui.JettyUtils$$anonfun$2.apply(JettyUtils.scala:230)
> at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1943)
> at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
> at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1934)
> at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:230)
> at org.apache.spark.ui.WebUI.bind(WebUI.scala:120)
> at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:420)
> at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:420)
> at scala.Option.foreach(Option.scala:236)
> at org.apache.spark.SparkContext.<init>(SparkContext.scala:420)
> at org.apache.spark.sql.hive.thriftserver.SparkSQLEnv$.init(SparkSQLEnv.scala:50)
> at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver.<init>(SparkSQLCLIDriver.scala:240)
> at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver$.main(SparkSQLCLIDriver.scala:129)
> at org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver.main(SparkSQLCLIDriver.scala)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:497)
> at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:607)
> at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:167)
> at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:190)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:111)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org