You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by ekraffmiller <el...@gmail.com> on 2015/10/09 23:37:34 UTC

Cannot connect to standalone spark cluster

Hi,
I'm trying to run a java application that connects to a local standalone
spark cluster.  I start the cluster with the default configuration, using
start-all.sh.  When I go to the web page for the cluster, it is started ok. 
I can connect to this cluster with SparkR, but when I use the same master
URL to connect from within Java, I get an error message.  

I'm using Spark 1.5.

Here is a snippet of the error message:

 ReliableDeliverySupervisor: Association with remote system
[akka.tcp://sparkMaster@Ellens-MacBook-Pro.local:7077] has failed, address
is now gated for [5000] ms. Reason: [Disassociated] 
15/10/09 17:31:41 INFO AppClient$ClientEndpoint: Connecting to master
spark://Ellens-MacBook-Pro.local:7077...
15/10/09 17:31:41 WARN ReliableDeliverySupervisor: Association with remote
system [akka.tcp://sparkMaster@Ellens-MacBook-Pro.local:7077] has failed,
address is now gated for [5000] ms. Reason: [Disassociated] 
15/10/09 17:32:01 INFO AppClient$ClientEndpoint: Connecting to master
spark://Ellens-MacBook-Pro.local:7077...
15/10/09 17:32:01 ERROR SparkUncaughtExceptionHandler: Uncaught exception in
thread Thread[appclient-registration-retry-thread,5,main]
java.util.concurrent.RejectedExecutionException: Task
java.util.concurrent.FutureTask@54e2b678 rejected from
java.util.concurrent.ThreadPoolExecutor@5d9f3e0d[Running, pool size = 1,
active threads = 1, queued tasks = 0, completed tasks = 2]
	at
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
	at
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)

Thanks,
Ellen



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Cannot-connect-to-standalone-spark-cluster-tp25004.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Cannot connect to standalone spark cluster

Posted by Akhil Das <ak...@sigmoidanalytics.com>.
Open a spark-shell by:

MASTER=Ellens-MacBook-Pro.local:7077 bin/spark-shell

And if its able to connect, then check your java projects build file and
make sure you are having the proper spark version.

Thanks
Best Regards

On Sat, Oct 10, 2015 at 3:07 AM, ekraffmiller <el...@gmail.com>
wrote:

> Hi,
> I'm trying to run a java application that connects to a local standalone
> spark cluster.  I start the cluster with the default configuration, using
> start-all.sh.  When I go to the web page for the cluster, it is started ok.
> I can connect to this cluster with SparkR, but when I use the same master
> URL to connect from within Java, I get an error message.
>
> I'm using Spark 1.5.
>
> Here is a snippet of the error message:
>
>  ReliableDeliverySupervisor: Association with remote system
> [akka.tcp://sparkMaster@Ellens-MacBook-Pro.local:7077] has failed, address
> is now gated for [5000] ms. Reason: [Disassociated]
> 15/10/09 17:31:41 INFO AppClient$ClientEndpoint: Connecting to master
> spark://Ellens-MacBook-Pro.local:7077...
> 15/10/09 17:31:41 WARN ReliableDeliverySupervisor: Association with remote
> system [akka.tcp://sparkMaster@Ellens-MacBook-Pro.local:7077] has failed,
> address is now gated for [5000] ms. Reason: [Disassociated]
> 15/10/09 17:32:01 INFO AppClient$ClientEndpoint: Connecting to master
> spark://Ellens-MacBook-Pro.local:7077...
> 15/10/09 17:32:01 ERROR SparkUncaughtExceptionHandler: Uncaught exception
> in
> thread Thread[appclient-registration-retry-thread,5,main]
> java.util.concurrent.RejectedExecutionException: Task
> java.util.concurrent.FutureTask@54e2b678 rejected from
> java.util.concurrent.ThreadPoolExecutor@5d9f3e0d[Running, pool size = 1,
> active threads = 1, queued tasks = 0, completed tasks = 2]
>         at
>
> java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
>         at
> java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
>
> Thanks,
> Ellen
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Cannot-connect-to-standalone-spark-cluster-tp25004.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>