cannot run spark shell in yarn-client mode

["Pennacchiotti, Marco" <mp...@ebay.com>]

I am pretty new to Spark and I am trying to run the spark shell on a Yarn cluster from the cli (in yarn-client mode). I am able to start the shell with the following command:

SPARK_JAR=../spark-0.9.0-incubating/jars/spark-assembly-0.9.0-incubating-hadoop2.2.0.jar \ SPARK_YARN_APP_JAR=emptyfile \
SPARK_WORKER_INSTANCES=10 \
SPARK_YARN_QUEUE=hdmi-others \
MASTER=yarn-client \
ADD_JARS="lib/avro-mapred-1.7.6-hadoop2.jar,schemas-java.jar" \
SPARK_CLASSPATH="lib/avro-mapred-1.7.6-hadoop2.jar:schemas-java.jar" \
SPARK_WORKER_MEMORY=512M \
SPARK_MASTER_MEMORY=512M \
../spark-0.9.0-incubating/bin/spark-shell

However, as soon as I try to execute an action that requires workers to execute on the cluster's machines I get this WARN message in the spark shell:

14/04/08 17:55:59 WARN YarnClientClusterScheduler: Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient memory

When I look a the log of my application master on the webUI I see this:

14/04/08 17:55:09 INFO slf4j.Slf4jLogger: Slf4jLogger started
14/04/08 17:55:09 INFO Remoting: Starting remoting
14/04/08 17:55:10 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkYarnAM@<i>machine</i>:35023]
14/04/08 17:55:10 INFO Remoting: Remoting now listens on addresses: [akka.tcp://sparkYarnAM@<i>machine</i>:35023]
14/04/08 17:55:11 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/04/08 17:55:11 INFO client.RMProxy: Connecting to ResourceManager at <i>cluster</i>:8030
14/04/08 17:55:11 INFO yarn.WorkerLauncher: ApplicationAttemptId: appattempt_1394582929977_173315_000001
14/04/08 17:55:11 INFO yarn.WorkerLauncher: Registering the ApplicationMaster
14/04/08 17:55:11 INFO yarn.WorkerLauncher: Waiting for Spark driver to be reachable.
**14/04/08 17:56:14 ERROR yarn.WorkerLauncher: Failed to connect to driver at <i>machine</i>:59281, retrying ...
14/04/08 17:57:17 ERROR yarn.WorkerLauncher: Failed to connect to driver at <i>machine</i>:59281, retrying ...
14/04/08 17:58:20 ERROR yarn.WorkerLauncher: Failed to connect to driver at <i>machine</i>:59281, retrying ...

It looks like the master cannot connect to a worker, but I have no idea why this is happening.
I didn't find any answer to this issue in the forum. Any idea of what the problem may be?

Thanks,
Marco

Re: cannot run spark shell in yarn-client mode

[quangnguyenbh <hu...@gmail.com>]

Does anyone fix this error ?



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/cannot-run-spark-shell-in-yarn-client-mode-tp4013p21761.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: cannot run spark shell in yarn-client mode

[TJ Klein <TJ...@gmail.com>]

Hi Marco,

I have the same issue. Did you fix it by chance? How?

Best,
 Tassilo



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/cannot-run-spark-shell-in-yarn-client-mode-tp4013p17603.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org