You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2016/07/15 03:55:20 UTC
[jira] [Commented] (SPARK-16560) Spark-submit fails without an
error
[ https://issues.apache.org/jira/browse/SPARK-16560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378814#comment-15378814 ]
Marcelo Vanzin commented on SPARK-16560:
----------------------------------------
Why do you think that's an error? Did you check the master web ui to see if your application is running?
You're submitting in cluster mode, your spark-submit command will not really show a lot of information about the application. You can also try client mode to see if it's working.
> Spark-submit fails without an error
> -----------------------------------
>
> Key: SPARK-16560
> URL: https://issues.apache.org/jira/browse/SPARK-16560
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 1.6.2
> Environment: Raspbian Jessie
> Reporter: Chaitanya
> Labels: example, java, newbie, spark-submit
> Fix For: 1.6.2
>
>
> I used the following command to run the spark java example of wordcount:-
> time spark-submit --deploy-mode cluster --master spark://192.168.0.7:7077 --class org.apache.spark.examples.JavaWordCount /home/pi/Desktop/example/new/target/javaword.jar /books_500.txt
> I have copied the same jar file into all nodes in the same location. (Copying into HDFS didn't work for me.) When I run it, the following is the output:-
> Running Spark using the REST application submission protocol.
> 16/07/14 16:32:18 INFO rest.RestSubmissionClient: Submitting a request to launch an application in spark://192.168.0.7:7077.
> 16/07/14 16:32:30 WARN rest.RestSubmissionClient: Unable to connect to server spark://192.168.0.7:7077.
> Warning: Master endpoint spark://192.168.0.7:7077 was not a REST server. Falling back to legacy submission gateway instead.
> 16/07/14 16:32:30 WARN util.Utils: Your hostname, master02 resolves to a loopback address: 127.0.1.1; using 192.168.0.7 instead (on interface wlan0)
> 16/07/14 16:32:30 WARN util.Utils: Set SPARK_LOCAL_IP if you need to bind to another address
> 16/07/14 16:32:31 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
> It just stops there, quits the job and waits for the next command on terminal. I didn't understand this error without an error message. Help needed please...!!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org