You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by kamatsuoka <ke...@gmail.com> on 2014/02/10 20:14:44 UTC

Unable to run spark in local mode

When I try to run spark in local mode on my Mac, it get stuck trying to fetch
my application jar.

My command line is:

SPARK_CLASSPATH=~/depot/Engineering/kenji/dadlog-filter/target/scala-2.10/dadlog-filter-assembly-1.0.jar
~/opt/spark/bin/spark-class {myMainClass} local s3n://{myInputFile}

Spark finds {myMainClass} but gets stuck here:

14/02/07 12:09:59 INFO Executor: Fetching
http://10.16.5.171:64530/jars/dadlog-filter-assembly-1.0.jar with timestamp
1391803795910
14/02/07 12:09:59 INFO Utils: Fetching
http://10.16.5.171:64530/jars/dadlog-filter-assembly-1.0.jar to
/var/folders/94/kz0lxyl56dv6rz9znvrndydh0000gn/T/fetchFileTemp1339484021541958973.tmp

The temp file is 64k in size.  It's as though it reads the first 64k then
hangs. 



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Unable-to-run-spark-in-local-mode-tp1368.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.