You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Sree Eedupuganti <sr...@inndata.in> on 2016/01/11 08:49:15 UTC
Getting an error while submitting spark jar
The way how i submitting jar
hadoop@localhost:/usr/local/hadoop/spark$ ./bin/spark-submit \
> --class mllib.perf.TesRunner \
> --master spark://localhost:7077 \
> --executor-memory 2G \
> --total-executor-cores 100 \
> /usr/local/hadoop/spark/lib/mllib-perf-tests-assembly.jar \
> 1000
And here is my error,Spark assembly has been built with Hive, including
Datanucleus jars on classpath
java.lang.ClassNotFoundException: mllib.perf.TesRunner
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:538)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:166)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:189)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:110)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
hadoop@localhost:/usr/local/hadoop/spark$
Thanks in Advance
--
Best Regards,
Sreeharsha Eedupuganti
Data Engineer
innData Analytics Private Limited
Re: Getting an error while submitting spark jar
Posted by Gaini Rajeshwar <ra...@gmail.com>.
Hi Sree,
I think it has to be *--class mllib.perf.TestRunner* instead of *--class
mllib.perf.TesRunner*
On Mon, Jan 11, 2016 at 1:19 PM, Sree Eedupuganti <sr...@inndata.in> wrote:
> The way how i submitting jar
>
> hadoop@localhost:/usr/local/hadoop/spark$ ./bin/spark-submit \
> > --class mllib.perf.TesRunner \
> > --master spark://localhost:7077 \
> > --executor-memory 2G \
> > --total-executor-cores 100 \
> > /usr/local/hadoop/spark/lib/mllib-perf-tests-assembly.jar \
> > 1000
>
> And here is my error,Spark assembly has been built with Hive, including
> Datanucleus jars on classpath
> java.lang.ClassNotFoundException: mllib.perf.TesRunner
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:348)
> at
> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:538)
> at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:166)
> at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:189)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:110)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> hadoop@localhost:/usr/local/hadoop/spark$
>
> Thanks in Advance
>
> --
> Best Regards,
> Sreeharsha Eedupuganti
> Data Engineer
> innData Analytics Private Limited
>