You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/01/30 17:48:35 UTC
[jira] [Resolved] (SPARK-5483) java.lang.NoSuchMethodError:
scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
[ https://issues.apache.org/jira/browse/SPARK-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-5483.
------------------------------
Resolution: Not a Problem
These too are clearly in the 2.10 artifact. Download it and grep for them. https://repo1.maven.org/maven2/org/apache/spark/spark-mllib_2.10/1.2.0/spark-mllib_2.10-1.2.0.jar There must be some issue in how you are adding the classes to the classpath.
You definitely can't mix Scala versions, and the classes are where they should be, so this should be resolved. I think further questions should go to the mailing list on this one, until it's clear there is a Spark issue.
> java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> -------------------------------------------------------------------------------------------
>
> Key: SPARK-5483
> URL: https://issues.apache.org/jira/browse/SPARK-5483
> Project: Spark
> Issue Type: Bug
> Components: MLlib
> Affects Versions: 1.2.0
> Environment: Maven
> Spark 1.2
> Reporter: DeepakVohra
>
> Naive Bayes classifier generates following error.
> ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)
> java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> at breeze.generic.MMRegistry2$class.register(Multimethod.scala:188)
> at breeze.linalg.VectorOps$$anon$1.breeze$linalg$operators$BinaryRegistry$$super$register(Vector.scala:303)
> at breeze.linalg.operators.BinaryRegistry$class.register(BinaryOp.scala:87)
> at breeze.linalg.VectorOps$$anon$1.register(Vector.scala:303)
> at breeze.linalg.operators.DenseVectorOps$$anon$1.<init>(DenseVectorOps.scala:38)
> at breeze.linalg.operators.DenseVectorOps$class.$init$(DenseVectorOps.scala:22)
> at breeze.linalg.DenseVector$.<init>(DenseVector.scala:225)
> at breeze.linalg.DenseVector$.<clinit>(DenseVector.scala)
> at breeze.linalg.DenseVector.<init>(DenseVector.scala:63)
> at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:50)
> at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:55)
> at org.apache.spark.mllib.linalg.DenseVector.toBreeze(Vectors.scala:329)
> at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:112)
> at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:110)
> at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:200)
> at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:199)
> at org.apache.spark.util.collection.AppendOnlyMap.changeValue(AppendOnlyMap.scala:142)
> at org.apache.spark.util.collection.SizeTrackingAppendOnlyMap.changeValue(SizeTrackingAppendOnlyMap.scala:32)
> at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:205)
> at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:58)
> at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
> at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
> at org.apache.spark.scheduler.Task.run(Task.scala:56)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:196)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 15/01/28 21:50:06 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[Executor task launch worker-0,5,main]
> java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
> at breeze.generic.MMRegistry2$class.register(Multimethod.scala:188)
> at breeze.linalg.VectorOps$$anon$1.breeze$linalg$operators$BinaryRegistry$$super$register(Vector.scala:303)
> at breeze.linalg.operators.BinaryRegistry$class.register(BinaryOp.scala:87)
> at breeze.linalg.VectorOps$$anon$1.register(Vector.scala:303)
> at breeze.linalg.operators.DenseVectorOps$$anon$1.<init>(DenseVectorOps.scala:38)
> at breeze.linalg.operators.DenseVectorOps$class.$init$(DenseVectorOps.scala:22)
> at breeze.linalg.DenseVector$.<init>(DenseVector.scala:225)
> at breeze.linalg.DenseVector$.<clinit>(DenseVector.scala)
> at breeze.linalg.DenseVector.<init>(DenseVector.scala:63)
> at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:50)
> at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:55)
> at org.apache.spark.mllib.linalg.DenseVector.toBreeze(Vectors.scala:329)
> at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:112)
> at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:110)
> at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:200)
> at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:199)
> at org.apache.spark.util.collection.AppendOnlyMap.changeValue(AppendOnlyMap.scala:142)
> at org.apache.spark.util.collection.SizeTrackingAppendOnlyMap.changeValue(SizeTrackingAppendOnlyMap.scala:32)
> at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:205)
> at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:58)
> at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
> at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
> at org.apache.spark.scheduler.Task.run(Task.scala:56)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:196)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org