You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Suneel Marthi (JIRA)" <ji...@apache.org> on 2016/10/17 12:16:58 UTC
[jira] [Commented] (MAHOUT-1889) Mahout doesn't work with Spark 2.0
[ https://issues.apache.org/jira/browse/MAHOUT-1889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15582071#comment-15582071 ]
Suneel Marthi commented on MAHOUT-1889:
---------------------------------------
Thanks for reporting this, it makes sense to work on this if any of the Hadoop vendors are already packaging Spark 2x in their distros. Feel free to submit a patch nevertheless.
> Mahout doesn't work with Spark 2.0
> ----------------------------------
>
> Key: MAHOUT-1889
> URL: https://issues.apache.org/jira/browse/MAHOUT-1889
> Project: Mahout
> Issue Type: Bug
> Reporter: Sergey Svinarchuk
>
> In Spark 2.0 was changes path to libraries and classpath. If change classpath to correct for Spark 2.0, all Spark job failed with java.lang.NoSuchMethodError: , because Spark API was changed.
> Example for spark-shell:
> {code}
> ./bin/mahout spark-shell
> Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.repl.SparkILoop.setPrompt(Ljava/lang/String;)V
> at org.apache.mahout.sparkbindings.shell.MahoutSparkILoop.<init>(MahoutSparkILoop.scala:58)
> at org.apache.mahout.sparkbindings.shell.Main$.main(Main.scala:32)
> at org.apache.mahout.sparkbindings.shell.Main.main(Main.scala)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)