You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Shixiong Zhu (JIRA)" <ji...@apache.org> on 2016/06/29 03:46:45 UTC
[jira] [Commented] (SPARK-16273) NoSuchMethodError on
SparkContext.rddToPairRDDFunctions
[ https://issues.apache.org/jira/browse/SPARK-16273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15354486#comment-15354486 ]
Shixiong Zhu commented on SPARK-16273:
--------------------------------------
This method has been moved into RDD object. You need to recompile that with Spark 2.0.
> NoSuchMethodError on SparkContext.rddToPairRDDFunctions
> -------------------------------------------------------
>
> Key: SPARK-16273
> URL: https://issues.apache.org/jira/browse/SPARK-16273
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.0.0
> Environment: Ubuntu Server 14.04.3 LTS
> Reporter: Fu Zhouwang
>
> The exception occurs when I tried to run TeraSort https://github.com/ehiggs/spark-terasort on Preview release of Spark 2.0, when _saveAsNewAPIHadoopFile_ or _sc.newAPIHadoopFile_ is called.
> The exception is
> bq. java.lang.NoSuchMethodError: org.apache.spark.SparkContext$.rddToPairRDDFunctions(Lorg/apache/spark/rdd/RDD;Lscala/reflect/ClassTag;Lscala/reflect/ClassTag;Lscala/math/Ordering;)Lorg/apache/spark/rdd/PairRDDFunctions;
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org