You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "liyunzhang (JIRA)" <ji...@apache.org> on 2017/11/30 06:35:00 UTC
[jira] [Commented] (SPARK-22660) Use position() and limit() to fix
ambiguity issue in scala-2.12 and JDK9
[ https://issues.apache.org/jira/browse/SPARK-22660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272225#comment-16272225 ]
liyunzhang commented on SPARK-22660:
------------------------------------
Besides above error, there are another errors with scala-2.12
{code}
/home/zly/prj/oss/jdk9_HOS_SOURCE/spark_source/core/src/test/scala/org/apache/spark/util/ClosureCleanerSuite.scala:151: reflective access of structural type member method getData should be enabled
by making the implicit value scala.language.reflectiveCalls visible.
64275 This can be achieved by adding the import clause 'import scala.language.reflectiveCalls'
64276 or by setting the compiler option -language:reflectiveCalls.
64277 See the Scaladoc for value scala.language.reflectiveCalls for a discussion
64278 why the feature should be explicitly enabled.
64279 val rdd = sc.parallelize(1 to 1).map(concreteObject.getData)
64280 ^
64281 /home/zly/prj/oss/jdk9_HOS_SOURCE/spark_source/core/src/test/scala/org/apache/spark/util/ClosureCleanerSuite.scala:175: reflective access of structural type member value innerObject2 should be enabled
64282 by making the implicit value scala.language.reflectiveCalls visible.
64283 val rdd = sc.parallelize(1 to 1).map(concreteObject.innerObject2.getData)
64284 ^
64285 /home/zly/prj/oss/jdk9_HOS_SOURCE/spark_source/core/src/test/scala/org/apache/spark/util/ClosureCleanerSuite.scala:175: reflective access of structural type member method getData should be enabled
64286 by making the implicit value scala.language.reflectiveCalls visible.
64287 val rdd = sc.parallelize(1 to 1).map(concreteObject.innerObject2.getData)
{code}
[~viirya]:As you are familar with SPARK-22328, do you know how to fix it?
> Use position() and limit() to fix ambiguity issue in scala-2.12 and JDK9
> ------------------------------------------------------------------------
>
> Key: SPARK-22660
> URL: https://issues.apache.org/jira/browse/SPARK-22660
> Project: Spark
> Issue Type: Improvement
> Components: Build
> Affects Versions: 2.2.0
> Reporter: liyunzhang
>
> Based on SPARK-22659
> 1. compile with -Pscala-2.12 and get the error
> {code}
> Use position() and limit() to fix ambiguity issue
> {code}
> spark_source/core/src/main/scala/org/apache/spark/executor/Executor.scala:455: ambiguous reference to overloaded definition, method limit in class ByteBuffer of type (x$1: Int)java.nio.ByteBuffer
> method limit in class Buffer of type ()Int
> match expected type ?
> val resultSize = serializedDirectResult.limit
> error
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org