You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yang Jie (Jira)" <ji...@apache.org> on 2021/10/21 11:53:00 UTC
[jira] [Commented] (SPARK-37072) Pass all UTs in `repl` with Java
17
[ https://issues.apache.org/jira/browse/SPARK-37072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17432413#comment-17432413 ]
Yang Jie commented on SPARK-37072:
----------------------------------
working on this
> Pass all UTs in `repl` with Java 17
> -----------------------------------
>
> Key: SPARK-37072
> URL: https://issues.apache.org/jira/browse/SPARK-37072
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Affects Versions: 3.3.0
> Reporter: Yang Jie
> Priority: Major
>
> Run `mvn clean install -pl repl` with Java 17
> {code:java}
> Run completed in 30 seconds, 826 milliseconds.
> Total number of tests run: 42
> Suites: completed 6, aborted 0
> Tests: succeeded 33, failed 9, canceled 0, ignored 0, pending 0
> *** 9 TESTS FAILED ***
> {code}
> The test failed as similar reasons:
> {code:java}
> - broadcast vars *** FAILED ***
> isContain was true Interpreter output contained 'Exception':
> Welcome to
> ____ __
> / __/__ ___ _____/ /__
> _\ \/ _ \/ _ `/ __/ '_/
> /___/ .__/\_,_/_/ /_/\_\ version 3.3.0-SNAPSHOT
> /_/
>
> Using Scala version 2.12.15 (OpenJDK 64-Bit Server VM, Java 17)
> Type in expressions to have them evaluated.
> Type :help for more information.
>
> scala>
> scala> array: Array[Int] = Array(0, 0, 0, 0, 0)
>
> scala> broadcastArray: org.apache.spark.broadcast.Broadcast[Array[Int]] = Broadcast(0)
>
> scala> java.lang.IllegalAccessException: Can not set final $iw field $Lambda$2879/0x000000080188b928.arg$1 to $iw
> at java.base/jdk.internal.reflect.UnsafeFieldAccessorImpl.throwFinalFieldIllegalAccessException(UnsafeFieldAccessorImpl.java:76)
> at java.base/jdk.internal.reflect.UnsafeFieldAccessorImpl.throwFinalFieldIllegalAccessException(UnsafeFieldAccessorImpl.java:80)
> at java.base/jdk.internal.reflect.UnsafeQualifiedObjectFieldAccessorImpl.set(UnsafeQualifiedObjectFieldAccessorImpl.java:79)
> at java.base/java.lang.reflect.Field.set(Field.java:799)
> at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:398)
> at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:162)
> at org.apache.spark.SparkContext.clean(SparkContext.scala:2490)
> at org.apache.spark.rdd.RDD.$anonfun$map$1(RDD.scala:414)
> at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
> at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
> at org.apache.spark.rdd.RDD.withScope(RDD.scala:406)
> at org.apache.spark.rdd.RDD.map(RDD.scala:413)
> ... 95 elided
>
> scala>
> scala> java.lang.IllegalAccessException: Can not set final $iw field $Lambda$2907/0x00000008019536f8.arg$1 to $iw
> at java.base/jdk.internal.reflect.UnsafeFieldAccessorImpl.throwFinalFieldIllegalAccessException(UnsafeFieldAccessorImpl.java:76)
> at java.base/jdk.internal.reflect.UnsafeFieldAccessorImpl.throwFinalFieldIllegalAccessException(UnsafeFieldAccessorImpl.java:80)
> at java.base/jdk.internal.reflect.UnsafeQualifiedObjectFieldAccessorImpl.set(UnsafeQualifiedObjectFieldAccessorImpl.java:79)
> at java.base/java.lang.reflect.Field.set(Field.java:799)
> at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:398)
> at org.apache.spark.util.ClosureCleaner$.clean(ClosureCleaner.scala:162)
> at org.apache.spark.SparkContext.clean(SparkContext.scala:2490)
> at org.apache.spark.rdd.RDD.$anonfun$map$1(RDD.scala:414)
> at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
> at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
> at org.apache.spark.rdd.RDD.withScope(RDD.scala:406)
> at org.apache.spark.rdd.RDD.map(RDD.scala:413)
> ... 95 elided
>
> scala> |
> scala> :quit (ReplSuite.scala:83)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org