You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 03:37:00 UTC
[jira] [Commented] (SPARK-37070) Pass all UTs in `mllib-local` and `mllib` with Java 17
[ https://issues.apache.org/jira/browse/SPARK-37070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17464246#comment-17464246 ]
Apache Spark commented on SPARK-37070:
--------------------------------------
User 'LuciferYang' has created a pull request for this issue:
https://github.com/apache/spark/pull/34991
> Pass all UTs in `mllib-local` and `mllib` with Java 17
> ------------------------------------------------------
>
> Key: SPARK-37070
> URL: https://issues.apache.org/jira/browse/SPARK-37070
> Project: Spark
> Issue Type: Sub-task
> Components: MLlib
> Affects Versions: 3.3.0
> Reporter: Yang Jie
> Assignee: Yang Jie
> Priority: Major
> Fix For: 3.3.0
>
>
> execute "mvn clean install -pl mllib-local" with Java 17
> {code:java}
> Run completed in 714 milliseconds.
> Total number of tests run: 96
> Suites: completed 9, aborted 0
> Tests: succeeded 92, failed 4, canceled 0, ignored 0, pending 0
> *** 4 TESTS FAILED ***
> {code}
>
> execute "mvn clean install -pl mllib" with Java 17
> {code:java}
> Run completed in 10 minutes, 54 seconds.
> Total number of tests run: 1639
> Suites: completed 206, aborted 0
> Tests: succeeded 1635, failed 4, canceled 0, ignored 7, pending 0
> *** 4 TESTS FAILED ***
> {code}
>
> All failed case has similar reasons:
> {code:java}
> - rand *** FAILED ***
> org.mockito.exceptions.base.MockitoException: Mockito cannot mock this class: class java.util.Random.
> Mockito can only mock non-private & non-final classes.
> If you're not sure why you're getting this error, please report to the mailing list.
> Java : 17
> JVM vendor name : Azul Systems, Inc.
> JVM vendor version : 17+35-LTS
> JVM name : OpenJDK 64-Bit Server VM
> JVM version : 17+35-LTS
> JVM info : mixed mode, sharing
> OS name : Mac OS X
> OS version : 11.4
> Underlying exception : java.lang.IllegalStateException: Cannot access annotation property public abstract boolean jdk.internal.util.random.RandomSupport$RandomGeneratorProperties.isStochastic()
> at org.scalatestplus.mockito.MockitoSugar.mock(MockitoSugar.scala:73)
> at org.scalatestplus.mockito.MockitoSugar.mock$(MockitoSugar.scala:72)
> at org.scalatestplus.mockito.MockitoSugar$.mock(MockitoSugar.scala:155)
> at org.apache.spark.ml.linalg.MatricesSuite.$anonfun$new$54(MatricesSuite.scala:807)
> at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
> at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
> at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
> at org.scalatest.Transformer.apply(Transformer.scala:22)
> at org.scalatest.Transformer.apply(Transformer.scala:20)
> at org.scalatest.funsuite.AnyFunSuiteLike$$anon$1.apply(AnyFunSuiteLike.scala:226)
> ...
> Cause: java.lang.IllegalStateException: Cannot access annotation property public abstract boolean jdk.internal.util.random.RandomSupport$RandomGeneratorProperties.isStochastic()
> at net.bytebuddy.description.annotation.AnnotationDescription$ForLoadedAnnotation.getValue(AnnotationDescription.java:663)
> at net.bytebuddy.implementation.attribute.AnnotationAppender$Default.handle(AnnotationAppender.java:298)
> at net.bytebuddy.implementation.attribute.AnnotationAppender$Default.doAppend(AnnotationAppender.java:361)
> at net.bytebuddy.implementation.attribute.AnnotationAppender$Default.append(AnnotationAppender.java:338)
> at net.bytebuddy.implementation.attribute.TypeAttributeAppender$ForInstrumentedType.apply(TypeAttributeAppender.java:93)
> at net.bytebuddy.dynamic.scaffold.TypeWriter$Default$ForCreation.create(TypeWriter.java:5652)
> at net.bytebuddy.dynamic.scaffold.TypeWriter$Default.make(TypeWriter.java:2166)
> at net.bytebuddy.dynamic.scaffold.subclass.SubclassDynamicTypeBuilder.make(SubclassDynamicTypeBuilder.java:232)
> at net.bytebuddy.dynamic.scaffold.subclass.SubclassDynamicTypeBuilder.make(SubclassDynamicTypeBuilder.java:204)
> at net.bytebuddy.dynamic.DynamicType$Builder$AbstractBase.make(DynamicType.java:3595)
> ...
> Cause: java.lang.IllegalAccessException: class net.bytebuddy.description.annotation.AnnotationDescription$ForLoadedAnnotation cannot access interface jdk.internal.util.random.RandomSupport$RandomGeneratorProperties (in module java.base) because module java.base does not export jdk.internal.util.random to unnamed module @e55b13
> at java.base/jdk.internal.reflect.Reflection.newIllegalAccessException(Reflection.java:392)
> at java.base/java.lang.reflect.AccessibleObject.checkAccess(AccessibleObject.java:674)
> at java.base/java.lang.reflect.Method.invoke(Method.java:560)
> at net.bytebuddy.description.annotation.AnnotationDescription$ForLoadedAnnotation.getValue(AnnotationDescription.java:642)
> at net.bytebuddy.implementation.attribute.AnnotationAppender$Default.handle(AnnotationAppender.java:298)
> at net.bytebuddy.implementation.attribute.AnnotationAppender$Default.doAppend(AnnotationAppender.java:361)
> at net.bytebuddy.implementation.attribute.AnnotationAppender$Default.append(AnnotationAppender.java:338)
> at net.bytebuddy.implementation.attribute.TypeAttributeAppender$ForInstrumentedType.apply(TypeAttributeAppender.java:93)
> at net.bytebuddy.dynamic.scaffold.TypeWriter$Default$ForCreation.create(TypeWriter.java:5652)
> at net.bytebuddy.dynamic.scaffold.TypeWriter$Default.make(TypeWriter.java:2166)
> ...
> {code}
>
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org