You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Johnny Sohn (Jira)" <ji...@apache.org> on 2024/01/29 20:34:00 UTC
[jira] [Updated] (SPARK-46909) Could not initialize class org.apache.spark.unsafe.array.ByteArrayMethods error in JDK 21
[ https://issues.apache.org/jira/browse/SPARK-46909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Johnny Sohn updated SPARK-46909:
--------------------------------
Affects Version/s: 3.5.0
> Could not initialize class org.apache.spark.unsafe.array.ByteArrayMethods error in JDK 21
> -----------------------------------------------------------------------------------------
>
> Key: SPARK-46909
> URL: https://issues.apache.org/jira/browse/SPARK-46909
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.3.1, 3.5.0
> Reporter: Johnny Sohn
> Priority: Major
>
> Trying to run spark on JDK 21, and we're getting this exception
> {code:java}
> Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.spark.unsafe.array.ByteArrayMethods
> at org.apache.spark.memory.MemoryManager.defaultPageSizeBytes$lzycompute(MemoryManager.scala:264)
> at org.apache.spark.memory.MemoryManager.defaultPageSizeBytes(MemoryManager.scala:254)
> at org.apache.spark.memory.MemoryManager.$anonfun$pageSizeBytes$1(MemoryManager.scala:273)
> at scala.runtime.java8.JFunction0$mcJ$sp.apply(JFunction0$mcJ$sp.java:23)
> at scala.Option.getOrElse(Option.scala:189)
> at org.apache.spark.memory.MemoryManager.<init>(MemoryManager.scala:273)
> at org.apache.spark.memory.UnifiedMemoryManager.<init>(UnifiedMemoryManager.scala:58)
> at org.apache.spark.memory.UnifiedMemoryManager$.apply(UnifiedMemoryManager.scala:207)
> at org.apache.spark.SparkEnv$.create(SparkEnv.scala:320)
> at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:194)
> at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:279)
> at org.apache.spark.SparkContext.<init>(SparkContext.scala:464)
> at org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
> at
> Caused by: java.lang.ExceptionInInitializerError: Exception java.lang.ExceptionInInitializerError [in thread "skir-0"]
> at org.apache.spark.unsafe.array.ByteArrayMethods.<clinit>(ByteArrayMethods.java:56)
> at org.apache.spark.memory.MemoryManager.defaultPageSizeBytes$lzycompute(MemoryManager.scala:264)
> at org.apache.spark.memory.MemoryManager.defaultPageSizeBytes(MemoryManager.scala:254)
> at org.apache.spark.memory.MemoryManager.$anonfun$pageSizeBytes$1(MemoryManager.scala:273)
> at scala.runtime.java8.JFunction0$mcJ$sp.apply(JFunction0$mcJ$sp.java:23)
> at scala.Option.getOrElse(Option.scala:189)
> at org.apache.spark.memory.MemoryManager.<init>(MemoryManager.scala:273)
> at org.apache.spark.memory.UnifiedMemoryManager.<init>(UnifiedMemoryManager.scala:58)
> at org.apache.spark.memory.UnifiedMemoryManager$.apply(UnifiedMemoryManager.scala:207)
> at org.apache.spark.SparkEnv$.create(SparkEnv.scala:320)
> at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:194)
> at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:279)
> at org.apache.spark.SparkContext.<init>(SparkContext.scala:464)
> at org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
> at {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org