[jira] [Created] (SPARK-42036) Kryo ClassCastException getting task result when JDK version mismatch

["John Zhuge (Jira)" <ji...@apache.org>]

John Zhuge created SPARK-42036:
----------------------------------

             Summary: Kryo ClassCastException getting task result when JDK version mismatch
                 Key: SPARK-42036
                 URL: https://issues.apache.org/jira/browse/SPARK-42036
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 3.3.0
            Reporter: John Zhuge


{noformat}
22/12/21 01:27:12 ERROR TaskResultGetter: Exception while getting task result
com.esotericsoftware.kryo.KryoException: java.lang.ClassCastException: java.lang.Integer cannot be cast to java.nio.ByteBuffer
Serialization trace:
lowerBounds (org.apache.iceberg.GenericDataFile)
taskFiles (org.apache.iceberg.spark.source.SparkWrite$TaskCommit)
writerCommitMessage (org.apache.spark.sql.execution.datasources.v2.DataWritingSparkTaskResult)
	at com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:144)
{noformat}
Iceberg 1.1 `BaseFile.lowerBounds` is defined as
{code:java}
Map<Integer, ByteBuffer> {code}
Driver JDK version: 1.8.0_352 (Azul Systems, Inc.)
Executor JDK version: openjdk version "17.0.5" 2022-10-18 LTS

Kryo version: 4.0.2

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org