You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2023/02/12 06:37:39 UTC
[spark] branch master updated: [SPARK-42408][CORE] Register DoubleType to KryoSerializer
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 559c1f8e9f3 [SPARK-42408][CORE] Register DoubleType to KryoSerializer
559c1f8e9f3 is described below
commit 559c1f8e9f3b9d15934aff9f80785177dc5624c5
Author: William Hyun <wi...@apache.org>
AuthorDate: Sat Feb 11 22:37:23 2023 -0800
[SPARK-42408][CORE] Register DoubleType to KryoSerializer
### What changes were proposed in this pull request?
This PR aims to register `DoubleType` to `KryoSerializer`
### Why are the changes needed?
There was an exception when running a TPCDS 3TB test.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Test manually.
Closes #39978 from williamhyun/double.
Authored-by: William Hyun <wi...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala | 2 ++
1 file changed, 2 insertions(+)
diff --git a/core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala b/core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala
index 5499732660b..307d55892aa 100644
--- a/core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala
+++ b/core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala
@@ -530,6 +530,8 @@ private[serializer] object KryoSerializer {
"org.apache.spark.sql.types.IntegerType",
"org.apache.spark.sql.types.IntegerType$",
"org.apache.spark.sql.types.LongType$",
+ "org.apache.spark.sql.types.DoubleType",
+ "org.apache.spark.sql.types.DoubleType$",
"org.apache.spark.sql.types.Metadata",
"org.apache.spark.sql.types.StringType$",
"org.apache.spark.sql.types.StructField",
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org