[GitHub] [hudi] watermelon12138 commented on a diff in pull request #5197: [HUDI-3768] Array Index Overflow Error Is Reported When Spark-Beeline…

[GitBox <gi...@apache.org>]

watermelon12138 commented on code in PR #5197:
URL: https://github.com/apache/hudi/pull/5197#discussion_r853857228


##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/SerDeUtils.scala:
##########
@@ -30,7 +30,10 @@ object SerDeUtils {
   private val kryoLocal = new ThreadLocal[Kryo] {
 
     override protected def initialValue: Kryo = {
-      val serializer = new KryoSerializer(new SparkConf(true))
+      val conf = new SparkConf(true)
+      conf.set("spark.kryo.referenceTracking", "true")

Review Comment:
   ok，i see. Thank you for your review.  Hard-coding is not a good way to determine the value of properties. Is it feasible to use logs to tell users what to do when this problem occurs?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org