[jira] [Created] (SPARK-4761) With JDBC server, set Kryo as default serializer and disable reference tracking

["Patrick Wendell (JIRA)" <ji...@apache.org>]

Patrick Wendell created SPARK-4761:
--------------------------------------

             Summary: With JDBC server, set Kryo as default serializer and disable reference tracking
                 Key: SPARK-4761
                 URL: https://issues.apache.org/jira/browse/SPARK-4761
             Project: Spark
          Issue Type: Bug
            Reporter: Patrick Wendell
            Assignee: Cheng Lian
            Priority: Blocker


I saw some regression in 1.2 Spark SQL due to our broadcast change which requires significantly more serialization. It would be good if when the JDBC server is running it automatically sets the serializer to Kryo and disables Kryo reference tracking.

Doing this while still honoring a user-provided serializer is tricky. I think the best way is to expose an internal (private) constructor to SparkConf that takes a set of lowest-precedence defaults. Those could get merged in with the lowest precedence before the config file is read.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org